One of the fundamental problems of information theory, since its foundation by Shannon in 1948, has been the computation of the ca- pacity of a discrete memoryless channel, a quantity expressing the max- imum rate at which information can travel through the channel. In the literature, several algorithms were proposed to estimate the channel ca- pacity, as an analytical solution is unavailable for the general channel. We propose a novel approach based on a continuous-time dynamical system to compute the capacity. We then derive an algorithm for computing the capacity, obtained by discretizing the flow that rules the evolution of this dynamical system. In the experimental analysis, we test the performance of our algorithm when different numerical ordinary differential equation solvers are utilized for its implementation. Remarkably, the results show that the algorithm is effective in computing the capacity.
Computing the capacity of discrete channels using vector flows / Beretta, Guglielmo; Chiarot, Giacomo; Cinà, Antonio Emanuele; Pelillo, Marcello. - (In corso di stampa). (Intervento presentato al convegno 7th International Conference on Dynamics of Information Systems (DIS 2024) tenutosi a Kalamata (GR) nel 2-7 June 2024).
Computing the capacity of discrete channels using vector flows
Beretta,Guglielmo;
In corso di stampa
Abstract
One of the fundamental problems of information theory, since its foundation by Shannon in 1948, has been the computation of the ca- pacity of a discrete memoryless channel, a quantity expressing the max- imum rate at which information can travel through the channel. In the literature, several algorithms were proposed to estimate the channel ca- pacity, as an analytical solution is unavailable for the general channel. We propose a novel approach based on a continuous-time dynamical system to compute the capacity. We then derive an algorithm for computing the capacity, obtained by discretizing the flow that rules the evolution of this dynamical system. In the experimental analysis, we test the performance of our algorithm when different numerical ordinary differential equation solvers are utilized for its implementation. Remarkably, the results show that the algorithm is effective in computing the capacity.Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/11583/2993113