One of the fundamental problems of information theory, since its foundation by Shannon in 1948, has been the computation of the ca- pacity of a discrete memoryless channel, a quantity expressing the max- imum rate at which information can travel through the channel. In the literature, several algorithms were proposed to estimate the channel ca- pacity, as an analytical solution is unavailable for the general channel. We propose a novel approach based on a continuous-time dynamical system to compute the capacity. We then derive an algorithm for computing the capacity, obtained by discretizing the flow that rules the evolution of this dynamical system. In the experimental analysis, we test the performance of our algorithm when different numerical ordinary differential equation solvers are utilized for its implementation. Remarkably, the results show that the algorithm is effective in computing the capacity.

Computing the capacity of discrete channels using vector flows / Beretta, Guglielmo; Chiarot, Giacomo; Cinà, Antonio Emanuele; Pelillo, Marcello. - (In corso di stampa). (Intervento presentato al convegno 7th International Conference on Dynamics of Information Systems (DIS 2024) tenutosi a Kalamata (GR) nel 2-7 June 2024).

Computing the capacity of discrete channels using vector flows

Beretta,Guglielmo;
In corso di stampa

Abstract

One of the fundamental problems of information theory, since its foundation by Shannon in 1948, has been the computation of the ca- pacity of a discrete memoryless channel, a quantity expressing the max- imum rate at which information can travel through the channel. In the literature, several algorithms were proposed to estimate the channel ca- pacity, as an analytical solution is unavailable for the general channel. We propose a novel approach based on a continuous-time dynamical system to compute the capacity. We then derive an algorithm for computing the capacity, obtained by discretizing the flow that rules the evolution of this dynamical system. In the experimental analysis, we test the performance of our algorithm when different numerical ordinary differential equation solvers are utilized for its implementation. Remarkably, the results show that the algorithm is effective in computing the capacity.
In corso di stampa
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11583/2993113