Vorträge und Posterpräsentationen (mit Tagungsband-Eintrag):
C. Mecklenbräuker:
"Proofs for the Maximum Entropy Property of the Normal Distribution";
Vortrag: Joint Workshop on Coding and Communications (JWCC),
Santo Stefano Belbo, Piemonte, Italia (eingeladen);
17.10.2010
- 19.10.2010; in: "Joint Workshop on Coding and Communications (JWCC 2010)",
H. Bölcskei, E. Biglieri (Hrg.);
(2010),
1 S.
Kurzfassung englisch:
It is well known that for any absolutely continuous random variable, the distribution that maximizes the differential entropy subject to an upper bound sigma^2 on its second moment is the zero-mean normal distribution with variance sigma^2. In this contribution, several proofs for the maximum entropy property of the normal distribution are reviewed: Calculus of variations [Shannon,Kapur], use of Jensen's inequality [McEliece], and exploitation of the information inequality [Cover and Thomas], as well as Gallager's proof [Gallager]. The discussion emphasizes the corresponding concepts and pedagogical aspects.
Schlagworte:
Gaussian, Entropy, Calculus of Variations, Jensen's Inequality, Information Inequality
Elektronische Version der Publikation:
http://publik.tuwien.ac.at/files/PubDat_188432.pdf
Erstellt aus der Publikationsdatenbank der Technischen Universität Wien.