Skip to main content

2011 | OriginalPaper | Buchkapitel

Information Theory and Statistics

verfasst von : Evgueni Haroutunian

Erschienen in: International Encyclopedia of Statistical Science

Verlag: Springer Berlin Heidelberg

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Excerpt

Information theory is a branch of mathematics based on probability theory andstatistical theory. The founder of information theory, Claude Shannon, created the“mathematical theory of communication” and the successors of Shannonthoroughly developed firm mathematical constructions for descriptions ofcommunication processes ensuring data reliable compression, transmissionand protection (Blahut 1974, 1987; Cover and Thomas 2006; Rissanen 2007). …

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Ahlswede R, Csiszár I (1986) Hypothesis testing with communication constraints. IEEE Trans Inform Theory 32:533–542MATHMathSciNet Ahlswede R, Csiszár I (1986) Hypothesis testing with communication constraints. IEEE Trans Inform Theory 32:533–542MATHMathSciNet
Zurück zum Zitat Ahlswede R, Haroutunian EA (2005) On logarithmically asymptotically optimal testing of hypotheses and identification. Lecture notes in computer science, vol 4123. Springer, New York, pp 462–478 Ahlswede R, Haroutunian EA (2005) On logarithmically asymptotically optimal testing of hypotheses and identification. Lecture notes in computer science, vol 4123. Springer, New York, pp 462–478
Zurück zum Zitat Ahlswede R, Wegener I (1987) Search problems. Wiley-Interscience, New York (German original, Teubner, Stuttgart (1979), Russian translation with supplement on information-theoretical methods in search problems, Mir, Moscow, 1982) Ahlswede R, Wegener I (1987) Search problems. Wiley-Interscience, New York (German original, Teubner, Stuttgart (1979), Russian translation with supplement on information-theoretical methods in search problems, Mir, Moscow, 1982)
Zurück zum Zitat Akaike H (1973) Information theory and an extension of the maximum likelihood principle. Proceedings of 2nd international symposium on information theory, Tsahkadzor, Armenia, 1971. Akademiai Kiado, Budapest, pp 267–281 Akaike H (1973) Information theory and an extension of the maximum likelihood principle. Proceedings of 2nd international symposium on information theory, Tsahkadzor, Armenia, 1971. Akademiai Kiado, Budapest, pp 267–281
Zurück zum Zitat Barron AR (1997) Information theory in probability, statistics, learning, and neural nets. Department of Statistics. Yale University. Working paper distributed at plenary presentation of the 10th annual ACM workshop on computational learning theory Barron AR (1997) Information theory in probability, statistics, learning, and neural nets. Department of Statistics. Yale University. Working paper distributed at plenary presentation of the 10th annual ACM workshop on computational learning theory
Zurück zum Zitat Blahut RE (1974) Hypotheses testing and information theory. IEEE Trans Inform Theory 20(4):405–417MATHMathSciNet Blahut RE (1974) Hypotheses testing and information theory. IEEE Trans Inform Theory 20(4):405–417MATHMathSciNet
Zurück zum Zitat Blahut RE (1987) Principles and practice of information theory. Addison-Wesley, ReadingMATH Blahut RE (1987) Principles and practice of information theory. Addison-Wesley, ReadingMATH
Zurück zum Zitat Cover T, Thomas J (2006) Elements of information theory, 2nd edn. Hoboken Cover T, Thomas J (2006) Elements of information theory, 2nd edn. Hoboken
Zurück zum Zitat Csiszár I, Shields PS (2004) Information theory and statistics: a tutorial. Foundations and Trends in Communications and Information Theory. Now Publishers, Hanover 1:4 Csiszár I, Shields PS (2004) Information theory and statistics: a tutorial. Foundations and Trends in Communications and Information Theory. Now Publishers, Hanover 1:4
Zurück zum Zitat Haroutunian EA, Haroutunian ME, Harutyunyan AN (2008) Realiability criteria in information theory and hypothesis testing. Foundations and Trends in Communications and Information Theory. Now Publishers, Hannover 4:2–3 Haroutunian EA, Haroutunian ME, Harutyunyan AN (2008) Realiability criteria in information theory and hypothesis testing. Foundations and Trends in Communications and Information Theory. Now Publishers, Hannover 4:2–3
Zurück zum Zitat Kendall DG (1963) Information theory and the limit theorem for Markov chains and processes with a countable infinity of states. Ann Inst Stat Math 15:137–143MATHMathSciNet Kendall DG (1963) Information theory and the limit theorem for Markov chains and processes with a countable infinity of states. Ann Inst Stat Math 15:137–143MATHMathSciNet
Zurück zum Zitat Kullback S (1959) Information theory and statistics. Wiley, New YorkMATH Kullback S (1959) Information theory and statistics. Wiley, New YorkMATH
Zurück zum Zitat Linnik YuV (1959) An information theoretic proof of the central limit theorem on Lindeberg conditions (in Russian). Teor Veroyat Primen 4:311–321 Linnik YuV (1959) An information theoretic proof of the central limit theorem on Lindeberg conditions (in Russian). Teor Veroyat Primen 4:311–321
Zurück zum Zitat Liese F, Vajda I (2006) On divergences and informations in statistics and information theory. IEEE Trans Inform Theory 52(10):4394–4413MATHMathSciNet Liese F, Vajda I (2006) On divergences and informations in statistics and information theory. IEEE Trans Inform Theory 52(10):4394–4413MATHMathSciNet
Zurück zum Zitat Pardo L (2006) Statistical inference based on divergence methods. Chapman & Hall/CRC Press, New York Pardo L (2006) Statistical inference based on divergence methods. Chapman & Hall/CRC Press, New York
Zurück zum Zitat Rényi A (1968) On some problems of statistics from the point of view of information Theory. In: Rényi A (ed) Proceedings of the colloquium on information theory. János Bolyai Mathematical Society, Budapest, pp 343–357 Rényi A (1968) On some problems of statistics from the point of view of information Theory. In: Rényi A (ed) Proceedings of the colloquium on information theory. János Bolyai Mathematical Society, Budapest, pp 343–357
Zurück zum Zitat Rissanen J (2007) Information and stability in statisical modeling. Information Science and Statistics. Springer, New York Rissanen J (2007) Information and stability in statisical modeling. Information Science and Statistics. Springer, New York
Metadaten
Titel
Information Theory and Statistics
verfasst von
Evgueni Haroutunian
Copyright-Jahr
2011
Verlag
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-642-04898-2_643