Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Crack Detection on Inner Tunnel Surface Using Image Processing Read chapter Read first chapter

2021 | OriginalPaper | Chapter

Adaptive Applications of Maximum Entropy Principle

Authors : Amit Kumar Singh, Dilip Senapati, Tanmay Mukherjee, Nikhil Kumar Rajput

Published in: Progress in Advanced Computing and Intelligent Engineering

Publisher: Springer Singapore

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The probability distribution of a system can be adaptively derived using the maximum entropy principle subject to its information set in terms of probabilistic moments. The obtained probability  distribution characterizes the wide range of exponential family of distributions when one maximizes Shannon entropy. On maximizing Tsallis entropy with non-extensive parameter q, power law distributions are obtained which portrays the well-known Shannon family of exponential distribution as, \(q \to 1\). The maximization of Shannon entropy subject to the shifted geometric mean constraints leads to a probability distribution in terms of Hurwitz zeta function. This density characterizes the equilibrium state of broadband network traffic. Moreover, maximization of Shannon entropy in Laplace domain subject to specific constraints provides a transient probability distribution which characterizes the behavior of M/M/1/1 queueing system.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter BOSCA—A Hybrid Butterfly Optimization Algorithm Modified with Sine Cosine Algorithm
next chapter Identifying Challenges in the Adoption of Industry 4.0 in the Indian Construction Industry
Literature
1.
Singh VP, Rajagopal AK, Singh K (1986) Derivation of some frequency distributions using the principle of maximum entropy (POME). Adv Water Resour 9(2):91–106CrossRef
2.
Mitzenmacher M (2003) A brief history of generative models for power law and lognormal distributions. Internet Math. 1(2):129–251MathSciNet
3.
Leland WE, Taqqu MS, Willinger W, Wilson DV (1994) On the self-similar nature of ethernet traffic. IEEE/ACM Trans Networking 2:1–15CrossRef
4.
Kapur JN (1989) Maximum-entropy models in science and engineering. Wiley Eastern Ltd.
5.
Sharma S (2006) Queue length distribution of network packet traffic: Tsallis entropy maximization with fractional moments. IEEE Commun Lett 10(1):34MathSciNetCrossRef
6.
Senapati D (2016) Generation of cubic power-law for high frequency intra-day returns: maximum Tsallis entropy framework. Digit Signal Proc 48:276–284MathSciNetCrossRef
7.
Lampo TJ, Stylianidou S, Backlund MP, Wiggins PA, Spakowitz AJ (2017) Cytoplasmic RNA-protein particles exhibit non-Gaussian subdiffusive behavior. Biophys J 112(3):532–542CrossRef
8.
Karagiannis T, Molle M, Faloutsos M (2004) Long-range dependence: ten years of internet traffic modeling. IEEE Internet Comput 8:57–64CrossRef
9.
Clegg RG, Cairano-Gilfedder CD, Zhou S (2010) A critical look at power law modelling of the internet. Comput Commun 33:259–268CrossRef
10.
Goh KI, Kahng B, Kim D (2001) Universal behavior of load distribution in scale-free networks. Phys Rev Lett 87(27):278701CrossRef
11.
Jaynes ET (1982) On the rationale of maximum-entropy methods. Proc IEEE 70:939–952CrossRef
12.
Presse S, Ghosh K, Lee J, Dill KA (2013) Principles of maximum entropy and maximum caliber in statistical physics. Rev Modern Phy 85:1115–1141CrossRef
13.
Visser M (2013) Zipf’s law, power laws and maximum entropy. New J Phys 15:040321CrossRef
14.
15.
Sharma S (2006) Queue length distribution of network packet traffic: Tsallis entropy maximization with fractional moments. IEEE Commun Lett 10(1):34MathSciNetCrossRef
16.
Koverda VP, Skokov VN (2012) Maximum entropy in a nonlinear system with a 1/f power spectrum. Physica A 391:21–28CrossRef
17.
Cover TM, Thomas JA (2012) Elements of information theory. Wiley, New YorkMATH
18.
Rajput NK, Ahuja B, Riyal MK (2018) A novel approach towards deriving vocabulary quotient. Digital Scholarship Human 33(4):894–901CrossRef
19.
Gell-Mann M, Tsallis C (eds) (2004) Nonextensive entropy: interdisciplinary applications. Oxford University Press on Demand, OxfordMATH
20.
Singh AK (2014) Power law behavior of queue size: maximum entropy principle with shifted geometric mean constraint. IEEE Commun Lett 18(8):1335–1338CrossRef
21.
Singh AK, Singh HP (2015) Karmeshu,: Analysis of finite buffer queue: maximum entropy probability distribution with shifted fractional geometric and arithmetic means. IEEE Commun Lett 19(2):163–166CrossRef
22.
Singh AK (2015) Performance modeling of communication networks: power law behavior in stationary and non-stationary environments, thesis, JNU, New Delhi
23.
Shortle JF, Thompson JM, Gross D, Harris CM (2014) Fundamentals of queueing theory. Wiley, New YorkMATH
24.
Mukherjee T, Singh AK, Senapati D (2019) Performance evaluation of wireless communication systems over Weibull/q-lognormal shadowed fading using Tsallis’ entropy framework. Wirel Pers Commun 106(2):789–803CrossRef
Metadata
Title
Adaptive Applications of Maximum Entropy Principle
Authors
Amit Kumar Singh
Dilip Senapati
Tanmay Mukherjee
Nikhil Kumar Rajput
Copyright Year
2021
Publisher
Springer Singapore
Book
Progress in Advanced Computing and Intelligent Engineering

Print ISBN: 978-981-15-6583-0

Electronic ISBN: 978-981-15-6584-7

Copyright Year: 2021

DOI
https://doi.org/10.1007/978-981-15-6584-7_36