Skip to main content
Top

2021 | OriginalPaper | Chapter

15. Bayesian Thinking in Machine Learning

Wie ein Pfarrer unbewusst die Statistik revolutionierte

Authors : Thomas Neifer, Andreas Schmidt, Dennis Lawo, Lukas Böhm, Özge Tetik

Published in: Data Science

Publisher: Springer Fachmedien Wiesbaden

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Zusammenfassung

Das Bayes-Theorem ermöglicht die Integration von Vorwissen und Erfahrung in die Datenanalyse und schafft dadurch Instrumente, die einen Mehrwert gegenüber klassischen multivariaten Verfahren hinaus gehen. Im Rahmen des maschinellen Lernens tritt es insbesondere in Regressions- und Klassifikationsfragestellungen in den Vordergrund und dient dort u. a. zur Klassifikation und Analyse von Texten, der Erkennung von Spam-Nachrichten oder auch Spracheingaben bei Sprachassistenten. Dieser Beitrag gibt einen Einblick in die Grundprinzipien des Bayes-Theorems, diskutiert seine Rolle in Regressions- und Klassifikationsfragestellungen und zeigt exemplarisch auf, wie er im Rahmen des Naive Bayes Classifiers im maschinellen Lernen zum Einsatz kommt.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Albert, J.: Bayesian computation with R. Springer, NY (2009) Albert, J.: Bayesian computation with R. Springer, NY (2009)
go back to reference Bayes, T.: LII. An essay towards solving a problem in the doctrine of chances. By the late Rev. Mr. Bayes, FRS communicated by Mr. Price, in a letter to John Canton, AMFR S. Philosophical transactions of the Royal Society of London 370–418 (1763) Bayes, T.: LII. An essay towards solving a problem in the doctrine of chances. By the late Rev. Mr. Bayes, FRS communicated by Mr. Price, in a letter to John Canton, AMFR S. Philosophical transactions of the Royal Society of London 370–418 (1763)
go back to reference Brooks, S., Gelman, A., Jones, G., Meng, X.L.: Handbook of markov chain monte carlo. CRC Press, NY (2011)CrossRef Brooks, S., Gelman, A., Jones, G., Meng, X.L.: Handbook of markov chain monte carlo. CRC Press, NY (2011)CrossRef
go back to reference Corfield, D., Williamson, J.: Foundations of Bayesianism. Springer Science & Business Media, Dordrecht (2013) Corfield, D., Williamson, J.: Foundations of Bayesianism. Springer Science & Business Media, Dordrecht (2013)
go back to reference Deisenroth, M. P., Aldo Faisal, A., Ong, C. S.: Mathematics for machine learning. Cambridge University Press, Cambridge (2020) Deisenroth, M. P., Aldo Faisal, A., Ong, C. S.: Mathematics for machine learning. Cambridge University Press, Cambridge (2020)
go back to reference Dey, L., Chakraborty, S., Biswas, A., Bose, B., Tiwari, S.: Sentiment analysis of review datasets using naive bayes and k-nn classifier (2016). arXiv preprint arXiv:1610.09982 Dey, L., Chakraborty, S., Biswas, A., Bose, B., Tiwari, S.: Sentiment analysis of review datasets using naive bayes and k-nn classifier (2016). arXiv preprint arXiv:​1610.​09982
go back to reference Elster, C. et al.: A guide to Bayesian inference for regression problems. deliverable of EMRP Project NEW04 “Novel Mathematical and Statistical Approaches to Uncertainty Evaluation,” (2015) Elster, C. et al.: A guide to Bayesian inference for regression problems. deliverable of EMRP Project NEW04 “Novel Mathematical and Statistical Approaches to Uncertainty Evaluation,” (2015)
go back to reference Elster, C., Wübbeler, G.: Bayesian regression versus application of least squares—an example. Metrologia 53, S. 10 (2015) Elster, C., Wübbeler, G.: Bayesian regression versus application of least squares—an example. Metrologia 53, S. 10 (2015)
go back to reference Gasparini, M.: Markov chain Monte Carlo in practice. Taylor & Francis, London (1997) Gasparini, M.: Markov chain Monte Carlo in practice. Taylor & Francis, London (1997)
go back to reference Gelman, A. et al.: Bayesian data analysis. Chapman and Hall/CRC Press, Taylor & Francis, Boca Raton, London, New York (2013) Gelman, A. et al.: Bayesian data analysis. Chapman and Hall/CRC Press, Taylor & Francis, Boca Raton, London, New York (2013)
go back to reference Gensler, S.: Heterogenität in der Präferenzanalyse. Deutscher Universitätsverlag, Wiesbaden (2003)CrossRef Gensler, S.: Heterogenität in der Präferenzanalyse. Deutscher Universitätsverlag, Wiesbaden (2003)CrossRef
go back to reference Jansen, B. J., Booth, D. L., Spink, A.: Determining the user intent of web search engine queries. In Proceedings of the 16th international conference on World Wide Web, 1149–1150 (2007) Jansen, B. J., Booth, D. L., Spink, A.: Determining the user intent of web search engine queries. In Proceedings of the 16th international conference on World Wide Web, 1149–1150 (2007)
go back to reference Janssen, J., Laatz, W.: Naive Bayes. In Statistische Datenanalyse mit SPSS S. 557–569. Springer, Berlin (2017) Janssen, J., Laatz, W.: Naive Bayes. In Statistische Datenanalyse mit SPSS S. 557–569. Springer, Berlin (2017)
go back to reference Kirk, M.: Thoughtful Machine Learning with Python: A Test-Driven Approach. O’Reilly Media, Inc., Sebastopol (2017) Kirk, M.: Thoughtful Machine Learning with Python: A Test-Driven Approach. O’Reilly Media, Inc., Sebastopol (2017)
go back to reference Kruschke, J.: Doing Bayesian data analysis: A tutorial with R, JAGS, and Stan. Academic Press, London, San Diego, Waltham, Oxford (2014) Kruschke, J.: Doing Bayesian data analysis: A tutorial with R, JAGS, and Stan. Academic Press, London, San Diego, Waltham, Oxford (2014)
go back to reference Lantz, B.: Machine learning with R: expert techniques for predictive modeling. Packt Publishing Ltd., Birmingham (2019) Lantz, B.: Machine learning with R: expert techniques for predictive modeling. Packt Publishing Ltd., Birmingham (2019)
go back to reference Laplace, P. S.: Théorie analytique des probabilités. Courcier, Paris (1820) Laplace, P. S.: Théorie analytique des probabilités. Courcier, Paris (1820)
go back to reference Lee, P.M.: Bayesian Statistics, (Arnold). Wiley, New York (1997) Lee, P.M.: Bayesian Statistics, (Arnold). Wiley, New York (1997)
go back to reference Levitin, D. J.: A field guide to lies: Critical thinking in the information age. Penguin Random House, New York City (2016) Levitin, D. J.: A field guide to lies: Critical thinking in the information age. Penguin Random House, New York City (2016)
go back to reference Maimon, O., Rokach, L.: Decomposition methodology for knowledge discovery and data mining. In Data mining and knowledge discovery handbook, S. 981–1003. Springer, Boston (2005) Maimon, O., Rokach, L.: Decomposition methodology for knowledge discovery and data mining. In Data mining and knowledge discovery handbook, S. 981–1003. Springer, Boston (2005)
go back to reference McGrayne, S.B.: The theory that would not die: how Bayes’ rule cracked the enigma code, hunted down Russian submarines, & emerged triumphant from two centuries of controversy. Yale University Press, UK (2011)MATH McGrayne, S.B.: The theory that would not die: how Bayes’ rule cracked the enigma code, hunted down Russian submarines, & emerged triumphant from two centuries of controversy. Yale University Press, UK (2011)MATH
go back to reference Natrop, J.: Angewandte Descriptive Statistik: Praxisbezogenes Lehrbuch mit Fallbeispielen. De Gruyter Oldenbourg, Berlin (2015)CrossRef Natrop, J.: Angewandte Descriptive Statistik: Praxisbezogenes Lehrbuch mit Fallbeispielen. De Gruyter Oldenbourg, Berlin (2015)CrossRef
go back to reference Noaman, H. M., Elmougy, S., Ghoneim, A., Hamza, T.: Naive Bayes classifier based Arabic document categorization. In 2010 the 7th International Conference on Informatics and Systems (INFOS), S. 1–5. IEEE (2010) Noaman, H. M., Elmougy, S., Ghoneim, A., Hamza, T.: Naive Bayes classifier based Arabic document categorization. In 2010 the 7th International Conference on Informatics and Systems (INFOS), S. 1–5. IEEE (2010)
go back to reference Oettinger, M.: Data Science: Eine praxisorientierte Einführung im Umfeld von Machine Learning, künstlicher Intelligenz und Big Data. 2. erw. Aufl., tredition, Hamburg (2020) Oettinger, M.: Data Science: Eine praxisorientierte Einführung im Umfeld von Machine Learning, künstlicher Intelligenz und Big Data. 2. erw. Aufl., tredition, Hamburg (2020)
go back to reference Polyakov, E. V. et al.: Investigation and development of the intelligent voice assistant for the Internet of Things using machine learning. In 2018 Moscow Workshop on Electronic and Networking Technologies (MWENT), S. 1–5. IEEE (2018) Polyakov, E. V. et al.: Investigation and development of the intelligent voice assistant for the Internet of Things using machine learning. In 2018 Moscow Workshop on Electronic and Networking Technologies (MWENT), S. 1–5. IEEE (2018)
go back to reference Ramasubramanian, K., Singh, A.: Machine Learning Using R: With Time Series and Industry-Based Use Cases in R. Apress, New York (2018) Ramasubramanian, K., Singh, A.: Machine Learning Using R: With Time Series and Industry-Based Use Cases in R. Apress, New York (2018)
go back to reference Robles, V., Larranaga, P., Menasalvas, E., Pérez, M. S., Herves, V.: Improvement of Naive Bayes collaborative filtering using interval estimation. In Proceedings IEEE/WIC International Conference on Web Intelligence (WI 2003), S. 168–174. IEEE (2003) Robles, V., Larranaga, P., Menasalvas, E., Pérez, M. S., Herves, V.: Improvement of Naive Bayes collaborative filtering using interval estimation. In Proceedings IEEE/WIC International Conference on Web Intelligence (WI 2003), S. 168–174. IEEE (2003)
go back to reference Smith, A.F., Gelfand, A.E.: Bayesian statistics without tears: a sampling–resampling perspective. The American Statistician 46(2), 84–88 (1992)MathSciNet Smith, A.F., Gelfand, A.E.: Bayesian statistics without tears: a sampling–resampling perspective. The American Statistician 46(2), 84–88 (1992)MathSciNet
go back to reference Spyroglou, I.I., Rigas, A.G.: A two-step Bayesian approach for modeling a complex neurophysiological system. International journal of biology and biomedical engineering 12, 66–74 (2018) Spyroglou, I.I., Rigas, A.G.: A two-step Bayesian approach for modeling a complex neurophysiological system. International journal of biology and biomedical engineering 12, 66–74 (2018)
Metadata
Title
Bayesian Thinking in Machine Learning
Authors
Thomas Neifer
Andreas Schmidt
Dennis Lawo
Lukas Böhm
Özge Tetik
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-658-33403-1_15

Premium Partner