Skip to main content

2023 | OriginalPaper | Buchkapitel

6. Supervised Machine Learning in a Nutshell

verfasst von : Majid Mohammadi, Dario Di Nucci

Erschienen in: Data Science for Entrepreneurship

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter introduces the fundamental to supervised machine learning algorithms, namely the classification and regression problems. We explain each technique using an inspiring example and discuss how the corresponding algorithms work together with the data engineering pipelines. They provide some guidelines for implementing a classification or regression task for other problems and required materials to evaluate the supervised learning being used.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
2
There is another type of regression, named ordinal regression, where the dependent variables are of ordinal type, each showing a rank assigned to a sample within the dataset.
 
3
In fact, it is the inverse of the covariance matrix if the data is normalized.
 
Literatur
Zurück zum Zitat Beck, A., & Teboulle, M. (2009). A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM Journal on Imaging Sciences, 2(1), 183–202.CrossRef Beck, A., & Teboulle, M. (2009). A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM Journal on Imaging Sciences, 2(1), 183–202.CrossRef
Zurück zum Zitat Bhattacharyya, S., Jha, S., Tharakunnel, K., & Westland, J. C. (2011). Data mining for credit card fraud: A comparative study. Decision Support Systems, 50(3), 602–613.CrossRef Bhattacharyya, S., Jha, S., Tharakunnel, K., & Westland, J. C. (2011). Data mining for credit card fraud: A comparative study. Decision Support Systems, 50(3), 602–613.CrossRef
Zurück zum Zitat Cunningham, P., & Delany, S. J. (2020). k-nearest neighbour classifiers. arXiv preprint arXiv:2004.04523. Cunningham, P., & Delany, S. J. (2020). k-nearest neighbour classifiers. arXiv preprint arXiv:2004.04523.
Zurück zum Zitat Drucker, H., Burges, C. J. C., Kaufman, L., Smola, A. J., & Vapnik, V. (1997). Support vector regression machines. In Advances in neural information processing systems (pp. 155–161). Drucker, H., Burges, C. J. C., Kaufman, L., Smola, A. J., & Vapnik, V. (1997). Support vector regression machines. In Advances in neural information processing systems (pp. 155–161).
Zurück zum Zitat Guyon, I., & Elisseeff, A. (2003). An introduction to variable and feature selection. Journal of Machine Learning Research, 3, 1157–1182. Guyon, I., & Elisseeff, A. (2003). An introduction to variable and feature selection. Journal of Machine Learning Research, 3, 1157–1182.
Zurück zum Zitat Han, J., Pei, J., & Kamber, M. (2011). Data mining: Concepts and techniques. Elsevier. Han, J., Pei, J., & Kamber, M. (2011). Data mining: Concepts and techniques. Elsevier.
Zurück zum Zitat Hastie, T., Tibshirani, R., & Wainwright, M. (2015). Statistical learning with sparsity: The lasso and generalizations. CRC Press.CrossRef Hastie, T., Tibshirani, R., & Wainwright, M. (2015). Statistical learning with sparsity: The lasso and generalizations. CRC Press.CrossRef
Zurück zum Zitat He, H., & Garcia, E. A. (2009). Learning from imbalanced data. IEEE Transactions on Knowledge and Data Engineering, 21(9), 1263–1284.CrossRef He, H., & Garcia, E. A. (2009). Learning from imbalanced data. IEEE Transactions on Knowledge and Data Engineering, 21(9), 1263–1284.CrossRef
Zurück zum Zitat Hoerl, A. E., Kannard, R. W., & Baldwin, K. F. (1975). Ridge regression: Some simulations. Communications in Statistics-Theory and Methods, 4(2), 105–123. Hoerl, A. E., Kannard, R. W., & Baldwin, K. F. (1975). Ridge regression: Some simulations. Communications in Statistics-Theory and Methods, 4(2), 105–123.
Zurück zum Zitat Kim, S.-J., Koh, K., Lustig, M., Boyd, S., & Gorinevsky, D. (2007). An interior-point method for large-scale l1-regularized least squares. IEEE Journal of Selected Topics in Signal Processing, 1(4), 606–617.CrossRef Kim, S.-J., Koh, K., Lustig, M., Boyd, S., & Gorinevsky, D. (2007). An interior-point method for large-scale l1-regularized least squares. IEEE Journal of Selected Topics in Signal Processing, 1(4), 606–617.CrossRef
Zurück zum Zitat Mitchell, T. M. (1999). Machine learning and data mining. Communications of the ACM, 42(11), 30–36.CrossRef Mitchell, T. M. (1999). Machine learning and data mining. Communications of the ACM, 42(11), 30–36.CrossRef
Zurück zum Zitat Mohammadi, M. (2019). A projection neural network for the generalized lasso. IEEE Transactions on Neural Networks and Learning Systems, 31, 2217–2221.CrossRef Mohammadi, M. (2019). A projection neural network for the generalized lasso. IEEE Transactions on Neural Networks and Learning Systems, 31, 2217–2221.CrossRef
Zurück zum Zitat Mohammadi, M., Mousavi, S. H., & Effati, S. (2019). Generalized variant support vector machine. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 51, 2798–2809.CrossRef Mohammadi, M., Mousavi, S. H., & Effati, S. (2019). Generalized variant support vector machine. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 51, 2798–2809.CrossRef
Zurück zum Zitat Paasch, C. A. W. (2008). Credit card fraud detection using artificial neural networks tuned by genetic algorithms. Hong Kong University of Science and Technology (Hong Kong).CrossRef Paasch, C. A. W. (2008). Credit card fraud detection using artificial neural networks tuned by genetic algorithms. Hong Kong University of Science and Technology (Hong Kong).CrossRef
Zurück zum Zitat Rish, I., et al. (2001). An empirical study of the naive bayes classifier. IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence, 3, 41–46. Rish, I., et al. (2001). An empirical study of the naive bayes classifier. IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence, 3, 41–46.
Zurück zum Zitat Samuel, A. L. (1959). Some studies in machine learning using the game of checkers. IBM Journal of Research and Development, 3(3), 210–229.CrossRef Samuel, A. L. (1959). Some studies in machine learning using the game of checkers. IBM Journal of Research and Development, 3(3), 210–229.CrossRef
Zurück zum Zitat Shawe-Taylor, J., Cristianini, N., et al. (2004). Kernel methods for pattern analysis. Cambridge University Press.CrossRef Shawe-Taylor, J., Cristianini, N., et al. (2004). Kernel methods for pattern analysis. Cambridge University Press.CrossRef
Zurück zum Zitat Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society: Series B (Methodological), 36(2), 111–133. Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society: Series B (Methodological), 36(2), 111–133.
Zurück zum Zitat Suykens, J. A. K., & Vandewalle, J. (1999). Least squares support vector machine classifiers. Neural Processing Letters, 9(3), 293–300.CrossRef Suykens, J. A. K., & Vandewalle, J. (1999). Least squares support vector machine classifiers. Neural Processing Letters, 9(3), 293–300.CrossRef
Zurück zum Zitat Whitrow, C., Hand, D. J., Juszczak, P., Weston, D., & Adams, N. M. (2009). Transaction aggregation as a strategy for credit card fraud detection. Data Mining and Knowledge Discovery, 18(1), 30–55.CrossRef Whitrow, C., Hand, D. J., Juszczak, P., Weston, D., & Adams, N. M. (2009). Transaction aggregation as a strategy for credit card fraud detection. Data Mining and Knowledge Discovery, 18(1), 30–55.CrossRef
Zurück zum Zitat Wright, R. E. (1995). Logistic regression. In L. G. Grimm & P. R. Yarnold (Eds.), Reading and understanding multivariate statistics (pp. 217–244). American Psychological Association. Wright, R. E. (1995). Logistic regression. In L. G. Grimm & P. R. Yarnold (Eds.), Reading and understanding multivariate statistics (pp. 217–244). American Psychological Association.
Zurück zum Zitat Aldridge, I. (2013). High-frequency trading: A practical guide to algorithmic strategies and trading systems (Vol. 604). John Wiley & Sons. Aldridge, I. (2013). High-frequency trading: A practical guide to algorithmic strategies and trading systems (Vol. 604). John Wiley & Sons.
Zurück zum Zitat Géron, A. (2019). Hands-on machine learning with Scikit-Learn, Keras, and TensorFlow: Concepts, tools, and techniques to build intelligent systems. O’Reilly Media. Géron, A. (2019). Hands-on machine learning with Scikit-Learn, Keras, and TensorFlow: Concepts, tools, and techniques to build intelligent systems. O’Reilly Media.
Zurück zum Zitat Mitchell, T. M. (1997). Machine learning (Vol. 45(37), pp. 870–877). McGraw Hill. Mitchell, T. M. (1997). Machine learning (Vol. 45(37), pp. 870–877). McGraw Hill.
Metadaten
Titel
Supervised Machine Learning in a Nutshell
verfasst von
Majid Mohammadi
Dario Di Nucci
Copyright-Jahr
2023
DOI
https://doi.org/10.1007/978-3-031-19554-9_6

Premium Partner