Skip to main content
Top

2018 | OriginalPaper | Chapter

Comparison of Machine Learning Algorithms for Handwritten Digit Recognition

Authors : Shixiao Wu, Wanyun Wei, Libing Zhang

Published in: Computational Intelligence and Intelligent Systems

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper adopts 10 machine learning algorithms to present the classification results of handwritten digit recognition on Minist dataset. These algorithms include k-nearest neighbors, support vector machine (SVM), decision trees (DT), random forest (RF), naive bayes, multilayer perception (MLP), logistic regression with neural network, artificial neural network (ANN), back-propagation (BP), convolutional neural network (CNN) and so on. We execute the experiments through matlab2015b and anaconda (python 3.6), and the result (accuracy and run-time) shows that SVM and RF achieve better performance. They has the accuracy of 98.08% and 97% separately, less running-time is taken compared with other methods. All the experiment are executed in CPU environment, without GPU. We also execute CNN algorithm for handwritten digit recognition in GPU (Nvidia GeForce GTX 1060), finally find that this algorithm achieves the best performance and the best classification result, the accuracy is up to 99%.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Liu, C.-L., Nakashima, K., Sako, H., Fujisawa, H.: Pattern Recogn. 36, 2271 (2003)CrossRef Liu, C.-L., Nakashima, K., Sako, H., Fujisawa, H.: Pattern Recogn. 36, 2271 (2003)CrossRef
5.
go back to reference Kherallah, M., Haddad, L., Alimi, A.M., Mitiche, A.: Pattern Recogn. Lett. 29, 580 (2008)CrossRef Kherallah, M., Haddad, L., Alimi, A.M., Mitiche, A.: Pattern Recogn. Lett. 29, 580 (2008)CrossRef
6.
go back to reference Arica, N., Yarman-Vural, F.T.: IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 31, 216 (2001)CrossRef Arica, N., Yarman-Vural, F.T.: IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 31, 216 (2001)CrossRef
7.
go back to reference LeCun, Y., et al.: Advances in Neural Information Processing Systems, pp. 396–404 (1990) LeCun, Y., et al.: Advances in Neural Information Processing Systems, pp. 396–404 (1990)
8.
go back to reference Matan, O., Burges, C.J., LeCun, Y., Denker, J.S.: Advances in Neural Information Processing Systems, pp. 488–495 (1992) Matan, O., Burges, C.J., LeCun, Y., Denker, J.S.: Advances in Neural Information Processing Systems, pp. 488–495 (1992)
9.
go back to reference Guyon, I., Schomaker, L., Plamondon, R., Liberman, M., Janet, S.: Proceedings of the 12th IAPR International Conference on Pattern recognition. Conference B: Computer Vision and Image Processing, vol. 2, pp. 29–33. IEEE (1994) Guyon, I., Schomaker, L., Plamondon, R., Liberman, M., Janet, S.: Proceedings of the 12th IAPR International Conference on Pattern recognition. Conference B: Computer Vision and Image Processing, vol. 2, pp. 29–33. IEEE (1994)
10.
go back to reference Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. Wiley, New York (2012)MATH Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. Wiley, New York (2012)MATH
11.
go back to reference Yu, N., Jiao, P.: 2012 IEEE Fifth International Conference on Advanced Computational Intelligence (ICACI), pp. 689–693. IEEE (2012) Yu, N., Jiao, P.: 2012 IEEE Fifth International Conference on Advanced Computational Intelligence (ICACI), pp. 689–693. IEEE (2012)
13.
14.
go back to reference Bag, S.: Deep learning localization for self-driving cars, Ph.D. thesis. Rochester Institute of Technology (2017) Bag, S.: Deep learning localization for self-driving cars, Ph.D. thesis. Rochester Institute of Technology (2017)
15.
go back to reference Qiu, X., Zhang, L., Ren, Y., Suganthan, P.N., Amaratunga, G.: 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL), pp. 1–6. IEEE (2014) Qiu, X., Zhang, L., Ren, Y., Suganthan, P.N., Amaratunga, G.: 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL), pp. 1–6. IEEE (2014)
17.
go back to reference Chang, C.-C., Lin, C.-J.: ACM Trans. Intell. Syst. Technol. (TIST) 2, 27 (2011) Chang, C.-C., Lin, C.-J.: ACM Trans. Intell. Syst. Technol. (TIST) 2, 27 (2011)
18.
go back to reference Bajpai, S., Jain, K., Jain, N.: Int. J. Soft Comput. Eng. (I-JSCE) 1 (2011) Bajpai, S., Jain, K., Jain, N.: Int. J. Soft Comput. Eng. (I-JSCE) 1 (2011)
Metadata
Title
Comparison of Machine Learning Algorithms for Handwritten Digit Recognition
Authors
Shixiao Wu
Wanyun Wei
Libing Zhang
Copyright Year
2018
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-13-1651-7_47

Premium Partner