Skip to main content
Top

2023 | OriginalPaper | Chapter

Comparative Study of Machine Learning and Deep Learning Classifiers on Handwritten Numeral Recognition

Authors : Meenal Jabde, Chandrashekhar Patil, Shankar Mali, Amol Vibhute

Published in: International Symposium on Intelligent Informatics

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Handwriting digit recognition is a computer technology that allows it to accept and decipher sound transcribed input from various sources, including paper reports, contact screens, and pictures. This paper presents the machine and Deep Learning approach for handwritten digit recognition from image input. This approach uses bench marked dataset MNIST English handwritten numeral digit dataset of size 70,000. Four machine learning and deep learning algorithms are explored, and a pattern recognition approach is used. We have explored the pattern matching approach and achieved 86% accuracy for the Decision Tree classifier, 91% accuracy for the Support Vector Machine classifier, 97% for Artificial Neural Network and 98.84% for Convolutional Neural Network. In the Deep Learning approach, the Convolutional Neural Network algorithm with the Vgg16 network is implemented to train the MNIST digit dataset and achieved an accuracy of 98.84%.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference S.M. Mali, C.H. Patil, Marathi handwritten numeral recognition using Zernike moments and Fourier descriptors. Int. J. Comput. Appli. 975, 8887 (2015) S.M. Mali, C.H. Patil, Marathi handwritten numeral recognition using Zernike moments and Fourier descriptors. Int. J. Comput. Appli. 975, 8887 (2015)
2.
go back to reference C.H. Patil, S.M. Mali, Handwritten Marathi consonants recognition using multilevel classification. Int. J. Comput. Appl 975, 8887 (2019) C.H. Patil, S.M. Mali, Handwritten Marathi consonants recognition using multilevel classification. Int. J. Comput. Appl 975, 8887 (2019)
3.
go back to reference Y. Xue, J.M. Jiang, B.P. Zhao, T.H. Ma, A self-adaptive artificial bee colony algorithm based on global best for global optimization. Soft. Comput. 22(9), 2935–2952 (2018)CrossRef Y. Xue, J.M. Jiang, B.P. Zhao, T.H. Ma, A self-adaptive artificial bee colony algorithm based on global best for global optimization. Soft. Comput. 22(9), 2935–2952 (2018)CrossRef
4.
go back to reference Y. Xue, T. Tang, W. Pang, A.X. Liu, Self-adaptive parameter and strategy based on particle swarm optimization for large-scale feature selection problems with multiple classifiers. Appl. Soft Comput. 88(4), 106031 (2020)CrossRef Y. Xue, T. Tang, W. Pang, A.X. Liu, Self-adaptive parameter and strategy based on particle swarm optimization for large-scale feature selection problems with multiple classifiers. Appl. Soft Comput. 88(4), 106031 (2020)CrossRef
5.
go back to reference Y. Xue, B. Xue, M. Zhang, Self-adaptive particle swarm optimization for large-scale feature selection in classification. ACM Trans. Knowl. Discov. Data 13(5), 1–27 (2019)CrossRef Y. Xue, B. Xue, M. Zhang, Self-adaptive particle swarm optimization for large-scale feature selection in classification. ACM Trans. Knowl. Discov. Data 13(5), 1–27 (2019)CrossRef
6.
go back to reference X. Yu, Y. Chu, F. Jiang, Y. Guo, D.W. Gong, SVMs classification based two-side cross domain collaborative filtering by inferring intrinsic user and item features. Knowl.-Based Syst. 141(1), 80–91 (2018)CrossRef X. Yu, Y. Chu, F. Jiang, Y. Guo, D.W. Gong, SVMs classification based two-side cross domain collaborative filtering by inferring intrinsic user and item features. Knowl.-Based Syst. 141(1), 80–91 (2018)CrossRef
7.
go back to reference Y. Zhang, X.F. Song, D.W. Gong, A return-cost-based binary firefly algorithm for feature selection. Inf. Sci. 418–419(3), 561–574 (2017)CrossRef Y. Zhang, X.F. Song, D.W. Gong, A return-cost-based binary firefly algorithm for feature selection. Inf. Sci. 418–419(3), 561–574 (2017)CrossRef
8.
go back to reference Y. Zhang, D.W. Gong, Y. Hu, W.Q. Zhang, Feature selection algorithm based on bare bones particle swarm optimization. Neurocomputing 148(5), 150–157 (2015)CrossRef Y. Zhang, D.W. Gong, Y. Hu, W.Q. Zhang, Feature selection algorithm based on bare bones particle swarm optimization. Neurocomputing 148(5), 150–157 (2015)CrossRef
9.
go back to reference S. Cheng, Y.H. Shi, Brain storm optimization algorithms: concepts, principles and applications, in Adaptation, Learning, and Optimization, vol. 23 (Springer International Publishing AG, 2019) S. Cheng, Y.H. Shi, Brain storm optimization algorithms: concepts, principles and applications, in Adaptation, Learning, and Optimization, vol. 23 (Springer International Publishing AG, 2019)
10.
go back to reference S. Cheng, L.B. Ma, H. Lu, X.J. Lei, Y.H. Shi, Evolutionary computation for solving search-based data analytics problems, in Artificial Intelligence Review (In press, 2020) S. Cheng, L.B. Ma, H. Lu, X.J. Lei, Y.H. Shi, Evolutionary computation for solving search-based data analytics problems, in Artificial Intelligence Review (In press, 2020)
11.
go back to reference Y. Zhang, D.W. Gong, J. Cheng, Multi-objective particle swarm optimization approach for cost-based feature selection in classification. IEEE/ACM Trans. Comput. Biol. Bioinf. 14(1), 64–75 (2017)CrossRef Y. Zhang, D.W. Gong, J. Cheng, Multi-objective particle swarm optimization approach for cost-based feature selection in classification. IEEE/ACM Trans. Comput. Biol. Bioinf. 14(1), 64–75 (2017)CrossRef
12.
go back to reference L.B. Ma, S. Cheng, Y.H. Shi, Enhancing learning efficiency of brain storm optimization via orthogonal learning design. IEEE Trans. Syst. Man Cybern. Syst. (2020) L.B. Ma, S. Cheng, Y.H. Shi, Enhancing learning efficiency of brain storm optimization via orthogonal learning design. IEEE Trans. Syst. Man Cybern. Syst. (2020)
13.
go back to reference B. Cao, J.W. Zhao, P. Yang, Y. Gu, K. Muhammad, et al., Multi-objective 3-D topology optimization of next-generation wireless data center network. IEEE Trans. Ind. Inf. 16(5), 3597–3605 (2020) B. Cao, J.W. Zhao, P. Yang, Y. Gu, K. Muhammad, et al., Multi-objective 3-D topology optimization of next-generation wireless data center network. IEEE Trans. Ind. Inf. 16(5), 3597–3605 (2020)
14.
go back to reference A.J. Qi, Talk about text recognition software OCR. Printing Technol. 000(013), 27–30 (2004) A.J. Qi, Talk about text recognition software OCR. Printing Technol. 000(013), 27–30 (2004)
15.
go back to reference Z.W. Zhang, Study of CNN and the Application in Character Recognition (Liaoning University of Science and Technology 2018) Z.W. Zhang, Study of CNN and the Application in Character Recognition (Liaoning University of Science and Technology 2018)
16.
go back to reference K. Gaurav, P.K. Bhatia, Analytical review of preprocessing techniques for offline handwritten character recognition, in 2nd International Conference on Emerging Trends in Engineering & Management, ICETEM (2013) K. Gaurav, P.K. Bhatia, Analytical review of preprocessing techniques for offline handwritten character recognition, in 2nd International Conference on Emerging Trends in Engineering & Management, ICETEM (2013)
17.
go back to reference S. España-Boquera, J.C.B. Maria, G.M. Jorge, Z.M. Francisco, Improving offline handwritten text recognition with hybrid HMM/ANN models. IEEE Trans. Pattern Anal. Mach. Intell. 33(4) (2011) S. España-Boquera, J.C.B. Maria, G.M. Jorge, Z.M. Francisco, Improving offline handwritten text recognition with hybrid HMM/ANN models. IEEE Trans. Pattern Anal. Mach. Intell. 33(4) (2011)
18.
go back to reference U. Pal, T. Wakabayashi, F. Kimura, Handwritten numeral recognition of six popular scripts, in Ninth International conference on Document Analysis and Recognition ICDAR 07, vol. 2, pp. 749–753 (2007) U. Pal, T. Wakabayashi, F. Kimura, Handwritten numeral recognition of six popular scripts, in Ninth International conference on Document Analysis and Recognition ICDAR 07, vol. 2, pp. 749–753 (2007)
19.
go back to reference A. Pal, D. Singh, Handwritten English character recognition using neural. Netw. Int. J. Comput. Sci. Commun. 1(2), 141–144 A. Pal, D. Singh, Handwritten English character recognition using neural. Netw. Int. J. Comput. Sci. Commun. 1(2), 141–144
20.
go back to reference J. Pradeep, E. Srinivasan, S. Himavathi, Diagonal based feature extraction for handwritten alphabets recognition system using neural network. Int. J. Comput. Sci. Inf. Technol. (IJCSIT), 3(1), (2011) J. Pradeep, E. Srinivasan, S. Himavathi, Diagonal based feature extraction for handwritten alphabets recognition system using neural network. Int. J. Comput. Sci. Inf. Technol. (IJCSIT), 3(1), (2011)
21.
go back to reference M. Hanmandlu, O.V.R. Murthy, Fuzzy model based recognition of handwritten numerals. Pattern Recogn. 40, 1840–1854 (2007) M. Hanmandlu, O.V.R. Murthy, Fuzzy model based recognition of handwritten numerals. Pattern Recogn. 40, 1840–1854 (2007)
22.
go back to reference R.F.P. Neves, A.N.G. Lopes Filho, C.A.B. Mello, C. Zanchettin, A SVM based off-line handwritten digit recognizer, in International conference on Systems, Man and Cybernetics (IEEE Xplore, 9–12 Oct, 2011, Brazil), pp. 510–515 R.F.P. Neves, A.N.G. Lopes Filho, C.A.B. Mello, C. Zanchettin, A SVM based off-line handwritten digit recognizer, in International conference on Systems, Man and Cybernetics (IEEE Xplore, 9–12 Oct, 2011, Brazil), pp. 510–515
23.
go back to reference A. Purohit, S. Chauhan, A literature survey on handwritten character recognition. Int. J. Comput. Sci. Inf. Technol. 7, 1–5 (2016) A. Purohit, S. Chauhan, A literature survey on handwritten character recognition. Int. J. Comput. Sci. Inf. Technol. 7, 1–5 (2016)
25.
go back to reference S.A., Mahmoud, M.H. Abu-Amara, Recognition of handwritten Arabic (Indian) numerals using Radon-Fourier-based features, in Proceedings of the 9th WSEAS International Conference on Signal Processing, Robotics and Automation, (ISPRA’10) (ACM Press, USA, 2010), pp. 158–163 S.A., Mahmoud, M.H. Abu-Amara, Recognition of handwritten Arabic (Indian) numerals using Radon-Fourier-based features, in Proceedings of the 9th WSEAS International Conference on Signal Processing, Robotics and Automation, (ISPRA’10) (ACM Press, USA, 2010), pp. 158–163
27.
go back to reference U. Bhattacharya, M. Shridhar, S.K. Parui, On recognition of handwritten Bangla characters, in Computer Vision, Graphics and Image Processing (Springer, Berlin, Heidelberg, 2006), pp. 817–828 U. Bhattacharya, M. Shridhar, S.K. Parui, On recognition of handwritten Bangla characters, in Computer Vision, Graphics and Image Processing (Springer, Berlin, Heidelberg, 2006), pp. 817–828
28.
go back to reference S. Basu, N. Das, R. Sarkar, M. Kundu, M. Nasipuri, D.K. Basu, Recognition of numeric postal codes from multi-script postal address blocks, in International Conference on Pattern Recognition and Machine Intelligence (Springer, Berlin, Heidelberg, 2009), pp. 381–386 S. Basu, N. Das, R. Sarkar, M. Kundu, M. Nasipuri, D.K. Basu, Recognition of numeric postal codes from multi-script postal address blocks, in International Conference on Pattern Recognition and Machine Intelligence (Springer, Berlin, Heidelberg, 2009), pp. 381–386
29.
go back to reference M.A.H. Akhand, M. Ahmed, M.H. Rahman, Convolutional neural network based handwritten Bengali and Bengali-English mixed numeral recognition. Int. J. Image Graph. Sign. Proces. 8(9), 40–50 (2016) M.A.H. Akhand, M. Ahmed, M.H. Rahman, Convolutional neural network based handwritten Bengali and Bengali-English mixed numeral recognition. Int. J. Image Graph. Sign. Proces. 8(9), 40–50 (2016)
30.
go back to reference M. Shopon, N. Mohammed, M.A. Abedin, Bangla handwritten digit recognition using autoencoder and deep convolutional neural network, in 2016 International Workshop on Computational Intelligence (IWCI) (IEEE, 2016), pp. 64–68 M. Shopon, N. Mohammed, M.A. Abedin, Bangla handwritten digit recognition using autoencoder and deep convolutional neural network, in 2016 International Workshop on Computational Intelligence (IWCI) (IEEE, 2016), pp. 64–68
31.
go back to reference R. Pramanik, P. Dansena, S. Bag, A study on the effect of CNN-based transfer learning on handwritten Indic and mixed numeral recognition, in Workshop on Document Analysis and Recognition (Springer, Singapore, 2018), pp. 41–51 R. Pramanik, P. Dansena, S. Bag, A study on the effect of CNN-based transfer learning on handwritten Indic and mixed numeral recognition, in Workshop on Document Analysis and Recognition (Springer, Singapore, 2018), pp. 41–51
32.
go back to reference K.S. Dash, N.B. Puhan, G. Panda, Handwritten numeral recognition using non-redundant Stockwell transform and bio-inspired optimal zoning (Academic Press, 2015) K.S. Dash, N.B. Puhan, G. Panda, Handwritten numeral recognition using non-redundant Stockwell transform and bio-inspired optimal zoning (Academic Press, 2015)
33.
go back to reference A. Ashiquzzaman, A.K. Tushar, A. Rahman, F. Mohsin, An efficient recognition method for handwritten arabic numerals using CNN with data augmentation and dropout, in Data Management, Analytics and Innovation (Springer, Singapore, 2019), pp. 299–309 A. Ashiquzzaman, A.K. Tushar, A. Rahman, F. Mohsin, An efficient recognition method for handwritten arabic numerals using CNN with data augmentation and dropout, in Data Management, Analytics and Innovation (Springer, Singapore, 2019), pp. 299–309
34.
go back to reference A. Choudhary, R. Rishi, S. Ahlawat, Handwritten numeral recognition using modified BP ANN structure. in International Conference on Computer Science and Information Technology (Springer, Berlin, Heidelberg, 2011), pp. 56–65 A. Choudhary, R. Rishi, S. Ahlawat, Handwritten numeral recognition using modified BP ANN structure. in International Conference on Computer Science and Information Technology (Springer, Berlin, Heidelberg, 2011), pp. 56–65
36.
go back to reference Y. LeCun, C. Cortes, MNIST handwritten digit database (2010) Y. LeCun, C. Cortes, MNIST handwritten digit database (2010)
Metadata
Title
Comparative Study of Machine Learning and Deep Learning Classifiers on Handwritten Numeral Recognition
Authors
Meenal Jabde
Chandrashekhar Patil
Shankar Mali
Amol Vibhute
Copyright Year
2023
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-19-8094-7_10