Skip to main content
Top
Published in: Neural Computing and Applications 1/2022

26-08-2021 | Original Article

Ensemble deep transfer learning model for Arabic (Indian) handwritten digit recognition

Authors: Rami S. Alkhawaldeh, Moatsum Alawida, Nawaf Farhan Funkur Alshdaifat, Wafa’ Za’al Alma’aitah, Ammar Almasri

Published in: Neural Computing and Applications | Issue 1/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Recognising handwritten digits or characters is a challenging task due to noisy data that results from different writing styles. Numerous applications essentially motivate to build an effective recognising model for such purposes by utilizing recent intelligent techniques. However, the difficulty emerges when using the Arabic language that suffers from diverse noises; because of the way of writing inherent in connecting characters and digits. Therefore, this work focuses on the Arabic (Indian) digits and propose an ensemble deep transfer learning (EDTL) model that efficaciously detect and recognise these digits. The EDTL model is a combination of two effective pre-trained transfer learning models that consume time and cost complexity in the training phase. The EDTL is trained on large datasets to extract relevant features as input to a fully-connected Artificial Neural Network classifier. The experimental results, using popular datasets, show significant performance obtained by the EDTL model with accuracy reached up to 99.83% in comparison to baseline methods include deep transfer learning models, ensemble deep transfer learning models and state-of-the-art techniques.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Abdleazeem S, El-Sherif E (2008) Arabic handwritten digit recognition. Int J Doc Anal Recognit (IJDAR) 11(3):127–141CrossRef Abdleazeem S, El-Sherif E (2008) Arabic handwritten digit recognition. Int J Doc Anal Recognit (IJDAR) 11(3):127–141CrossRef
5.
go back to reference Alkhateeb JH (2020) Handwritten arabic digit recognition using convolutional neural network. Int J Commun Netw Inf Secur 12(3):411–416 Alkhateeb JH (2020) Handwritten arabic digit recognition using convolutional neural network. Int J Commun Netw Inf Secur 12(3):411–416
7.
go back to reference Alkhawaldeh RS (2020) Arabic (indian) digit handwritten recognition using recurrent transfer deep architecture. Soft Computing pp. 1–11 Alkhawaldeh RS (2020) Arabic (indian) digit handwritten recognition using recurrent transfer deep architecture. Soft Computing pp. 1–11
8.
go back to reference Alkhawaldeh RS, Khawaldeh S, Pervaiz U, Alawida M, Alkhawaldeh H (2019) Niml: non-intrusive machine learning-based speech quality prediction on voip networks. IET Commun 13(16):2609–2616CrossRef Alkhawaldeh RS, Khawaldeh S, Pervaiz U, Alawida M, Alkhawaldeh H (2019) Niml: non-intrusive machine learning-based speech quality prediction on voip networks. IET Commun 13(16):2609–2616CrossRef
9.
go back to reference Alom MZ, Taha TM, Yakopcic C, Westberg S, Sidike P, Nasrin MS, Hasan M, Van Essen BC, Awwal AA, Asari VK (2019) A state-of-the-art survey on deep learning theory and architectures. Electronics 8(3):292CrossRef Alom MZ, Taha TM, Yakopcic C, Westberg S, Sidike P, Nasrin MS, Hasan M, Van Essen BC, Awwal AA, Asari VK (2019) A state-of-the-art survey on deep learning theory and architectures. Electronics 8(3):292CrossRef
10.
go back to reference Alshdaifat NFF, Talib AZ, Osman MA (2020) Improved deep learning framework for fish segmentation in underwater videos. Ecol Inf 59:101121CrossRef Alshdaifat NFF, Talib AZ, Osman MA (2020) Improved deep learning framework for fish segmentation in underwater videos. Ecol Inf 59:101121CrossRef
12.
go back to reference Ashiquzzaman A, Tushar AK (2017) Handwritten arabic numeral recognition using deep learning neural networks. In: 2017 IEEE International Conference on Imaging, Vision & Pattern Recognition (icIVPR), IEEE, pp. 1–4 Ashiquzzaman A, Tushar AK (2017) Handwritten arabic numeral recognition using deep learning neural networks. In: 2017 IEEE International Conference on Imaging, Vision & Pattern Recognition (icIVPR), IEEE, pp. 1–4
13.
go back to reference Ashiquzzaman A, Tushar AK, Rahman A, Mohsin F (2019) An efficient recognition method for handwritten arabic numerals using cnn with data augmentation and dropout. In: Balas VE, Sharma N, Chakrabarti A (eds) Data management, analytics and innovation. Springer Singapore, Singapore, pp 299–309CrossRef Ashiquzzaman A, Tushar AK, Rahman A, Mohsin F (2019) An efficient recognition method for handwritten arabic numerals using cnn with data augmentation and dropout. In: Balas VE, Sharma N, Chakrabarti A (eds) Data management, analytics and innovation. Springer Singapore, Singapore, pp 299–309CrossRef
14.
go back to reference Ashiquzzaman A, Tushar AK, Rahman A, Mohsin F (2019) An efficient recognition method for handwritten arabic numerals using cnn with data augmentation and dropout. Data management, analytics and innovation. Springer, Berlin, pp 299–309CrossRef Ashiquzzaman A, Tushar AK, Rahman A, Mohsin F (2019) An efficient recognition method for handwritten arabic numerals using cnn with data augmentation and dropout. Data management, analytics and innovation. Springer, Berlin, pp 299–309CrossRef
15.
go back to reference Boufenar C, Kerboua A, Batouche M (2018) Investigation on deep learning for off-line handwritten arabic character recognition. Cognit Syst Res 50:180–195CrossRef Boufenar C, Kerboua A, Batouche M (2018) Investigation on deep learning for off-line handwritten arabic character recognition. Cognit Syst Res 50:180–195CrossRef
17.
go back to reference Chollet F (2018) Deep learning mit python und keras: das praxis-handbuch vom entwickler der keras-bibliothek. MITP-Verlags GmbH & Co, KG Chollet F (2018) Deep learning mit python und keras: das praxis-handbuch vom entwickler der keras-bibliothek. MITP-Verlags GmbH & Co, KG
18.
go back to reference Dietterich TG (2000) Ensemble methods in machine learning. In: International workshop on multiple classifier systems, pp. 1–15. Springer Dietterich TG (2000) Ensemble methods in machine learning. In: International workshop on multiple classifier systems, pp. 1–15. Springer
19.
go back to reference Dua M, Singla R, Raj S, Jangra A et al (2021) Deep cnn models-based ensemble approach to driver drowsiness detection. Neural Comput Appl 33(8):3155–3168CrossRef Dua M, Singla R, Raj S, Jangra A et al (2021) Deep cnn models-based ensemble approach to driver drowsiness detection. Neural Comput Appl 33(8):3155–3168CrossRef
20.
go back to reference El-Sawy A, EL-Bakry H, Loey M (2017) Cnn for handwritten arabic digits recognition based on lenet-5. In: A.E. Hassanien, K. Shaalan, T. Gaber, A.T. Azar, M.F. Tolba (eds.) Proceedings of the international conference on advanced intelligent systems and informatics 2016. Springer International Publishing, Cham. pp. 566–575 El-Sawy A, EL-Bakry H, Loey M (2017) Cnn for handwritten arabic digits recognition based on lenet-5. In: A.E. Hassanien, K. Shaalan, T. Gaber, A.T. Azar, M.F. Tolba (eds.) Proceedings of the international conference on advanced intelligent systems and informatics 2016. Springer International Publishing, Cham. pp. 566–575
21.
go back to reference Giovannetti A, Susi G, Casti P, Mencattini A, Pusil S, López ME, Di Natale C, Martinelli E (2021) Deep-meg: spatiotemporal cnn features and multiband ensemble classification for predicting the early signs of alzheimers disease with magnetoencephalography. Neural Comput Appl. https://doi.org/10.1007/s00521-021-06105-4CrossRef Giovannetti A, Susi G, Casti P, Mencattini A, Pusil S, López ME, Di Natale C, Martinelli E (2021) Deep-meg: spatiotemporal cnn features and multiband ensemble classification for predicting the early signs of alzheimers disease with magnetoencephalography. Neural Comput Appl. https://​doi.​org/​10.​1007/​s00521-021-06105-4CrossRef
23.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778
24.
go back to reference Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: Efficient convolutional neural networks for mobile vision applications Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: Efficient convolutional neural networks for mobile vision applications
25.
go back to reference Khawaldeh S, Pervaiz U, Rafiq A, Alkhawaldeh RS (2018) Noninvasive grading of glioma tumor using magnetic resonance imaging with convolutional neural networks. Appl Sci 8(1):27CrossRef Khawaldeh S, Pervaiz U, Rafiq A, Alkhawaldeh RS (2018) Noninvasive grading of glioma tumor using magnetic resonance imaging with convolutional neural networks. Appl Sci 8(1):27CrossRef
26.
go back to reference Latif G, Alghazo J, Alzubaidi L, Naseer MM, Alghazo Y (2018) Deep convolutional neural network for recognition of unified multi-language handwritten numerals. In: 2018 IEEE 2nd International Workshop on Arabic and Derived Script Analysis and Recognition (ASAR), pp. 90–95 . https://doi.org/10.1109/ASAR.2018.8480289 Latif G, Alghazo J, Alzubaidi L, Naseer MM, Alghazo Y (2018) Deep convolutional neural network for recognition of unified multi-language handwritten numerals. In: 2018 IEEE 2nd International Workshop on Arabic and Derived Script Analysis and Recognition (ASAR), pp. 90–95 . https://​doi.​org/​10.​1109/​ASAR.​2018.​8480289
27.
28.
go back to reference Loey M, El-Sawy A, El-Bakry H (2017) Deep learning autoencoder approach for handwritten arabic digits recognition. arXiv preprint arXiv:1706.06720 Loey M, El-Sawy A, El-Bakry H (2017) Deep learning autoencoder approach for handwritten arabic digits recognition. arXiv preprint arXiv:​1706.​06720
29.
go back to reference Lumini A, Nanni L (2019) Deep learning and transfer learning features for plankton classification. Ecol Inform 51:33–43CrossRef Lumini A, Nanni L (2019) Deep learning and transfer learning features for plankton classification. Ecol Inform 51:33–43CrossRef
30.
go back to reference Maheshwari M, Namdev D, Maheshwari S (2018) A systematic review of automation in handwritten character recognition. Int J Appl Eng Res 13(10):8090–8099 Maheshwari M, Namdev D, Maheshwari S (2018) A systematic review of automation in handwritten character recognition. Int J Appl Eng Res 13(10):8090–8099
31.
go back to reference Mahmoud S (2008) Recognition of writer-independent off-line handwritten arabic (indian) numerals using hidden markov models. Signal Process 88(4):844–857CrossRef Mahmoud S (2008) Recognition of writer-independent off-line handwritten arabic (indian) numerals using hidden markov models. Signal Process 88(4):844–857CrossRef
32.
go back to reference Minetto R, Segundo MP, Sarkar S (2019) Hydra: an ensemble of convolutional neural networks for geospatial land classification. IEEE Trans Geosci Remote Sens 57(9):6530–6541CrossRef Minetto R, Segundo MP, Sarkar S (2019) Hydra: an ensemble of convolutional neural networks for geospatial land classification. IEEE Trans Geosci Remote Sens 57(9):6530–6541CrossRef
33.
go back to reference Mudhsh M, Almodfer R (2017) Arabic handwritten alphanumeric character recognition using very deep neural network. Information 8(3):105CrossRef Mudhsh M, Almodfer R (2017) Arabic handwritten alphanumeric character recognition using very deep neural network. Information 8(3):105CrossRef
35.
go back to reference Perez L, Wang J (2017) The effectiveness of data augmentation in image classification using deep learning. arXiv preprint arXiv:1712.04621 Perez L, Wang J (2017) The effectiveness of data augmentation in image classification using deep learning. arXiv preprint arXiv:​1712.​04621
36.
go back to reference Rawat W, Wang Z (2017) Deep convolutional neural networks for image classification: a comprehensive review. Neural Comput 29(9):2352–2449MathSciNetCrossRef Rawat W, Wang Z (2017) Deep convolutional neural networks for image classification: a comprehensive review. Neural Comput 29(9):2352–2449MathSciNetCrossRef
37.
go back to reference Rehman A, Naz S, Razzak MI, Hameed IA (2019) Automatic visual features for writer identification: a deep learning approach. IEEE Access 7:17149–17157CrossRef Rehman A, Naz S, Razzak MI, Hameed IA (2019) Automatic visual features for writer identification: a deep learning approach. IEEE Access 7:17149–17157CrossRef
38.
go back to reference Sandler M, Howard A, Zhu M, Zhmoginov A, Chen L (2018) Mobilenetv2: Inverted residuals and linear bottlenecks. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 4510–4520 Sandler M, Howard A, Zhu M, Zhmoginov A, Chen L (2018) Mobilenetv2: Inverted residuals and linear bottlenecks. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 4510–4520
39.
go back to reference Shahabi MS, Maghsoudi A (2021) Prediction of drug response in major depressive disorder using ensemble of transfer learning with convolutional neural network based on eeg. Biocybernet Biomed Eng 41:946–959CrossRef Shahabi MS, Maghsoudi A (2021) Prediction of drug response in major depressive disorder using ensemble of transfer learning with convolutional neural network based on eeg. Biocybernet Biomed Eng 41:946–959CrossRef
40.
go back to reference de Sousa IP (2018) Convolutional ensembles for arabic handwritten character and digit recognition. PeerJ Comput Sci 4:e167CrossRef de Sousa IP (2018) Convolutional ensembles for arabic handwritten character and digit recognition. PeerJ Comput Sci 4:e167CrossRef
Metadata
Title
Ensemble deep transfer learning model for Arabic (Indian) handwritten digit recognition
Authors
Rami S. Alkhawaldeh
Moatsum Alawida
Nawaf Farhan Funkur Alshdaifat
Wafa’ Za’al Alma’aitah
Ammar Almasri
Publication date
26-08-2021
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 1/2022
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-021-06423-7

Other articles of this Issue 1/2022

Neural Computing and Applications 1/2022 Go to the issue

Premium Partner