Skip to main content
Top
Published in: Soft Computing 19/2018

30-06-2017 | Methodologies and Application

Vehicle license plate detection using region-based convolutional neural networks

Authors: Muhammad Aasim Rafique, Witold Pedrycz, Moongu Jeon

Published in: Soft Computing | Issue 19/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Vehicle license plate (LP) detection is a relatively complex problem until we assume the use of a static camera, variations in illumination, known templates of the LP, guaranteed color patterns and other simple assumptions. Practical applications demand robust and generalized LP detection techniques to accommodate complex scenarios. This work suggests a new approach to solving this problem by treating the vehicle LP as an object. The primary focus of this study is to address following tasks associated with the challenge of LP detection: (1) LP detection in every frame of a video sequence, (2) detection of partial LPs and (3) detection of LPs with moving cameras and moving vehicles. The state-of-the-art object detection techniques, including convolutional neural networks with region proposal (RCNN), its successors (Fast-RCNN and Faster-RCNN) and the exemplar-SVM, are used in this work to provide solutions to the problem. The suggested study demonstrates better results in comprehensive tests and comparisons than other conventional approaches.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Al-Ghaili AM, Mashohor S, Ramli AR, Ismail A (2013) Vertical-edge-based car-license-plate detection method. IEEE Trans Veh Technol 62:26–38CrossRef Al-Ghaili AM, Mashohor S, Ramli AR, Ismail A (2013) Vertical-edge-based car-license-plate detection method. IEEE Trans Veh Technol 62:26–38CrossRef
go back to reference Anagnostopoulos C, Anagnostopoulos I, Loumos V, Kayafas E (2006) A license plate-recognition algorithm for intelligent transportation system applications. IEEE Trans Intell Transp Syst 7(3):377–392CrossRef Anagnostopoulos C, Anagnostopoulos I, Loumos V, Kayafas E (2006) A license plate-recognition algorithm for intelligent transportation system applications. IEEE Trans Intell Transp Syst 7(3):377–392CrossRef
go back to reference Anagnostopoulos CNE, Anagnostopoulos IE, Psoroulas ID, Loumos V, Kayafas E (2008) License plate recognition from still images and video sequences: a survey. IEEE Trans Intell Transp Syst 9(3):377–391CrossRef Anagnostopoulos CNE, Anagnostopoulos IE, Psoroulas ID, Loumos V, Kayafas E (2008) License plate recognition from still images and video sequences: a survey. IEEE Trans Intell Transp Syst 9(3):377–391CrossRef
go back to reference Ashtari AH, Nordin MJ, Fathy M (2014) An iranian license plate recognition system based on color features. IEEE Trans Intell Transp Syst 15:1690–1705CrossRef Ashtari AH, Nordin MJ, Fathy M (2014) An iranian license plate recognition system based on color features. IEEE Trans Intell Transp Syst 15:1690–1705CrossRef
go back to reference Broitman M, Klopovsky Y, Silinskis N (2013) License plate detection algorithm, vol 9067, p 90670Z Broitman M, Klopovsky Y, Silinskis N (2013) License plate detection algorithm, vol 9067, p 90670Z
go back to reference Chavali N, Agrawal H, Mahendru A, Batra D (2015) Object-proposal evaluation protocol is ’gameable’. In: CoRR, vol abs/1505.05836 Chavali N, Agrawal H, Mahendru A, Batra D (2015) Object-proposal evaluation protocol is ’gameable’. In: CoRR, vol abs/1505.05836
go back to reference Du S, Ibrahim M, Shehata M, Badawy W (2013) Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans Circuits Syst Video Technol 23(2):311–325CrossRef Du S, Ibrahim M, Shehata M, Badawy W (2013) Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans Circuits Syst Video Technol 23(2):311–325CrossRef
go back to reference Girshick R (2015) Fast R-CNN. In: Proceedings of the international conference on computer vision (ICCV) Girshick R (2015) Fast R-CNN. In: Proceedings of the international conference on computer vision (ICCV)
go back to reference Girshick R, Donahue J, Darrell T, Malik J (2016) Region-based convolutional networks for accurate object detection and segmentation. IEEE Trans Pattern Anal Mach Intell 38:142–158CrossRef Girshick R, Donahue J, Darrell T, Malik J (2016) Region-based convolutional networks for accurate object detection and segmentation. IEEE Trans Pattern Anal Mach Intell 38:142–158CrossRef
go back to reference Gu Q, Yang J, Kong L, Cui G (2015) Multi-scaled license plate detection based on the label-moveable maximal MSER clique. Opt Rev 22(4):669–678CrossRef Gu Q, Yang J, Kong L, Cui G (2015) Multi-scaled license plate detection based on the label-moveable maximal MSER clique. Opt Rev 22(4):669–678CrossRef
go back to reference Hosang J, Benenson R, Dollr P, Schiele B (2016) What makes for effective detection proposals? IEEE Trans Pattern Anal Mach Intell 38:814–830CrossRef Hosang J, Benenson R, Dollr P, Schiele B (2016) What makes for effective detection proposals? IEEE Trans Pattern Anal Mach Intell 38:814–830CrossRef
go back to reference Hsu GS, Chen JC, Chung YZ (2013) Application-oriented license plate recognition. IEEE Trans Veh Technol 62:552–561CrossRef Hsu GS, Chen JC, Chung YZ (2013) Application-oriented license plate recognition. IEEE Trans Veh Technol 62:552–561CrossRef
go back to reference Ilonen J, Kamarainen J-K, Paalanen P, Hamouz M, Kittler J, Kaviainen H (2008) Image feature localization by multiple hypothesis testing of Gabor features. IEEE Trans Image Process 17:311–325MathSciNetCrossRef Ilonen J, Kamarainen J-K, Paalanen P, Hamouz M, Kittler J, Kaviainen H (2008) Image feature localization by multiple hypothesis testing of Gabor features. IEEE Trans Image Process 17:311–325MathSciNetCrossRef
go back to reference Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: convolutional architecture for fast feature embedding. arXiv:1408.5093 Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: convolutional architecture for fast feature embedding. arXiv:​1408.​5093
go back to reference Kobayashi T (2015) Three viewpoints toward exemplar svm. In: 2015 IEEE conference on computer vision and pattern recognition (CVPR), pp 2765–2773 Kobayashi T (2015) Three viewpoints toward exemplar svm. In: 2015 IEEE conference on computer vision and pattern recognition (CVPR), pp 2765–2773
go back to reference Lalimi MA, Ghofrani S, McLernon D (2012) A vehicle license plate detection method using region and edge based methods. Comput Electr Eng 39(3):834–845CrossRef Lalimi MA, Ghofrani S, McLernon D (2012) A vehicle license plate detection method using region and edge based methods. Comput Electr Eng 39(3):834–845CrossRef
go back to reference Lecun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86:2278–2324CrossRef Lecun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86:2278–2324CrossRef
go back to reference Malisiewicz T (2011) Exemplar-based representations for object detection, association and beyond. PhD thesis, The Robotics Institute Carnegie Mellon University Pittsburgh, Pennsylvania, vol 15213, p 7 Malisiewicz T (2011) Exemplar-based representations for object detection, association and beyond. PhD thesis, The Robotics Institute Carnegie Mellon University Pittsburgh, Pennsylvania, vol 15213, p 7
go back to reference Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149. doi:10.1109/TPAMI.2016.2577031 Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149. doi:10.​1109/​TPAMI.​2016.​2577031
go back to reference Smara GA, Khalefah F (2014) Localization of license plate number using dynamic image processing techniques and genetic algorithms. IEEE Trans Evol Comput 18:244–257CrossRef Smara GA, Khalefah F (2014) Localization of license plate number using dynamic image processing techniques and genetic algorithms. IEEE Trans Evol Comput 18:244–257CrossRef
go back to reference Tadic V, Popovic M, Odry P (2016) Fuzzified Gabor filter for license plate detection. Eng Appl Artif Intell 48:40–58CrossRef Tadic V, Popovic M, Odry P (2016) Fuzzified Gabor filter for license plate detection. Eng Appl Artif Intell 48:40–58CrossRef
go back to reference Uijlings JRR, Sande KEA, Gevers T, Smeulders AWM (2013) Selective search for object recognition. Int J Comput Vis 104(2):154–171CrossRef Uijlings JRR, Sande KEA, Gevers T, Smeulders AWM (2013) Selective search for object recognition. Int J Comput Vis 104(2):154–171CrossRef
go back to reference Wang R, Sang N, Wang R, Jiang L (2014a) Detection and tracking strategy for license plate detection in video. Opt Int J Light Electron Opt 125(10):2283–2288CrossRef Wang R, Sang N, Wang R, Jiang L (2014a) Detection and tracking strategy for license plate detection in video. Opt Int J Light Electron Opt 125(10):2283–2288CrossRef
go back to reference Wang R, Sang N, Huang R, Wang Y (2014b) License plate detection using gradient information and cascade detectors. Opt Int J Light Electron Opt 125(1):186–190CrossRef Wang R, Sang N, Huang R, Wang Y (2014b) License plate detection using gradient information and cascade detectors. Opt Int J Light Electron Opt 125(1):186–190CrossRef
go back to reference Xing X, Choi B-J, Chae S, Lee M-H (2009) Design of a recognizing system for vehicle’s license plates with English characters. Int J Fuzzy Logic Intell Syst 9(3):166–171CrossRef Xing X, Choi B-J, Chae S, Lee M-H (2009) Design of a recognizing system for vehicle’s license plates with English characters. Int J Fuzzy Logic Intell Syst 9(3):166–171CrossRef
go back to reference Yao Z, Yi W (2014) License plate detection based on multistage information fusion. Inf Fusion 18(1):78–85CrossRef Yao Z, Yi W (2014) License plate detection based on multistage information fusion. Inf Fusion 18(1):78–85CrossRef
go back to reference Zeiler M, Fergus R (2014) Visualizing and understanding convolutional networks. In: Computer VisionECCV 2014, vol 8689, pp 818–833 Zeiler M, Fergus R (2014) Visualizing and understanding convolutional networks. In: Computer VisionECCV 2014, vol 8689, pp 818–833
go back to reference Zheng L, He X, Samali B, Yang LT (2013) An algorithm for accuracy enhancement of license plate recognition. J Comput Syst Sci 79(2):245–255MathSciNetCrossRef Zheng L, He X, Samali B, Yang LT (2013) An algorithm for accuracy enhancement of license plate recognition. J Comput Syst Sci 79(2):245–255MathSciNetCrossRef
Metadata
Title
Vehicle license plate detection using region-based convolutional neural networks
Authors
Muhammad Aasim Rafique
Witold Pedrycz
Moongu Jeon
Publication date
30-06-2017
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 19/2018
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-017-2696-2

Other articles of this Issue 19/2018

Soft Computing 19/2018 Go to the issue

Premium Partner