Skip to main content
Top

2018 | OriginalPaper | Chapter

Towards Human-Level License Plate Recognition

Authors : Jiafan Zhuang, Saihui Hou, Zilei Wang, Zheng-Jun Zha

Published in: Computer Vision – ECCV 2018

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

License plate recognition (LPR) is a fundamental component of various intelligent transport systems, which is always expected to be accurate and efficient enough. In this paper, we propose a novel LPR framework consisting of semantic segmentation and character counting, towards achieving human-level performance. Benefiting from innovative structure, our method can recognize a whole license plate once rather than conducting character detection or sliding window followed by per-character recognition. Moreover, our method can achieve higher recognition accuracy due to more effectively exploiting global information and avoiding sensitive character detection, and is time-saving due to eliminating one-by-one character recognition. Finally, we experimentally verify the effectiveness of the proposed method on two public datasets (AOLP and Media Lab) and our License Plate Dataset. The results demonstrate our method significantly outperforms the previous state-of-the-art methods, and achieves the accuracies of more than 99% for almost all settings.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
In the current version of our dataset, \(m=3\) is used due to the limitation of image acquisition.
 
Literature
1.
go back to reference Adorni, G., Bergenti, F., Cagnoni, S.: Vehicle license plate recognition by means of cellular automata. In: IV (1998) Adorni, G., Bergenti, F., Cagnoni, S.: Vehicle license plate recognition by means of cellular automata. In: IV (1998)
2.
go back to reference Anagnostopoulos, C.N.E., Anagnostopoulos, I.E., Loumos, V., Kayafas, E.: A license plate-recognition algorithm for intelligent transportation system applications. IEEE Trans. Intell. Transp. Syst. 7(3), 377–392 (2006)CrossRef Anagnostopoulos, C.N.E., Anagnostopoulos, I.E., Loumos, V., Kayafas, E.: A license plate-recognition algorithm for intelligent transportation system applications. IEEE Trans. Intell. Transp. Syst. 7(3), 377–392 (2006)CrossRef
3.
go back to reference Anagnostopoulos, C.N.E., Anagnostopoulos, I.E., Psoroulas, I.D., Loumos, V., Kayafas, E.: License plate recognition from still images and video sequences: a survey. IEEE Trans. Intell. Transp. Syst. 9(3), 377–391 (2008)CrossRef Anagnostopoulos, C.N.E., Anagnostopoulos, I.E., Psoroulas, I.D., Loumos, V., Kayafas, E.: License plate recognition from still images and video sequences: a survey. IEEE Trans. Intell. Transp. Syst. 9(3), 377–391 (2008)CrossRef
5.
go back to reference Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)CrossRef Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)CrossRef
6.
go back to reference Bulan, O., Kozitsky, V., Ramesh, P., Shreve, M.: Segmentation-and annotation-free license plate recognition with deep localization and failure identification. IEEE Trans. Intell. Transp. Syst. 18(9), 2351–2363 (2017)CrossRef Bulan, O., Kozitsky, V., Ramesh, P., Shreve, M.: Segmentation-and annotation-free license plate recognition with deep localization and failure identification. IEEE Trans. Intell. Transp. Syst. 18(9), 2351–2363 (2017)CrossRef
7.
go back to reference Cheang, T.K., Chong, Y.S., Tay, Y.H.: Segmentation-free vehicle license plate recognition using convnet-RNN. arXiv preprint arXiv:1701.06439 (2017) Cheang, T.K., Chong, Y.S., Tay, Y.H.: Segmentation-free vehicle license plate recognition using convnet-RNN. arXiv preprint arXiv:​1701.​06439 (2017)
8.
go back to reference Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L.: DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 40(4), 834–848 (2018)CrossRef Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L.: DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 40(4), 834–848 (2018)CrossRef
9.
go back to reference Cherng, S., Fang, C.Y., Chen, C.P., Chen, S.W.: Critical motion detection of nearby moving vehicles in a vision-based driver-assistance system. IEEE Tran. Intell. Transp. Syst. 10(1), 70–82 (2009)CrossRef Cherng, S., Fang, C.Y., Chen, C.P., Chen, S.W.: Critical motion detection of nearby moving vehicles in a vision-based driver-assistance system. IEEE Tran. Intell. Transp. Syst. 10(1), 70–82 (2009)CrossRef
10.
go back to reference Davies, P., Emmott, N., Ayland, N.: License plate recognition technology for toll violation enforcement. In: Image Analysis for Transport Applications (1990) Davies, P., Emmott, N., Ayland, N.: License plate recognition technology for toll violation enforcement. In: Image Analysis for Transport Applications (1990)
11.
go back to reference Du, S., Ibrahim, M., Shehata, M., Badawy, W.: Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans. Circuits Syst. Video Technol. 23(2), 311–325 (2013)CrossRef Du, S., Ibrahim, M., Shehata, M., Badawy, W.: Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans. Circuits Syst. Video Technol. 23(2), 311–325 (2013)CrossRef
12.
go back to reference Duan, T.D., Du, T.H., Phuoc, T.V., Hoang, N.V.: Building an automatic vehicle license plate recognition system. In: RIVF (2005) Duan, T.D., Du, T.H., Phuoc, T.V., Hoang, N.V.: Building an automatic vehicle license plate recognition system. In: RIVF (2005)
13.
go back to reference Hegt, H.A., De La Haye, R.J., Khan, N.A.: A high performance license plate recognition system (1998) Hegt, H.A., De La Haye, R.J., Khan, N.A.: A high performance license plate recognition system (1998)
14.
go back to reference Hsu, G.S., Alexandra, P., Chen, J.C., Yeh, F., Chen, M.H.: License plate recognition for categorized applications. In: ICVES (2011) Hsu, G.S., Alexandra, P., Chen, J.C., Yeh, F., Chen, M.H.: License plate recognition for categorized applications. In: ICVES (2011)
15.
go back to reference Hsu, G.S., Chen, J.C., Chung, Y.Z.: Application-oriented license plate recognition. IEEE Trans. Veh. Technol. 62(2), 552–561 (2013)CrossRef Hsu, G.S., Chen, J.C., Chung, Y.Z.: Application-oriented license plate recognition. IEEE Trans. Veh. Technol. 62(2), 552–561 (2013)CrossRef
16.
go back to reference Huang, Y.S., Weng, Y.S., Zhou, M.: Critical scenarios and their identification in parallel railroad level crossing traffic control systems. IEEE Trans. Intell. Transp. Syst. 11(4), 968–977 (2010)CrossRef Huang, Y.S., Weng, Y.S., Zhou, M.: Critical scenarios and their identification in parallel railroad level crossing traffic control systems. IEEE Trans. Intell. Transp. Syst. 11(4), 968–977 (2010)CrossRef
17.
go back to reference Jia, Y., et al.: Caffe: convolutional architecture for fast feature embedding. In: ACM MM (2014) Jia, Y., et al.: Caffe: convolutional architecture for fast feature embedding. In: ACM MM (2014)
18.
go back to reference Kim, K.K., Kim, K., Kim, J., Kim, H.J.: Learning-based approach for license plate recognition. In: Neural Networks for Signal Processing (2000) Kim, K.K., Kim, K., Kim, J., Kim, H.J.: Learning-based approach for license plate recognition. In: Neural Networks for Signal Processing (2000)
19.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: NIPS (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: NIPS (2012)
20.
go back to reference Lempitsky, V., Zisserman, A.: Learning to count objects in images. In: NIPS (2010) Lempitsky, V., Zisserman, A.: Learning to count objects in images. In: NIPS (2010)
21.
go back to reference Li, H., Shen, C.: Reading car license plates using deep convolutional neural networks and LSTMs. arXiv preprint arXiv:1601.05610 (2016) Li, H., Shen, C.: Reading car license plates using deep convolutional neural networks and LSTMs. arXiv preprint arXiv:​1601.​05610 (2016)
23.
go back to reference Liu, X., Wang, Z., Feng, J., Xi, H.: Highway vehicle counting in compressed domain. In: CVPR (2016) Liu, X., Wang, Z., Feng, J., Xi, H.: Highway vehicle counting in compressed domain. In: CVPR (2016)
24.
go back to reference Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: CVPR (2015) Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: CVPR (2015)
25.
go back to reference Masood, S.Z., Shu, G., Dehghan, A., Ortiz, E.G.: License plate detection and recognition using deeply learned convolutional neural networks. arXiv preprint arXiv:1703.07330 (2017) Masood, S.Z., Shu, G., Dehghan, A., Ortiz, E.G.: License plate detection and recognition using deeply learned convolutional neural networks. arXiv preprint arXiv:​1703.​07330 (2017)
26.
go back to reference Naito, T., Tsukada, T., Yamada, K., Kozuka, K., Yamamoto, S.: Robust license-plate recognition method for passing vehicles under outside environment. IEEE Trans. Veh. Technol. 49(6), 2309–2319 (2000)CrossRef Naito, T., Tsukada, T., Yamada, K., Kozuka, K., Yamamoto, S.: Robust license-plate recognition method for passing vehicles under outside environment. IEEE Trans. Veh. Technol. 49(6), 2309–2319 (2000)CrossRef
27.
go back to reference Nijhuis, J., et al.: Car license plate recognition with neural networks and fuzzy logic (1995) Nijhuis, J., et al.: Car license plate recognition with neural networks and fuzzy logic (1995)
28.
go back to reference Omitaomu, O.A., Ganguly, A.R., Patton, B.W., Protopopescu, V.A.: Anomaly detection in radiation sensor data with application to transportation security. IEEE Trans. Intell. Transp. Syst. 10(2), 324–334 (2009)CrossRef Omitaomu, O.A., Ganguly, A.R., Patton, B.W., Protopopescu, V.A.: Anomaly detection in radiation sensor data with application to transportation security. IEEE Trans. Intell. Transp. Syst. 10(2), 324–334 (2009)CrossRef
29.
go back to reference Parizi, S.N., Targhi, A.T., Aghazadeh, O., Eklundh, J.O.: Reading street signs using a generic structured object detection and signature recognition approach. In: VISAPP (2009) Parizi, S.N., Targhi, A.T., Aghazadeh, O., Eklundh, J.O.: Reading street signs using a generic structured object detection and signature recognition approach. In: VISAPP (2009)
30.
go back to reference Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: CVPR (2016) Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: CVPR (2016)
31.
go back to reference Wang, F., Man, L., Wang, B., Xiao, Y., Pan, W., Lu, X.: Fuzzy-based algorithm for color recognition of license plates. Pattern Recogn. Lett. 29(7), 1007–1020 (2008)CrossRef Wang, F., Man, L., Wang, B., Xiao, Y., Pan, W., Lu, X.: Fuzzy-based algorithm for color recognition of license plates. Pattern Recogn. Lett. 29(7), 1007–1020 (2008)CrossRef
33.
go back to reference Yamaguchi, K., Nagaya, Y., Ueda, K., Nemoto, H., Nakagawa, M.: A method for identifying specific vehicles using template matching (1999) Yamaguchi, K., Nagaya, Y., Ueda, K., Nemoto, H., Nakagawa, M.: A method for identifying specific vehicles using template matching (1999)
34.
go back to reference Yu, M., Kim, Y.D.: An approach to Korean license plate recognition based on vertical edge matching (2000) Yu, M., Kim, Y.D.: An approach to Korean license plate recognition based on vertical edge matching (2000)
35.
go back to reference Zhu, S., Dianat, S., Mestha, L.K.: End-to-end system of license plate localization and recognition. JEI 24(2), 023020 (2015) Zhu, S., Dianat, S., Mestha, L.K.: End-to-end system of license plate localization and recognition. JEI 24(2), 023020 (2015)
Metadata
Title
Towards Human-Level License Plate Recognition
Authors
Jiafan Zhuang
Saihui Hou
Zilei Wang
Zheng-Jun Zha
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-01219-9_19

Premium Partner