Skip to main content

2018 | OriginalPaper | Buchkapitel

Towards Human-Level License Plate Recognition

verfasst von : Jiafan Zhuang, Saihui Hou, Zilei Wang, Zheng-Jun Zha

Erschienen in: Computer Vision – ECCV 2018

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

License plate recognition (LPR) is a fundamental component of various intelligent transport systems, which is always expected to be accurate and efficient enough. In this paper, we propose a novel LPR framework consisting of semantic segmentation and character counting, towards achieving human-level performance. Benefiting from innovative structure, our method can recognize a whole license plate once rather than conducting character detection or sliding window followed by per-character recognition. Moreover, our method can achieve higher recognition accuracy due to more effectively exploiting global information and avoiding sensitive character detection, and is time-saving due to eliminating one-by-one character recognition. Finally, we experimentally verify the effectiveness of the proposed method on two public datasets (AOLP and Media Lab) and our License Plate Dataset. The results demonstrate our method significantly outperforms the previous state-of-the-art methods, and achieves the accuracies of more than 99% for almost all settings.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
In the current version of our dataset, \(m=3\) is used due to the limitation of image acquisition.
 
Literatur
1.
Zurück zum Zitat Adorni, G., Bergenti, F., Cagnoni, S.: Vehicle license plate recognition by means of cellular automata. In: IV (1998) Adorni, G., Bergenti, F., Cagnoni, S.: Vehicle license plate recognition by means of cellular automata. In: IV (1998)
2.
Zurück zum Zitat Anagnostopoulos, C.N.E., Anagnostopoulos, I.E., Loumos, V., Kayafas, E.: A license plate-recognition algorithm for intelligent transportation system applications. IEEE Trans. Intell. Transp. Syst. 7(3), 377–392 (2006)CrossRef Anagnostopoulos, C.N.E., Anagnostopoulos, I.E., Loumos, V., Kayafas, E.: A license plate-recognition algorithm for intelligent transportation system applications. IEEE Trans. Intell. Transp. Syst. 7(3), 377–392 (2006)CrossRef
3.
Zurück zum Zitat Anagnostopoulos, C.N.E., Anagnostopoulos, I.E., Psoroulas, I.D., Loumos, V., Kayafas, E.: License plate recognition from still images and video sequences: a survey. IEEE Trans. Intell. Transp. Syst. 9(3), 377–391 (2008)CrossRef Anagnostopoulos, C.N.E., Anagnostopoulos, I.E., Psoroulas, I.D., Loumos, V., Kayafas, E.: License plate recognition from still images and video sequences: a survey. IEEE Trans. Intell. Transp. Syst. 9(3), 377–391 (2008)CrossRef
5.
Zurück zum Zitat Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)CrossRef Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)CrossRef
6.
Zurück zum Zitat Bulan, O., Kozitsky, V., Ramesh, P., Shreve, M.: Segmentation-and annotation-free license plate recognition with deep localization and failure identification. IEEE Trans. Intell. Transp. Syst. 18(9), 2351–2363 (2017)CrossRef Bulan, O., Kozitsky, V., Ramesh, P., Shreve, M.: Segmentation-and annotation-free license plate recognition with deep localization and failure identification. IEEE Trans. Intell. Transp. Syst. 18(9), 2351–2363 (2017)CrossRef
7.
Zurück zum Zitat Cheang, T.K., Chong, Y.S., Tay, Y.H.: Segmentation-free vehicle license plate recognition using convnet-RNN. arXiv preprint arXiv:1701.06439 (2017) Cheang, T.K., Chong, Y.S., Tay, Y.H.: Segmentation-free vehicle license plate recognition using convnet-RNN. arXiv preprint arXiv:​1701.​06439 (2017)
8.
Zurück zum Zitat Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L.: DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 40(4), 834–848 (2018)CrossRef Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L.: DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 40(4), 834–848 (2018)CrossRef
9.
Zurück zum Zitat Cherng, S., Fang, C.Y., Chen, C.P., Chen, S.W.: Critical motion detection of nearby moving vehicles in a vision-based driver-assistance system. IEEE Tran. Intell. Transp. Syst. 10(1), 70–82 (2009)CrossRef Cherng, S., Fang, C.Y., Chen, C.P., Chen, S.W.: Critical motion detection of nearby moving vehicles in a vision-based driver-assistance system. IEEE Tran. Intell. Transp. Syst. 10(1), 70–82 (2009)CrossRef
10.
Zurück zum Zitat Davies, P., Emmott, N., Ayland, N.: License plate recognition technology for toll violation enforcement. In: Image Analysis for Transport Applications (1990) Davies, P., Emmott, N., Ayland, N.: License plate recognition technology for toll violation enforcement. In: Image Analysis for Transport Applications (1990)
11.
Zurück zum Zitat Du, S., Ibrahim, M., Shehata, M., Badawy, W.: Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans. Circuits Syst. Video Technol. 23(2), 311–325 (2013)CrossRef Du, S., Ibrahim, M., Shehata, M., Badawy, W.: Automatic license plate recognition (ALPR): a state-of-the-art review. IEEE Trans. Circuits Syst. Video Technol. 23(2), 311–325 (2013)CrossRef
12.
Zurück zum Zitat Duan, T.D., Du, T.H., Phuoc, T.V., Hoang, N.V.: Building an automatic vehicle license plate recognition system. In: RIVF (2005) Duan, T.D., Du, T.H., Phuoc, T.V., Hoang, N.V.: Building an automatic vehicle license plate recognition system. In: RIVF (2005)
13.
Zurück zum Zitat Hegt, H.A., De La Haye, R.J., Khan, N.A.: A high performance license plate recognition system (1998) Hegt, H.A., De La Haye, R.J., Khan, N.A.: A high performance license plate recognition system (1998)
14.
Zurück zum Zitat Hsu, G.S., Alexandra, P., Chen, J.C., Yeh, F., Chen, M.H.: License plate recognition for categorized applications. In: ICVES (2011) Hsu, G.S., Alexandra, P., Chen, J.C., Yeh, F., Chen, M.H.: License plate recognition for categorized applications. In: ICVES (2011)
15.
Zurück zum Zitat Hsu, G.S., Chen, J.C., Chung, Y.Z.: Application-oriented license plate recognition. IEEE Trans. Veh. Technol. 62(2), 552–561 (2013)CrossRef Hsu, G.S., Chen, J.C., Chung, Y.Z.: Application-oriented license plate recognition. IEEE Trans. Veh. Technol. 62(2), 552–561 (2013)CrossRef
16.
Zurück zum Zitat Huang, Y.S., Weng, Y.S., Zhou, M.: Critical scenarios and their identification in parallel railroad level crossing traffic control systems. IEEE Trans. Intell. Transp. Syst. 11(4), 968–977 (2010)CrossRef Huang, Y.S., Weng, Y.S., Zhou, M.: Critical scenarios and their identification in parallel railroad level crossing traffic control systems. IEEE Trans. Intell. Transp. Syst. 11(4), 968–977 (2010)CrossRef
17.
Zurück zum Zitat Jia, Y., et al.: Caffe: convolutional architecture for fast feature embedding. In: ACM MM (2014) Jia, Y., et al.: Caffe: convolutional architecture for fast feature embedding. In: ACM MM (2014)
18.
Zurück zum Zitat Kim, K.K., Kim, K., Kim, J., Kim, H.J.: Learning-based approach for license plate recognition. In: Neural Networks for Signal Processing (2000) Kim, K.K., Kim, K., Kim, J., Kim, H.J.: Learning-based approach for license plate recognition. In: Neural Networks for Signal Processing (2000)
19.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: NIPS (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: NIPS (2012)
20.
Zurück zum Zitat Lempitsky, V., Zisserman, A.: Learning to count objects in images. In: NIPS (2010) Lempitsky, V., Zisserman, A.: Learning to count objects in images. In: NIPS (2010)
21.
Zurück zum Zitat Li, H., Shen, C.: Reading car license plates using deep convolutional neural networks and LSTMs. arXiv preprint arXiv:1601.05610 (2016) Li, H., Shen, C.: Reading car license plates using deep convolutional neural networks and LSTMs. arXiv preprint arXiv:​1601.​05610 (2016)
23.
Zurück zum Zitat Liu, X., Wang, Z., Feng, J., Xi, H.: Highway vehicle counting in compressed domain. In: CVPR (2016) Liu, X., Wang, Z., Feng, J., Xi, H.: Highway vehicle counting in compressed domain. In: CVPR (2016)
24.
Zurück zum Zitat Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: CVPR (2015) Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: CVPR (2015)
25.
Zurück zum Zitat Masood, S.Z., Shu, G., Dehghan, A., Ortiz, E.G.: License plate detection and recognition using deeply learned convolutional neural networks. arXiv preprint arXiv:1703.07330 (2017) Masood, S.Z., Shu, G., Dehghan, A., Ortiz, E.G.: License plate detection and recognition using deeply learned convolutional neural networks. arXiv preprint arXiv:​1703.​07330 (2017)
26.
Zurück zum Zitat Naito, T., Tsukada, T., Yamada, K., Kozuka, K., Yamamoto, S.: Robust license-plate recognition method for passing vehicles under outside environment. IEEE Trans. Veh. Technol. 49(6), 2309–2319 (2000)CrossRef Naito, T., Tsukada, T., Yamada, K., Kozuka, K., Yamamoto, S.: Robust license-plate recognition method for passing vehicles under outside environment. IEEE Trans. Veh. Technol. 49(6), 2309–2319 (2000)CrossRef
27.
Zurück zum Zitat Nijhuis, J., et al.: Car license plate recognition with neural networks and fuzzy logic (1995) Nijhuis, J., et al.: Car license plate recognition with neural networks and fuzzy logic (1995)
28.
Zurück zum Zitat Omitaomu, O.A., Ganguly, A.R., Patton, B.W., Protopopescu, V.A.: Anomaly detection in radiation sensor data with application to transportation security. IEEE Trans. Intell. Transp. Syst. 10(2), 324–334 (2009)CrossRef Omitaomu, O.A., Ganguly, A.R., Patton, B.W., Protopopescu, V.A.: Anomaly detection in radiation sensor data with application to transportation security. IEEE Trans. Intell. Transp. Syst. 10(2), 324–334 (2009)CrossRef
29.
Zurück zum Zitat Parizi, S.N., Targhi, A.T., Aghazadeh, O., Eklundh, J.O.: Reading street signs using a generic structured object detection and signature recognition approach. In: VISAPP (2009) Parizi, S.N., Targhi, A.T., Aghazadeh, O., Eklundh, J.O.: Reading street signs using a generic structured object detection and signature recognition approach. In: VISAPP (2009)
30.
Zurück zum Zitat Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: CVPR (2016) Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: CVPR (2016)
31.
Zurück zum Zitat Wang, F., Man, L., Wang, B., Xiao, Y., Pan, W., Lu, X.: Fuzzy-based algorithm for color recognition of license plates. Pattern Recogn. Lett. 29(7), 1007–1020 (2008)CrossRef Wang, F., Man, L., Wang, B., Xiao, Y., Pan, W., Lu, X.: Fuzzy-based algorithm for color recognition of license plates. Pattern Recogn. Lett. 29(7), 1007–1020 (2008)CrossRef
33.
Zurück zum Zitat Yamaguchi, K., Nagaya, Y., Ueda, K., Nemoto, H., Nakagawa, M.: A method for identifying specific vehicles using template matching (1999) Yamaguchi, K., Nagaya, Y., Ueda, K., Nemoto, H., Nakagawa, M.: A method for identifying specific vehicles using template matching (1999)
34.
Zurück zum Zitat Yu, M., Kim, Y.D.: An approach to Korean license plate recognition based on vertical edge matching (2000) Yu, M., Kim, Y.D.: An approach to Korean license plate recognition based on vertical edge matching (2000)
35.
Zurück zum Zitat Zhu, S., Dianat, S., Mestha, L.K.: End-to-end system of license plate localization and recognition. JEI 24(2), 023020 (2015) Zhu, S., Dianat, S., Mestha, L.K.: End-to-end system of license plate localization and recognition. JEI 24(2), 023020 (2015)
Metadaten
Titel
Towards Human-Level License Plate Recognition
verfasst von
Jiafan Zhuang
Saihui Hou
Zilei Wang
Zheng-Jun Zha
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-01219-9_19