Skip to main content
Erschienen in: Evolutionary Intelligence 2/2021

28.09.2020 | Special Issue

A review on various methodologies used for vehicle classification, helmet detection and number plate recognition

verfasst von: S. Sanjana, S. Sanjana, V. R. Shriya, Gururaj Vaishnavi, K. Ashwini

Erschienen in: Evolutionary Intelligence | Ausgabe 2/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Vehicle detection and classification has been an area of application of image processing and machine learning which is being researched extensively in accordance with its importance due to increasing number of vehicles, traffic rule defaulters and accidents. This paper aims to review various methodologies used and how it has evolved to give better results in the past years, closely moving towards usage of machine learning. This has resulted in advancing the problem statement towards helmet detection followed by number plate detection of defaulters. Object detection and Text recognition that are available in various frameworks offer built-in models which are easy to use or offer easy methods to build and train customized models.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Lei M, Lefloch D, Gouton P, Madani K (2008) A video-based real-time vehicle counting system using adaptive background method. In: IEEE international conference on signal image technology and internet based systems (SITIS’08), pp 523–528 Lei M, Lefloch D, Gouton P, Madani K (2008) A video-based real-time vehicle counting system using adaptive background method. In: IEEE international conference on signal image technology and internet based systems (SITIS’08), pp 523–528
2.
Zurück zum Zitat O’Mahony N et al (2020) Deep learning vs. traditional computer vision. In: Arai K, Kapoor S (eds) Advances in computer vision. CVC 2019. Advances in intelligent systems and computing, vol 943. Springer, Cham O’Mahony N et al (2020) Deep learning vs. traditional computer vision. In: Arai K, Kapoor S (eds) Advances in computer vision. CVC 2019. Advances in intelligent systems and computing, vol 943. Springer, Cham
5.
Zurück zum Zitat Gonzales R, Woods R (1992) Digital image processing. Addison-Wesley Publishing Company, Boston, pp 81–125 Gonzales R, Woods R (1992) Digital image processing. Addison-Wesley Publishing Company, Boston, pp 81–125
6.
Zurück zum Zitat Liu F, Koenig H (2010) A survey of video encryption algorithms. Comput Secur 29(1):3–15CrossRef Liu F, Koenig H (2010) A survey of video encryption algorithms. Comput Secur 29(1):3–15CrossRef
7.
Zurück zum Zitat Culjak I, Abram D, Pribanic T, Dzapo H, Cifrek M (2012) A brief introduction to OpenCV. In: 2012 proceedings of the 35th international convention MIPRO, Opatija, pp 1725–1730 Culjak I, Abram D, Pribanic T, Dzapo H, Cifrek M (2012) A brief introduction to OpenCV. In: 2012 proceedings of the 35th international convention MIPRO, Opatija, pp 1725–1730
8.
Zurück zum Zitat Cheung S-Y, Varaiya PP (2006) Traffic surveillance by wireless sensor networks: final report. PhD diss., University of California at Berkeley Cheung S-Y, Varaiya PP (2006) Traffic surveillance by wireless sensor networks: final report. PhD diss., University of California at Berkeley
9.
Zurück zum Zitat Oh S, Ritchie S, Oh C (2002) Real-time traffic measurement from single loop inductive signatures. Transp Res Rec J Transp Res Board 1804:98–106CrossRef Oh S, Ritchie S, Oh C (2002) Real-time traffic measurement from single loop inductive signatures. Transp Res Rec J Transp Res Board 1804:98–106CrossRef
10.
Zurück zum Zitat Coifman B (2006) Vehicle level evaluation of loop detectors and the remote traffic microwave sensor. J Transp Eng 132(3):213–226CrossRef Coifman B (2006) Vehicle level evaluation of loop detectors and the remote traffic microwave sensor. J Transp Eng 132(3):213–226CrossRef
11.
Zurück zum Zitat Tursun M, Amrulla G (2013) A video based real-time vehicle counting system using optimized virtual loop method. In: IEEE 8th international workshop on systems signal processing and their applications (WoSSPA) Tursun M, Amrulla G (2013) A video based real-time vehicle counting system using optimized virtual loop method. In: IEEE 8th international workshop on systems signal processing and their applications (WoSSPA)
12.
Zurück zum Zitat Seki M, Fujiwara H, Sumi K (2000) A robust background subtraction method for changing background. In: Fifth IEEE workshop on applications of computer vision Seki M, Fujiwara H, Sumi K (2000) A robust background subtraction method for changing background. In: Fifth IEEE workshop on applications of computer vision
13.
Zurück zum Zitat Mithun NC, Rashid NU, Rahman SM (2012) Detection and classification of vehicles from video using multiple time-spatial images. IEEE Trans Intell Transp Syst 13(3):1215–1225CrossRef Mithun NC, Rashid NU, Rahman SM (2012) Detection and classification of vehicles from video using multiple time-spatial images. IEEE Trans Intell Transp Syst 13(3):1215–1225CrossRef
14.
Zurück zum Zitat Boonsirisumpun N, Puarungroj W,Wairotchanaphuttha P (2018) Automatic detector for bikers with no helmet using deep learning. In: 2018 22nd international computer science and engineering conference (ICSEC), Chiang Mai, Thailand, pp 1–4 Boonsirisumpun N, Puarungroj W,Wairotchanaphuttha P (2018) Automatic detector for bikers with no helmet using deep learning. In: 2018 22nd international computer science and engineering conference (ICSEC), Chiang Mai, Thailand, pp 1–4
15.
Zurück zum Zitat Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Proceedings of the advances in neural information processing systems (NIPS), Lake Tahoe, Nevada, United States, 3–6 December 2012, pp 1097–1105 Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Proceedings of the advances in neural information processing systems (NIPS), Lake Tahoe, Nevada, United States, 3–6 December 2012, pp 1097–1105
16.
Zurück zum Zitat Kumar S, Balyan A, Chawla M (2017) Object detection and recognition in images. Int J Eng Dev Res 5(4):1029–1034 Kumar S, Balyan A, Chawla M (2017) Object detection and recognition in images. Int J Eng Dev Res 5(4):1029–1034
17.
Zurück zum Zitat Ren S, He K, Girshick RB, Sun J (2015) Faster R-CNN: towards real time object detection with region proposal networks. In: Advances in neural information processing systems 28: annual conference on neural information processing systems 2015, December 7–12, 2015, Montreal, Quebec, Canada, pp 91–99 Ren S, He K, Girshick RB, Sun J (2015) Faster R-CNN: towards real time object detection with region proposal networks. In: Advances in neural information processing systems 28: annual conference on neural information processing systems 2015, December 7–12, 2015, Montreal, Quebec, Canada, pp 91–99
18.
Zurück zum Zitat Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788 Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788
19.
Zurück zum Zitat Liu W, Anguelov D, Erhan D, Szegedy C, Reed SE, Fu C, Berg AC (2016) SSD: single shot multibox detector. In: Computer vision—ECCV 2016—14th European conference, Amsterdam, The Netherlands, October 11–14, 2016, proceedings, part I, pp 21–37 Liu W, Anguelov D, Erhan D, Szegedy C, Reed SE, Fu C, Berg AC (2016) SSD: single shot multibox detector. In: Computer vision—ECCV 2016—14th European conference, Amsterdam, The Netherlands, October 11–14, 2016, proceedings, part I, pp 21–37
20.
Zurück zum Zitat Lin T, Goyal P, Girshick RB, He K, Doll’ar P (2017) Focal loss for dense object detection. In: IEEE international conference on computer vision, ICCV 2017, Venice, Italy, October 22–29, 2017, pp 2999–3007 Lin T, Goyal P, Girshick RB, He K, Doll’ar P (2017) Focal loss for dense object detection. In: IEEE international conference on computer vision, ICCV 2017, Venice, Italy, October 22–29, 2017, pp 2999–3007
21.
Zurück zum Zitat Tekleyohannes MK, Weis C, When N, Klein M, Siegrist M (2018) A reconfigurable accelerator for morphological operations. In: 2018 IEEE international parallel and distributed processing symposium workshops (IPDPSW), Vancouver, BC Tekleyohannes MK, Weis C, When N, Klein M, Siegrist M (2018) A reconfigurable accelerator for morphological operations. In: 2018 IEEE international parallel and distributed processing symposium workshops (IPDPSW), Vancouver, BC
22.
Zurück zum Zitat Charouh Z, Ghogho M, Guennoun Z (2019) Improved background subtraction-based moving vehicle detection by optimizing morphological operations using machine learning. In: 2019 IEEE international symposium on innovations in intelligent systems and applications (INISTA), Sofia, Bulgaria, pp 1–6 Charouh Z, Ghogho M, Guennoun Z (2019) Improved background subtraction-based moving vehicle detection by optimizing morphological operations using machine learning. In: 2019 IEEE international symposium on innovations in intelligent systems and applications (INISTA), Sofia, Bulgaria, pp 1–6
23.
Zurück zum Zitat Singh D, Vishnu C, Mohan CK (2016) Visual big data analytics for traffic monitoring in smart city. In: Proceedings of the IEEE conference on machine learning and application (ICMLA), Anaheim, California, 18–20 December 2016 Singh D, Vishnu C, Mohan CK (2016) Visual big data analytics for traffic monitoring in smart city. In: Proceedings of the IEEE conference on machine learning and application (ICMLA), Anaheim, California, 18–20 December 2016
24.
Zurück zum Zitat Bishop CM (1995) Neural networks for pattern recognition. Oxford University Press, OxfordMATH Bishop CM (1995) Neural networks for pattern recognition. Oxford University Press, OxfordMATH
25.
Zurück zum Zitat Annavarapu JK (2015) Statistical feature selection for image texture analysis. Int Res J Eng Technol 2:546–550 Annavarapu JK (2015) Statistical feature selection for image texture analysis. Int Res J Eng Technol 2:546–550
26.
Zurück zum Zitat Babayan PV, Ershov MD, Erokhin DY (2019) Neural network-based vehicle and pedestrian detection for video analysis system. In: 2019 8th mediterranean conference on embedded computing (MECO), Budva, Montenegro, pp 1–5 Babayan PV, Ershov MD, Erokhin DY (2019) Neural network-based vehicle and pedestrian detection for video analysis system. In: 2019 8th mediterranean conference on embedded computing (MECO), Budva, Montenegro, pp 1–5
29.
Zurück zum Zitat Baruah A, Kandali AB (2018) Pedestrian detection on OpenCV and TensorFlow. Int J Res Anal Rev 5(2):1–4 Baruah A, Kandali AB (2018) Pedestrian detection on OpenCV and TensorFlow. Int J Res Anal Rev 5(2):1–4
30.
Zurück zum Zitat Memon S, Bhatti S, Ali L, Talpur M, Memon M (2018) A video based vehicle detection, counting and classification system. Int J Image Graph Signal Process 9:34–41CrossRef Memon S, Bhatti S, Ali L, Talpur M, Memon M (2018) A video based vehicle detection, counting and classification system. Int J Image Graph Signal Process 9:34–41CrossRef
31.
Zurück zum Zitat Vapnik VN (1998) Statistical learning theory. Wiley, New YorkMATH Vapnik VN (1998) Statistical learning theory. Wiley, New YorkMATH
32.
Zurück zum Zitat Friedman N, Russell S (1997) Image segmentation in video sequences: a probabilistic approach. In: Proceedings of the thirteenth conference on uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc Friedman N, Russell S (1997) Image segmentation in video sequences: a probabilistic approach. In: Proceedings of the thirteenth conference on uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc
33.
Zurück zum Zitat Contractorr D, Pathak K, Sharma S, Bhagat S, Sharma T (2016) Cascade classifier based helmet detection using OpenCV in image processing Contractorr D, Pathak K, Sharma S, Bhagat S, Sharma T (2016) Cascade classifier based helmet detection using OpenCV in image processing
34.
Zurück zum Zitat Gururaj V, Shriya VR, Ashwini K (2019) Stock market prediction using linear regression and support vector machines. Int J Appl Eng Res 14(8):1931–1934 Gururaj V, Shriya VR, Ashwini K (2019) Stock market prediction using linear regression and support vector machines. Int J Appl Eng Res 14(8):1931–1934
35.
Zurück zum Zitat Dahiya K, Singh D, Mohan CK (2016) Automatic detection of bike-riders without helmet using surveillance videos in real-time. In: 2016 international joint conference on neural networks (IJCNN), Vancouver, BC, pp 3046–3051 Dahiya K, Singh D, Mohan CK (2016) Automatic detection of bike-riders without helmet using surveillance videos in real-time. In: 2016 international joint conference on neural networks (IJCNN), Vancouver, BC, pp 3046–3051
36.
Zurück zum Zitat Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: IEEE computer society conference on computer vision and pattern recognition, vol 1, pp 886–893 Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: IEEE computer society conference on computer vision and pattern recognition, vol 1, pp 886–893
37.
Zurück zum Zitat Lowe DG (1999) Object recognition from local scale-invariant features. In: Computer vision, seventh IEEE international conference Lowe DG (1999) Object recognition from local scale-invariant features. In: Computer vision, seventh IEEE international conference
38.
Zurück zum Zitat Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef
40.
Zurück zum Zitat Silva R, Aires K, Santos T, Abdala K, Veras R, Soares A (2013) Automatic detection of motorcyclists without helmet. In: 2013 XXXIX Latin American computing conference (CLEI), Naiguata, pp 1–7 Silva R, Aires K, Santos T, Abdala K, Veras R, Soares A (2013) Automatic detection of motorcyclists without helmet. In: 2013 XXXIX Latin American computing conference (CLEI), Naiguata, pp 1–7
41.
Zurück zum Zitat Doungmala P, Klubsuwan K (2016) Helmet wearing detection in Thailand using haar like feature and circle hough transform on image processing. In: 2016 IEEE international conference on computer and information technology (CIT), Nadi, pp 611–614. https://doi.org/10.1109/CIT.2016.87. Doungmala P, Klubsuwan K (2016) Helmet wearing detection in Thailand using haar like feature and circle hough transform on image processing. In: 2016 IEEE international conference on computer and information technology (CIT), Nadi, pp 611–614. https://​doi.​org/​10.​1109/​CIT.​2016.​87.
42.
Zurück zum Zitat Vishnu C, Singh D, Mohan CK, Babu S (2017) Detection of motorcyclists without helmet in videos using convolutional neural network. In: 2017 international joint conference on neural networks (IJCNN), Anchorage, AK, pp 3036–3041 Vishnu C, Singh D, Mohan CK, Babu S (2017) Detection of motorcyclists without helmet in videos using convolutional neural network. In: 2017 international joint conference on neural networks (IJCNN), Anchorage, AK, pp 3036–3041
44.
Zurück zum Zitat Mistry J, Misraa AK, Agarwal M, Vyas A, Chudasama VM, Upla KP (2017) An automatic detection of helmeted and non-helmeted motorcyclist with license plate extraction using convolutional neural network. In: 2017 seventh international conference on image processing theory, tools and applications (IPTA), Montreal, QC, pp 1–6. https://doi.org/10.1109/IPTA.2017.8310092. Mistry J, Misraa AK, Agarwal M, Vyas A, Chudasama VM, Upla KP (2017) An automatic detection of helmeted and non-helmeted motorcyclist with license plate extraction using convolutional neural network. In: 2017 seventh international conference on image processing theory, tools and applications (IPTA), Montreal, QC, pp 1–6. https://​doi.​org/​10.​1109/​IPTA.​2017.​8310092.
45.
Zurück zum Zitat Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions (2014). arXiv preprint arXiv:1409.4842, 7 Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions (2014). arXiv preprint arXiv:​1409.​4842, 7
46.
Zurück zum Zitat Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:​1704.​04861
47.
Zurück zum Zitat Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:​1409.​1556
48.
Zurück zum Zitat Li K, Zhao X, Bian J, Tan M (2017) Automatic safety helmet wearing detection. In: 2017 IEEE 7th annual international conference on CYBER technology in automation, control, and intelligent systems (CYBER), Honolulu, HI, pp 617–622 Li K, Zhao X, Bian J, Tan M (2017) Automatic safety helmet wearing detection. In: 2017 IEEE 7th annual international conference on CYBER technology in automation, control, and intelligent systems (CYBER), Honolulu, HI, pp 617–622
49.
Zurück zum Zitat Rattapoom W, Nannaphat B, Vasan T, Chainarong T, Pattanawadee P (2013) Machine vision techniques for motorcycle safety helmet detection. In: Proceedings of the international conference on image and vision computing New Zealand (IVCNZ), Wellington, New Zealand, 27–29 November 2013, pp 35–40 Rattapoom W, Nannaphat B, Vasan T, Chainarong T, Pattanawadee P (2013) Machine vision techniques for motorcycle safety helmet detection. In: Proceedings of the international conference on image and vision computing New Zealand (IVCNZ), Wellington, New Zealand, 27–29 November 2013, pp 35–40
53.
Zurück zum Zitat Goyal A, Bhatia R (2016) Automated car number plate detection system to detect far number plates. IOSR J Comput Eng 18(4):34–40CrossRef Goyal A, Bhatia R (2016) Automated car number plate detection system to detect far number plates. IOSR J Comput Eng 18(4):34–40CrossRef
54.
Zurück zum Zitat Qadri MT, Asif M (2009) Automatic number plate recoginization system for vehicle identification using optical character recoginization. In: 2009 international conference on education technology and computer Qadri MT, Asif M (2009) Automatic number plate recoginization system for vehicle identification using optical character recoginization. In: 2009 international conference on education technology and computer
55.
Zurück zum Zitat Kuldeepak MK, Vashishath M (2012) License plate recognition system based on image processing using labview. Int J Electron Commun Comput Technol 2(4):183 Kuldeepak MK, Vashishath M (2012) License plate recognition system based on image processing using labview. Int J Electron Commun Comput Technol 2(4):183
56.
Metadaten
Titel
A review on various methodologies used for vehicle classification, helmet detection and number plate recognition
verfasst von
S. Sanjana
S. Sanjana
V. R. Shriya
Gururaj Vaishnavi
K. Ashwini
Publikationsdatum
28.09.2020
Verlag
Springer Berlin Heidelberg
Erschienen in
Evolutionary Intelligence / Ausgabe 2/2021
Print ISSN: 1864-5909
Elektronische ISSN: 1864-5917
DOI
https://doi.org/10.1007/s12065-020-00493-7

Weitere Artikel der Ausgabe 2/2021

Evolutionary Intelligence 2/2021 Zur Ausgabe