Top

International Journal of Intelligent Transportation Systems Research

Published in:

13-11-2023

Effective Semantic Video Classification Model for Driverless Car

Authors: Sujata Jagtap, Sudhir Kanade

Published in: International Journal of Intelligent Transportation Systems Research | Issue 1/2024

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

The prime motto of the research work is to design a semantic video classification model with improved efficiency. In order to attain this preferred target, the problem statement is concisely framed to detect the situation in which the brake of the preceding car is applied or not. The semantic video classification model is proposed using transfer learning techniques for autonomous vehicles. To implement the proposed model, a database consisting of positive and negative images is used to train the machine learning architecture. For effective implementation of the model, the car as an object is detected in the frame of the video using the HAAR cascade approach, and subsequently, the brake light status is scanned for estimating the possibility of brake applied, brake not applied, left indicator activated, right indicator activated, parking activated and light off state. Further, the actual time required to classify the video semantics is calculated. The event detection time of the proposed model is less than 0.69 ms with 99. 23% of accuracy, and precision along with 100% F1-Score and sensitivity. Further, a cogent comparative analysis of the model was carried out by using the performance evaluation with respect to the modelling style.

next article Direction-Oriented Topic Modeling with Applications in Traffic Scene Analysis

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

ATZelectronics worldwide

ATZlectronics worldwide is up-to-speed on new trends and developments in automotive electronics on a scientific level with a high depth of information.

Order your 30-days-trial for free and without any commitment.

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

ATZelektronik

Die Fachzeitschrift ATZelektronik bietet für Entwickler und Entscheider in der Automobil- und Zulieferindustrie qualitativ hochwertige und fundierte Informationen aus dem gesamten Spektrum der Pkw- und Nutzfahrzeug-Elektronik.

Lassen Sie sich jetzt unverbindlich 2 kostenlose Ausgabe zusenden.

inform now

Savino, G., Giovannini, F., Baldanzini, N., Pierini, M., Rizzi, M., et al.: Assessing the potential benefits of the motorcycle autonomous emergency braking using detailed crash reconstructions. Traffic Inj Prev 14(Suppl), S 40-9 (2013). https://doi.org/10.1080/15389588.2013.803280CrossRef

Siddiqi, K., Raza, A.D., Muhammad, S.S.: Visible light communication for V2V intelligent transport system. International Conference on Broadband Communications for Next Generation Networks and Multimedia Applications (CoBCom), 1–4 (2016).https://doi.org/10.1109/COBCOM.2016.7593510

Siebert, F.M., Ringhand, M., Englert, F., Hoffknecht, M., Edwards, T., Rotting, M.: Braking bad –ergonomic design and implications for the safe use of shared E-scooters. 140, 105294 (2021). https://doi.org/10.1016/j.ssci.2021.105294

Shimazaki, K., Ito, T., Fujii, Ai., Ishida, T.: The public’s understanding of the functionality and limitations of automatic braking in Japan. Int. Assoc. Traff. Saf. Sci. 42(4), 221–229 (2018). https://doi.org/10.1016/j.iatssr.2017.11.002CrossRef

Satzoda, R.K., Trivedi, M.M.: Looking at vehicles in the night: detection and dynamics of rear lights. IEEE Trans. Intell. Transp. Syst. 20(12), 4297–4307 (2019). https://doi.org/10.1109/TITS.2016.2614545CrossRef

Tiwari, A., Karthikeyan, B., Suresh, S.: Testing and implementation of smart brake pedal system with signal diagnostic and failure detection. International Conference on Vision Towards Emerging Trends in Communication and Networking (ViTECoN), 1–3 (2019). https://doi.org/10.1109/ViTECoN.2019.8899361

Chen, D.-Y., Chen, C.-H.: Salient video cube guided nighttime vehicle braking event detection. J. Vis. Commun. Image Represent. 23, 586–597 (2012). https://doi.org/10.1016/j.jvcir.2012.01.013CrossRef

Wang, J., et al.: Appearance-based Brake-Lights recognition using deep learning and vehicle detection. 2016 IEEE Intelligent Vehicles Symposium (IV), 815–820 (2016). https://doi.org/10.1109/IVS.2016.7535481

Rapson, C.J., Seet, B., Naeem, M.A., Eun Lee, J., Klette, R.: A performance comparison of deep learning methods for real-time localisation of vehicle lights in video frames. IEEE Intelligent Transportation Systems Conference (ITSC), 567–572. (2019). https://doi.org/10.1109/ITSC.2019.8917087

10.

Chen, D., Peng, Y.: Frequency-tuned taillight-based nighttime vehicle braking warning system. IEEE Sens. J. 12(11), 3285–3292 (2012). https://doi.org/10.1109/JSEN.2012.2212971CrossRef

11.

Edwards, M., Nathanson, A., Wisch, M.: Estimate of potential benefit for Europe of fitting Autonomous Emergency Braking (AEB) systems for pedestrian protection to passenger cars. Traffic Inj. Prev. 15(Suppl 1), S173–S182 (2014). https://doi.org/10.1080/15389588.2014.931579CrossRef

12.

Fowler, G.F., Ray, R.M., Huang, S., Zhao, K., Frank, T.A.: An examination of motorcycle antilock brake systems in reducing crash risk. ASME ASME J. Risk Uncert. Part B 2(2), 021006 (2016). https://doi.org/10.1115/1.4031522CrossRef

13.

Lucci, C., Marra, M., Huertas-Leyva, P., Baldanzini, N., Savino, G.: Investigating the feasibility of motorcycle autonomous emergency braking (MAEB): design criteria for new experiments to field test automatic braking. Methods 8, 101225 (2021). https://doi.org/10.1016/j.mex.2021.101225CrossRef

14.

Wang, J., Zhou, L., Song, Z., Yuan, M.: Real-time vehicle signal lights recognition with HDR camera. IEEE International Conference on Internet of Things (I Things) and IEEE Green Computing and Communications (Green Com) and IEEE Cyber, Physical and Social Computing (CPS Com) and IEEE Smart Data (Smart Data), 355–358. (2016). https://doi.org/10.1109/iThings-GreenCom-CPSCom-SmartData.2016.84

15.

Savino, G., Pierini, M., Rizzi, M., Frampton, R.: Evaluation of an autonomous braking system in real-world PTW crashes. Traffic Inj. Prev. 14, 532–543 (2013)CrossRef

16.

Wang, X., Tang, J., Niu, J., Zhao, X.: Vision-based two-step brake detection method for vehicle collision avoidance. Neurocomputing 173, 450–461 (2016). https://doi.org/10.1016/j.neucom.2015.04.117CrossRef

17.

Wang, F., He, S., Zhong, J.: Application of vehicle tail light identification technology in traffic safety. 17^th COTA International Conference of Transportation Professionals, 7–9. (2017). https://doi.org/10.1061/9780784480915.485

18.

Xiang, W., Yan, X., Weng, J., Li, X.: Effect of auditory in-vehicle warning information on drivers’ brake response time to red-light running vehicles during collision avoidance. Transp. Res. F: Traffic Psychol. Behav. 40, 56–67 (2016). https://doi.org/10.1016/j.trf.2015.12.002CrossRef

19.

Zhu, Y., Wu, H., Zhang, J.: Regenerative braking control strategy for electric vehicles based on optimization of switched reluctance generator drive system. IEEE Access. 8(1–1) 76671–76682 (2020). https://doi.org/10.1109/ACCESS.2020.2990349

20.

Chen, J.: Mining urban sustainable performance: GPS data-based Spatio-temporal analysis on on-road braking emission. J. Clean. Prod. 270, 122489 (2020)CrossRef

21.

Elghitany, M.N., Tolba, F., Abdelkader, A.M.: Low vehicle speeds regenerative anti-lock braking system. Ain Shams Eng. J. (2021). https://doi.org/10.1016/j.asej.2021.08.013CrossRef

22.

Feng, J.K., Chiang, M.-L., Chuang, S.-H., Fang, C.-Y., Chen, S.-W.: Forward vehicle deceleration detection system for motorcycle at nighttime. IEEE 4^th International Conference on Computer and Communications. (2018)

23.

Jen, C.L., Chen, Y.L., Hsiao, H.Y.: Robust detection and tracking of vehicle taillight signals using frequency domain feature based Adaboost learning. IEEE International Conference on Consumer Electronics - Taiwan (ICCE-TW), 423–424 (2017). https://doi.org/10.1109/ICCE-China.2017.7991176

24.

Li, Q., et al.: A highly efficient vehicle taillight detection approach based on deep learning. IEEE Trans. Intell. Transp. Syst. 22(7), 4716–4726 (2021). https://doi.org/10.1109/TITS.2020.3027421CrossRef

25.

Jagtap, S.D., Kanade, S.S.: Improving run time efficiency of semantic video event classifcation. Int. J. Intell. Transp. Syst. Res. (2022). https://doi.org/10.1007/s13177-022-00333-1CrossRef

26.

Nava, D., Panzani, G., Savaresi, S. M.: A collision warning oriented brake lights detection and classification algorithm based on a mono camera sensor. 2019 IEEE Intelligent Transportation Systems Conference (ITSC), 319–324 (2019). https://doi.org/10.1109/ITSC.2019.8916961

27.

Choudhary, A., Goyal, D., Letha, S.S.: Infrared thermography based fault diagnosis of induction motor bearings using machine learning. IEEE Sensors J. 20(2), 1727–1734 (2020). https://doi.org/10.1109/JSEN.2020.3015868

28.

Hamidi, H., Kamankesh, A.: An approach to intelligent traffic management system using a multi-agent system. Int. J. ITS Res. 16, 112-124 (2) (2018). https://doi.org/10.1007/s13177-017-0142-6CrossRef

29.

Choudhary, A., Fatima, S., Panigrahi, B. K.: State of the art technologies in fault diagnosis of electric vehicles: a component-based review. IEEE Global Humanitarian Technology Conference (GHTC). (2022). https://doi.org/10.1109/TTE.2022.3209166

30.

Deva Hema, D., Kumar, K.A.: Optimized deep neural network based intelligent decision support system for traffic state prediction. Int. J. ITS Res. 21, 26–35 (2023). https://doi.org/10.1007/s13177-022-00332-2CrossRef

31.

Choudhary, A., Mian, T., Fatima, S., Panigrahi, B. K.: Fault diagnosis of electric two-wheeler under pragmatic operating conditions using wavelet synchro squeezing transform and CNN 23(6) 6254–6263. 14^th International Conference on Computer and Automation Engineering (ICCAE). (2023). https://doi.org/10.1109/JSEN.2023.3239383

32.

Diedie, G.H.F., Anoh, N.G., Oumtanaga, S.: Hybrid acyclic and spillback-aware scheduling protocol for intelligent traffic lights control. Int. J. ITS Res. 21, 178–191 (2023). https://doi.org/10.1007/s13177-023-00344-6CrossRef

33.

Choudhary, A., Mishra, R.K., Fatima, S., Panigrahi, B.K.: Multi-input CNN based vibro-acoustic fusion for accurate fault diagnosis of induction motor. Eng. Appl. Artif. Intell. 120, 105872 (2023). https://doi.org/10.1016/j.engappai.2023.105872CrossRef

34.

Yahiaoui, A.: Stability analysis of following vehicles on a highway for safety of automated transportation systems. Int. J. ITS Res. 17, 190–199 (2019). https://doi.org/10.1007/s13177-019-00177-2CrossRef

Title: Effective Semantic Video Classification Model for Driverless Car
Authors: Sujata Jagtap
Sudhir Kanade
Publication date: 13-11-2023
Publisher: Springer US
Published in: International Journal of Intelligent Transportation Systems Research / Issue 1/2024
Print ISSN: 1348-8503
Electronic ISSN: 1868-8659
DOI: https://doi.org/10.1007/s13177-023-00370-4

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

ATZelectronics worldwide

Springer Professional "Technik"

ATZelektronik

Other articles of this Issue 1/2024

Model Predictive Sliding Mode Control of Highway Traffic Flow: Cooperative and Integrated Approach

Predicted Average Annual Cost of Crashes on the US-16 Wyoming Downgrade Using Time Series Analysis and Forecasting

Design Problem of Travel Sections for Shared Autonomous Vehicles Considering the Immaturity of Autonomous Vehicle Technology

Monocular Vision Based Approach for Occlusion Detection and Handling: A Way Forward for Advanced Driver Assistance Systems

Enhancing Autonomous Driving By Exploiting Thermal Object Detection Through Feature Fusion

Identification of Traffic Accident Black Spots on Suburban Highways Based on Smartphone Sensors of Drivers

Premium Partners