nach oben

Neural Computing and Applications

Erschienen in:

24.04.2021 | S.I. : NCACVIP

Synthetic Data generation using DCGAN for improved traffic sign recognition

verfasst von: Christine Dewi, Rung-Ching Chen, Yan-Ting Liu, Shao-Kuo Tai

Erschienen in: Neural Computing and Applications | Ausgabe 24/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Traffic sign detection and recognition perform a vital function in real-world driver guidance applications, including driver assistance systems. Research into vision-based traffic sign detection (TSD) and traffic sign recognition (TSR) has gained considerable attention in the scientific community, led mainly by three variables: identification, monitoring, and classification. In addition, TSR provides valuable details and alerts for smart cars including advanced driving assistance (ADAS) and cooperative intelligent transport systems (CITS). Our work will generate high-quality synthetic prohibitory sign images using deep convolutional generative adversarial networks (DCGAN). This paper analyzes and discusses CNN models incorporating different backbone architectures and feature extractors, focusing on Resnet 50 and Densenet for object detection. Assessment of the models provides important information, including mean average accuracy (mAP), workspace capacity, detection period, and the amount of billion floating-point operations (BFLOPS). The maximum average accuracy is 92% (Densenet DCGAN), led by 91% (Resnet 50 DCGAN), 88% (Densenet), and 63% (Resnet 50). We find when using the original image and a synthetic image, accuracy increases, while detection time falls. Our findings show that combining original images and synthetic images in the dataset for training can improve intersection over union (IoU) and traffic sign recognition performance.

Vorheriger Artikel Effective training of convolutional neural networks for age estimation based on knowledge distillation

Nächster Artikel Understanding cartoon emotion using integrated deep neural network on large dataset

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Arcos-García Á, Álvarez-García JA, Soria-Morillo LM (2018) Deep neural network for traffic sign recognition systems: an analysis of spatial transformers and stochastic optimisation methods. Neural Netw 99:158–165. https://doi.org/10.1016/j.neunet.2018.01.005CrossRef

Stallkamp J, Schlipsing M, Salmen J, Igel C (2011) The German Traffic Sign Recognition Benchmark: A multi-class classification competition. In: Proceedings of the international joint conference on neural networks. pp 1453–1460

Zhu Z, Liang D, Zhang S, et al (2016) Traffic-Sign Detection and Classification in the Wild. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. pp 2110–2118

Sermanet P, Eigen D, Zhang X, et al (2014) Overfeat: Integrated recognition, localization and detection using convolutional networks. In: 2nd International Conference on Learning Representations, ICLR 2014 - Conference Track Proceedings. pp 1–16

Tao X, Gong Y, Shi W, Cheng D (2018) Object detection with class aware region proposal network and focused attention objective. Pattern Recogn Lett. https://doi.org/10.1016/j.patrec.2018.09.025CrossRef

M. Shahud, J. Bajracharya, P. Praneetpolgrang SP (2018) Thai Traffic Sign Detection and Recognition Using Convolutional Neural Networks. In: 22nd International Computer Science and Engineering Conference, ICSEC 2018 (2019). pp 1–5

Dewi C, Chen RC (2019) Random forest and support vector machine on features selection for regression analysis. International Journal of Innovative Computing, Information and Control 15:2027–2037. https://doi.org/10.24507/ijicic.15.06.2027CrossRef

Tai S, Dewi C, Chen R et al (2020) Deep learning for traffic sign recognition based on spatial pyramid pooling with scale analysis. Appl Sci (Switzerland) 10:6997. https://doi.org/10.3390/app10196997CrossRef

Hu Y, Wang FY, Liu X (2014) A CPSS approach for emergency evacuation in building fires. IEEE Intell Syst 29:1541–1672. https://doi.org/10.1109/MIS.2014.38CrossRef

10.

Wu CC, Wu SL (2019) Research and implementation of road traffic sign identification system. J Netw Intell 4:47–57

11.

Zhang H, Goodfellow I, Metaxas D, Odena A (2019) Self-attention generative adversarial networks. In: 36th International Conference on Machine Learning, ICML 2019. pp 12744–12753

12.

Dewi C, Chen R-C, Tai S-K (2020) Evaluation of robust spatial pyramid pooling based on convolutional neural network for traffic sign recognition system. Electron 9:889. https://doi.org/10.3390/electronics9060889CrossRef

13.

Luo H, Yang Y, Tong B et al (2018) Traffic Sign Recognition Using a Multi-Task Convolutional Neural Network. IEEE Trans Intell Transp Syst 19:1100–1111. https://doi.org/10.1109/TITS.2017.2714691CrossRef

14.

Girshick R (2015) Fast R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision. pp 1440–1448

15.

Ren S, He K, Girshick R (2015) Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. In: Proceedings of the 2015 advances in Neural Information Processing Systems. pp 91–99

16.

Redmon J, Farhadi A (2017) YOLO9000: Better, faster, stronger. In: Proceedings—30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017. pp 6517–6525

17.

Tian Y, Yang G, Wang Z et al (2019) Apple detection during different growth stages in orchards using the improved YOLO-V3 model. Comput Electron Agric 157:417–426. https://doi.org/10.1016/j.compag.2019.01.012CrossRef

18.

Dewi C, Chen R-C, Liu Y-T, et al (2020) Taiwan Stop Sign Recognition with Customize Anchor. In: ACM International Conference Proceeding Series. pp 51–55

19.

Chen RC, Dewi C, Huang SW, Caraka RE (2020) Selecting critical features for data classification based on machine learning methods. J Big Data 7:1–26. https://doi.org/10.1186/s40537-020-00327-4CrossRef

20.

Radford A, Metz L, Chintala S (2016) Unsupervised representation learning with deep convolutional GANs. Int Conf Learn Represent. https://doi.org/10.1051/0004-6361/201527329CrossRef

21.

Goodfellow I, Pouget-Abadie J, Mirza M et al (2014) Generative Adversarial Nets (NIPS version). Adv Neural Inf Process Syst 27(27):2672–2680. https://doi.org/10.1001/jamainternmed.2016.8245CrossRef

22.

Bau D, Zhu JY, Strobelt H, et al (2019) GaN dissection: Visualizing and understanding generative adversarial networks. In: 7th International Conference on Learning Representations, ICLR 2019. pp 1–18

23.

Wei G, Luo M, Liu H et al (2020) Progressive generative adversarial networks with reliable sample identification. Pattern Recognit Lett 130:91–98CrossRef

24.

Volkhonskiy D, Nazarov I, Burnaev E (2019) Steganographic generative adversarial networks. In: Proceedings Volume 11433, Twelfth International Conference on Machine Vision (ICMV 2019). pp 1–12

25.

Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: From error visibility to structural similarity. IEEE Trans Image Process 13:600–612. https://doi.org/10.1109/TIP.2003.819861CrossRef

26.

Deshmukh A, Sivaswamy J (2019) Synthesis of optical nerve head region of fundus image. In: Proceedings—International Symposium on Biomedical Imaging. pp 583–586

27.

Rehman A, Wang Z (2012) Reduced-reference image quality assessment by structural similarity estimation. IEEE Trans Image Process 21:3378–3389. https://doi.org/10.1109/TIP.2012.2197011MathSciNetCrossRefMATH

28.

Rohani M, Avanaki AN (2009) A watermarking method based on optimizing SSIM index by using PSO in DCT domain. In: 2009 14th International CSI Computer Conference, CSICC 2009. pp 418–422

29.

Dewi C, Chen RC, Yu H (2020) Weight analysis for various prohibitory sign detection and recognition using deep learning. Multimed Tools Appl 79:32897–32915. https://doi.org/10.1007/s11042-020-09509-xCrossRef

30.

Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. pp 779–788

31.

Redmon J, Farhadi A (2018) YOLOv3: An Incremental Improvement. CoRR abs/1804.0:1–5

32.

Ghatwary N, Ye X, Zolgharni M (2019) Esophageal abnormality detection using densenet based faster R-CNN with gabor features. IEEE Access 7:84374–84385. https://doi.org/10.1109/ACCESS.2019.2925585CrossRef

33.

Zhang J, Wang W, Lu C et al (2019) Lightweight deep network for traffic sign classification. Annales des Telecommun/Annals of Telecommun 75:369–379. https://doi.org/10.1007/s12243-019-00731-9CrossRef

34.

Li T, Jiao W, Wang LN, Zhong G (2020) Automatic DenseNet sparsification. IEEE Access 8:62561–62571. https://doi.org/10.1109/ACCESS.2020.2984130CrossRef

35.

Huang Z, Zhu X, Ding M, Zhang X (2020) Medical image classification using a light-weighted hybrid neural network based on PCANet and DenseNet. IEEE Access 8:24697–24712. https://doi.org/10.1109/ACCESS.2020.2971225CrossRef

36.

Jang DW, Park RH (2019) Densenet with deep residual channel-attention blocks for single image super resolution. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. pp 1–9

37.

Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017. pp 2261–2269

38.

He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. pp 770–778

39.

Chander G, Markham BL, Helder DL (2009) Summary of current radiometric calibration coefficients for Landsat MSS, TM, ETM+, and EO-1 ALI sensors. Remote Sens Environ 113:893–903. https://doi.org/10.1016/j.rse.2009.01.007CrossRef

40.

Fang W, Wang C, Chen X et al (2019) Recognizing global reservoirs from landsat 8 images: a deep learning approach. IEEE J Sel Top Appl Earth Obsd Remote Sens 12:3168–3177. https://doi.org/10.1109/jstars.2019.2929601CrossRef

41.

Sai Sundar K V., Bonta LR, Reddy AKB, et al (2018) Evaluating Training Time of Inception-v3 and Resnet-50,101 Models using TensorFlow across CPU and GPU. In: Proceedings of the 2nd International Conference on Electronics, Communication and Aerospace Technology, ICECA 2018. pp 1964–1968

42.

Hagerty JR, Stanley RJ, Almubarak HA et al (2019) Deep Learning and Handcrafted Method Fusion: Higher Diagnostic Accuracy for Melanoma Dermoscopy Images. IEEE J Biomed Health Inform 23:1385–1391. https://doi.org/10.1109/JBHI.2019.2891049CrossRef

43.

Sai Bharadwaj Reddy A, Sujitha Juliet D (2019) Transfer learning with RESNET-50 for malaria cell-image classification. In: Proceedings of the 2019 IEEE International Conference on Communication and Signal Processing, ICCSP 2019. pp 0945–0949

44.

Bbox label tool (2019) In: https://github.com/puzzledqs/BBox-Label-Tool

45.

Hendry CRC (2019) Automatic License Plate Recognition via sliding-window darknet-YOLO deep learning. Image Vis Comput 87:47–56. https://doi.org/10.1016/j.imavis.2019.04.007CrossRef

46.

Abadi M, Barham P, Chen J et al (2016) TensorFlow: A system for large-scale machine learning. In: Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2016. pp 1–21

47.

Arcos-García Á, Álvarez-García JA, Soria-Morillo LM (2018) Evaluation of deep neural networks for traffic sign detection systems. Neurocomput 316:332–344. https://doi.org/10.1016/j.neucom.2018.08.009CrossRef

48.

Yang H, Chen L, Chen M et al (2019) Tender tea shoots recognition and positioning for picking robot using improved YOLO-V3 model. IEEE Access 7:180998–181011. https://doi.org/10.1109/ACCESS.2019.2958614CrossRef

49.

Yuan Y, Xiong Z, Wang Q (2017) An incremental framework for video-based traffic sign detection, tracking, and recognition. IEEE Trans Intell Transp Syst 18:1918–1929. https://doi.org/10.1109/TITS.2016.2614548CrossRef

50.

Shi R, Li T, Yamaguchi Y (2020) An attribution-based pruning method for real-time mango detection with YOLO network. Comput Electron Agric. https://doi.org/10.1016/j.compag.2020.105214CrossRef

51.

Kang H, Chen C (2020) Fast implementation of real-time fruit detection in apple orchards using deep learning. Comput Electron Agric 168:1–10. https://doi.org/10.1016/j.compag.2019.105108CrossRef

Titel: Synthetic Data generation using DCGAN for improved traffic sign recognition
verfasst von: Christine Dewi
Rung-Ching Chen
Yan-Ting Liu
Shao-Kuo Tai
Publikationsdatum: 24.04.2021
Verlag: Springer London
Erschienen in: Neural Computing and Applications / Ausgabe 24/2022
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI: https://doi.org/10.1007/s00521-021-05982-z

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Weitere Artikel der Ausgabe 24/2022

A review on crowd analysis of evacuation and abnormality detection based on machine learning systems

Artificial neural networks integrated mixed integer mathematical model for multi-fleet heterogeneous time-dependent cash in transit problem with time windows

Individual tree crown delineation in high-resolution remote sensing images based on U-Net

On multi-objective covering salesman problem

Sentiment knowledge-induced neural network for aspect-level sentiment analysis

Automatic segmentation of COVID-19 from computed tomography images using modified U-Net model-based majority voting approach

Premium Partner