Skip to main content
Top

2023 | OriginalPaper | Chapter

Sensitivity Analysis of Regularization Techniques in Convolution Neural Networks with Tensorflow

Authors : Shivakumar Dalali, B. E. ManjunathSwamy, Giridhar Gowda, N. S. Girish Rao Salanke

Published in: ICDSMLA 2021

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Achieving excellent performance in the fields of classification, detection, and recognition of objects in pictures and videos, Convolution Neural Networks (CNN) have been developed. Different Regularization Techniques have an impact on the performance of Convolution Neural Networks. By Applying Regularization Techniques such as Early halting, L2 Norm, Dropout, and data augmentation approach, we may improve the model performance significantly. The integration of all of these Regularization Techniques results in a drastic improvements in the performance of the neural network model. Model’s accuracy will improve up to 90%–95% and also reduces the over fitting problems, where results are predicting with respect to training model. This paper highlights the impact of various regularization techniques that boosts the learning convergence.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
3.
go back to reference Wan L, Eigen D, Fergus R (2014) End-to-end integration of a convolutional network, deformable parts model and non-maximum suppression, airXIV Wan L, Eigen D, Fergus R (2014) End-to-end integration of a convolutional network, deformable parts model and non-maximum suppression, airXIV
4.
go back to reference Eshratifar AE, Eigen D, Gormish M, Pedram M (2019) Coarse2Fine: a two-stage training method for fine-grained visual classification, airXIV Eshratifar AE, Eigen D, Gormish M, Pedram M (2019) Coarse2Fine: a two-stage training method for fine-grained visual classification, airXIV
5.
go back to reference Girshick RB, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detectionand semantic segmentation. CoRR, abs/1311.2524v5, 2014. Published in Proc. CVPR Girshick RB, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detectionand semantic segmentation. CoRR, abs/1311.2524v5, 2014. Published in Proc. CVPR
7.
go back to reference Yosinski J, Clune J, Bengio Y, Lipson H (2014) How transferable are features in deep neural networks? In: NIPS 2014 Yosinski J, Clune J, Bengio Y, Lipson H (2014) How transferable are features in deep neural networks? In: NIPS 2014
8.
go back to reference Goodfellow IJ, Bulatov Y, Ibarz J, Arnoud S, Shet V (2014) Multi-digit number recognition from streetview imagery using deep convolutional neural networks. In: Proceedings of ICLR Goodfellow IJ, Bulatov Y, Ibarz J, Arnoud S, Shet V (2014) Multi-digit number recognition from streetview imagery using deep convolutional neural networks. In: Proceedings of ICLR
9.
go back to reference Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift 100(317):320 Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift 100(317):320
10.
go back to reference Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A (2015) Object detectors emerge in deep scene CNNs. ICLR’2015, arXiv:1412.6856 Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A (2015) Object detectors emerge in deep scene CNNs. ICLR’2015, arXiv:​1412.​6856
11.
go back to reference Bell S, Upchurch P, Snavely N, Bala K (2014) Material recognition in the wild with the materials in contextdatabase. CoRR, abs/1412.0623 Bell S, Upchurch P, Snavely N, Bala K (2014) Material recognition in the wild with the materials in contextdatabase. CoRR, abs/1412.0623
12.
go back to reference He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification. arXiv preprint arXiv:1502.01852, 28, 193 He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification. arXiv preprint arXiv:​1502.​01852, 28, 193
13.
go back to reference Hinton GE, Srivastava N, Krizhevsky A, Sutskever I, Salakhutdinov R (2012) Improving neural networks by preventing co-adaptation of feature detectors. Technical report, arXiv:1207.0580. 238, 263, 267 Hinton GE, Srivastava N, Krizhevsky A, Sutskever I, Salakhutdinov R (2012) Improving neural networks by preventing co-adaptation of feature detectors. Technical report, arXiv:​1207.​0580. 238, 263, 267
14.
go back to reference Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: ECCV’14 Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: ECCV’14
Metadata
Title
Sensitivity Analysis of Regularization Techniques in Convolution Neural Networks with Tensorflow
Authors
Shivakumar Dalali
B. E. ManjunathSwamy
Giridhar Gowda
N. S. Girish Rao Salanke
Copyright Year
2023
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-19-5936-3_54

Premium Partner