Skip to main content
Top

2021 | OriginalPaper | Chapter

On Improving Generalization of CNN-Based Image Classification with Delineation Maps Using the CORF Push-Pull Inhibition Operator

Authors : Guru Swaroop Bennabhaktula, Joey Antonisse, George Azzopardi

Published in: Computer Analysis of Images and Patterns

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The chapter delves into the challenge of real-world image classification, where images may be affected by various types of noise. It introduces the CORF push-pull inhibition operator, inspired by the mammalian visual system, to enhance the robustness of CNN-based classifiers. The focus on perceptual contours is hypothesized to improve generalization in the presence of unseen noise. The authors evaluate this approach on the Fashion MNIST dataset using the AlexNet architecture, comparing it with a conventional pipeline. The results show that the CORF-augmented pipeline significantly outperforms the baseline in handling different levels of additive noise, highlighting the potential of this method in enhancing the reliability of image classification systems.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Business + Economics & Engineering + Technology"

Online-Abonnement

Springer Professional "Business + Economics & Engineering + Technology" gives you access to:

  • more than 102.000 books
  • more than 537 journals

from the following subject areas:

  • Automotive
  • Construction + Real Estate
  • Business IT + Informatics
  • Electrical Engineering + Electronics
  • Energy + Sustainability
  • Finance + Banking
  • Management + Leadership
  • Marketing + Sales
  • Mechanical Engineering + Materials
  • Insurance + Risk


Secure your knowledge advantage now!

Springer Professional "Engineering + Technology"

Online-Abonnement

Springer Professional "Engineering + Technology" gives you access to:

  • more than 67.000 books
  • more than 390 journals

from the following specialised fileds:

  • Automotive
  • Business IT + Informatics
  • Construction + Real Estate
  • Electrical Engineering + Electronics
  • Energy + Sustainability
  • Mechanical Engineering + Materials





 

Secure your knowledge advantage now!

Springer Professional "Business + Economics"

Online-Abonnement

Springer Professional "Business + Economics" gives you access to:

  • more than 67.000 books
  • more than 340 journals

from the following specialised fileds:

  • Construction + Real Estate
  • Business IT + Informatics
  • Finance + Banking
  • Management + Leadership
  • Marketing + Sales
  • Insurance + Risk



Secure your knowledge advantage now!

Footnotes
1
The CORF parameters are set as follows. The afferent DoG functions have a standard deviation \(\sigma =5\). As suggested in [1] for \(\sigma =5\), we use two parallel sets of ten center-on and ten center-off collinear DoG functions, whose distances from the center are 34, 18, 9, 5, and 3 pixels. The two parallel sets of center-on and center-off DoG functions are separated by \(\beta =4.0\) pixels and the inhibition factor \(\alpha =5\).
 
Literature
1.
go back to reference Azzopardi, G., Petkov, N.: A CORF computational model of a simple cell that relies on LGN input outperforms the Gabor function model. Biol. Cybern. 106(3), 177–189 (2012) Azzopardi, G., Petkov, N.: A CORF computational model of a simple cell that relies on LGN input outperforms the Gabor function model. Biol. Cybern. 106(3), 177–189 (2012)
3.
go back to reference Azzopardi, G., Rodríguez-Sánchez, A., Piater, J., Petkov, N.: A push-pull CORF model of a simple cell with antiphase inhibition improves SNR and contour detection. PLoS One 9(7), e98424 (2014) Azzopardi, G., Rodríguez-Sánchez, A., Piater, J., Petkov, N.: A push-pull CORF model of a simple cell with antiphase inhibition improves SNR and contour detection. PLoS One 9(7), e98424 (2014)
4.
go back to reference Boncelet, C.: Image noise models. In: The Essential Guide to Image Processing, pp. 143–167. Elsevier (2009) Boncelet, C.: Image noise models. In: The Essential Guide to Image Processing, pp. 143–167. Elsevier (2009)
5.
go back to reference Da Costa, G.B.P., Contato, W.A., Nazare, T.S., Neto, J.E., Ponti, M.: An empirical study on the effects of different types of noise in image classification tasks. arXiv preprint arXiv:1609.02781 (2016) Da Costa, G.B.P., Contato, W.A., Nazare, T.S., Neto, J.E., Ponti, M.: An empirical study on the effects of different types of noise in image classification tasks. arXiv preprint arXiv:​1609.​02781 (2016)
6.
go back to reference Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009) Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)
7.
go back to reference Dodge, S., Karam, L.: Understanding how image quality affects deep neural networks. In: 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX), pp. 1–6. IEEE (2016) Dodge, S., Karam, L.: Understanding how image quality affects deep neural networks. In: 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX), pp. 1–6. IEEE (2016)
8.
10.
go back to reference He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
11.
go back to reference Hubel, D.H., Wiesel, T.N.: 8. Receptive fields of single neurones in the cat’s striate cortex. In: Brain Physiology and Psychology, pp. 129–150. University of California Press (2020) Hubel, D.H., Wiesel, T.N.: 8. Receptive fields of single neurones in the cat’s striate cortex. In: Brain Physiology and Psychology, pp. 129–150. University of California Press (2020)
12.
go back to reference Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning, pp. 448–456. PMLR (2015) Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning, pp. 448–456. PMLR (2015)
13.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 25, 1097–1105 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 25, 1097–1105 (2012)
14.
go back to reference Melotti, D., Heimbach, K., Rodríguez-Sánchez, A., Strisciuglio, N., Azzopardi, G.: A robust contour detection operator with combined push-pull inhibition and surround suppression. Inf. Sci. 524, 229–240 (2020) Melotti, D., Heimbach, K., Rodríguez-Sánchez, A., Strisciuglio, N., Azzopardi, G.: A robust contour detection operator with combined push-pull inhibition and surround suppression. Inf. Sci. 524, 229–240 (2020)
16.
17.
go back to reference Ng, A.Y.: Feature selection, l 1 vs. l 2 regularization, and rotational invariance. In: Proceedings of the Twenty-First International Conference on Machine Learning, p. 78 (2004) Ng, A.Y.: Feature selection, l 1 vs. l 2 regularization, and rotational invariance. In: Proceedings of the Twenty-First International Conference on Machine Learning, p. 78 (2004)
18.
go back to reference Shamsabadi, A.S., Sanchez-Matilla, R., Cavallaro, A.: Colorfool: Semantic adversarial colorization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2020) Shamsabadi, A.S., Sanchez-Matilla, R., Cavallaro, A.: Colorfool: Semantic adversarial colorization. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2020)
19.
go back to reference Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014) Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:​1409.​1556 (2014)
20.
go back to reference Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014) Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)
22.
go back to reference Strisciuglio, N., Lopez-Antequera, M., Petkov, N.: Enhanced robustness of convolutional networks with a push-pull inhibition layer. Neural Comput. Appl, pp. 1–15 (2020) Strisciuglio, N., Lopez-Antequera, M., Petkov, N.: Enhanced robustness of convolutional networks with a push-pull inhibition layer. Neural Comput. Appl, pp. 1–15 (2020)
23.
go back to reference Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015) Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)
24.
go back to reference Xiao, H., Rasul, K., Vollgraf, R.: Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms. arXiv preprint arXiv:1708.07747 (2017) Xiao, H., Rasul, K., Vollgraf, R.: Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms. arXiv preprint arXiv:​1708.​07747 (2017)
26.
go back to reference Zhai, J., Shen, W., Singh, I., Wanyama, T., Gao, Z.: A review of the evolution of deep learning architectures and comparison of their performances for histopathologic cancer detection. Proc. Manuf. 46, 683–689 (2020) Zhai, J., Shen, W., Singh, I., Wanyama, T., Gao, Z.: A review of the evolution of deep learning architectures and comparison of their performances for histopathologic cancer detection. Proc. Manuf. 46, 683–689 (2020)
Metadata
Title
On Improving Generalization of CNN-Based Image Classification with Delineation Maps Using the CORF Push-Pull Inhibition Operator
Authors
Guru Swaroop Bennabhaktula
Joey Antonisse
George Azzopardi
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-89128-2_42

Premium Partner