Skip to main content
Erschienen in:
Buchtitelbild

2018 | OriginalPaper | Buchkapitel

Hand-Designed Local Image Descriptors vs. Off-the-Shelf CNN-Based Features for Texture Classification: An Experimental Comparison

verfasst von : Raquel Bello-Cerezo, Francesco Bianconi, Silvia Cascianelli, Mario Luca Fravolini, Francesco di Maria, Fabrizio Smeraldi

Erschienen in: Intelligent Interactive Multimedia Systems and Services 2017

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Convolutional Neural Networks have proved extremely successful in object classification applications; however, their suitability for texture analysis largely remains to be established. We investigate the use of pre-trained CNNs as texture descriptors by tapping the output of the last fully connected layer, an approach that has proved its effectiveness in other domains. Comparison with classical descriptors based on signal processing or statistics over a range of standard databases suggests that CNNs may be more effective where the intra-class variability is large. Conversely, classical approaches may be preferable where classes are well defined and homogeneous.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Source: Scopus®; visited on Januray 18, 2017.
 
Literatur
1.
Zurück zum Zitat Andrearczyk, V., Whelan, P.F.: Using filter banks in convolutional neural networks for texture classification. Pattern Recogn. Lett. 84, 63–69 (2016)CrossRef Andrearczyk, V., Whelan, P.F.: Using filter banks in convolutional neural networks for texture classification. Pattern Recogn. Lett. 84, 63–69 (2016)CrossRef
2.
Zurück zum Zitat Bianconi, F., Bello, R., Fernández, A., González, E.: On comparing colour spaces from a performance perspective: application to automated classification of polished natural stones. In: Murino, V., Puppo, E., Sona, D., Cristani, M., Sansone, C. (eds.) New Trends in Image Analysis and Processing, ICIAP 2015 Workshops, Genoa, Italy. LNCS, vol. 9281, pp. 71–78. Springer (2015) Bianconi, F., Bello, R., Fernández, A., González, E.: On comparing colour spaces from a performance perspective: application to automated classification of polished natural stones. In: Murino, V., Puppo, E., Sona, D., Cristani, M., Sansone, C. (eds.) New Trends in Image Analysis and Processing, ICIAP 2015 Workshops, Genoa, Italy. LNCS, vol. 9281, pp. 71–78. Springer (2015)
3.
Zurück zum Zitat Bianconi, F., Fernández, A.: Evaluation of the effects of Gabor filter parameters on texture classification. Pattern Recogn. 40(12), 3325–3335 (2007)CrossRefMATH Bianconi, F., Fernández, A.: Evaluation of the effects of Gabor filter parameters on texture classification. Pattern Recogn. 40(12), 3325–3335 (2007)CrossRefMATH
4.
Zurück zum Zitat Bianconi, F., Fernández, A.: Rotation invariant co-occurrence features based on digital circles and discrete Fourier transform. Pattern Recogn. Lett. 48, 34–41 (2014)CrossRef Bianconi, F., Fernández, A.: Rotation invariant co-occurrence features based on digital circles and discrete Fourier transform. Pattern Recogn. Lett. 48, 34–41 (2014)CrossRef
5.
Zurück zum Zitat Bianconi, F., Fernández, A.: A unifying framework for LBP and related methods. In: Brahnam, S., Jain, L.C., Nanni, L., Lumini, A. (eds.) Local Binary Patterns: New Variants and Applications. Studies in computational intelligence, vol. 506, pp. 17–46. Springer (2014) Bianconi, F., Fernández, A.: A unifying framework for LBP and related methods. In: Brahnam, S., Jain, L.C., Nanni, L., Lumini, A. (eds.) Local Binary Patterns: New Variants and Applications. Studies in computational intelligence, vol. 506, pp. 17–46. Springer (2014)
6.
Zurück zum Zitat Caputo, B., Hayman, E., Mallikarjuna, P.: Class-specific material categorisation. In: Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV 2005), vol. II, pp. 1597–1604 (2005) Caputo, B., Hayman, E., Mallikarjuna, P.: Class-specific material categorisation. In: Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV 2005), vol. II, pp. 1597–1604 (2005)
7.
Zurück zum Zitat Chatfield, K., Simonyan, K., Vedaldi, A., Zisserman, A.: Return of the devil in the details: delving deep into convolutional nets. In: Proceedings of the British Machine Vision Conference 2014, Nottingham, United Kingdom, September 2014 Chatfield, K., Simonyan, K., Vedaldi, A., Zisserman, A.: Return of the devil in the details: delving deep into convolutional nets. In: Proceedings of the British Machine Vision Conference 2014, Nottingham, United Kingdom, September 2014
8.
Zurück zum Zitat Cimpoi, M., Maji, S., Vedaldi, A.: Deep filter banks for texture recognition and segmentation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Boston, USA, pp. 3828–3836, June 2015 Cimpoi, M., Maji, S., Vedaldi, A.: Deep filter banks for texture recognition and segmentation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Boston, USA, pp. 3828–3836, June 2015
9.
Zurück zum Zitat Clarke, A.D.F., Halley, F., Newell, A.J., Griffin, L.D., Chantler, M.J.: Perceptual similarity: a texture challenge. In: Proceedings of the British Machine Vision Conference 2011, Dundee, UK, August–September 2011 Clarke, A.D.F., Halley, F., Newell, A.J., Griffin, L.D., Chantler, M.J.: Perceptual similarity: a texture challenge. In: Proceedings of the British Machine Vision Conference 2011, Dundee, UK, August–September 2011
10.
Zurück zum Zitat Cusano, C., Napoletano, P., Schettini, R.: Combining multiple features for color texture classification. J. Electron. Imaging 25(6) (2016) Cusano, C., Napoletano, P., Schettini, R.: Combining multiple features for color texture classification. J. Electron. Imaging 25(6) (2016)
11.
Zurück zum Zitat Cusano, C., Napoletano, P., Schettini, R.: Evaluating color texture descriptors under large variations of controlled lighting conditions. J. Opt. Soc. Am. A 33(1), 17–30 (2016)CrossRef Cusano, C., Napoletano, P., Schettini, R.: Evaluating color texture descriptors under large variations of controlled lighting conditions. J. Opt. Soc. Am. A 33(1), 17–30 (2016)CrossRef
12.
Zurück zum Zitat Haralick, R.M., Shanmugam, K., Dinstein, I.: Textural features for image classification. IEEE Trans. Syst. Man Cybern. 3(6), 610–621 (1973)CrossRef Haralick, R.M., Shanmugam, K., Dinstein, I.: Textural features for image classification. IEEE Trans. Syst. Man Cybern. 3(6), 610–621 (1973)CrossRef
13.
Zurück zum Zitat Hayman, E., Caputo, B., Fritz, M., Eklundh, J.-O.: On the significance of real-world conditions for material classification. In: Proceedings of the 8th European Conference on Computer Vision (ECCV 2004), Prague, Czech Republic. LNCS, vol. 3024, pp. 253–266. Springer, May 2004 Hayman, E., Caputo, B., Fritz, M., Eklundh, J.-O.: On the significance of real-world conditions for material classification. In: Proceedings of the 8th European Conference on Computer Vision (ECCV 2004), Prague, Czech Republic. LNCS, vol. 3024, pp. 253–266. Springer, May 2004
14.
Zurück zum Zitat Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Proceedings of Advances in Neural Information Processing Systems, Lake Tahoe, USA, vol. 2, pp. 1097–1105 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Proceedings of Advances in Neural Information Processing Systems, Lake Tahoe, USA, vol. 2, pp. 1097–1105 (2012)
16.
Zurück zum Zitat Kylberg, G.: The Kylberg texture dataset v. 1.0. External report (Blue series) 35, Centre for Image Analysis, Swedish University of Agricultural Sciences and Uppsala University, Uppsala, Sweden, September 2011 Kylberg, G.: The Kylberg texture dataset v. 1.0. External report (Blue series) 35, Centre for Image Analysis, Swedish University of Agricultural Sciences and Uppsala University, Uppsala, Sweden, September 2011
17.
Zurück zum Zitat Kylberg, G., Sintorn, I.-M.: On the influence of interpolation method on rotation invariance in texture recognition. EURASIP J. Image Video Process. 2016(1) (2016) Kylberg, G., Sintorn, I.-M.: On the influence of interpolation method on rotation invariance in texture recognition. EURASIP J. Image Video Process. 2016(1) (2016)
19.
Zurück zum Zitat Liu, L., Fieguth, P., Wang, X., Pietikäinen, M., Hu, D.: Evaluation of LBP and Deep Texture Descriptors with a New Robustness Benchmark. In: Proceedings of the 14th European Conference on Computer Vision (ECCV 2016). LNCS, Amsterdam, The Netherlands, vol. 9907, pp. 69–86. Springer (2016) Liu, L., Fieguth, P., Wang, X., Pietikäinen, M., Hu, D.: Evaluation of LBP and Deep Texture Descriptors with a New Robustness Benchmark. In: Proceedings of the 14th European Conference on Computer Vision (ECCV 2016). LNCS, Amsterdam, The Netherlands, vol. 9907, pp. 69–86. Springer (2016)
22.
Zurück zum Zitat Ojala, T., Pietikäinen, M., Mäenpää, T., Viertola, J., Kyllönen, J., Huovinen, S.: Outex - new framework for empirical evaluation of texture analysis algorithms. In: Proceedings of the 16th International Conference on Pattern Recognition (ICPR 2002), Quebec, Canada, vol. 1, pp. 701–706. IEEE Computer Society (2002) Ojala, T., Pietikäinen, M., Mäenpää, T., Viertola, J., Kyllönen, J., Huovinen, S.: Outex - new framework for empirical evaluation of texture analysis algorithms. In: Proceedings of the 16th International Conference on Pattern Recognition (ICPR 2002), Quebec, Canada, vol. 1, pp. 701–706. IEEE Computer Society (2002)
23.
Zurück zum Zitat Parkhi, O.M., Vedaldi, A., Zissermann, A.: Deep face recognition. In: Proceedings of the British Machine Vision Conference 2015, Swansea, United Kingdom, September 2015 Parkhi, O.M., Vedaldi, A., Zissermann, A.: Deep face recognition. In: Proceedings of the British Machine Vision Conference 2015, Swansea, United Kingdom, September 2015
26.
Zurück zum Zitat Razavian, A.S., Azizpour, H., Sullivan, J., Carlsson, S.: CNN features off-the-shelf: an astounding baseline for recognition. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Columbus, USA, pp. 512–519, June 2014 Razavian, A.S., Azizpour, H., Sullivan, J., Carlsson, S.: CNN features off-the-shelf: an astounding baseline for recognition. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Columbus, USA, pp. 512–519, June 2014
27.
Zurück zum Zitat Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR, abs/1409.1556 (2014) Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR, abs/1409.1556 (2014)
28.
Zurück zum Zitat Vedaldi, A., Lenc, K.: MatConvNet: convolutional neural networks for MATLAB. In: MM 2015 - Proceedings of the 2015 ACM Multimedia Conference, Brisbane, Australia, pp. 689–692, October 2015 Vedaldi, A., Lenc, K.: MatConvNet: convolutional neural networks for MATLAB. In: MM 2015 - Proceedings of the 2015 ACM Multimedia Conference, Brisbane, Australia, pp. 689–692, October 2015
29.
Zurück zum Zitat Xie, X., Mirmehdi, M.: A galaxy of texture features. In: Mirmehdi, M., Xie, X., Suri, J. (eds.) Handbook of Texture Analysis, pp. 375–406. Imperial College Press (2008) Xie, X., Mirmehdi, M.: A galaxy of texture features. In: Mirmehdi, M., Xie, X., Suri, J. (eds.) Handbook of Texture Analysis, pp. 375–406. Imperial College Press (2008)
30.
Zurück zum Zitat Zhang, J., Marszałek, M., Lazebnik, S., Schmid, C.: Local features and kernels for classification of texture and object categories: a comprehensive study. Int. J. Comput. Vision 73(2), 213–238 (2007)CrossRef Zhang, J., Marszałek, M., Lazebnik, S., Schmid, C.: Local features and kernels for classification of texture and object categories: a comprehensive study. Int. J. Comput. Vision 73(2), 213–238 (2007)CrossRef
31.
Zurück zum Zitat Zhong, Y., Sullivan, J., Li, H.: Face attribute prediction using off-the-shelf CNN features. In Proocedings of the 2016 International Conference on Biometrics, ICB 2016, Halmstad, Sweden, 6 2016 Zhong, Y., Sullivan, J., Li, H.: Face attribute prediction using off-the-shelf CNN features. In Proocedings of the 2016 International Conference on Biometrics, ICB 2016, Halmstad, Sweden, 6 2016
Metadaten
Titel
Hand-Designed Local Image Descriptors vs. Off-the-Shelf CNN-Based Features for Texture Classification: An Experimental Comparison
verfasst von
Raquel Bello-Cerezo
Francesco Bianconi
Silvia Cascianelli
Mario Luca Fravolini
Francesco di Maria
Fabrizio Smeraldi
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-59480-4_1

Premium Partner