Skip to main content
Erschienen in: Machine Vision and Applications 3/2018

29.11.2017 | Original Paper

Introducing spectral moment features in analyzing the SpecTex hyperspectral texture database

verfasst von: Arash Mirhashemi

Erschienen in: Machine Vision and Applications | Ausgabe 3/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Hyperspectral imaging provides more information than conventional RGB images. However, its high dimensionality prevents its adaptation to the existing image processing techniques. Defining full-band spectral feature is the first missing step, which is currently dealt with indirectly by band selection or dimension reduction. This article proposes a spectral feature extraction method using the mathematical moments to quantify the shape of the reflectance spectrum from different aspects. A whole family of features is presented by changing the moment attributes. All the features and their combinations are extensively tested in texture analysis of a new hyperspectral image database from textile samples (SpecTex). Two supervised experiments are performed: image patch classification and pixel-wise mosaic image segmentation. The proposed features are compared to four other features: the grayscale intensity, the RGB and CIELab values, and the principal components. Also, three analysis methods are tested: co-occurrence matrix, Gabor filter bank, and local binary pattern. In all cases, the moment features outperformed the opponents. Notably, combining the moment features with complementary attributes remarkably improved the performance. The most discriminative combinations are studied and formulated in this article.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Safia, A., He, D.-C.: Multiband compact texture unit descriptor for intra-band and inter-band texture analysis. ISPRS J. Photogramm. Remote Sens. 105, 169–185 (2015)CrossRef Safia, A., He, D.-C.: Multiband compact texture unit descriptor for intra-band and inter-band texture analysis. ISPRS J. Photogramm. Remote Sens. 105, 169–185 (2015)CrossRef
2.
Zurück zum Zitat Li, W., Chen, C., Su, H., Du, Q.: Local binary patterns and extreme learning machine for hyperspectral imagery classification. IEEE Trans. Geosci. Remote Sens. 53(7), 3681–3693 (2015)CrossRef Li, W., Chen, C., Su, H., Du, Q.: Local binary patterns and extreme learning machine for hyperspectral imagery classification. IEEE Trans. Geosci. Remote Sens. 53(7), 3681–3693 (2015)CrossRef
3.
Zurück zum Zitat Brusco, N., Capeleto, S., Fedel, M., Paviotti, A., Poletto, L., Cortelazzo, G.M., Tondello, G.: A system for 3d modeling frescoed historical buildings with multispectral texture information. Mach. Vis. Appl. 17(6), 373–393 (2006)CrossRef Brusco, N., Capeleto, S., Fedel, M., Paviotti, A., Poletto, L., Cortelazzo, G.M., Tondello, G.: A system for 3d modeling frescoed historical buildings with multispectral texture information. Mach. Vis. Appl. 17(6), 373–393 (2006)CrossRef
4.
Zurück zum Zitat Pan, Z., Healey, G., Prasad, M., Tromberg, B.: Face recognition in hyperspectral images. IEEE Trans. Pattern Anal. Mach. Intell. 25(12), 1552–1560 (2003)CrossRef Pan, Z., Healey, G., Prasad, M., Tromberg, B.: Face recognition in hyperspectral images. IEEE Trans. Pattern Anal. Mach. Intell. 25(12), 1552–1560 (2003)CrossRef
5.
Zurück zum Zitat Bouatmane, S., Roula, M.A., Bouridane, A., Al-Maadeed, S.: Round-Robin sequential forward selection algorithm for prostate cancer classification and diagnosis using multispectral imagery. Mach. Vis. Appl. 22(5), 865–878 (2011)CrossRef Bouatmane, S., Roula, M.A., Bouridane, A., Al-Maadeed, S.: Round-Robin sequential forward selection algorithm for prostate cancer classification and diagnosis using multispectral imagery. Mach. Vis. Appl. 22(5), 865–878 (2011)CrossRef
6.
Zurück zum Zitat Eckhard, T., Klammer, M., Valero, E.M., Hernández-Andrés, J.: Improved spectral density measurement from estimated reflectance data with kernel ridge regression. In: Image and Signal Processing, ser. Lecture Notes in Computer Science, pp. 79–86. Springer International Publishing (2014) Eckhard, T., Klammer, M., Valero, E.M., Hernández-Andrés, J.: Improved spectral density measurement from estimated reflectance data with kernel ridge regression. In: Image and Signal Processing, ser. Lecture Notes in Computer Science, pp. 79–86. Springer International Publishing (2014)
7.
Zurück zum Zitat Porebski, A., Vandenbroucke, N., Macaire, L.: Haralick feature extraction from LBP images for color texture classification. In: First Workshops on Image Processing Theory, Tools and Application, IPTA 2008, pp. 1–8 (2008) Porebski, A., Vandenbroucke, N., Macaire, L.: Haralick feature extraction from LBP images for color texture classification. In: First Workshops on Image Processing Theory, Tools and Application, IPTA 2008, pp. 1–8 (2008)
8.
Zurück zum Zitat Khelifi, R., Adel, M., Bourennane, S.: Multispectral texture characterization: application to computer aided diagnosis on prostatic tissue images. EURASIP J. Adv. Signal Process. 2012(1), 118 (2012)CrossRef Khelifi, R., Adel, M., Bourennane, S.: Multispectral texture characterization: application to computer aided diagnosis on prostatic tissue images. EURASIP J. Adv. Signal Process. 2012(1), 118 (2012)CrossRef
9.
Zurück zum Zitat Hauta-Kasari, M., Parkkinen, J., Jaaskelainen, T., Lenz, R.: Multi-spectral texture segmentation based on the spectral cooccurrence matrix. Pattern Anal. Appl. 2(4), 275–284 (1999)CrossRef Hauta-Kasari, M., Parkkinen, J., Jaaskelainen, T., Lenz, R.: Multi-spectral texture segmentation based on the spectral cooccurrence matrix. Pattern Anal. Appl. 2(4), 275–284 (1999)CrossRef
10.
Zurück zum Zitat Münzenmayer, C., Volk, H., Küblbeck, C., Spinnler, K., Wittenberg, T.: Multispectral texture analysis using interplane sum-and difference-histograms. In: Joint Pattern Recognition Symposium. Springer, Berlin, Heidelberg, pp. 42–49 (2002) Münzenmayer, C., Volk, H., Küblbeck, C., Spinnler, K., Wittenberg, T.: Multispectral texture analysis using interplane sum-and difference-histograms. In: Joint Pattern Recognition Symposium. Springer, Berlin, Heidelberg, pp. 42–49 (2002)
11.
Zurück zum Zitat Ledoux, A., Losson, O., Macaire, L.: Color local binary patterns: compact descriptors for texture classification. J. Electron. Imaging 25(6), 061 404–061 404 (2016)CrossRef Ledoux, A., Losson, O., Macaire, L.: Color local binary patterns: compact descriptors for texture classification. J. Electron. Imaging 25(6), 061 404–061 404 (2016)CrossRef
12.
Zurück zum Zitat Zhao, W., Du, S.: Spectral-spatial feature extraction for hyperspectral image classification: a dimension reduction and deep learning approach. IEEE Trans. Geosci. Remote Sens. 54(8), 4544–4554 (2016)CrossRef Zhao, W., Du, S.: Spectral-spatial feature extraction for hyperspectral image classification: a dimension reduction and deep learning approach. IEEE Trans. Geosci. Remote Sens. 54(8), 4544–4554 (2016)CrossRef
13.
Zurück zum Zitat Xu, L., Wong, A., Li, F., Clausi, D.A.: Intrinsic representation of hyperspectral imagery for unsupervised feature extraction. IEEE Trans. Geosci. Remote Sens. 54(2), 1118–1130 (2016)CrossRef Xu, L., Wong, A., Li, F., Clausi, D.A.: Intrinsic representation of hyperspectral imagery for unsupervised feature extraction. IEEE Trans. Geosci. Remote Sens. 54(2), 1118–1130 (2016)CrossRef
14.
Zurück zum Zitat Puetz, A.M., Olsen, R.C.: Haralick texture features expanded into the spectral domain. In: Defense and Security Symposium. International Society for Optics and Photonics, 623311 (2006) Puetz, A.M., Olsen, R.C.: Haralick texture features expanded into the spectral domain. In: Defense and Security Symposium. International Society for Optics and Photonics, 623311 (2006)
15.
Zurück zum Zitat Nouri, D., Lucas, Y., Treuillet, S.: Hyperspectral interventional imaging for enhanced tissue visualization and discrimination combining band selection methods. Int. J. Comput. Assist. Radiol. Surg. 11(12), 2185–2197 (2016)CrossRef Nouri, D., Lucas, Y., Treuillet, S.: Hyperspectral interventional imaging for enhanced tissue visualization and discrimination combining band selection methods. Int. J. Comput. Assist. Radiol. Surg. 11(12), 2185–2197 (2016)CrossRef
16.
Zurück zum Zitat Sharma, V., Van Gool, L.: Image-level classification in hyperspectral images using feature descriptors, with application to face recognition. arXiv:1605.03428 (2016) Sharma, V., Van Gool, L.: Image-level classification in hyperspectral images using feature descriptors, with application to face recognition. arXiv:​1605.​03428 (2016)
17.
Zurück zum Zitat Flusser, J., Zitova, B., Suk, T.: Moments and Moment Invariants in Pattern Recognition. Wiley, New York (2009)CrossRefMATH Flusser, J., Zitova, B., Suk, T.: Moments and Moment Invariants in Pattern Recognition. Wiley, New York (2009)CrossRefMATH
18.
Zurück zum Zitat Zhang, L., Zhang, L., Tao, D., Huang, X.: On combining multiple features for hyperspectral remote sensing image classification. IEEE Trans. Geosci. Remote Sens. 50(3), 879–893 (2012)CrossRef Zhang, L., Zhang, L., Tao, D., Huang, X.: On combining multiple features for hyperspectral remote sensing image classification. IEEE Trans. Geosci. Remote Sens. 50(3), 879–893 (2012)CrossRef
19.
Zurück zum Zitat Sinha, A., Banerji, S., Liu, C.: New color GPHOG descriptors for object and scene image classification. Mach. Vis. Appl. 25(2), 361–375 (2014)CrossRef Sinha, A., Banerji, S., Liu, C.: New color GPHOG descriptors for object and scene image classification. Mach. Vis. Appl. 25(2), 361–375 (2014)CrossRef
20.
Zurück zum Zitat Mirmehdi, M., Xie, X., Suri, J.: Handbook of Texture Analysis. Imperial College Press, London (2008)CrossRef Mirmehdi, M., Xie, X., Suri, J.: Handbook of Texture Analysis. Imperial College Press, London (2008)CrossRef
21.
Zurück zum Zitat Petrou, M., Sevilla, P.: Image Processing: Dealing with Texture. Wiley, New York (2006)CrossRef Petrou, M., Sevilla, P.: Image Processing: Dealing with Texture. Wiley, New York (2006)CrossRef
22.
Zurück zum Zitat Haralick, R.M., Shanmugam, K., Dinstein, I.: Textural features for image classification. IEEE Trans. Syst. Man Cybern. SMC–3(6), 610–621 (1973)CrossRef Haralick, R.M., Shanmugam, K., Dinstein, I.: Textural features for image classification. IEEE Trans. Syst. Man Cybern. SMC–3(6), 610–621 (1973)CrossRef
23.
Zurück zum Zitat Jain, A.K., Farrokhnia, F.: Unsupervised texture segmentation using Gabor filters. Pattern Recognit. 24(12), 1167–1186 (1991)CrossRef Jain, A.K., Farrokhnia, F.: Unsupervised texture segmentation using Gabor filters. Pattern Recognit. 24(12), 1167–1186 (1991)CrossRef
24.
Zurück zum Zitat Mäenpää, T.: The Local Binary Pattern Approach to Texture Analysis: Extensions and Applications. Oulun yliopisto, Oulu (2003) Mäenpää, T.: The Local Binary Pattern Approach to Texture Analysis: Extensions and Applications. Oulun yliopisto, Oulu (2003)
25.
Zurück zum Zitat Kumar, B., Dikshit, O.: Spectral-spatial classification of hyperspectral imagery based on moment invariants. IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens. 8(6), 2457–2463 (2015)CrossRef Kumar, B., Dikshit, O.: Spectral-spatial classification of hyperspectral imagery based on moment invariants. IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens. 8(6), 2457–2463 (2015)CrossRef
26.
Zurück zum Zitat Mirzapour, F., Ghassemian, H.: Moment-based feature extraction from high spatial resolution hyperspectral images. Int. J. Remote Sens. 37(6), 1349–1361 (2016)CrossRef Mirzapour, F., Ghassemian, H.: Moment-based feature extraction from high spatial resolution hyperspectral images. Int. J. Remote Sens. 37(6), 1349–1361 (2016)CrossRef
27.
Zurück zum Zitat Zhang, Y., Wirkert, S.J., Iszatt, J., Kenngott, H., Wagner, M., Mayer, B., Stock, C., Clancy, N.T., Elson, D.S., Maier-Hein, L.: Tissue classification for laparoscopic image understanding based on multispectral texture analysis. In: SPIE Medical Imaging. International Society for Optics and Photonics, p. 978619 (2016) Zhang, Y., Wirkert, S.J., Iszatt, J., Kenngott, H., Wagner, M., Mayer, B., Stock, C., Clancy, N.T., Elson, D.S., Maier-Hein, L.: Tissue classification for laparoscopic image understanding based on multispectral texture analysis. In: SPIE Medical Imaging. International Society for Optics and Photonics, p. 978619 (2016)
28.
Zurück zum Zitat Kohonen, O.: Retrieval of Databased Spectral Images. Joensuu yliopistopaino, Joensuu (2007) Kohonen, O.: Retrieval of Databased Spectral Images. Joensuu yliopistopaino, Joensuu (2007)
30.
Zurück zum Zitat Barra, V.: Expanding the local binary pattern to multispectral images using total orderings. In: International Conference on Computer Vision, Imaging and Computer Graphics. Springer, pp. 67–80 (2010) Barra, V.: Expanding the local binary pattern to multispectral images using total orderings. In: International Conference on Computer Vision, Imaging and Computer Graphics. Springer, pp. 67–80 (2010)
31.
Zurück zum Zitat Song, C., Li, P., Yang, F.: Multivariate texture measured by Local binary pattern for multispectral image classification. IEEE Int. Conf. Geosci. Remote Sens. Symp. IGARSS 2006, 2145–2148 (2006) Song, C., Li, P., Yang, F.: Multivariate texture measured by Local binary pattern for multispectral image classification. IEEE Int. Conf. Geosci. Remote Sens. Symp. IGARSS 2006, 2145–2148 (2006)
32.
Zurück zum Zitat Khelifi, R., Adel, M., Bourennane, S.: Segmentation of multispectral images based on band selection by including texture and mutual information. Biomed. Signal Process. Control 20, 16–23 (2015)CrossRef Khelifi, R., Adel, M., Bourennane, S.: Segmentation of multispectral images based on band selection by including texture and mutual information. Biomed. Signal Process. Control 20, 16–23 (2015)CrossRef
33.
Zurück zum Zitat Ledoux, A., Richard, N., Capelle-Laizé, A.S., Deborah, H., Fernandez-Maloigne, C.: Toward a full-band texture features for spectral images. IEEE Int. Conf. Image Process. (ICIP) 2014, 708–712 (2014) Ledoux, A., Richard, N., Capelle-Laizé, A.S., Deborah, H., Fernandez-Maloigne, C.: Toward a full-band texture features for spectral images. IEEE Int. Conf. Image Process. (ICIP) 2014, 708–712 (2014)
34.
Zurück zum Zitat Deborah, H., Richard, N., Hardeberg, J.Y.: On the quality evaluation of spectral image processing algorithms. In: Tenth International Conference on Signal-Image Technology and Internet-Based Systems (SITIS), 2014, pp. 133–140 (2014) Deborah, H., Richard, N., Hardeberg, J.Y.: On the quality evaluation of spectral image processing algorithms. In: Tenth International Conference on Signal-Image Technology and Internet-Based Systems (SITIS), 2014, pp. 133–140 (2014)
35.
Zurück zum Zitat Deborah, H., Richard, N., Hardeberg, J.Y.: Spectral ordering assessment using spectral median filters. In: International Symposium on Mathematical Morphology and Its Applications to Signal and Image Processing. Springer, pp. 387–397 (2015) Deborah, H., Richard, N., Hardeberg, J.Y.: Spectral ordering assessment using spectral median filters. In: International Symposium on Mathematical Morphology and Its Applications to Signal and Image Processing. Springer, pp. 387–397 (2015)
36.
Zurück zum Zitat Liao, S.X., Pawlak, M.: On image analysis by moments. IEEE Trans. Pattern Anal. Mach. Intell. 18(3), 254–266 (1996)CrossRef Liao, S.X., Pawlak, M.: On image analysis by moments. IEEE Trans. Pattern Anal. Mach. Intell. 18(3), 254–266 (1996)CrossRef
37.
Zurück zum Zitat Flusser, J., Suk, T., Boldyš, J., Zitová, B.: Projection operators and moment invariants to image blurring. IEEE Trans. Pattern Anal. Mach. Intell. 37(4), 786–802 (2015)CrossRef Flusser, J., Suk, T., Boldyš, J., Zitová, B.: Projection operators and moment invariants to image blurring. IEEE Trans. Pattern Anal. Mach. Intell. 37(4), 786–802 (2015)CrossRef
38.
Zurück zum Zitat Flusser, J., Suk, T., Zitova, B.: 2D and 3D Image Analysis by Moments. Wiley, New York (2016)CrossRefMATH Flusser, J., Suk, T., Zitova, B.: 2D and 3D Image Analysis by Moments. Wiley, New York (2016)CrossRefMATH
39.
Zurück zum Zitat Mukundan, R., Ramakrishnan, K.R.: Moment Functions in Image Analysis: Theory and Applications. World Scientific, Singapore (1998)CrossRefMATH Mukundan, R., Ramakrishnan, K.R.: Moment Functions in Image Analysis: Theory and Applications. World Scientific, Singapore (1998)CrossRefMATH
40.
Zurück zum Zitat Papakostas, G.A.: Moments and moment invariants: theory and applications. Science Gate 1, 3–32 (2014) Papakostas, G.A.: Moments and moment invariants: theory and applications. Science Gate 1, 3–32 (2014)
41.
Zurück zum Zitat Bigun, J., du Buf, J.M.H.: N-folded symmetries by complex moments in Gabor space and their application to unsupervised texture segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 16(1), 80–87 (1994)CrossRef Bigun, J., du Buf, J.M.H.: N-folded symmetries by complex moments in Gabor space and their application to unsupervised texture segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 16(1), 80–87 (1994)CrossRef
42.
Zurück zum Zitat Super, B.J., Bovik, A.C.: Shape from texture using local spectral moments. IEEE Trans. Pattern Anal. Mach. Intell. 17(4), 333–343 (1995)CrossRef Super, B.J., Bovik, A.C.: Shape from texture using local spectral moments. IEEE Trans. Pattern Anal. Mach. Intell. 17(4), 333–343 (1995)CrossRef
43.
Zurück zum Zitat Mäenpää, T., Pietikäinen, M., Viertola, J.: Separating color and pattern information for color texture discrimination. In: Proceedings of 16th International Conference on Pattern Recognition, 2002, pp. 668–671 (2002) Mäenpää, T., Pietikäinen, M., Viertola, J.: Separating color and pattern information for color texture discrimination. In: Proceedings of 16th International Conference on Pattern Recognition, 2002, pp. 668–671 (2002)
44.
Zurück zum Zitat Liu, L., Fieguth, P., Guo, Y., Wang, X., Pietikäinen, M.: Local binary features for texture classification: taxonomy and experimental study. Pattern Recognit. 62, 135–160 (2017)CrossRef Liu, L., Fieguth, P., Guo, Y., Wang, X., Pietikäinen, M.: Local binary features for texture classification: taxonomy and experimental study. Pattern Recognit. 62, 135–160 (2017)CrossRef
45.
Zurück zum Zitat Liu, L., Lao, S., Fieguth, P.W., Guo, Y., Wang, X., Pietikäinen, M.: Median robust extended local binary pattern for texture classification. IEEE Trans. Image Process. 25(3), 1368–1381 (2016)MathSciNetCrossRef Liu, L., Lao, S., Fieguth, P.W., Guo, Y., Wang, X., Pietikäinen, M.: Median robust extended local binary pattern for texture classification. IEEE Trans. Image Process. 25(3), 1368–1381 (2016)MathSciNetCrossRef
46.
Zurück zum Zitat Porebski, A., Vandenbroucke, N., Macaire, L., Hamad, D.: A new benchmark image test suite for evaluating colour texture classification schemes. Multimed. Tools Appl. 70(1), 543–556 (2014)CrossRef Porebski, A., Vandenbroucke, N., Macaire, L., Hamad, D.: A new benchmark image test suite for evaluating colour texture classification schemes. Multimed. Tools Appl. 70(1), 543–556 (2014)CrossRef
Metadaten
Titel
Introducing spectral moment features in analyzing the SpecTex hyperspectral texture database
verfasst von
Arash Mirhashemi
Publikationsdatum
29.11.2017
Verlag
Springer Berlin Heidelberg
Erschienen in
Machine Vision and Applications / Ausgabe 3/2018
Print ISSN: 0932-8092
Elektronische ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-017-0892-9

Weitere Artikel der Ausgabe 3/2018

Machine Vision and Applications 3/2018 Zur Ausgabe