Skip to main content
Top
Published in: Neural Computing and Applications 3/2016

01-04-2016 | Original Article

Block-based selection random forest for texture classification using multi-fractal spectrum feature

Authors: Qian Zhang, Yong Xu

Published in: Neural Computing and Applications | Issue 3/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper proposes a block-based selection random forest (BBSRF) for texture classification task using multi-fractal spectrum (MFS) feature descriptor. The random feature selection method for node splitting in random forest may omit some features which would be informative and critical to represent the instances. The BBSRF ensures that each feature would be considered via the block-based selection strategy. In BBSRF, all features are divided into \(k\) blocks; next, we generate synthesis feature subset which is made up of all features in one block and \(m\) random features from the remaining \((k-1)\) blocks; finally, each node splitting of the random tree is operated on one synthesis feature subset. After all blocks have been searched, all features are re-divided into new \(k\) blocks. The above process works iteratively until the satisfactory result is obtained. Once the random trees have been built, a testing instance is classified by voting from them. We conducted the experiments on five texture benchmark datasets with the help of MFS feature. Experimental results demonstrate the excellent performance of the proposed method in comparison with state-of-the-art results on these datasets.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Booth A, Gerding E, McGroarty F (2014) Automated trading with performance weighted random forests and seasonality. Expert Syst Appl 41(8):3651–3661CrossRef Booth A, Gerding E, McGroarty F (2014) Automated trading with performance weighted random forests and seasonality. Expert Syst Appl 41(8):3651–3661CrossRef
3.
go back to reference Bovik AC, Clark M, Geisler WS (1990) Multichannel texture analysis using localized spatial filters. IEEE Trans Pattern Anal Mach Intell 12(1):55–73CrossRef Bovik AC, Clark M, Geisler WS (1990) Multichannel texture analysis using localized spatial filters. IEEE Trans Pattern Anal Mach Intell 12(1):55–73CrossRef
6.
go back to reference Burges CJ (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Discov 2(2):121–167CrossRef Burges CJ (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Discov 2(2):121–167CrossRef
7.
9.
go back to reference Cross GR, Jain AK (1983) Markov random field texture models. IEEE Trans Pattern Anal Mach Intell 1:25–39CrossRef Cross GR, Jain AK (1983) Markov random field texture models. IEEE Trans Pattern Anal Mach Intell 1:25–39CrossRef
10.
go back to reference de Freitas N et al (2014) Narrowing the gap: random forests in theory and in practice. J Mach Learn Res 32:665–673 de Freitas N et al (2014) Narrowing the gap: random forests in theory and in practice. J Mach Learn Res 32:665–673
11.
go back to reference Dietterich TG (2000) An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization. Mach Learn 40(2):139–157CrossRef Dietterich TG (2000) An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization. Mach Learn 40(2):139–157CrossRef
12.
go back to reference Efron B, Tibshirani RJ (1994) An introduction to the bootstrap, vol 57. CRC Press, Boca RatonMATH Efron B, Tibshirani RJ (1994) An introduction to the bootstrap, vol 57. CRC Press, Boca RatonMATH
13.
go back to reference Falconer KJ, Falconer K (1997) Techniques in fractal geometry, vol 16. Wiley, ChichesterMATH Falconer KJ, Falconer K (1997) Techniques in fractal geometry, vol 16. Wiley, ChichesterMATH
14.
go back to reference Florindo JB, Bruno OM (2014) Fractal descriptors based on the probability dimension: a texture analysis and classification approach. Pattern Recognit Lett 42:107–114CrossRef Florindo JB, Bruno OM (2014) Fractal descriptors based on the probability dimension: a texture analysis and classification approach. Pattern Recognit Lett 42:107–114CrossRef
15.
16.
go back to reference Gheyas IA, Smith LS (2010) Feature subset selection in large dimensionality domains. Pattern Recognit 43(1):5–13CrossRefMATH Gheyas IA, Smith LS (2010) Feature subset selection in large dimensionality domains. Pattern Recognit 43(1):5–13CrossRefMATH
17.
go back to reference González E, Fernández A, Bianconi F (2014) General framework for rotation invariant texture classification through co-occurrence of patterns. J Math Imaging Vis 50(3):300–313CrossRefMATH González E, Fernández A, Bianconi F (2014) General framework for rotation invariant texture classification through co-occurrence of patterns. J Math Imaging Vis 50(3):300–313CrossRefMATH
18.
go back to reference Hapfelmeier A, Hothorn T, Ulm K, Strobl C (2014) A new variable importance measure for random forests with missing data. Stat Comput 24(1):21–34MathSciNetCrossRefMATH Hapfelmeier A, Hothorn T, Ulm K, Strobl C (2014) A new variable importance measure for random forests with missing data. Stat Comput 24(1):21–34MathSciNetCrossRefMATH
19.
go back to reference Haralick RM, Shanmugam K, Dinstein IH (1973) Textural features for image classification. IEEE Trans Syst Man Cybern 6:610–621CrossRef Haralick RM, Shanmugam K, Dinstein IH (1973) Textural features for image classification. IEEE Trans Syst Man Cybern 6:610–621CrossRef
20.
go back to reference Hastie T, Tibshirani R, Friedman J, Hastie T, Friedman J, Tibshirani R (2009) The elements of statistical learning, vol 2. Springer, BerlinCrossRefMATH Hastie T, Tibshirani R, Friedman J, Hastie T, Friedman J, Tibshirani R (2009) The elements of statistical learning, vol 2. Springer, BerlinCrossRefMATH
21.
go back to reference Heeger DJ, Bergen JR (1995) Pyramid-based texture analysis/synthesis. In: Proceedings of the 22nd annual conference on computer graphics and interactive techniques. ACM, London, pp 229–238 Heeger DJ, Bergen JR (1995) Pyramid-based texture analysis/synthesis. In: Proceedings of the 22nd annual conference on computer graphics and interactive techniques. ACM, London, pp 229–238
22.
go back to reference Ho TK (1998) The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 20(8):832–844CrossRef Ho TK (1998) The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 20(8):832–844CrossRef
23.
go back to reference Huy NH, Frenzel S, Bandt C (2014) Two-step linear discriminant analysis for classification of eeg data. In: Spiliopoulou M, Schmidt-Thieme L, Janning R (eds) Data analysis, machine learning and knowledge discovery. Springer, Berlin, pp 51–59CrossRef Huy NH, Frenzel S, Bandt C (2014) Two-step linear discriminant analysis for classification of eeg data. In: Spiliopoulou M, Schmidt-Thieme L, Janning R (eds) Data analysis, machine learning and knowledge discovery. Springer, Berlin, pp 51–59CrossRef
24.
go back to reference Jain S, Papadakis M, Upadhyay S, Azencott R (2012) Rigid-motion-invariant classification of 3-d textures. IEEE Trans Image Process 21(5):2449–2463MathSciNetCrossRef Jain S, Papadakis M, Upadhyay S, Azencott R (2012) Rigid-motion-invariant classification of 3-d textures. IEEE Trans Image Process 21(5):2449–2463MathSciNetCrossRef
25.
go back to reference Janitza S, Strobl C, Boulesteix A-L (2013) An AUC-based permutation variable importance measure for random forests. BMC Bioinf 14(1):119CrossRef Janitza S, Strobl C, Boulesteix A-L (2013) An AUC-based permutation variable importance measure for random forests. BMC Bioinf 14(1):119CrossRef
26.
go back to reference Kulkarni VY, Sinha PK (2013) Random forest classifiers: a survey and future research directions. Int J Adv Comput 36(1):1144–1153 Kulkarni VY, Sinha PK (2013) Random forest classifiers: a survey and future research directions. Int J Adv Comput 36(1):1144–1153
27.
go back to reference Li CR, Li JP, Gao DP, Fu B (2014) Rapid-transform based rotation invariant descriptor for texture classification under non-ideal conditions. Pattern Recognit 47(1):313–325CrossRef Li CR, Li JP, Gao DP, Fu B (2014) Rapid-transform based rotation invariant descriptor for texture classification under non-ideal conditions. Pattern Recognit 47(1):313–325CrossRef
28.
go back to reference Liu L, Fieguth P, Kuang GY, Zha, HB (2011) Sorted random projections for robust texture classification. In: 2011 IEEE international conference on computer vision (ICCV). IEEE, pp 391–398 Liu L, Fieguth P, Kuang GY, Zha, HB (2011) Sorted random projections for robust texture classification. In: 2011 IEEE international conference on computer vision (ICCV). IEEE, pp 391–398
29.
go back to reference Liu L, Fieguth PW (2012) Texture classification from random features. IEEE Trans Pattern Anal Mach Intell 34(3):574–586CrossRef Liu L, Fieguth PW (2012) Texture classification from random features. IEEE Trans Pattern Anal Mach Intell 34(3):574–586CrossRef
30.
go back to reference Liu X, Song ML, Tao DC, Liu ZC, Zhang LM, Chen C, Bu JJ (2013) Semi-supervised node splitting for random forest construction. In: 2013 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 492–499 Liu X, Song ML, Tao DC, Liu ZC, Zhang LM, Chen C, Bu JJ (2013) Semi-supervised node splitting for random forest construction. In: 2013 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 492–499
31.
go back to reference Manfredi M, Vezzani R, Calderara S, Cucchiara R (2014) Detection of static groups and crowds gathered in open spaces by texture classification. Pattern Recognit Lett 44:39–48CrossRef Manfredi M, Vezzani R, Calderara S, Cucchiara R (2014) Detection of static groups and crowds gathered in open spaces by texture classification. Pattern Recognit Lett 44:39–48CrossRef
32.
go back to reference Martínez-Muñoz G, Suárez A (2010) Out-of-bag estimation of the optimal sample size in bagging. Pattern Recognit 43(1):143–152CrossRefMATH Martínez-Muñoz G, Suárez A (2010) Out-of-bag estimation of the optimal sample size in bagging. Pattern Recognit 43(1):143–152CrossRefMATH
33.
go back to reference Neville PG (2013) Controversy of variable importance in random forests. J Unified Stat Tech 1(1):15–20 Neville PG (2013) Controversy of variable importance in random forests. J Unified Stat Tech 1(1):15–20
34.
go back to reference Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987CrossRefMATH Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987CrossRefMATH
35.
go back to reference Qi XB, Xiao R, Guo J, Zhang L (2012) Pairwise rotation invariant co-occurrence local binary pattern. In: Computer vision-ECCV 2012. Springer, Berlin, pp 158–171 Qi XB, Xiao R, Guo J, Zhang L (2012) Pairwise rotation invariant co-occurrence local binary pattern. In: Computer vision-ECCV 2012. Springer, Berlin, pp 158–171
36.
go back to reference Quan YH, Xu Y, Sun YP, Luo Y (2013) Lacunarity analysis on image patterns for texture classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 160–167 Quan YH, Xu Y, Sun YP, Luo Y (2013) Lacunarity analysis on image patterns for texture classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 160–167
37.
go back to reference Robnik-Šikonja M (2004) Improving random forests. In: Machine learning: ECML 2004. Springer, Berlin, pp 359–370 Robnik-Šikonja M (2004) Improving random forests. In: Machine learning: ECML 2004. Springer, Berlin, pp 359–370
38.
go back to reference Rodriguez JJ, Kuncheva LI, Alonso CJ (2006) Rotation forest: a new classifier ensemble method. IEEE Trans Pattern Anal Mach Intell 28(10):1619–1630CrossRef Rodriguez JJ, Kuncheva LI, Alonso CJ (2006) Rotation forest: a new classifier ensemble method. IEEE Trans Pattern Anal Mach Intell 28(10):1619–1630CrossRef
39.
go back to reference Rutkowski L, Jaworski M, Pietruczuk L, Duda P (2014) The cart decision tree for mining data streams. Inf Sci 266:1–15CrossRef Rutkowski L, Jaworski M, Pietruczuk L, Duda P (2014) The cart decision tree for mining data streams. Inf Sci 266:1–15CrossRef
40.
go back to reference Sánchez J, Perronnin F, Mensink T, Verbeek J (2013) Image classification with the fisher vector: theory and practice. Int J Comput Vis 105(3):222–245MathSciNetCrossRefMATH Sánchez J, Perronnin F, Mensink T, Verbeek J (2013) Image classification with the fisher vector: theory and practice. Int J Comput Vis 105(3):222–245MathSciNetCrossRefMATH
41.
go back to reference Sim A, Tsagkrasoulis D, Montana G (2013) Random forests on distance matrices for imaging genetics studies. Stat Appl Genet Mol Biol 12(6):757–786MathSciNet Sim A, Tsagkrasoulis D, Montana G (2013) Random forests on distance matrices for imaging genetics studies. Stat Appl Genet Mol Biol 12(6):757–786MathSciNet
42.
go back to reference Singh K, Guntuku SC, Thakur A, Hota C (2014) Big data analytics framework for peer-to-peer botnet detection using random forests. Inf Sci 278:488–497CrossRef Singh K, Guntuku SC, Thakur A, Hota C (2014) Big data analytics framework for peer-to-peer botnet detection using random forests. Inf Sci 278:488–497CrossRef
43.
go back to reference Taheri S, Yearwood J, Mammadov M, Seifollahi S (2014) Attribute weighted Naive Bayes classifier using a local optimization. Neural Comput Appl 24(5):995–1002CrossRef Taheri S, Yearwood J, Mammadov M, Seifollahi S (2014) Attribute weighted Naive Bayes classifier using a local optimization. Neural Comput Appl 24(5):995–1002CrossRef
44.
go back to reference Taneja S, Gupta C, Goyal K, Gureja D (2014) An enhanced k-nearest neighbor algorithm using information gain and clustering. In: 2014 Fourth international conference on Advanced Computing & Communication Technologies (ACCT). IEEE, pp 325–329 Taneja S, Gupta C, Goyal K, Gureja D (2014) An enhanced k-nearest neighbor algorithm using information gain and clustering. In: 2014 Fourth international conference on Advanced Computing & Communication Technologies (ACCT). IEEE, pp 325–329
45.
go back to reference Targhi AT, Geusebroek J-M, Zisserman A (2008) Texture classification with minimal training images. In: 19th international conference on pattern recognition, 2008. ICPR 2008. IEEE, pp 1–4 Targhi AT, Geusebroek J-M, Zisserman A (2008) Texture classification with minimal training images. In: 19th international conference on pattern recognition, 2008. ICPR 2008. IEEE, pp 1–4
46.
go back to reference Weszka JS, Rosenfeld A (1975) A comparative study of texture measures for terrain classification. NASA STI/Recon Technical Report N 76:269–285 Weszka JS, Rosenfeld A (1975) A comparative study of texture measures for terrain classification. NASA STI/Recon Technical Report N 76:269–285
48.
go back to reference Woźniak M, Graña M, Corchado E (2014) A survey of multiple classifier systems as hybrid systems. Inf Fus 16:3–17CrossRef Woźniak M, Graña M, Corchado E (2014) A survey of multiple classifier systems as hybrid systems. Inf Fus 16:3–17CrossRef
49.
go back to reference Xu BX, Huang JZ, Williams G, Wang Q, Ye YM (2012) Classifying very high-dimensional data with random forests built from small subspaces. Int J Data Warehous Min (IJDWM) 8(2):44–63CrossRef Xu BX, Huang JZ, Williams G, Wang Q, Ye YM (2012) Classifying very high-dimensional data with random forests built from small subspaces. Int J Data Warehous Min (IJDWM) 8(2):44–63CrossRef
50.
go back to reference Xu Y, Ji H, Fermüller C (2009) Viewpoint invariant texture description using fractal analysis. Int J Comput Vis 83(1):85–100CrossRef Xu Y, Ji H, Fermüller C (2009) Viewpoint invariant texture description using fractal analysis. Int J Comput Vis 83(1):85–100CrossRef
51.
go back to reference Xu Y, Yang X, Ling HB, Ji H (2010) A new texture descriptor using multifractal analysis in multi-orientation wavelet pyramid. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 161–168 Xu Y, Yang X, Ling HB, Ji H (2010) A new texture descriptor using multifractal analysis in multi-orientation wavelet pyramid. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 161–168
52.
go back to reference Yang F, Lu WH, Luo LK, Li T (2012) Margin optimization based pruning for random forest. Neurocomputing 94:54–63CrossRef Yang F, Lu WH, Luo LK, Li T (2012) Margin optimization based pruning for random forest. Neurocomputing 94:54–63CrossRef
53.
go back to reference Yang PY, Hwa Yang Y, B Zhou B, Y Zomaya A (2010) A review of ensemble methods in bioinformatics. Curr Bioinf 5(4):296–308CrossRef Yang PY, Hwa Yang Y, B Zhou B, Y Zomaya A (2010) A review of ensemble methods in bioinformatics. Curr Bioinf 5(4):296–308CrossRef
54.
go back to reference Ye YM, Wu QY, Huang JZ, Ng MK, Li XT (2013) Stratified sampling for feature subspace selection in random forests for high dimensional data. Pattern Recognit 46(3):769–787CrossRef Ye YM, Wu QY, Huang JZ, Ng MK, Li XT (2013) Stratified sampling for feature subspace selection in random forests for high dimensional data. Pattern Recognit 46(3):769–787CrossRef
55.
go back to reference Zhang L, Suganthan PN (2014) Random forests with ensemble of feature spaces. Pattern Recognit 47(10):3429–3437CrossRef Zhang L, Suganthan PN (2014) Random forests with ensemble of feature spaces. Pattern Recognit 47(10):3429–3437CrossRef
56.
go back to reference Zuñiga AG, Florindo JB, Bruno OM (2014) Gabor wavelets combined with volumetric fractal dimension applied to texture analysis. Pattern Recognit Lett 36:135–143CrossRef Zuñiga AG, Florindo JB, Bruno OM (2014) Gabor wavelets combined with volumetric fractal dimension applied to texture analysis. Pattern Recognit Lett 36:135–143CrossRef
Metadata
Title
Block-based selection random forest for texture classification using multi-fractal spectrum feature
Authors
Qian Zhang
Yong Xu
Publication date
01-04-2016
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 3/2016
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-015-1880-5

Other articles of this Issue 3/2016

Neural Computing and Applications 3/2016 Go to the issue

Premium Partner