Skip to main content

2015 | OriginalPaper | Buchkapitel

Large-Scale Indoor/Outdoor Image Classification via Expert Decision Fusion (EDF)

verfasst von : Chen Chen, Yuzhuo Ren, C.-C. Jay Kuo

Erschienen in: Computer Vision - ACCV 2014 Workshops

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this work, we propose an Expert Decision Fusion (EDF) system to tackle the large-scale indoor/outdoor image classification problem using two key ideas, namely, data grouping and decision stacking. By data grouping, we partition the entire data space into multiple disjoint sub-spaces so that a more accurate prediction model can be trained in each sub-space. After data grouping, the EDF system integrates soft decisions from multiple classifiers (called experts here) through stacking so that multiple experts can compensate each other’s weakness. The EDF system offers more accurate and robust classification performance since it can handle data diversity effectively while benefiting from data abundance in large-scale datasets. The advantages of data grouping and decision stacking are explained and demonstrated in detail. We conduct experiments on the SUN dataset and show that the EDF system outperforms all existing methods by a significant margin with a correct classification rate of 91 %.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bosch, A., Zisserman, A., Muñoz, X.: Scene classification via pLSA. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 517–530. Springer, Heidelberg (2006) CrossRef Bosch, A., Zisserman, A., Muñoz, X.: Scene classification via pLSA. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 517–530. Springer, Heidelberg (2006) CrossRef
2.
Zurück zum Zitat Fei-Fei, L., Perona, P.: A bayesian hierarchical model for learning natural scene categories. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005, CVPR 2005, vol. 2, pp. 524–531. IEEE (2005) Fei-Fei, L., Perona, P.: A bayesian hierarchical model for learning natural scene categories. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005, CVPR 2005, vol. 2, pp. 524–531. IEEE (2005)
3.
Zurück zum Zitat Quattoni, A., Torralba, A.: Recognizing indoor scenes. In: 2009 IEEE Conference Computer Vision and Pattern Recognition (CVPR) (2009) Quattoni, A., Torralba, A.: Recognizing indoor scenes. In: 2009 IEEE Conference Computer Vision and Pattern Recognition (CVPR) (2009)
4.
Zurück zum Zitat Li, L.J., Su, H., Xing, E.P., Li, F.F.: Object bank: A high-level image representation for scene classification & semantic feature sparsification. In: NIPS, vol. 2, p. 5 (2010) Li, L.J., Su, H., Xing, E.P., Li, F.F.: Object bank: A high-level image representation for scene classification & semantic feature sparsification. In: NIPS, vol. 2, p. 5 (2010)
5.
Zurück zum Zitat Wu, J., Rehg, J.M.: Centrist: A visual descriptor for scene categorization. IEEE Trans. Pattern Anal. Mach. Intell. 33, 1489–1501 (2011)CrossRef Wu, J., Rehg, J.M.: Centrist: A visual descriptor for scene categorization. IEEE Trans. Pattern Anal. Mach. Intell. 33, 1489–1501 (2011)CrossRef
6.
Zurück zum Zitat Vailaya, A., Figueiredo, M., Jain, A., Zhang, H.: Content-based hierarchical classification of vacation images. In: IEEE International Conference on Multimedia Computing and Systems, 1999, vol. 1, pp. 518–523. IEEE (1999) Vailaya, A., Figueiredo, M., Jain, A., Zhang, H.: Content-based hierarchical classification of vacation images. In: IEEE International Conference on Multimedia Computing and Systems, 1999, vol. 1, pp. 518–523. IEEE (1999)
7.
Zurück zum Zitat Lim, J.H., Jin, J.S.: A structured learning framework for content-based image indexing and visual query. Multimed. Syst. 10, 317–331 (2005)CrossRef Lim, J.H., Jin, J.S.: A structured learning framework for content-based image indexing and visual query. Multimed. Syst. 10, 317–331 (2005)CrossRef
8.
Zurück zum Zitat Chatzichristofis, S.A., Boutalis, Y.S.: CEDD: Color and edge directivity descriptor: A compact descriptor for image indexing and retrieval. In: Gasteratos, A., Vincze, M., Tsotsos, J.K. (eds.) ICVS 2008. LNCS, vol. 5008, pp. 312–322. Springer, Heidelberg (2008) CrossRef Chatzichristofis, S.A., Boutalis, Y.S.: CEDD: Color and edge directivity descriptor: A compact descriptor for image indexing and retrieval. In: Gasteratos, A., Vincze, M., Tsotsos, J.K. (eds.) ICVS 2008. LNCS, vol. 5008, pp. 312–322. Springer, Heidelberg (2008) CrossRef
9.
Zurück zum Zitat Vailaya, A., Jain, A., Zhang, H.J.: On image classification: City images vs. landscapes. Pattern Recogn. 31, 1921–1935 (1998)CrossRef Vailaya, A., Jain, A., Zhang, H.J.: On image classification: City images vs. landscapes. Pattern Recogn. 31, 1921–1935 (1998)CrossRef
10.
Zurück zum Zitat Zhang, L., Li, M., Zhang, H.J.: Boosting image orientation detection with indoor vs. outdoor classification. In: Sixth IEEE Workshop on Applications of Computer Vision, 2002, (WACV 2002), Proceedings, pp. 95–99. IEEE (2002) Zhang, L., Li, M., Zhang, H.J.: Boosting image orientation detection with indoor vs. outdoor classification. In: Sixth IEEE Workshop on Applications of Computer Vision, 2002, (WACV 2002), Proceedings, pp. 95–99. IEEE (2002)
11.
Zurück zum Zitat Battiato, S., Curti, S., La Cascia, M., Tortora, M., Scordato, E.: Depth map generation by image classification. Proc. SPIE 5302, 95–104 (2004)CrossRef Battiato, S., Curti, S., La Cascia, M., Tortora, M., Scordato, E.: Depth map generation by image classification. Proc. SPIE 5302, 95–104 (2004)CrossRef
12.
Zurück zum Zitat Bianco, S., Ciocca, G., Cusano, C., Schettini, R.: Improving color constancy using indoor-outdoor image classification. IEEE Trans. Image Process. 17, 2381–2392 (2008)CrossRefMathSciNet Bianco, S., Ciocca, G., Cusano, C., Schettini, R.: Improving color constancy using indoor-outdoor image classification. IEEE Trans. Image Process. 17, 2381–2392 (2008)CrossRefMathSciNet
13.
Zurück zum Zitat Boutell, M.R., Luo, J., Shen, X., Brown, C.M.: Learning multi-label scene classification. Pattern Recogn. 37, 1757–1771 (2004)CrossRef Boutell, M.R., Luo, J., Shen, X., Brown, C.M.: Learning multi-label scene classification. Pattern Recogn. 37, 1757–1771 (2004)CrossRef
14.
Zurück zum Zitat Vailaya, A., Figueiredo, M., Jain, A., Zhang, H.J.: Content-based hierarchical classification of vacation images. IEEE Int. Conf. Multimed. Comput. Syst. 1, 518–523 (1999) Vailaya, A., Figueiredo, M., Jain, A., Zhang, H.J.: Content-based hierarchical classification of vacation images. IEEE Int. Conf. Multimed. Comput. Syst. 1, 518–523 (1999)
15.
Zurück zum Zitat Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2006, vol. 2, pp. 2169–2178 (2006) Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2006, vol. 2, pp. 2169–2178 (2006)
16.
Zurück zum Zitat Vogel, J., Schiele, B.: Semantic modeling of natural scenes for content-based image retrieval. Int. J. Comput. Vis. 72, 133–157 (2007)CrossRef Vogel, J., Schiele, B.: Semantic modeling of natural scenes for content-based image retrieval. Int. J. Comput. Vis. 72, 133–157 (2007)CrossRef
17.
Zurück zum Zitat Jégou, H., Douze, M., Schmid, C.: Improving bag-of-features for large scale image search. Int. J. Comput. Vis. 87, 316–336 (2010)CrossRef Jégou, H., Douze, M., Schmid, C.: Improving bag-of-features for large scale image search. Int. J. Comput. Vis. 87, 316–336 (2010)CrossRef
18.
Zurück zum Zitat Li, Y., Crandall, D.J., Huttenlocher, D.P.: Landmark classification in large-scale image collections. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 1957–1964. IEEE (2009) Li, Y., Crandall, D.J., Huttenlocher, D.P.: Landmark classification in large-scale image collections. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 1957–1964. IEEE (2009)
19.
Zurück zum Zitat Szummer, M., Picard, R.W.: Indoor-outdoor image classification. In: Content-Based Access of Image and Video Database, pp. 42–51. IEEE (1998) Szummer, M., Picard, R.W.: Indoor-outdoor image classification. In: Content-Based Access of Image and Video Database, pp. 42–51. IEEE (1998)
20.
Zurück zum Zitat Vailaya, A., Figueiredo, M.A., Jain, A.K., Zhang, H.J.: Image classification for content-based indexing. IEEE Trans. Image Process. 10, 117–130 (2001)CrossRefMATH Vailaya, A., Figueiredo, M.A., Jain, A.K., Zhang, H.J.: Image classification for content-based indexing. IEEE Trans. Image Process. 10, 117–130 (2001)CrossRefMATH
21.
Zurück zum Zitat Serrano, N., Savakis, A., Luo, A.: A computationally efficient approach to indoor/outdoor scene classification. In: 16th International Conference on Pattern Recognition, Proceedings, vol. 4, pp. 146–149 (2002) Serrano, N., Savakis, A., Luo, A.: A computationally efficient approach to indoor/outdoor scene classification. In: 16th International Conference on Pattern Recognition, Proceedings, vol. 4, pp. 146–149 (2002)
22.
Zurück zum Zitat Pavlopoulou, C., Yu, S.: Indoor-outdoor classification with human accuracies: Image or edge gist? In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 41–47 (2010) Pavlopoulou, C., Yu, S.: Indoor-outdoor classification with human accuracies: Image or edge gist? In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 41–47 (2010)
23.
Zurück zum Zitat Kim, W., Park, J., Kim, C.: A novel method for efficient indoor-outdoor image classification. J. Sig. Process. Syst. 61, 251–258 (2010)CrossRef Kim, W., Park, J., Kim, C.: A novel method for efficient indoor-outdoor image classification. J. Sig. Process. Syst. 61, 251–258 (2010)CrossRef
24.
Zurück zum Zitat Xiao, J., Hays, J., Ehinger, K.A., Oliva, A., Torralba, A.: Sun database: Large-scale scene recognition from abbey to zoo. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3485–3492. IEEE (2010) Xiao, J., Hays, J., Ehinger, K.A., Oliva, A., Torralba, A.: Sun database: Large-scale scene recognition from abbey to zoo. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3485–3492. IEEE (2010)
25.
Zurück zum Zitat Luo, J., Savakis, A.: Indoor vs outdoor classification of consumer photographs using low-level and semantic features. In: 2001 International Conference on Image Processing, 2001, Proceedings, vol. 2, pp. 745–748 (2001) Luo, J., Savakis, A.: Indoor vs outdoor classification of consumer photographs using low-level and semantic features. In: 2001 International Conference on Image Processing, 2001, Proceedings, vol. 2, pp. 745–748 (2001)
26.
Zurück zum Zitat Kane, M.J., Savakis, A.: Bayesian network structure learning and inference in indoor vs. outdoor image classification. In: Proceedings of the 17th International Conference on Pattern Recognition, 2004, ICPR 2004, vol. 2, pp. 479–482. IEEE (2004) Kane, M.J., Savakis, A.: Bayesian network structure learning and inference in indoor vs. outdoor image classification. In: Proceedings of the 17th International Conference on Pattern Recognition, 2004, ICPR 2004, vol. 2, pp. 479–482. IEEE (2004)
27.
Zurück zum Zitat Traherne, M., Singh, S.: An integrated approach to automatic indoor outdoor scene classification in digital images. In: Yang, Z.R., Yin, H., Everson, R.M. (eds.) IDEAL 2004. LNCS, vol. 3177, pp. 511–516. Springer, Heidelberg (2004) CrossRef Traherne, M., Singh, S.: An integrated approach to automatic indoor outdoor scene classification in digital images. In: Yang, Z.R., Yin, H., Everson, R.M. (eds.) IDEAL 2004. LNCS, vol. 3177, pp. 511–516. Springer, Heidelberg (2004) CrossRef
28.
Zurück zum Zitat Radu, V.: Application. In: Radu, V. (ed.) Stochastic Modeling of Thermal Fatigue Crack Growth. ACM, vol. 1, pp. 63–70. Springer, Heidelberg (2015) CrossRef Radu, V.: Application. In: Radu, V. (ed.) Stochastic Modeling of Thermal Fatigue Crack Growth. ACM, vol. 1, pp. 63–70. Springer, Heidelberg (2015) CrossRef
29.
Zurück zum Zitat Payne, A., Singh, S.: Indoor vs. outdoor scene classification in digital photographs. Pattern Recogn. 38, 1533–1545 (2005)CrossRef Payne, A., Singh, S.: Indoor vs. outdoor scene classification in digital photographs. Pattern Recogn. 38, 1533–1545 (2005)CrossRef
30.
Zurück zum Zitat Payne, A., Singh, S.: A benchmark for indoor/outdoor scene classification. In: Singh, S., Singh, M., Apte, C., Perner, P. (eds.) ICAPR 2005. LNCS, vol. 3687, pp. 711–718. Springer, Heidelberg (2005) CrossRef Payne, A., Singh, S.: A benchmark for indoor/outdoor scene classification. In: Singh, S., Singh, M., Apte, C., Perner, P. (eds.) ICAPR 2005. LNCS, vol. 3687, pp. 711–718. Springer, Heidelberg (2005) CrossRef
31.
Zurück zum Zitat Hu, G.H., Bu, J.J., Chen, C.: A novel bayesian framework for indoor-outdoor image classification. In: 2003 International Conference on Machine Learning and Cybernetics, vol. 5, pp. 3028–3032. IEEE (2003) Hu, G.H., Bu, J.J., Chen, C.: A novel bayesian framework for indoor-outdoor image classification. In: 2003 International Conference on Machine Learning and Cybernetics, vol. 5, pp. 3028–3032. IEEE (2003)
32.
Zurück zum Zitat Efimov, S., Nefyodov, A., Rychagov, M.: Block-based image exposure assessment and indoor/outdoor classification. In: Proceedings of 17th Conference on Computer Graphics GraphiCon (2007) Efimov, S., Nefyodov, A., Rychagov, M.: Block-based image exposure assessment and indoor/outdoor classification. In: Proceedings of 17th Conference on Computer Graphics GraphiCon (2007)
33.
Zurück zum Zitat Tao, L., Kim, Y.H., Kim, Y.T.: An efficient neural network based indoor-outdoor scene classification algorithm. In: 2010 Digest of Technical Papers International Conference Consumer Electronics (ICCE), pp. 317–318. IEEE (2010) Tao, L., Kim, Y.H., Kim, Y.T.: An efficient neural network based indoor-outdoor scene classification algorithm. In: 2010 Digest of Technical Papers International Conference Consumer Electronics (ICCE), pp. 317–318. IEEE (2010)
34.
Zurück zum Zitat Wolpert, D.H.: Stacked generalization. Neural Netw. 5, 241–259 (1992)CrossRef Wolpert, D.H.: Stacked generalization. Neural Netw. 5, 241–259 (1992)CrossRef
35.
Zurück zum Zitat Deng, L., Yu, D., Platt, J.: Scalable stacking and learning for building deep architectures. In: 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2133–2136. IEEE (2012) Deng, L., Yu, D., Platt, J.: Scalable stacking and learning for building deep architectures. In: 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2133–2136. IEEE (2012)
36.
Zurück zum Zitat Džeroski, S., Ženko, B.: Is combining classifiers with stacking better than selecting the best one? Mach. Learn> 54, 255–273 (2004)CrossRefMATH Džeroski, S., Ženko, B.: Is combining classifiers with stacking better than selecting the best one? Mach. Learn> 54, 255–273 (2004)CrossRefMATH
37.
Zurück zum Zitat Ohta, Y.I., Kanade, T., Sakai, T.: Color information for region segmentation. Comput. Graph. Image Process. 13, 222–241 (1980)CrossRef Ohta, Y.I., Kanade, T., Sakai, T.: Color information for region segmentation. Comput. Graph. Image Process. 13, 222–241 (1980)CrossRef
38.
Zurück zum Zitat Mao, J., Jain, A.K.: Texture classification and segmentation using multiresolution simultaneous autoregressive models. Pattern Recogn. 25, 173–188 (1992)CrossRef Mao, J., Jain, A.K.: Texture classification and segmentation using multiresolution simultaneous autoregressive models. Pattern Recogn. 25, 173–188 (1992)CrossRef
39.
40.
Zurück zum Zitat Oliva, A., Torralba, A.: Modeling the shape of the scene: A holistic representation of the spatial envelope. Int. J. Comput. Vis. 42, 145–175 (2001)CrossRefMATH Oliva, A., Torralba, A.: Modeling the shape of the scene: A holistic representation of the spatial envelope. Int. J. Comput. Vis. 42, 145–175 (2001)CrossRefMATH
41.
Zurück zum Zitat Radu, V.: Application. In: Radu, V. (ed.) Stochastic Modeling of Thermal Fatigue Crack Growth. ACM, vol. 1, pp. 63–70. Springer, Heidelberg (2015) CrossRef Radu, V.: Application. In: Radu, V. (ed.) Stochastic Modeling of Thermal Fatigue Crack Growth. ACM, vol. 1, pp. 63–70. Springer, Heidelberg (2015) CrossRef
42.
Zurück zum Zitat Chang, C.C., Lin, C.J.: Libsvm: a library for support vector machines. ACM Trans. Intell. Syst. Technol. (TIST) 2, 27 (2011) Chang, C.C., Lin, C.J.: Libsvm: a library for support vector machines. ACM Trans. Intell. Syst. Technol. (TIST) 2, 27 (2011)
43.
Zurück zum Zitat Gupta, L., Pathangay, V., Patra, A., Dyana, A., Das, S.: Indoor versus outdoor scene classification using probabilistic neural network. EURASIP J. Appl. Sig. Process. 2007, 123–123 (2007) Gupta, L., Pathangay, V., Patra, A., Dyana, A., Das, S.: Indoor versus outdoor scene classification using probabilistic neural network. EURASIP J. Appl. Sig. Process. 2007, 123–123 (2007)
44.
Zurück zum Zitat Johnson, J.B.: Thermal agitation of electricity in conductors. Phys. Rev. 32, 97 (1928)CrossRef Johnson, J.B.: Thermal agitation of electricity in conductors. Phys. Rev. 32, 97 (1928)CrossRef
45.
Zurück zum Zitat Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: Sixth International Conference on Computer Vision, 1998, pp. 839–846. IEEE (1998) Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: Sixth International Conference on Computer Vision, 1998, pp. 839–846. IEEE (1998)
46.
Zurück zum Zitat He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 33, 2341–2353 (2011)CrossRef He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 33, 2341–2353 (2011)CrossRef
47.
Zurück zum Zitat Iversen, G.R., Norpoth, H.: Analysis of Variance. Sage, Newbury Park (1987) Iversen, G.R., Norpoth, H.: Analysis of Variance. Sage, Newbury Park (1987)
48.
Zurück zum Zitat Lomax, R.G., Hahs-Vaughn, D.L.: Statistical Concepts: A Second Course. Routledge, New York (2013) Lomax, R.G., Hahs-Vaughn, D.L.: Statistical Concepts: A Second Course. Routledge, New York (2013)
Metadaten
Titel
Large-Scale Indoor/Outdoor Image Classification via Expert Decision Fusion (EDF)
verfasst von
Chen Chen
Yuzhuo Ren
C.-C. Jay Kuo
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-16628-5_31

Premium Partner