Skip to main content

2019 | OriginalPaper | Buchkapitel

Illumination Estimation Is Sufficient for Indoor-Outdoor Image Classification

verfasst von : Nikola Banić, Sven Lončarić

Erschienen in: Pattern Recognition

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Indoor-outdoor image classification is a well-known problem for which multiple solutions have been proposed, many of which use both low-level and high-level features put into various models. Despite varying complexity, the accuracy of most of these models is reported to be around 90%. In this paper it is shown that the same accuracy can be obtained by simple manipulation of only low-level features extracted from the image in the early phase of image formation and based on the simplest forms of illumination estimation, namely methods such as Gray-World. Additionally, it is shown how using the built-in camera auto white balance is also enough to effectively achieve state-of-the-art indoor-outdoor classification accuracy. The results are presented and discussed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Banić, N., Lončarić, S.: Color Cat: remembering colors for illumination estimation. IEEE Sig. Process. Lett. 22(6), 651–655 (2015)CrossRef Banić, N., Lončarić, S.: Color Cat: remembering colors for illumination estimation. IEEE Sig. Process. Lett. 22(6), 651–655 (2015)CrossRef
2.
Zurück zum Zitat Banić, N., Lončarić, S.: Using the red chromaticity for illumination estimation. In: 2015 9th International Symposium on Image and Signal Processing and Analysis (ISPA), pp. 131–136. IEEE (2015) Banić, N., Lončarić, S.: Using the red chromaticity for illumination estimation. In: 2015 9th International Symposium on Image and Signal Processing and Analysis (ISPA), pp. 131–136. IEEE (2015)
4.
Zurück zum Zitat Barla, A., Odone, F., Verri, A.: Histogram intersection kernel for image classification. In: 2003 Proceedings of the International Conference on Image Processing, ICIP 2003, vol. 3, p. III-513. IEEE (2003) Barla, A., Odone, F., Verri, A.: Histogram intersection kernel for image classification. In: 2003 Proceedings of the International Conference on Image Processing, ICIP 2003, vol. 3, p. III-513. IEEE (2003)
5.
Zurück zum Zitat Bianco, S., Ciocca, G., Cusano, C., Schettini, R.: Improving color constancy using indoor-outdoor image classification. IEEE Trans. Image Process. 17(12), 2381–2392 (2008)MathSciNetMATHCrossRef Bianco, S., Ciocca, G., Cusano, C., Schettini, R.: Improving color constancy using indoor-outdoor image classification. IEEE Trans. Image Process. 17(12), 2381–2392 (2008)MathSciNetMATHCrossRef
6.
Zurück zum Zitat Buchsbaum, G.: A spatial processor model for object colour perception. J. Franklin Inst. 310(1), 1–26 (1980)CrossRef Buchsbaum, G.: A spatial processor model for object colour perception. J. Franklin Inst. 310(1), 1–26 (1980)CrossRef
8.
Zurück zum Zitat Cheng, D., Abdelhamed, A., Price, B., Cohen, S., Brown, M.S.: Two illuminant estimation and user correction preference. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 469–477 (2016) Cheng, D., Abdelhamed, A., Price, B., Cohen, S., Brown, M.S.: Two illuminant estimation and user correction preference. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 469–477 (2016)
9.
Zurück zum Zitat Cheng, D., Prasad, D.K., Brown, M.S.: Illuminant estimation for color constancy: why spatial-domain methods work and the role of the color distribution. JOSA A 31(5), 1049–1058 (2014)CrossRef Cheng, D., Prasad, D.K., Brown, M.S.: Illuminant estimation for color constancy: why spatial-domain methods work and the role of the color distribution. JOSA A 31(5), 1049–1058 (2014)CrossRef
10.
Zurück zum Zitat Cvetković, S.S., Nikolić, S.V., Ilić, S.: Effective combining of color and texture descriptors for indoor-outdoor image classification. Facta Universitatis Ser. Electron. Energ. 27(3), 399–410 (2014)CrossRef Cvetković, S.S., Nikolić, S.V., Ilić, S.: Effective combining of color and texture descriptors for indoor-outdoor image classification. Facta Universitatis Ser. Electron. Energ. 27(3), 399–410 (2014)CrossRef
11.
Zurück zum Zitat Ebner, M.: Color Constancy. The Wiley-IS&T Series in Imaging Science and Technology. Wiley, Chichester (2007)MATH Ebner, M.: Color Constancy. The Wiley-IS&T Series in Imaging Science and Technology. Wiley, Chichester (2007)MATH
12.
Zurück zum Zitat Finlayson, G.D.: Corrected-moment illuminant estimation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1904–1911 (2013) Finlayson, G.D.: Corrected-moment illuminant estimation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1904–1911 (2013)
13.
Zurück zum Zitat Finlayson, G.D., Trezzi, E.: Shades of gray and colour constancy. In: Color and Imaging Conference, vol. 2004, pp. 37–41. Society for Imaging Science and Technology (2004) Finlayson, G.D., Trezzi, E.: Shades of gray and colour constancy. In: Color and Imaging Conference, vol. 2004, pp. 37–41. Society for Imaging Science and Technology (2004)
14.
Zurück zum Zitat Funt, B., Shi, L.: The rehabilitation of MaxRGB. In: Color and Imaging Conference, vol. 2010, pp. 256–259. Society for Imaging Science and Technology (2010) Funt, B., Shi, L.: The rehabilitation of MaxRGB. In: Color and Imaging Conference, vol. 2010, pp. 256–259. Society for Imaging Science and Technology (2010)
15.
Zurück zum Zitat Gehler, P.V., Rother, C., Blake, A., Minka, T., Sharp, T.: Bayesian color constancy revisited. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8. IEEE (2008) Gehler, P.V., Rother, C., Blake, A., Minka, T., Sharp, T.: Bayesian color constancy revisited. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8. IEEE (2008)
16.
Zurück zum Zitat Ghomsheh, A.N., Talebpour, A.: A new method for indoor-outdoor image classification using color correlated temperature. Int. J. Image Process 6(3), 167–181 (2012) Ghomsheh, A.N., Talebpour, A.: A new method for indoor-outdoor image classification using color correlated temperature. Int. J. Image Process 6(3), 167–181 (2012)
17.
Zurück zum Zitat Gijsenij, A., Gevers, T., Van De Weijer, J.: Computational color constancy: survey and experiments. IEEE Trans. Image Process. 20(9), 2475–2489 (2011)MathSciNetMATHCrossRef Gijsenij, A., Gevers, T., Van De Weijer, J.: Computational color constancy: survey and experiments. IEEE Trans. Image Process. 20(9), 2475–2489 (2011)MathSciNetMATHCrossRef
18.
Zurück zum Zitat Gloe, T., Böhme, R.: The ‘Dresden Image Database’ for benchmarking digital image forensics. In: Proceedings of the 2010 ACM Symposium on Applied Computing, pp. 1584–1590. ACM (2010) Gloe, T., Böhme, R.: The ‘Dresden Image Database’ for benchmarking digital image forensics. In: Proceedings of the 2010 ACM Symposium on Applied Computing, pp. 1584–1590. ACM (2010)
19.
Zurück zum Zitat He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
20.
Zurück zum Zitat Hu, G.H., Bu, J.J., Chen, C.: A novel Bayesian framework for indoor-outdoor image classification. In: 2003 International Conference on Machine Learning and Cybernetics, vol. 5, pp. 3028–3032. IEEE (2003) Hu, G.H., Bu, J.J., Chen, C.: A novel Bayesian framework for indoor-outdoor image classification. In: 2003 International Conference on Machine Learning and Cybernetics, vol. 5, pp. 3028–3032. IEEE (2003)
21.
Zurück zum Zitat Joze, V., Reza, H.: Estimating the colour of the illuminant using specular reflection and exemplar-based method. Ph.D. thesis, Applied Sciences: School of Computing Science (2013) Joze, V., Reza, H.: Estimating the colour of the illuminant using specular reflection and exemplar-based method. Ph.D. thesis, Applied Sciences: School of Computing Science (2013)
22.
Zurück zum Zitat Kim, S.J., Lin, H.T., Lu, Z., Süsstrunk, S., Lin, S., Brown, M.S.: A new in-camera imaging model for color computer vision and its application. IEEE Trans. Pattern Anal. Mach. Intell. 34(12), 2289–2302 (2012)CrossRef Kim, S.J., Lin, H.T., Lu, Z., Süsstrunk, S., Lin, S., Brown, M.S.: A new in-camera imaging model for color computer vision and its application. IEEE Trans. Pattern Anal. Mach. Intell. 34(12), 2289–2302 (2012)CrossRef
23.
Zurück zum Zitat Kim, W., Park, J., Kim, C.: A novel method for efficient indoor-outdoor image classification. J. Sig. Process. Syst. 61(3), 251–258 (2010)CrossRef Kim, W., Park, J., Kim, C.: A novel method for efficient indoor-outdoor image classification. J. Sig. Process. Syst. 61(3), 251–258 (2010)CrossRef
25.
Zurück zum Zitat Land, E.H.: The retinex theory of color vision. Sci. Am. 237(6), 108–128 (1977)CrossRef Land, E.H.: The retinex theory of color vision. Sci. Am. 237(6), 108–128 (1977)CrossRef
26.
Zurück zum Zitat Luo, J., Savakis, A.: Indoor vs outdoor classification of consumer photographs using low-level and semantic features. In: 2001 Proceedings of the International Conference on Image Processing, vol. 2, pp. 745–748. IEEE (2001) Luo, J., Savakis, A.: Indoor vs outdoor classification of consumer photographs using low-level and semantic features. In: 2001 Proceedings of the International Conference on Image Processing, vol. 2, pp. 745–748. IEEE (2001)
27.
Zurück zum Zitat Nguyen, R.M., Brown, M.S.: RAW image reconstruction using a self-contained sRGB-JPEG image with only 64 KB overhead. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1655–1663 (2016) Nguyen, R.M., Brown, M.S.: RAW image reconstruction using a self-contained sRGB-JPEG image with only 64 KB overhead. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1655–1663 (2016)
28.
Zurück zum Zitat Nguyen, R.M., Brown, M.S.: RAW image reconstruction using a self-contained sRGB-JPEG image with small memory overhead. Int. J. Comput. Vis. 126(6), 637–650 (2018)MathSciNetCrossRef Nguyen, R.M., Brown, M.S.: RAW image reconstruction using a self-contained sRGB-JPEG image with small memory overhead. Int. J. Comput. Vis. 126(6), 637–650 (2018)MathSciNetCrossRef
29.
Zurück zum Zitat Payne, A., Singh, S.: Indoor vs. outdoor scene classification in digital photographs. Pattern Recogn. 38(10), 1533–1545 (2005)CrossRef Payne, A., Singh, S.: Indoor vs. outdoor scene classification in digital photographs. Pattern Recogn. 38(10), 1533–1545 (2005)CrossRef
30.
Zurück zum Zitat Serrano, N., Savakis, A., Luo, A.: A computationally efficient approach to indoor/outdoor scene classification. In: 2002 Proceedings of the 16th International Conference on Pattern Recognition, vol. 4, pp. 146–149. IEEE (2002) Serrano, N., Savakis, A., Luo, A.: A computationally efficient approach to indoor/outdoor scene classification. In: 2002 Proceedings of the 16th International Conference on Pattern Recognition, vol. 4, pp. 146–149. IEEE (2002)
31.
Zurück zum Zitat Shwetha, T., Shaila, H.: Indoor outdoor scene classification in digital images. Int. J. Electr. Electron. Comput. Syst. 2(11–12), 34–38 (2014) Shwetha, T., Shaila, H.: Indoor outdoor scene classification in digital images. Int. J. Electr. Electron. Comput. Syst. 2(11–12), 34–38 (2014)
33.
Zurück zum Zitat Szummer, M., Picard, R.W.: Indoor-outdoor image classification. In: 1998 Proceedings of the IEEE International Workshop on Content-Based Access of Image and Video Database, pp. 42–51. IEEE (1998) Szummer, M., Picard, R.W.: Indoor-outdoor image classification. In: 1998 Proceedings of the IEEE International Workshop on Content-Based Access of Image and Video Database, pp. 42–51. IEEE (1998)
34.
Zurück zum Zitat Tahir, W., Majeed, A., Rehman, T.: Indoor/outdoor image classification using gist image features and neural network classifiers. In: 2015 12th International Conference on High-Capacity Optical Networks and Enabling/Emerging Technologies (HONET), pp. 1–5. IEEE (2015) Tahir, W., Majeed, A., Rehman, T.: Indoor/outdoor image classification using gist image features and neural network classifiers. In: 2015 12th International Conference on High-Capacity Optical Networks and Enabling/Emerging Technologies (HONET), pp. 1–5. IEEE (2015)
35.
Zurück zum Zitat Vailaya, A., Figueiredo, M.A., Jain, A.K., Zhang, H.J.: Image classification for content-based indexing. IEEE Trans. Image Process. 10(1), 117–130 (2001)MATHCrossRef Vailaya, A., Figueiredo, M.A., Jain, A.K., Zhang, H.J.: Image classification for content-based indexing. IEEE Trans. Image Process. 10(1), 117–130 (2001)MATHCrossRef
36.
Zurück zum Zitat Zhu, Y., Newsam, S.: Land use classification using convolutional neural networks applied to ground-level images. In: Proceedings of the 23rd SIGSPATIAL International Conference on Advances in Geographic Information Systems, p. 61. ACM (2015) Zhu, Y., Newsam, S.: Land use classification using convolutional neural networks applied to ground-level images. In: Proceedings of the 23rd SIGSPATIAL International Conference on Advances in Geographic Information Systems, p. 61. ACM (2015)
37.
Zurück zum Zitat Zou, J., Li, W., Chen, C., Du, Q.: Scene classification using local and global features with collaborative representation fusion. Inf. Sci. 348, 209–226 (2016)MathSciNetCrossRef Zou, J., Li, W., Chen, C., Du, Q.: Scene classification using local and global features with collaborative representation fusion. Inf. Sci. 348, 209–226 (2016)MathSciNetCrossRef
Metadaten
Titel
Illumination Estimation Is Sufficient for Indoor-Outdoor Image Classification
verfasst von
Nikola Banić
Sven Lončarić
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-12939-2_33

Premium Partner