Skip to main content

2019 | OriginalPaper | Buchkapitel

Evaluation of Automatic Image Color Theme Extraction Methods

verfasst von : Gianluigi Ciocca, Paolo Napoletano, Raimondo Schettini

Erschienen in: Computational Color Imaging

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Color themes are quite important in several fields from visual and graphic art design to image analysis and manipulation. Color themes can be extracted from an image manually by humans or automatically by a software. Plenty of automatic color theme extraction methods, either supervised or unsupervised, have been presented in the state of the art in the last years. Evaluation of a color theme goodness with respect to a reference one is based on visual and subjective comparisons, that may be affected by cultural and social aspects, they are time consuming and not costless. In this paper we experiment several supervised and unsupervised state-of-the-art methods for color theme extraction. To overcome the burden of a subjective evaluation, we experiment the use of a computational metric based on the Earth Mover’s distance for goodness evaluation instead of a subjective one. Results show the best color theme is extracted by using a supervised method based on a regression model trained on user-defined color themes and that the computational metric adopted is comparable to a subjective one.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
3.
Zurück zum Zitat Bianco, S., Cadene, R., Celona, L., Napoletano, P.: Benchmark analysis of representative deep neural network architectures. IEEE Access 6, 64270–64277 (2018)CrossRef Bianco, S., Cadene, R., Celona, L., Napoletano, P.: Benchmark analysis of representative deep neural network architectures. IEEE Access 6, 64270–64277 (2018)CrossRef
4.
Zurück zum Zitat Bianco, S., Ciocca, G.: User preferences modeling and learning for pleasing photo collage generation. ACM Trans. Multimedia Comput. Commun. Appl. (TOMM) 12(1), 6 (2015) Bianco, S., Ciocca, G.: User preferences modeling and learning for pleasing photo collage generation. ACM Trans. Multimedia Comput. Commun. Appl. (TOMM) 12(1), 6 (2015)
5.
Zurück zum Zitat Boccignone, G., Ferraro, M., Napoletano, P.: Diffused expectation maximisation for image segmentation. Electron. Lett. 40(18), 1 (2004)CrossRef Boccignone, G., Ferraro, M., Napoletano, P.: Diffused expectation maximisation for image segmentation. Electron. Lett. 40(18), 1 (2004)CrossRef
6.
Zurück zum Zitat Boccignone, G., Napoletano, P., Caggiano, V., Ferraro, M.: A multiresolution diffused expectation-maximization algorithm for medical image segmentation. Comput. Biol. Med. 37(1), 83–96 (2007)CrossRef Boccignone, G., Napoletano, P., Caggiano, V., Ferraro, M.: A multiresolution diffused expectation-maximization algorithm for medical image segmentation. Comput. Biol. Med. 37(1), 83–96 (2007)CrossRef
7.
Zurück zum Zitat Centore, P.: sRGB centroids for the ISCC-NBS colour system. Munsell Colour Sci. Painters (2016) Centore, P.: sRGB centroids for the ISCC-NBS colour system. Munsell Colour Sci. Painters (2016)
8.
Zurück zum Zitat Chang, H., Fried, O., Liu, Y., DiVerdi, S., Finkelstein, A.: Palette-based photo recoloring. ACM Trans. Graph. (TOG) 34(4), 139 (2015)CrossRef Chang, H., Fried, O., Liu, Y., DiVerdi, S., Finkelstein, A.: Palette-based photo recoloring. ACM Trans. Graph. (TOG) 34(4), 139 (2015)CrossRef
9.
Zurück zum Zitat Cheng, Y.: Mean shift, mode seeking, and clustering. IEEE Trans. Pattern Anal. Mach. Intell. 17(8), 790–799 (1995)CrossRef Cheng, Y.: Mean shift, mode seeking, and clustering. IEEE Trans. Pattern Anal. Mach. Intell. 17(8), 790–799 (1995)CrossRef
10.
Zurück zum Zitat Chuang, J., Stone, M., Hanrahan, P.: A probabilistic model of the categorical association between colors. In: Color and Imaging Conference. vol. 2008, pp. 6–11. Society for Imaging Science and Technology (2008) Chuang, J., Stone, M., Hanrahan, P.: A probabilistic model of the categorical association between colors. In: Color and Imaging Conference. vol. 2008, pp. 6–11. Society for Imaging Science and Technology (2008)
13.
Zurück zum Zitat Corchs, S., Ciocca, G., Bricolo, E., Gasparini, F.: Predicting complexity perception of real world images. PLoS ONE 11(6), e0157986 (2016)CrossRef Corchs, S., Ciocca, G., Bricolo, E., Gasparini, F.: Predicting complexity perception of real world images. PLoS ONE 11(6), e0157986 (2016)CrossRef
14.
Zurück zum Zitat Cusano, C., Napoletano, P., Schettini, R.: Remote sensing image classification exploiting multiple kernel learning. IEEE Geosci. Remote Sens. Lett. 12(11), 2331–2335 (2015)CrossRef Cusano, C., Napoletano, P., Schettini, R.: Remote sensing image classification exploiting multiple kernel learning. IEEE Geosci. Remote Sens. Lett. 12(11), 2331–2335 (2015)CrossRef
15.
Zurück zum Zitat Delon, J., Desolneux, A., Lisani, J.L., Petro, A.B.: Automatic color palette. In: IEEE International Conference on 2005 Image Processing, ICIP 2005, vol. 2, pp. II-706. IEEE (2005) Delon, J., Desolneux, A., Lisani, J.L., Petro, A.B.: Automatic color palette. In: IEEE International Conference on 2005 Image Processing, ICIP 2005, vol. 2, pp. II-706. IEEE (2005)
16.
Zurück zum Zitat Dunn, J.C.: A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters. J. Cybern. 3, 32–57 (1973)MathSciNetCrossRef Dunn, J.C.: A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters. J. Cybern. 3, 32–57 (1973)MathSciNetCrossRef
17.
Zurück zum Zitat Gonzalez, R.C., Woods, R.E., et al.: Digital Image Processing. Prentice Hall, Upper Saddle River (2017) Gonzalez, R.C., Woods, R.E., et al.: Digital Image Processing. Prentice Hall, Upper Saddle River (2017)
18.
Zurück zum Zitat Greenfield, G.R., House, D.H.: Image recoloring induced by palette color associations. J. WSCG 11, 189–196 (2003) Greenfield, G.R., House, D.H.: Image recoloring induced by palette color associations. J. WSCG 11, 189–196 (2003)
19.
Zurück zum Zitat Gudivada, V.N., Raghavan, V.V.: Content based image retrieval systems. Computer 28(9), 18–22 (1995)CrossRef Gudivada, V.N., Raghavan, V.V.: Content based image retrieval systems. Computer 28(9), 18–22 (1995)CrossRef
20.
Zurück zum Zitat Hubel, D.H.: Eye, Brain, and Vision. Scientific American Library/Scientific American Books, New York (1995) Hubel, D.H.: Eye, Brain, and Vision. Scientific American Library/Scientific American Books, New York (1995)
21.
Zurück zum Zitat Lin, S., Hanrahan, P.: Modeling how people extract color themes from images. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 3101–3110. ACM (2013) Lin, S., Hanrahan, P.: Modeling how people extract color themes from images. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 3101–3110. ACM (2013)
22.
Zurück zum Zitat MacQueen, J., et al.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Oakland, CA, USA, vol. 1, pp. 281–297 (1967) MacQueen, J., et al.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Oakland, CA, USA, vol. 1, pp. 281–297 (1967)
23.
Zurück zum Zitat Meier, B.J., Spalter, A.M., Karelitz, D.B.: Interactive color palette tools. IEEE Comput. Graph. Appl. 3, 64–72 (2004)CrossRef Meier, B.J., Spalter, A.M., Karelitz, D.B.: Interactive color palette tools. IEEE Comput. Graph. Appl. 3, 64–72 (2004)CrossRef
24.
Zurück zum Zitat Mellado, N., Vanderhaeghe, D., Hoarau, C., Christophe, S., Brédif, M., Barthe, L.: Constrained palette-space exploration. ACM Trans. Graph. (TOG) 36(4), 60 (2017)CrossRef Mellado, N., Vanderhaeghe, D., Hoarau, C., Christophe, S., Brédif, M., Barthe, L.: Constrained palette-space exploration. ACM Trans. Graph. (TOG) 36(4), 60 (2017)CrossRef
26.
Zurück zum Zitat Obrador, P.: Automatic color scheme picker for document templates based on image analysis and dual problem. In: Digital Publishing, vol. 6076, p. 607609. International Society for Optics and Photonics (2006) Obrador, P.: Automatic color scheme picker for document templates based on image analysis and dual problem. In: Digital Publishing, vol. 6076, p. 607609. International Society for Optics and Photonics (2006)
27.
Zurück zum Zitat O’Donovan, P., Agarwala, A., Hertzmann, A.: Color compatibility from large datasets. ACM Trans. Graph. (TOG) 30, 63 (2011) O’Donovan, P., Agarwala, A., Hertzmann, A.: Color compatibility from large datasets. ACM Trans. Graph. (TOG) 30, 63 (2011)
29.
Zurück zum Zitat Rubner, Y., Tomasi, C., Guibas, L.J.: The earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vis. 40(2), 99–121 (2000)CrossRef Rubner, Y., Tomasi, C., Guibas, L.J.: The earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vis. 40(2), 99–121 (2000)CrossRef
31.
Zurück zum Zitat Shugrina, M., Kar, A., Singh, K., Fidler, S.: Color sails: discrete-continuous palettes for deep color exploration. arXiv preprint arXiv:1806.02918 (2018) Shugrina, M., Kar, A., Singh, K., Fidler, S.: Color sails: discrete-continuous palettes for deep color exploration. arXiv preprint arXiv:​1806.​02918 (2018)
32.
Zurück zum Zitat Walch, M., Hope, A.: Living Colors: The Definitive Guide to Color Palettes Through the Ages. Chronicle Books, San Francisco (1995) Walch, M., Hope, A.: Living Colors: The Definitive Guide to Color Palettes Through the Ages. Chronicle Books, San Francisco (1995)
33.
Zurück zum Zitat Wang, B., Yu, Y., Wong, T.T., Chen, C., Xu, Y.O.: Data-driven image color theme enhancement. ACM Trans. Graph. (TOG) 29, 146 (2010) Wang, B., Yu, Y., Wong, T.T., Chen, C., Xu, Y.O.: Data-driven image color theme enhancement. ACM Trans. Graph. (TOG) 29, 146 (2010)
34.
Zurück zum Zitat Weeks, A.R., Hague, G.E.: Color segmentation in the HSI color space using the k-means algorithm. In: Nonlinear Image Processing VIII, vol. 3026, pp. 143–155. International Society for Optics and Photonics (1997) Weeks, A.R., Hague, G.E.: Color segmentation in the HSI color space using the k-means algorithm. In: Nonlinear Image Processing VIII, vol. 3026, pp. 143–155. International Society for Optics and Photonics (1997)
35.
Zurück zum Zitat Wong, K.M., Chey, C.H., Liu, T.S., Po, L.M.: Dominant color image retrieval using merged histogram. In: Proceedings of the 2003 International Symposium on Circuits and Systems, 2003 ISCAS 2003, vol. 2, p. II. IEEE (2003) Wong, K.M., Chey, C.H., Liu, T.S., Po, L.M.: Dominant color image retrieval using merged histogram. In: Proceedings of the 2003 International Symposium on Circuits and Systems, 2003 ISCAS 2003, vol. 2, p. II. IEEE (2003)
36.
Zurück zum Zitat Wyszecki, G., Stiles, W.S.: Color Science, vol. 8. Wiley, New York (1982) Wyszecki, G., Stiles, W.S.: Color Science, vol. 8. Wiley, New York (1982)
Metadaten
Titel
Evaluation of Automatic Image Color Theme Extraction Methods
verfasst von
Gianluigi Ciocca
Paolo Napoletano
Raimondo Schettini
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-13940-7_13