Skip to main content

2016 | OriginalPaper | Buchkapitel

Large Image Collection Visualization Using Perception-Based Similarity with Color Features

verfasst von : Zeyuan Chen, Christopher G. Healey

Erschienen in: Advances in Visual Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper introduces the basic steps to build a similarity-based visualization tool for large image collections. We build the similarity metrics based on human perception. Psychophysical experiments have shown that human observers can recognize the gist of scenes within 100 milliseconds (ms) by comprehending the global properties of an image. Color also plays an important role in human rapid scene recognition. However, previous works often neglect color features. We propose new scene descriptors that preserve the information from coherent color regions, as well as the spatial layouts of scenes. Experiments show that our descriptors outperform existing state-of-the-art approaches. Given the similarity metrics, a hierarchical structure of an image collection can be built in a top-down manner. Representative images are chosen for image clusters and visualized using a force-directed graph.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
3.
Zurück zum Zitat Nguyen, G.P., Worring, M.: Interactive access to large image collections using similarity-based visualization. J. Vis. Lang. Comput. 19, 203–224 (2008)CrossRef Nguyen, G.P., Worring, M.: Interactive access to large image collections using similarity-based visualization. J. Vis. Lang. Comput. 19, 203–224 (2008)CrossRef
4.
Zurück zum Zitat Yang, J., Fan, J., Hubball, D., Gao, Y., Luo, H., Ribarsky, W., Ward, M.: Semantic image browser: bridging information visualization with automated intelligent image analysis. In: 2006 IEEE Symposium on Visual Analytics Science and Technology, pp. 191–198. IEEE (2006) Yang, J., Fan, J., Hubball, D., Gao, Y., Luo, H., Ribarsky, W., Ward, M.: Semantic image browser: bridging information visualization with automated intelligent image analysis. In: 2006 IEEE Symposium on Visual Analytics Science and Technology, pp. 191–198. IEEE (2006)
5.
Zurück zum Zitat Jing, Y., Rowley, H., Wang, J., Tsai, D., Rosenberg, C., Covell, M.: Google image swirl: a large-scale content-based image visualization system. In: Proceedings of the 21st International Conference Companion on World Wide Web, pp. 539–540. ACM (2012) Jing, Y., Rowley, H., Wang, J., Tsai, D., Rosenberg, C., Covell, M.: Google image swirl: a large-scale content-based image visualization system. In: Proceedings of the 21st International Conference Companion on World Wide Web, pp. 539–540. ACM (2012)
6.
Zurück zum Zitat Barnard, K., Forsyth, D.: Learning the semantics of words and pictures. In: Proceedings of the Eighth IEEE International Conference on Computer Vision, ICCV 2001, vol. 2, pp. 408–415. IEEE (2001) Barnard, K., Forsyth, D.: Learning the semantics of words and pictures. In: Proceedings of the Eighth IEEE International Conference on Computer Vision, ICCV 2001, vol. 2, pp. 408–415. IEEE (2001)
7.
Zurück zum Zitat Carson, C., Belongie, S., Greenspan, H., Malik, J.: Blobworld: image segmentation using expectation-maximization and its application to image querying. IEEE Trans. Pattern Anal. Mach. Intell. 24, 1026–1038 (2002)CrossRef Carson, C., Belongie, S., Greenspan, H., Malik, J.: Blobworld: image segmentation using expectation-maximization and its application to image querying. IEEE Trans. Pattern Anal. Mach. Intell. 24, 1026–1038 (2002)CrossRef
8.
Zurück zum Zitat Schyns, P.G., Oliva, A.: From blobs to boundary edges: evidence for time-and spatial-scale-dependent scene recognition. Psychol. Sci. 5, 195–200 (1994)CrossRef Schyns, P.G., Oliva, A.: From blobs to boundary edges: evidence for time-and spatial-scale-dependent scene recognition. Psychol. Sci. 5, 195–200 (1994)CrossRef
9.
Zurück zum Zitat Oliva, A., Torralba, A.: Modeling the shape of the scene: a holistic representation of the spatial envelope. Int. J. Comput. Vis. 42, 145–175 (2001)CrossRefMATH Oliva, A., Torralba, A.: Modeling the shape of the scene: a holistic representation of the spatial envelope. Int. J. Comput. Vis. 42, 145–175 (2001)CrossRefMATH
10.
Zurück zum Zitat Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 2169–2178. IEEE (2006) Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 2169–2178. IEEE (2006)
11.
Zurück zum Zitat Oliva, A.: Gist of the scene. Neurobiol. Atten. 696, 251–258 (2005)CrossRef Oliva, A.: Gist of the scene. Neurobiol. Atten. 696, 251–258 (2005)CrossRef
12.
Zurück zum Zitat Greene, M.R., Oliva, A.: The briefest of glances the time course of natural scene understanding. Psychol. Sci. 20, 464–472 (2009)CrossRef Greene, M.R., Oliva, A.: The briefest of glances the time course of natural scene understanding. Psychol. Sci. 20, 464–472 (2009)CrossRef
13.
Zurück zum Zitat Greene, M.R., Oliva, A.: Recognition of natural scenes from global properties: seeing the forest without representing the trees. Cogn. Psychol. 58, 137–176 (2009)CrossRef Greene, M.R., Oliva, A.: Recognition of natural scenes from global properties: seeing the forest without representing the trees. Cogn. Psychol. 58, 137–176 (2009)CrossRef
14.
Zurück zum Zitat Castelhano, M.S., Henderson, J.M.: The influence of color on the perception of scene gist. J. Exp. Psychol. Hum. Percept. Perform. 34, 660 (2008)CrossRef Castelhano, M.S., Henderson, J.M.: The influence of color on the perception of scene gist. J. Exp. Psychol. Hum. Percept. Perform. 34, 660 (2008)CrossRef
15.
Zurück zum Zitat Torralba, A., Oliva, A.: Statistics of natural image categories. Netw. Comput. Neural Syst. 14, 391–412 (2003)CrossRef Torralba, A., Oliva, A.: Statistics of natural image categories. Netw. Comput. Neural Syst. 14, 391–412 (2003)CrossRef
16.
Zurück zum Zitat Oliva, A., Torralba, A.: Building the gist of a scene: the role of global image features in recognition. Prog. Brain Re. 155, 23–36 (2006)CrossRef Oliva, A., Torralba, A.: Building the gist of a scene: the role of global image features in recognition. Prog. Brain Re. 155, 23–36 (2006)CrossRef
17.
Zurück zum Zitat Xiao, J., Hays, J., Ehinger, K.A., Oliva, A., Torralba, A.: Sun database: large-scale scene recognition from abbey to zoo. In: 2010 IEEE conference on Computer vision and pattern recognition (CVPR), pp. 3485–3492. IEEE (2010) Xiao, J., Hays, J., Ehinger, K.A., Oliva, A., Torralba, A.: Sun database: large-scale scene recognition from abbey to zoo. In: 2010 IEEE conference on Computer vision and pattern recognition (CVPR), pp. 3485–3492. IEEE (2010)
18.
Zurück zum Zitat Zhou, B., Lapedriza, A., Xiao, J., Torralba, A., Oliva, A.: Learning deep features for scene recognition using places database. In: Advances in Neural Information Processing Systems, pp. 487–495 (2014) Zhou, B., Lapedriza, A., Xiao, J., Torralba, A., Oliva, A.: Learning deep features for scene recognition using places database. In: Advances in Neural Information Processing Systems, pp. 487–495 (2014)
19.
Zurück zum Zitat Chang, P., Krumm, J.: Object recognition with color cooccurrence histograms. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2. IEEE (1999) Chang, P., Krumm, J.: Object recognition with color cooccurrence histograms. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2. IEEE (1999)
20.
Zurück zum Zitat Pass, G., Zabih, R.: Histogram refinement for content-based image retrieval. In: Proceedings 3rd IEEE Workshop on Applications of Computer Vision, WACV 1996, pp. 96–102. IEEE (1996) Pass, G., Zabih, R.: Histogram refinement for content-based image retrieval. In: Proceedings 3rd IEEE Workshop on Applications of Computer Vision, WACV 1996, pp. 96–102. IEEE (1996)
21.
Zurück zum Zitat Huang, J., Kumar, S.R., Mitra, M., Zhu, W.J., Zabih, R.: Image indexing using color correlograms. In: Proceedings of the 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 762–768. IEEE (1997) Huang, J., Kumar, S.R., Mitra, M., Zhu, W.J., Zabih, R.: Image indexing using color correlograms. In: Proceedings of the 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 762–768. IEEE (1997)
22.
Zurück zum Zitat Van De Sande, K.E., Gevers, T., Snoek, C.G.: Evaluating color descriptors for object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1582–1596 (2010)CrossRef Van De Sande, K.E., Gevers, T., Snoek, C.G.: Evaluating color descriptors for object and scene recognition. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1582–1596 (2010)CrossRef
23.
Zurück zum Zitat Bosch, A., Zisserman, A., Muoz, X.: Scene classification using a hybrid generative/discriminative approach. IEEE Trans. Pattern Anal. Mach. Intell. 30, 712–727 (2008)CrossRef Bosch, A., Zisserman, A., Muoz, X.: Scene classification using a hybrid generative/discriminative approach. IEEE Trans. Pattern Anal. Mach. Intell. 30, 712–727 (2008)CrossRef
24.
Zurück zum Zitat Oliva, A., Schyns, P.G.: Diagnostic colors mediate scene recognition. Cogn. Psychol. 41, 176–210 (2000)CrossRef Oliva, A., Schyns, P.G.: Diagnostic colors mediate scene recognition. Cogn. Psychol. 41, 176–210 (2000)CrossRef
25.
Zurück zum Zitat Yang, J., Jiang, Y.G., Hauptmann, A.G., Ngo, C.W.: Evaluating bag-of-visual-words representations in scene classification. In: Proceedings of the International Workshop on Workshop on Multimedia Information Retrieval, pp. 197–206. ACM (2007) Yang, J., Jiang, Y.G., Hauptmann, A.G., Ngo, C.W.: Evaluating bag-of-visual-words representations in scene classification. In: Proceedings of the International Workshop on Workshop on Multimedia Information Retrieval, pp. 197–206. ACM (2007)
26.
Zurück zum Zitat Hou, J., Gao, H., Xia, Q., Qi, N.: Feature combination and the knn framework in object classification. IEEE Trans. Neural Netw. Learn. Syst. 27, 1368–1378 (2016)CrossRef Hou, J., Gao, H., Xia, Q., Qi, N.: Feature combination and the knn framework in object classification. IEEE Trans. Neural Netw. Learn. Syst. 27, 1368–1378 (2016)CrossRef
27.
Zurück zum Zitat Swain, M.J., Ballard, D.H.: Color indexing. Int. J. Comput. Vis. 7, 11–32 (1991)CrossRef Swain, M.J., Ballard, D.H.: Color indexing. Int. J. Comput. Vis. 7, 11–32 (1991)CrossRef
28.
Zurück zum Zitat Tibshirani, R., Walther, G., Hastie, T.: Estimating the number of clusters in a data set via the gap statistic. J. Roy. Stat. Soc. Ser. B (Stat. Methodol.) 63, 411–423 (2001)MathSciNetCrossRefMATH Tibshirani, R., Walther, G., Hastie, T.: Estimating the number of clusters in a data set via the gap statistic. J. Roy. Stat. Soc. Ser. B (Stat. Methodol.) 63, 411–423 (2001)MathSciNetCrossRefMATH
Metadaten
Titel
Large Image Collection Visualization Using Perception-Based Similarity with Color Features
verfasst von
Zeyuan Chen
Christopher G. Healey
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-50835-1_35