Skip to main content
Top

2017 | OriginalPaper | Chapter

Research on Image Emotional Semantic Retrieval Mechanism Based on Cognitive Quantification Model

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In the wake of the development of first-person engagement and crowdsourcing content creation, images are given abundant subjective dimensions of information, especially emotional ones. This research tried to purpose an approach for the image emotional semantic retrieval based on cognitive quantification model by using tags. In this research “Daqi”, a typical Chinese emotional experience, is taken as an example to construct an emotional quantification model of it through semantic association analysis and statistical data analysis. The results of verification experiments indicated that it is practical and effective to rank images and recommend tags in image emotional retrieval system based on cognitive model. It is foreseeable that the theory of this research can be applied to other social digital resources, like music or video.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ames, M., Naaman, M.: Why we tag: motivations for annotation in mobile and online media. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM (2007) Ames, M., Naaman, M.: Why we tag: motivations for annotation in mobile and online media. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM (2007)
2.
go back to reference Budanitsky, A., Hirst, G.: Evaluating wordnet-based measures of lexical semantic relatedness. Comput. Linguist. 32(1), 13–47 (2006)CrossRefMATH Budanitsky, A., Hirst, G.: Evaluating wordnet-based measures of lexical semantic relatedness. Comput. Linguist. 32(1), 13–47 (2006)CrossRefMATH
3.
go back to reference Cambria, E., Hussain, A., Havasi, C., Eckl, C.: Sentic computing: exploitation of common sense for the development of emotion-sensitive systems. In: Esposito, A., Campbell, N., Vogel, C., Hussain, A., Nijholt, A. (eds.) Development of Multimodal Interfaces: Active Listening and Synchrony. LNCS, vol. 5967, pp. 148–156. Springer, Heidelberg (2010). doi:10.1007/978-3-642-12397-9_12 CrossRef Cambria, E., Hussain, A., Havasi, C., Eckl, C.: Sentic computing: exploitation of common sense for the development of emotion-sensitive systems. In: Esposito, A., Campbell, N., Vogel, C., Hussain, A., Nijholt, A. (eds.) Development of Multimodal Interfaces: Active Listening and Synchrony. LNCS, vol. 5967, pp. 148–156. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-12397-9_​12 CrossRef
4.
go back to reference Fukumoto, T.: An analysis of image retrieval behavior for metadata type image database. Inf. Process. Manag. 42(3), 723–728 (2006)CrossRef Fukumoto, T.: An analysis of image retrieval behavior for metadata type image database. Inf. Process. Manag. 42(3), 723–728 (2006)CrossRef
5.
go back to reference Hanbury, A.: A survey of methods for image annotation. J. Visual Lang. Comput. 19(5), 617–627 (2008)CrossRef Hanbury, A.: A survey of methods for image annotation. J. Visual Lang. Comput. 19(5), 617–627 (2008)CrossRef
6.
go back to reference Li, X., et al.: Low-rank image tag completion with dual reconstruction structure preserved. Neurocomputing 173, 425–433 (2016)CrossRef Li, X., et al.: Low-rank image tag completion with dual reconstruction structure preserved. Neurocomputing 173, 425–433 (2016)CrossRef
7.
go back to reference Liu, N., et al.: Multimodal recognition of visual concepts using histograms of textual concepts and selective weighted late fusion scheme. Comput. Vis. Image Underst. 117(5), 493–512 (2013)CrossRef Liu, N., et al.: Multimodal recognition of visual concepts using histograms of textual concepts and selective weighted late fusion scheme. Comput. Vis. Image Underst. 117(5), 493–512 (2013)CrossRef
8.
go back to reference Liu, Y., et al.: A survey of content-based image retrieval with high-level semantics. Pattern Recogn. 40(1), 262–282 (2007)CrossRefMATH Liu, Y., et al.: A survey of content-based image retrieval with high-level semantics. Pattern Recogn. 40(1), 262–282 (2007)CrossRefMATH
9.
go back to reference Lu, Y., et al.: A unified framework for semantics and feature based relevance feedback in image retrieval systems. In: Proceedings of the Eighth ACM International Conference on Multimedia. ACM (2000) Lu, Y., et al.: A unified framework for semantics and feature based relevance feedback in image retrieval systems. In: Proceedings of the Eighth ACM International Conference on Multimedia. ACM (2000)
10.
go back to reference Matusiak, K.K.: Information seeking behavior in digital image collections: a cognitive approach. J. Acad. Librariansh. 32(5), 479–488 (2006)CrossRef Matusiak, K.K.: Information seeking behavior in digital image collections: a cognitive approach. J. Acad. Librariansh. 32(5), 479–488 (2006)CrossRef
11.
go back to reference Müller, H., et al.: Learning from user behavior in image retrieval: application of market basket analysis. Int. J. Comput. Vis. 56(1–2), 65–77 (2004)CrossRef Müller, H., et al.: Learning from user behavior in image retrieval: application of market basket analysis. Int. J. Comput. Vis. 56(1–2), 65–77 (2004)CrossRef
12.
go back to reference Sánchez-Rada, J.F., Iglesias, C.A.: Onyx: a linked data approach to emotion representation. Inf. Process. Manag. 52(1), 99–114 (2016)CrossRef Sánchez-Rada, J.F., Iglesias, C.A.: Onyx: a linked data approach to emotion representation. Inf. Process. Manag. 52(1), 99–114 (2016)CrossRef
14.
go back to reference Schmidt, S., Stock, W.G.: Collective indexing of emotions in images. A study in emotional information retrieval. J. Am. Soc. Inf. Sci. Technol. 60(5), 863–876 (2009)CrossRef Schmidt, S., Stock, W.G.: Collective indexing of emotions in images. A study in emotional information retrieval. J. Am. Soc. Inf. Sci. Technol. 60(5), 863–876 (2009)CrossRef
15.
go back to reference Schröder, M., Pirker, H., Lamolle, M., Burkhardt, F., Peter, C., Zovato, E.: Representing emotions and related states in technological systems. In: Cowie, R., Pelachaud, C., Petta, P. (eds.) Emotion-Oriented Systems, Cognitive Technologies, pp. 369–387. Springer, Heidelberg (2011)CrossRef Schröder, M., Pirker, H., Lamolle, M., Burkhardt, F., Peter, C., Zovato, E.: Representing emotions and related states in technological systems. In: Cowie, R., Pelachaud, C., Petta, P. (eds.) Emotion-Oriented Systems, Cognitive Technologies, pp. 369–387. Springer, Heidelberg (2011)CrossRef
16.
go back to reference Sun, A., et al.: Tag-based social image retrieval: an empirical evaluation. J. Am. Soc. Inf. Sci. Technol. 62(12), 2364–2381 (2011)CrossRef Sun, A., et al.: Tag-based social image retrieval: an empirical evaluation. J. Am. Soc. Inf. Sci. Technol. 62(12), 2364–2381 (2011)CrossRef
17.
go back to reference Wang, W., He, Q.: A survey on emotional semantic image retrieval. In: 15th IEEE International Conference on Image Processing, ICIP 2008. IEEE (2008) Wang, W., He, Q.: A survey on emotional semantic image retrieval. In: 15th IEEE International Conference on Image Processing, ICIP 2008. IEEE (2008)
18.
go back to reference Wei-ning, W., et al.: Image retrieval by emotional semantics: a study of emotional space and feature extraction. In: IEEE International Conference on Systems, Man and Cybernetics, SMC 2006. IEEE (2006) Wei-ning, W., et al.: Image retrieval by emotional semantics: a study of emotional space and feature extraction. In: IEEE International Conference on Systems, Man and Cybernetics, SMC 2006. IEEE (2006)
19.
go back to reference Wu, L., et al.: Tag completion for image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 35(3), 716–727 (2013)CrossRef Wu, L., et al.: Tag completion for image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 35(3), 716–727 (2013)CrossRef
20.
go back to reference Zha, Z.-J., et al.: Interactive social group recommendation for Flickr photos. Neurocomputing 105, 30–37 (2013)CrossRef Zha, Z.-J., et al.: Interactive social group recommendation for Flickr photos. Neurocomputing 105, 30–37 (2013)CrossRef
21.
go back to reference Zhang, H., Augilius, E., Honkela, T., Laaksonen, J., Gamper, H., Alene, H.: Analyzing emotional semantics of abstract art using low-level image features. In: Gama, J., Bradley, E., Hollmén, J. (eds.) IDA 2011. LNCS, vol. 7014, pp. 413–423. Springer, Heidelberg (2011). doi:10.1007/978-3-642-24800-9_38 CrossRef Zhang, H., Augilius, E., Honkela, T., Laaksonen, J., Gamper, H., Alene, H.: Analyzing emotional semantics of abstract art using low-level image features. In: Gama, J., Bradley, E., Hollmén, J. (eds.) IDA 2011. LNCS, vol. 7014, pp. 413–423. Springer, Heidelberg (2011). doi:10.​1007/​978-3-642-24800-9_​38 CrossRef
22.
go back to reference Zimmermann, P., et al.: Affective computing – a rationale for measuring mood with mouse and keyboard. Int. J. Occup. Saf. Ergon. 9(4), 539–551 (2003)CrossRef Zimmermann, P., et al.: Affective computing – a rationale for measuring mood with mouse and keyboard. Int. J. Occup. Saf. Ergon. 9(4), 539–551 (2003)CrossRef
Metadata
Title
Research on Image Emotional Semantic Retrieval Mechanism Based on Cognitive Quantification Model
Authors
Tian Liang
Liqun Zhang
Min Xie
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-58640-3_10