Skip to main content
Top
Published in:
Cover of the book

2011 | OriginalPaper | Chapter

Quantifying Visual-Representativeness of Social Image Tags Using Image Tag Clarity

Authors : Aixin Sun, Sourav S. Bhowmick

Published in: Social Media Modeling and Computing

Publisher: Springer London

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Tags associated with images in various social media sharing web sites are valuable information source for superior image retrieval experiences. Due to the nature of tagging, many tags associated with images are not visually descriptive. In this chapter, we propose Image Tag Clarity to evaluate the effectiveness of a tag in describing the visual content of its annotated images, which is also known as the image tag visual-representativeness. It is measured by computing the zero-mean normalized distance between the tag language model estimated from the images annotated by the tag and the collection language model. The tag/collection language models are derived from the bag of visual-word local content features of the images. The visual-representative tags that are commonly used to annotate visually similar images are given high tag clarity scores. Evaluated on a large real-world dataset containing more than 269K images and their associated tags, we show that the image tag clarity score can effectively identify the visual-representative tags from all tags contributed by users. Based on the tag clarity scores, we have made a few interesting observations that could be used to support many tag-based applications.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
2
Nevertheless, we believe that the image tag clarity score is generic and can be computed using other feature representations.
 
3
Recall that both τ(t) and τ(t′) are computed purely from visual content features of their tagged images.
 
4
Note that the way we bin the tag frequencies and the number of dummy tags used for estimation of the expected tag clarity scores and their standard deviations are different from that in [11]. This leads to differences in the normalized tag clarity scores reported in Sects. 4 and 5.
 
6
The number reported here is slightly different from that reported in [1] probably due to different pre-processing. Nevertheless, the tag distribution remains similar.
 
7
One image may be annotated by multiple visual or non-visual tags, respectively.
 
Literature
1.
go back to reference Chua, T.-S., Tang, J., Hong, R., Li, H., Luo, Z., Zheng, Y.-T.: Nus-wide: A real-world web image database from National University of Singapore. In: Proc. of ACM CIVR, Santorini, Greece, July 2009 Chua, T.-S., Tang, J., Hong, R., Li, H., Luo, Z., Zheng, Y.-T.: Nus-wide: A real-world web image database from National University of Singapore. In: Proc. of ACM CIVR, Santorini, Greece, July 2009
2.
go back to reference Cronen-Townsend, S., Zhou, Y., Croft, W.B.: Predicting query performance. In: Proc. of SIGIR, Tampere, Finland, pp. 299–306 (2002) Cronen-Townsend, S., Zhou, Y., Croft, W.B.: Predicting query performance. In: Proc. of SIGIR, Tampere, Finland, pp. 299–306 (2002)
3.
go back to reference Elsas, J.L., Arguello, J., Callan, J., Carbonell, J.G.: Retrieval and feedback models for blog feed search. In: Proc. of SIGIR, Singapore, pp. 347–354 (2008) CrossRef Elsas, J.L., Arguello, J., Callan, J., Carbonell, J.G.: Retrieval and feedback models for blog feed search. In: Proc. of SIGIR, Singapore, pp. 347–354 (2008) CrossRef
4.
go back to reference Golder, S.A., Huberman, B.A.: Usage patterns of collaborative tagging systems. J. Inf. Sci. 32(2), 198–208 (2006) CrossRef Golder, S.A., Huberman, B.A.: Usage patterns of collaborative tagging systems. J. Inf. Sci. 32(2), 198–208 (2006) CrossRef
5.
go back to reference Hauff, C., Murdock, V., Baeza-Yates, R.: Improved query difficulty prediction for the web. In: Proc. of CIKM, Napa Valley, CA, pp. 439–448 (2008) CrossRef Hauff, C., Murdock, V., Baeza-Yates, R.: Improved query difficulty prediction for the web. In: Proc. of CIKM, Napa Valley, CA, pp. 439–448 (2008) CrossRef
6.
go back to reference Knorr, E.M., Ng, R.T.: Algorithms for mining distance-based outliers in large datasets. In: Proc. of VLDB, pp. 392–403. Morgan Kaufmann, San Mateo (1998) Knorr, E.M., Ng, R.T.: Algorithms for mining distance-based outliers in large datasets. In: Proc. of VLDB, pp. 392–403. Morgan Kaufmann, San Mateo (1998)
7.
go back to reference Li, X., Snoek, C.G.M., Worring, M.: Learning tag relevance by neighbor voting for social image retrieval. In: Proc. of MIR, pp. 180–187 (2008) CrossRef Li, X., Snoek, C.G.M., Worring, M.: Learning tag relevance by neighbor voting for social image retrieval. In: Proc. of MIR, pp. 180–187 (2008) CrossRef
8.
go back to reference Liu, D., Hua, X.-S., Yang, L., Wang, M., Zhang, H.-J.: Tag ranking. In: Proc. WWW, Madrid, Spain, pp. 351–360 (2009) CrossRef Liu, D., Hua, X.-S., Yang, L., Wang, M., Zhang, H.-J.: Tag ranking. In: Proc. WWW, Madrid, Spain, pp. 351–360 (2009) CrossRef
9.
go back to reference Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004) CrossRef Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004) CrossRef
10.
go back to reference Lu, Y., Zhang, L., Tian, Q., Ma, W.-Y.: What are the high-level concepts with small semantic gaps. In: Proc. of CVPR, Alaska, USA (2008) Lu, Y., Zhang, L., Tian, Q., Ma, W.-Y.: What are the high-level concepts with small semantic gaps. In: Proc. of CVPR, Alaska, USA (2008)
11.
go back to reference Sun, A., Bhowmick, S.S.: Image tag clarity: In search of visual-representative tags for social images. In: Proc. of ACM SIGMM Workshop on Social Media (WSM) with ACM Multimedia, Beijing, China, Oct 2009 Sun, A., Bhowmick, S.S.: Image tag clarity: In search of visual-representative tags for social images. In: Proc. of ACM SIGMM Workshop on Social Media (WSM) with ACM Multimedia, Beijing, China, Oct 2009
12.
go back to reference Sun, A., Bhowmick, S.S.: Quantifying tag representativeness of visual content of social images. In: Proc. of ACM Multimedia (MM), Firenze, Italy, Oct 2010 Sun, A., Bhowmick, S.S.: Quantifying tag representativeness of visual content of social images. In: Proc. of ACM Multimedia (MM), Firenze, Italy, Oct 2010
13.
go back to reference Sun, A., Datta, A.: On stability, clarity, and co-occurrence of self-tagging. In: Proc. of ACM WSDM (Late Breaking-Results) (2009) Sun, A., Datta, A.: On stability, clarity, and co-occurrence of self-tagging. In: Proc. of ACM WSDM (Late Breaking-Results) (2009)
14.
go back to reference Sun, A., Bhowmick, S.S., Liu, Y.: iavatar: An interactive tool for finding and visualizing visual-representative tags in image search. In: Proceedings of the VLDB Endowment (PVLDB) 3(2), Sep 2010 Sun, A., Bhowmick, S.S., Liu, Y.: iavatar: An interactive tool for finding and visualizing visual-representative tags in image search. In: Proceedings of the VLDB Endowment (PVLDB) 3(2), Sep 2010
15.
go back to reference Teevan, J., Dumais, S.T., Liebling, D.J.: To personalize or not to personalize: modeling queries with variation in user intent. In: Proc. of SIGIR, Singapore, pp. 163–170 (2008) CrossRef Teevan, J., Dumais, S.T., Liebling, D.J.: To personalize or not to personalize: modeling queries with variation in user intent. In: Proc. of SIGIR, Singapore, pp. 163–170 (2008) CrossRef
16.
go back to reference Weinberger, K., Slaney, M., van Zwol, R.: Resolving tag ambiguity. In: Proc. of ACM Multimedia (MM), Vancouver, Canada (2008) Weinberger, K., Slaney, M., van Zwol, R.: Resolving tag ambiguity. In: Proc. of ACM Multimedia (MM), Vancouver, Canada (2008)
17.
go back to reference Wu, L., Hua, X.-S., Yu, N., Ma, W.-Y., Li, S.: Flickr distance. In: Proc. of ACM Multimedia (MM), Vancouver, Canada, pp. 31–40 (2008) Wu, L., Hua, X.-S., Yu, N., Ma, W.-Y., Li, S.: Flickr distance. In: Proc. of ACM Multimedia (MM), Vancouver, Canada, pp. 31–40 (2008)
18.
go back to reference Wu, L., Yang, L., Yu, N., Hua, X.-S.: Learning to tag. In: Proc. WWW, Madrid, Spain, pp. 361–370 (2009) CrossRef Wu, L., Yang, L., Yu, N., Hua, X.-S.: Learning to tag. In: Proc. WWW, Madrid, Spain, pp. 361–370 (2009) CrossRef
19.
go back to reference Yom-Tov, E., Fine, S., Carmel, D., Darlow, A.: Learning to estimate query difficulty: including applications to missing content detection and distributed information retrieval. In: Proc. of SIGIR, Salvador, Brazil, pp. 512–519 (2005) Yom-Tov, E., Fine, S., Carmel, D., Darlow, A.: Learning to estimate query difficulty: including applications to missing content detection and distributed information retrieval. In: Proc. of SIGIR, Salvador, Brazil, pp. 512–519 (2005)
20.
go back to reference Zhou, Y., Croft, W.B.: Query performance prediction in web search environments. In: Proc. of SIGIR, Amsterdam, pp. 543–550 (2007) Zhou, Y., Croft, W.B.: Query performance prediction in web search environments. In: Proc. of SIGIR, Amsterdam, pp. 543–550 (2007)
Metadata
Title
Quantifying Visual-Representativeness of Social Image Tags Using Image Tag Clarity
Authors
Aixin Sun
Sourav S. Bhowmick
Copyright Year
2011
Publisher
Springer London
DOI
https://doi.org/10.1007/978-0-85729-436-4_1

Premium Partner