Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Visual Tracking by Local Superpixel Matching with Markov Random Field Read chapter Read first chapter

2016 | OriginalPaper | Chapter

Automatic Image Annotation Using Adaptive Weighted Distance in Improved K Nearest Neighbors Framework

Authors : Jiancheng Li, Chun Yuan

Published in: Advances in Multimedia Information Processing - PCM 2016

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Automatic image annotation is a challenging problem due to the label-image-matching, label-imbalance and label-missing problems. Some research tried to address part of these problems but didn’t integrate them. In this paper, an adaptive weighted distance method which incorporates the CNN (convolutional neural network) feature and multiple handcrafted features is proposed to handle the label-image-matching and label-imbalance issues, while the K nearest neighbors framework is improved by using the neighborhood with all labels which can reduce the effects of the label-missing problem. Finally, experiments on three benchmark datasets (Corel-5k, ESP-Game and IAPRTC-12) for image annotation are performed, and the results show that our approach is competitive to the state-of-the-art methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Prototyping Methodology with Motion Estimation Algorithm
next chapter One-Shot-Learning Gesture Segmentation and Recognition Using Frame-Based PDV Features
Literature
1.
Carneiro, G., Chan, A.B., Moreno, P.J., Vasconcelos, N.: Supervised learning of semantic classes for image annotation and retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 29(3), 394–410 (2007)CrossRef
2.
Chen, M., Zheng, A., Weinberger, K.: Fast image tagging. In: Proceedings of the 30th International Conference on Machine Learning, pp. 1274–1282 (2013)
3.
Duygulu, P., Barnard, K., Freitas, J.F.G., Forsyth, D.A.: Object recognition as machine translation: learning a lexicon for a fixed image vocabulary. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 97–112. Springer, Heidelberg (2002). doi:10.​1007/​3-540-47979-1_​7 CrossRef
4.
Feng, S., Manmatha, R., Lavrenko, V.: Multiple Bernoulli relevance models for image and video annotation. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, vol. 2, pp. II:1002–II:1009. IEEE (2004)
5.
Gong, Y., Jia, Y., Leung, T., Toshev, A., Ioffe, S.: Deep convolutional ranking for multilabel image annotation. arXiv:​1312.​4894 (2013)
6.
Gu, Y., Qian, X., Li, Q., Wang, M., Hong, R., Tian, Q.: Image annotation by latent community detection and multikernel learning. IEEE Trans. Image Process. 24(11), 3450–3463 (2015)MathSciNetCrossRef
7.
Guillaumin, M., Mensink, T., Verbeek, J., Schmid, C.: TagProp: discriminative metric learning in nearest neighbor models for image auto-annotation. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 309–316. IEEE (2009)
8.
He, Y., Wang, J., Kang, C., Xiang, S., Pan, C.: Large scale image annotation via deep representation learning and tag embedding learning. In: Proceedings of the 5th ACM on International Conference on Multimedia Retrieval, pp. 523–526. ACM (2015)
9.
Kalayeh, M.M., Idrees, H., Shah, M.: NMF-KNN: Image annotation using weighted multi-view non-negative matrix factorization. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 184–191. IEEE (2014)
10.
Liu, W., Tao, D.: Multiview Hessian regularization for image annotation. IEEE Trans. Image Process. 22(7), 2676–2687 (2013)MathSciNetCrossRef
11.
12.
Murthy, V.N., Maji, S., Manmatha, R.: Automatic image annotation using deep learning representations. In: Proceedings of the 5th ACM on International Conference on Multimedia Retrieval, pp. 603–606. ACM (2015)
13.
Oliva, A., Torralba, A.: Modeling the shape of the scene: a holistic representation of the spatial envelope. Int. J. Comput. Vis. 42(3), 145–175 (2001)CrossRefMATH
14.
Schroff, F., Kalenichenko, D., Philbin, J.: FaceNet: a unified embedding for face recognition and clustering. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 815–823 (2015)
15.
16.
Su, F., Xue, L.: Graph learning on k nearest neighbours for automatic image annotation. In: Proceedings of the 5th ACM on International Conference on Multimedia Retrieval, pp. 403–410. ACM (2015)
17.
Tariq, A., Foroosh, H.: Feature-independent context estimation for automatic image annotation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1958–1965 (2015)
18.
de Weijer, J., Schmid, C.: Coloring local feature extraction. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 334–348. Springer, Heidelberg (2006). doi:10.​1007/​11744047_​26 CrossRef
19.
Verma, Y., Jawahar, C.V.: Image annotation using metric learning in semantic neighbourhoods. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7578, pp. 836–849. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-33712-3_​60 CrossRef
20.
Von Ahn, L., Dabbish, L.: Labeling images with a computer game. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 319–326. ACM (2004)
21.
Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 818–833. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-10590-1_​53
Metadata
Title
Automatic Image Annotation Using Adaptive Weighted Distance in Improved K Nearest Neighbors Framework
Authors
Jiancheng Li
Chun Yuan
Copyright Year
2016
Book
Advances in Multimedia Information Processing - PCM 2016

Print ISBN: 978-3-319-48889-9

Electronic ISBN: 978-3-319-48890-5

Copyright Year: 2016

DOI
https://doi.org/10.1007/978-3-319-48890-5_34