Top

Cognitive Computation

Published in:

07-03-2019

Discriminant Zero-Shot Learning with Center Loss

Authors: Xiao-Bo Jin, Guo-Sen Xie, Kaizhu Huang, Heling Cao, Qiu-Feng Wang

Published in: Cognitive Computation | Issue 4/2019

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Current work on zero-shot learning (ZSL) generally does not focus on the discriminative ability of the models, which is important for differentiating between classes since our brain focuses on the discriminating part of the object to classify it. For generalized ZSL (GZSL), the fact that the outputs of the model are not comparable leads to a degraded performance. We propose a new ZSL method with a center loss to make the instances from the same class more compact by extracting their discriminative parts. Further, we introduce a varying learning rate to accelerate the model selection process. We also demonstrate how to boost the performance of GZSL by rectifying the outputs of the model to make the outputs be comparable. Experimental results on four benchmarks, including SUN, CUB, AWA2, and aPY, demonstrate the superiority of the proposed method, therein achieving state-of-the-art performance.

previous article Cognitively Inspired Feature Extraction and Speech Recognition for Automated Hearing Loss Testing

next article Multi-Granulation-Based Graphical Analytics of Three-Way Bipolar Neutrosophic Contexts

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Akata Z, Perronnin F, Harchaoui Z, Schmid C. 2013. Label-Embedding for attribute-based classification. In: 2013 IEEE Conference on computer vision and pattern recognition, p. 819–826.

Akata Z, Perronnin F, Harchaoui Z, Schmid C. Label-Embedding for image classification. IEEE Trans Pattern Anal Mach Intell 2016;38(7):1425–38.CrossRefPubMed

Akata Z, Reed S, Walter D, Lee H, Schiele B. 2015. Evaluation of output embeddings for fine-grained image classification. In: CVPR 2016, p. 2927–2936.

Ba JL, Swersky K, Fidler S, Salakhutdinov R. 2015. Predicting deep zero-shot convolutional neural networks using textual descriptions. In: ICCV 2015. p. 4247–4255.

Bergstra J, Bengio Y. Random search for hyper-parameter optimization. J Mach Learn Res 2012;13:281–305.

Bucher M, Herbin S, Jurie F. 2016. Improving semantic embedding consistency by metric learning for zero-Shot classiffication. In: ECCV 2016, Lecture Notes in Computer Science. Springer International Publishing, p. 730–746.

Changpinyo S, Chao W-L, Gong B, Sha F. 2016. Synthesized Classifiers for Zero-Shot. Learning, p. 5327–5336.

Changpinyo S, Chao W-L, Sha F. 2016. Predicting visual exemplars of unseen classes for zero-Shot learning. In: ICCV 2017.

Chao W-L, Changpinyo S, Gong B, Sha F. 2016. An empirical study and analysis of generalized zero-Shot learning for object recognition in the wild. In: ECCV 2016.

10.

Frome A, Corrado GS, Shlens J, Bengio S, Dean J, Marc’Aurelio R, Mikolov T. 2013. DeviSE A Deep visual-Semantic Embedding Model. In: Advances in neural information processing systems 26, p. 2121–2129.

11.

Jayaraman D, Grauman K. 2014. Zero-shot recognition with unreliable attributes. In: Advances in neural information processing systems, p. 3464–3472.

12.

Jiang H, Wang R, Shan S, Yang Y, Chen X. 2017. Learning discriminative latent attributes for zero-Shot classification. In: 2017 IEEE international conference on computer vision (ICCV), p. 4233–4242.

13.

Jin X-B, Geng G-G, Xie G-S, Huang K. Approximately optimizing NDCG using pair-wise loss. Inf Sci 2018;453:50–65.CrossRef

14.

Jin X-B, Xie G-S, Huang K, Hussain A. 2018. Accelerating infinite ensemble of clustering by pivot features. Cognitive Computation, p. 1–9.

15.

Jin X-B, Zhang X-Y, Huang K, Geng G-G. 2017. Stochastic Conjugate Gradient Algorithm with Variance Reduction. arXiv:1710.09979.

16.

Kodirov E, Xiang T, Gong S. 2017. Semantic autoencoder for zero-Shot learning. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR), p. 4447–4456.

17.

Kodirov E, Xiang T, Fu Z, Gong S. 2015. Unsupervised domain adaptation for zero-Shot learning. In: ICCV 2015, p. 2452–2460.

18.

Lampert CH, Nickisch H, Harmeling S. Attribute-based classification for zero-Shot visual object categorization. IEEE Trans Pattern Anal Mach Intell 2014;36(3):453– 65.CrossRefPubMed

19.

Lampert CH, Nickisch H, Harmeling S. 2009. Learning to detect unseen object classes by between-class attribute transfer. In: 2009. CVPR 2009. IEEE conference on Computer vision and pattern recognition. IEEE, p. 951–958.

20.

Li Y, Zhang J, Xhang J, Huang K. 2018. Discriminative learning of latent features for zero-Shot recognition.

21.

Loshchilov I, Hutter F. 2017. SGDR Stochastic gradient descent with warm restarts. In: ICLR 2017.

22.

Norouzi M, Mikolov T, Bengio S, Singer Y, Shlens J, Frome A, Corrado GS, Jeffrey D. 2013. Zero-Shot learning by convex combination of semantic embeddings. In: ICLR 2014.

23.

Palatucci M, Pomerleau D, Hinton GE, Mitchell TM. Zero-shot Learning with Semantic Output Codes. Advances in Neural Information Processing Systems. In: Bengio Y, Schuurmans D, Lafferty JD, Williams CKI, and Culotta A, editors; 2009. p. 1410– 1418.

24.

Peng P, Tian Y, Xiang T, Wang Y, Huang T. 2016. Joint learning of semantic and latent attributes. In: European conference on computer vision. Springer. p. 336–353.

25.

Romera-Paredes B, Torr PHS. 2015. An Embarrassingly Simple Approach to Zero-shot Learning. In: ICML, ICML’15, Lille, p. 2152–2161. JMLR.org.

26.

Scheirer WJ, de Rezende Rocha A, Sapkota A, Boult TE. Toward open set recognition. IEEE Trans Pattern Anal Mach Intell 2013;35(7):1757–72.CrossRefPubMed

27.

Shigeto Y, Suzuki I, Hara K, Shimbo M, Matsumoto Y. Ridge Regression, Hubness, and Zero-Shot Learning. ECML PKDD 2015, Lecture Notes in Computer Science. In: Appice A, Rodrigues PP, Costa VS, Soares C, Gama J, and Jorge A, editors. Springer; 2015. p. 135–151.

28.

Socher R, Ganjoo M, Manning CD, Ng AY. 2013. Zero-shot learning through cross-modal transfer. In: Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 1, NIPS’13, p. 935–943, USA.

29.

Spratling MW. A hierarchical predictive coding model of object recognition in natural images. Cogn Comput 2017;9(2):151– 67.CrossRef

30.

Wen Y, Zhang K, Li Z, Qiao Y. A discriminative feature learning approach for deep face recognition. Computer Vision – ECCV Lecture Notes in Computer Science. In: Leibe, B, Matas, J, Sebe, N, and Welling, M, editors. Springer International Publishing; 2016. p. 2016.

31.

Xian Y, Akata Z, Sharma G, Nguyen Q, Hein M, Schiele B. 2016. Latent Embeddings for Zero-shot Classification. In: CVPR 2016.

32.

Xian Y, Schiele B, Akata Z. 2017. Zero-Shot Learning - The Good, the Bad and the Ugly. In: CVPR 2017, arXiv:1703.04394.

33.

Xie J, Yu L, Zhu L, Chen X. Semantic image segmentation method with multiple adjacency trees and multiscale features. Cogn Comput 2017;9(2):168–79.CrossRef

34.

Yang FSY, Zhang L, Xiang T, Torr PHS, Hospedales TM. 2018. Learning to compare: Relation network for few-shot learning.

35.

Zhang L, Xiang T, Gong S. 2017. Learning a deep embedding model for zero-Shot learning. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR), p. 3010–3019.

36.

Zhang Z, Saligrama V. 2015. Zero-Shot learning via semantic similarity embedding. In: ICCV 2015. p. 4166–4174.

37.

Zhang Ziming, Saligrama V. 2016. Zero-Shot Learning via Joint Latent Similarity Embedding, p. 6034–6042.

38.

Zhong G, Zheng Y, Zhang X-Y, Wei H, Ling X. 2018. Convolutional discriminant analysis. In: ICPR 2018, p. 6.

Title: Discriminant Zero-Shot Learning with Center Loss
Authors: Xiao-Bo Jin
Guo-Sen Xie
Kaizhu Huang
Heling Cao
Qiu-Feng Wang
Publication date: 07-03-2019
Publisher: Springer US
Published in: Cognitive Computation / Issue 4/2019
Print ISSN: 1866-9956
Electronic ISSN: 1866-9964
DOI: https://doi.org/10.1007/s12559-019-09629-z

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 4/2019

ReUS: a Real-time Unsupervised System For Monitoring Opinion Streams

Cognitively Inspired Feature Extraction and Speech Recognition for Automated Hearing Loss Testing

Facial Expression Recognition Based on a Hybrid Model Combining Deep and Shallow Features

Improving User Attribute Classification with Text and Social Network Attention

A Handwriting-Based Protocol for Assessing Neurodegenerative Dementia

Multi-Region Risk-Sensitive Cognitive Ensembler for Accurate Detection of Attention-Deficit/Hyperactivity Disorder

Premium Partner