Skip to main content
Top

2020 | OriginalPaper | Chapter

Multi-label Quadruplet Dictionary Learning

Authors : Jiayu Zheng, Wencheng Zhu, Pengfei Zhu

Published in: Artificial Neural Networks and Machine Learning – ICANN 2020

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The explosion of the label space degrades the performance of the classic multi-class learning models. Label space dimension reduction (LSDR) is developed to reduce the dimension of the label space by learning a latent representation of both the feature space and label space. Almost all existing models adopt a two-step strategy, i.e., first learn the latent space, and then connect the feature space with the label space by the latent space. Additionally, the latent space lacks interpretability for LSDR. In this paper, motivated by cross-modal learning, we propose a novel one-step model, named Quadruplet Dictionary Learning (QDL), for multi-label classification with many labels. QDL models the latent space by the representation coefficients, which own preeminent recoverability, predictability and interpretability. By simultaneously learning two dictionary pairs, the feature space and label space are well bi-directly bridged and recovered by four dictionaries. Experiments on benchmark datasets show that QDL outperforms the state-of-the-art label space dimension reduction algorithms.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Balasubramanian, K., Lebanon, G.: The landmark selection method for multiple output prediction. In: ICML (2012) Balasubramanian, K., Lebanon, G.: The landmark selection method for multiple output prediction. In: ICML (2012)
2.
go back to reference Bhatia, K., Jain, H., Kar, P., Varma, M., Jain, P.: Sparse local embeddings for extreme multi-label classification. In: NIPS, pp. 730–738. Curran Associates, Inc. (2015) Bhatia, K., Jain, H., Kar, P., Varma, M., Jain, P.: Sparse local embeddings for extreme multi-label classification. In: NIPS, pp. 730–738. Curran Associates, Inc. (2015)
3.
go back to reference Bi, W., Kwok, J.T.Y.: Efficient multi-label classification with many labels. In: ICML, vol. 3, pp. 405–413 (2013) Bi, W., Kwok, J.T.Y.: Efficient multi-label classification with many labels. In: ICML, vol. 3, pp. 405–413 (2013)
4.
go back to reference Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends® Mach. Learn. 3(1), 1–122 (2011)MATH Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends® Mach. Learn. 3(1), 1–122 (2011)MATH
5.
go back to reference Chen, Y.N., Lin, H.T.: Feature-aware label space dimension reduction for multi-label classification. In: NIPS, pp. 1529–1537 (2012) Chen, Y.N., Lin, H.T.: Feature-aware label space dimension reduction for multi-label classification. In: NIPS, pp. 1529–1537 (2012)
6.
go back to reference Duygulu, P., Barnard, K., de Freitas, J.F., Forsyth, D.A.: Object recognition as machine translation: learning a lexicon for a fixed image vocabulary. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 97–112. Springer, Berlin, Heidelberg (2002). https://doi.org/10.1007/3-540-47979-1_7CrossRef Duygulu, P., Barnard, K., de Freitas, J.F., Forsyth, D.A.: Object recognition as machine translation: learning a lexicon for a fixed image vocabulary. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 97–112. Springer, Berlin, Heidelberg (2002). https://​doi.​org/​10.​1007/​3-540-47979-1_​7CrossRef
7.
go back to reference Fürnkranz, J., Hüllermeier, E., Mencía, E.L., Brinker, K.: Multilabel classification via calibrated label ranking. Mach. Learn. 73(2), 133–153 (2008)CrossRef Fürnkranz, J., Hüllermeier, E., Mencía, E.L., Brinker, K.: Multilabel classification via calibrated label ranking. Mach. Learn. 73(2), 133–153 (2008)CrossRef
8.
go back to reference Gorski, J., Pfeuffer, F., Klamroth, K.: Biconvex sets and optimization with biconvex functions: a survey and extensions. Math. Methods Oper. Res. 66(3), 373–407 (2007)MathSciNetMATHCrossRef Gorski, J., Pfeuffer, F., Klamroth, K.: Biconvex sets and optimization with biconvex functions: a survey and extensions. Math. Methods Oper. Res. 66(3), 373–407 (2007)MathSciNetMATHCrossRef
9.
go back to reference Guo, Y., Gu, S.: Multi-label classification using conditional dependency networks. In: IJCAI, pp. 1300–1305 (2011) Guo, Y., Gu, S.: Multi-label classification using conditional dependency networks. In: IJCAI, pp. 1300–1305 (2011)
10.
go back to reference Hsu, D., Kakade, S., Langford, J., Zhang, T.: Multi-label prediction via compressed sensing. NIPS 22, 772–780 (2009) Hsu, D., Kakade, S., Langford, J., Zhang, T.: Multi-label prediction via compressed sensing. NIPS 22, 772–780 (2009)
11.
go back to reference Huang, D.A., Frank Wang, Y.C.: Coupled dictionary and feature space learning with applications to cross-domain image synthesis and recognition. In: ICCV, pp. 2496–2503 (2013) Huang, D.A., Frank Wang, Y.C.: Coupled dictionary and feature space learning with applications to cross-domain image synthesis and recognition. In: ICCV, pp. 2496–2503 (2013)
12.
go back to reference Kang, F., Jin, R., Sukthankar, R.: Correlated label propagation with application to multi-label learning. In: CVPR, vol. 2, pp. 1719–1726. IEEE (2006) Kang, F., Jin, R., Sukthankar, R.: Correlated label propagation with application to multi-label learning. In: CVPR, vol. 2, pp. 1719–1726. IEEE (2006)
13.
go back to reference Katakis, I., Tsoumakas, G., Vlahavas, I.: Multilabel text classification for automated tag suggestion. In: ECML-PKDD, vol. 75 (2008) Katakis, I., Tsoumakas, G., Vlahavas, I.: Multilabel text classification for automated tag suggestion. In: ECML-PKDD, vol. 75 (2008)
14.
go back to reference Li, X., Guo, Y.: Multi-label classification with feature-aware non-linear label space transformation. In: IJCAI, pp. 3635–3642 (2015) Li, X., Guo, Y.: Multi-label classification with feature-aware non-linear label space transformation. In: IJCAI, pp. 3635–3642 (2015)
15.
go back to reference Lin, Z., Ding, G., Hu, M., Wang, J.: Multi-label classification via feature-aware implicit label space encoding. In: ICML, pp. 325–333 (2014) Lin, Z., Ding, G., Hu, M., Wang, J.: Multi-label classification via feature-aware implicit label space encoding. In: ICML, pp. 325–333 (2014)
17.
go back to reference Mandal, D., Biswas, S.: Generalized coupled dictionary learning approach with applications to cross-modal matching. TIP 25(8), 3826–3837 (2016)MathSciNetMATH Mandal, D., Biswas, S.: Generalized coupled dictionary learning approach with applications to cross-modal matching. TIP 25(8), 3826–3837 (2016)MathSciNetMATH
19.
go back to reference Schapire, R.E., Singer, Y.: Boostexter: a boosting-based system for text categorization. Mach. Learn. 39(2), 135–168 (2000)MATHCrossRef Schapire, R.E., Singer, Y.: Boostexter: a boosting-based system for text categorization. Mach. Learn. 39(2), 135–168 (2000)MATHCrossRef
20.
go back to reference Schietgat, L., Vens, C., Struyf, J., Blockeel, H., Kocev, D., Džeroski, S.: Predicting gene function using hierarchical multi-label decision tree ensembles. BMC Bioinf. 11(1), 1 (2010)MATHCrossRef Schietgat, L., Vens, C., Struyf, J., Blockeel, H., Kocev, D., Džeroski, S.: Predicting gene function using hierarchical multi-label decision tree ensembles. BMC Bioinf. 11(1), 1 (2010)MATHCrossRef
21.
go back to reference Snoek, C.G., Worring, M., Van Gemert, J.C., Geusebroek, J.M., Smeulders, A.W.: The challenge problem for automated detection of 101 semantic concepts in multimedia. In: ACM Multimedia, pp. 421–430. ACM (2006) Snoek, C.G., Worring, M., Van Gemert, J.C., Geusebroek, J.M., Smeulders, A.W.: The challenge problem for automated detection of 101 semantic concepts in multimedia. In: ACM Multimedia, pp. 421–430. ACM (2006)
22.
go back to reference Sun, L., Ji, S., Ye, J.: Canonical correlation analysis for multilabel classification: a least-squares formulation, extensions, and analysis. TPAMI 33(1), 194–200 (2011)CrossRef Sun, L., Ji, S., Ye, J.: Canonical correlation analysis for multilabel classification: a least-squares formulation, extensions, and analysis. TPAMI 33(1), 194–200 (2011)CrossRef
23.
25.
go back to reference Tsoumakas, G., Spyromitros-Xioufis, E., Vilcek, J., Vlahavas, I.: Mulan: a java library for multi-label learning. JMLR 12, 2411–2414 (2011)MathSciNetMATH Tsoumakas, G., Spyromitros-Xioufis, E., Vilcek, J., Vlahavas, I.: Mulan: a java library for multi-label learning. JMLR 12, 2411–2414 (2011)MathSciNetMATH
26.
go back to reference Von Ahn, L., Dabbish, L.: Labeling images with a computer game. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 319–326. ACM (2004) Von Ahn, L., Dabbish, L.: Labeling images with a computer game. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 319–326. ACM (2004)
27.
go back to reference Yang, J., Wang, Z., Lin, Z., Cohen, S., Huang, T.: Coupled dictionary training for image super-resolution. TIP 21(8), 3467–3478 (2012)MathSciNetMATH Yang, J., Wang, Z., Lin, Z., Cohen, S., Huang, T.: Coupled dictionary training for image super-resolution. TIP 21(8), 3467–3478 (2012)MathSciNetMATH
28.
go back to reference Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. TKDE 26(8), 1819–1837 (2014) Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. TKDE 26(8), 1819–1837 (2014)
Metadata
Title
Multi-label Quadruplet Dictionary Learning
Authors
Jiayu Zheng
Wencheng Zhu
Pengfei Zhu
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-61616-8_10

Premium Partner