Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 11/2023

12-06-2023 | Original Article

Label-dependent feature exploration for label distribution learning

Authors: Run-Ting Bai, Heng-Ru Zhang, Fan Min

Published in: International Journal of Machine Learning and Cybernetics | Issue 11/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Label distribution learning (LDL) explicitly models label ambiguity by assigning a real-valued vector with label description degrees to each sample. Most LDL methods only build models on the same feature (sub)space shared by all labels. However, they ignore that each label has its own specific features, and there are some common features among labels. In this paper, we propose a novel LDL (LDL-LDF) algorithm that aims to exploit both label-dependent and common features. First, label-dependent feature reconstruction utilizes thresholding for relevant sample subset identification, density peaks clustering for representative sample selection, and Euclidean distance for feature value calculation. Second, common feature reconstruction follows a similar approach, however, on the whole dataset. Finally, the prediction neural network is composed of several components that serve each label with label-dependent features, one component that serves all labels with common features, and the fusion component. The effectiveness and competitiveness of our algorithm are verified through various experiments comparing seven algorithms on fourteen real-world datasets.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Zhang M-L, Zhou Z-H (2013) A review on multi-label learning algorithms. IEEE Trans Knowl Data Eng 26(8):1819–1837CrossRef Zhang M-L, Zhou Z-H (2013) A review on multi-label learning algorithms. IEEE Trans Knowl Data Eng 26(8):1819–1837CrossRef
2.
go back to reference Gao B-B, Xing C, Xie C-W, Wu J-X, Geng X (2017) Deep label distribution learning with label ambiguity. IEEE Trans Imag Process 26(6):2825–2838MathSciNetCrossRefMATH Gao B-B, Xing C, Xie C-W, Wu J-X, Geng X (2017) Deep label distribution learning with label ambiguity. IEEE Trans Imag Process 26(6):2825–2838MathSciNetCrossRefMATH
3.
go back to reference Geng X, Smith-Miles K, Zhou Z-H ( 2010) Facial age estimation by learning from label distributions. In: AAAI, pp. 451– 456 Geng X, Smith-Miles K, Zhou Z-H ( 2010) Facial age estimation by learning from label distributions. In: AAAI, pp. 451– 456
4.
go back to reference Wen X, Li B, Guo H, Liu Z, Hu G, Tang M, Wang J ( 2020) Adaptive variance based label distribution learning for facial age estimation. In: ECCV, pp. 379– 395 Wen X, Li B, Guo H, Liu Z, Hu G, Tang M, Wang J ( 2020) Adaptive variance based label distribution learning for facial age estimation. In: ECCV, pp. 379– 395
5.
go back to reference Zhou Y, Xue H, Geng X ( 2015) Emotion distribution recognition from facial expressions. In: ACM MM, pp. 1247– 1250 Zhou Y, Xue H, Geng X ( 2015) Emotion distribution recognition from facial expressions. In: ACM MM, pp. 1247– 1250
6.
go back to reference Li S, Deng W (2019) Blended emotion in-the-wild: multi-label facial expression recognition using crowdsourced annotations and deep locality feature learning. Inter J Comput Vision 127(6):884–906CrossRef Li S, Deng W (2019) Blended emotion in-the-wild: multi-label facial expression recognition using crowdsourced annotations and deep locality feature learning. Inter J Comput Vision 127(6):884–906CrossRef
7.
go back to reference Geng X, Xia Y ( 2014) Head pose estimation based on multivariate label distribution. In: CVPR, pp. 1837– 1842 Geng X, Xia Y ( 2014) Head pose estimation based on multivariate label distribution. In: CVPR, pp. 1837– 1842
8.
go back to reference Zhang Z, Wang M, Geng X (2015) Crowd counting in public video surveillance by label distribution learning. Neurocomputing 166:151–163CrossRef Zhang Z, Wang M, Geng X (2015) Crowd counting in public video surveillance by label distribution learning. Neurocomputing 166:151–163CrossRef
9.
go back to reference Liang L, Lin L, Jin L, Xie D, Li M (2018) Scut-fbp5500: a diverse benchmark dataset for multi-paradigm facial beauty prediction. In: ICPR, pp. 1598– 1603 Liang L, Lin L, Jin L, Xie D, Li M (2018) Scut-fbp5500: a diverse benchmark dataset for multi-paradigm facial beauty prediction. In: ICPR, pp. 1598– 1603
10.
go back to reference Yang J, She D, Sun M ( 2017) Joint image emotion classification and distribution learning via deep nonvolutional neural network. In: IJCAI, pp. 3266– 3272 Yang J, She D, Sun M ( 2017) Joint image emotion classification and distribution learning via deep nonvolutional neural network. In: IJCAI, pp. 3266– 3272
11.
go back to reference Zhang M-L, Wu L (2014) Lift: Multi-label learning with label-specific features. IEEE Trans Pattern Anal Machine Intell 37(1):107–120CrossRef Zhang M-L, Wu L (2014) Lift: Multi-label learning with label-specific features. IEEE Trans Pattern Anal Machine Intell 37(1):107–120CrossRef
12.
go back to reference Xu N, Liu Y-P, Geng X (2019) Label enhancement for label distribution learning. IEEE Trans Knowl Data Eng 33(4):1632–1643CrossRef Xu N, Liu Y-P, Geng X (2019) Label enhancement for label distribution learning. IEEE Trans Knowl Data Eng 33(4):1632–1643CrossRef
13.
go back to reference Xu N, Lv J, Geng X (2019) Partial label learning via label enhancement. AAAI 33:5557–5564CrossRef Xu N, Lv J, Geng X (2019) Partial label learning via label enhancement. AAAI 33:5557–5564CrossRef
14.
go back to reference Gao Y, Wang K, Geng X (2022) Sequential label enhancement. IEEE Transactions on Neural Networks and Learning Systems Gao Y, Wang K, Geng X (2022) Sequential label enhancement. IEEE Transactions on Neural Networks and Learning Systems
15.
go back to reference Du G, Zhang J, Jiang M, Long J, Lin Y, Li S, Tan KC (2021) Graph-based class-imbalance learning with label enhancement. IEEE Transactions on Neural Networks and Learning Systems Du G, Zhang J, Jiang M, Long J, Lin Y, Li S, Tan KC (2021) Graph-based class-imbalance learning with label enhancement. IEEE Transactions on Neural Networks and Learning Systems
16.
go back to reference Geng X (2016) Label distribution learning. IEEE Trans Knowl Data Eng 28(7):1734–1748CrossRef Geng X (2016) Label distribution learning. IEEE Trans Knowl Data Eng 28(7):1734–1748CrossRef
17.
go back to reference Xing C, Geng X, Xue H (2016) Logistic boosting regression for label distribution learning. In: CVPR, pp. 4489– 4497 Xing C, Geng X, Xue H (2016) Logistic boosting regression for label distribution learning. In: CVPR, pp. 4489– 4497
18.
go back to reference Shen W, Zhao K, Guo Y, Yuille AL (2017) Label distribution learning forests. Advances in Neural Information Processing Systems 30 Shen W, Zhao K, Guo Y, Yuille AL (2017) Label distribution learning forests. Advances in Neural Information Processing Systems 30
19.
go back to reference Jia X, Zheng X, Li W, Zhang C, Li Z (2019) Facial emotion distribution learning by exploiting low-rank label correlations locally. In: CVPR, pp. 9841– 9850 Jia X, Zheng X, Li W, Zhang C, Li Z (2019) Facial emotion distribution learning by exploiting low-rank label correlations locally. In: CVPR, pp. 9841– 9850
20.
go back to reference Xu S, Shang L, Shen F (2019) Latent semantics encoding for label distribution learning. In: IJCAI, pp. 3982– 3988 Xu S, Shang L, Shen F (2019) Latent semantics encoding for label distribution learning. In: IJCAI, pp. 3982– 3988
21.
go back to reference Zheng X, Jia X, Li W (2018) Label distribution learning by exploiting sample correlations locally. In: AAAI, pp. 4556– 4563 Zheng X, Jia X, Li W (2018) Label distribution learning by exploiting sample correlations locally. In: AAAI, pp. 4556– 4563
22.
go back to reference Jia X, Li W, Liu J-Y, Zhang Y (2018) Label distribution learning by exploiting label correlations. In: AAAI, pp. 3310– 3317 Jia X, Li W, Liu J-Y, Zhang Y (2018) Label distribution learning by exploiting label correlations. In: AAAI, pp. 3310– 3317
23.
go back to reference Ren T, Jia X, Li W, Chen L, Li Z (2019) Label distribution learning with label-specific features. In: IJCAI, pp. 3318– 3324 Ren T, Jia X, Li W, Chen L, Li Z (2019) Label distribution learning with label-specific features. In: IJCAI, pp. 3318– 3324
24.
go back to reference Huang J, Li G, Huang Q, Wu X (2015) Learning label specific features for multi-label classification. In: ICDM, pp. 181– 190 Huang J, Li G, Huang Q, Wu X (2015) Learning label specific features for multi-label classification. In: ICDM, pp. 181– 190
25.
go back to reference Zhang J, Li C, Cao D, Lin Y, Su S, Dai L, Li S (2018) Multi-label learning with label-specific features by resolving label correlations. Knowl-Based Syst 159:148–157CrossRef Zhang J, Li C, Cao D, Lin Y, Su S, Dai L, Li S (2018) Multi-label learning with label-specific features by resolving label correlations. Knowl-Based Syst 159:148–157CrossRef
26.
go back to reference Lin Y, Liu H, Zhao H, Hu Q, Zhu X, Wu X (2022) Hierarchical feature selection based on label distribution learning. IEEE Transactions on Knowledge and Data Engineering Lin Y, Liu H, Zhao H, Hu Q, Zhu X, Wu X (2022) Hierarchical feature selection based on label distribution learning. IEEE Transactions on Knowledge and Data Engineering
27.
go back to reference Rodriguez A, Laio A (2014) Clustering by fast search and find of density peaks. Science 344(6191):1492–1496CrossRef Rodriguez A, Laio A (2014) Clustering by fast search and find of density peaks. Science 344(6191):1492–1496CrossRef
28.
go back to reference Eisen MB, Spellman PT, Brown PO, Botstein D (1998) Cluster analysis and display of genome-wide expression patterns. Proceed Nat Acad Sci 95(25):14863–14868CrossRef Eisen MB, Spellman PT, Brown PO, Botstein D (1998) Cluster analysis and display of genome-wide expression patterns. Proceed Nat Acad Sci 95(25):14863–14868CrossRef
29.
go back to reference Peng K-C, Chen T, Sadovnik A, Gallagher AC ( 2015) A mixed bag of emotions: model, predict, and transfer emotion distributions. In: CVPR, pp. 860– 868 Peng K-C, Chen T, Sadovnik A, Gallagher AC ( 2015) A mixed bag of emotions: model, predict, and transfer emotion distributions. In: CVPR, pp. 860– 868
30.
go back to reference Yu J-F, Jiang D-K, Xiao K, Jin Y, Wang J-H, Sun X (2012) Discriminate the falsely predicted protein-coding genes in aeropyrum pernix k1 genome based on graphical representation. Match-Commun Mathe Comput Chem 67(3):845–866MathSciNet Yu J-F, Jiang D-K, Xiao K, Jin Y, Wang J-H, Sun X (2012) Discriminate the falsely predicted protein-coding genes in aeropyrum pernix k1 genome based on graphical representation. Match-Commun Mathe Comput Chem 67(3):845–866MathSciNet
31.
go back to reference Zhang H-R, Huang Y-T, Xu Y-Y, Min F (2020) COS-LDL: Label distribution learning by cosine-based distance-mapping correlation. IEEE Access 8:63961–63970CrossRef Zhang H-R, Huang Y-T, Xu Y-Y, Min F (2020) COS-LDL: Label distribution learning by cosine-based distance-mapping correlation. IEEE Access 8:63961–63970CrossRef
32.
go back to reference Jia X, Ren T, Chen L, Wang J, Zhu J, Long X (2019) Weakly supervised label distribution learning based on transductive matrix completion with sample correlations. Pattern Recognit Lett 125:453–462CrossRef Jia X, Ren T, Chen L, Wang J, Zhu J, Long X (2019) Weakly supervised label distribution learning based on transductive matrix completion with sample correlations. Pattern Recognit Lett 125:453–462CrossRef
33.
go back to reference Jia X, Li Z, Zheng X, Li W, Huang S-J (2021) Label distribution learning with label correlations on local samples. IEEE Trans Knowl Data Eng 33(04):1619–1631CrossRef Jia X, Li Z, Zheng X, Li W, Huang S-J (2021) Label distribution learning with label correlations on local samples. IEEE Trans Knowl Data Eng 33(04):1619–1631CrossRef
34.
go back to reference Wang J, Geng X (2021) Label distribution learning by exploiting label distribution manifold. IEEE Trans Neural Netw Learn Syst 01:1–14 Wang J, Geng X (2021) Label distribution learning by exploiting label distribution manifold. IEEE Trans Neural Netw Learn Syst 01:1–14
35.
go back to reference Wang J , Geng X ( 2021) Learn the highest label and rest label description degrees. In: IJCAI, pp. 3097– 3103 Wang J , Geng X ( 2021) Learn the highest label and rest label description degrees. In: IJCAI, pp. 3097– 3103
36.
37.
go back to reference Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Machine Learn Res 7:1–30MathSciNetMATH Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Machine Learn Res 7:1–30MathSciNetMATH
38.
go back to reference Li J, Huang C, Qi J, Qian Y, Liu W (2017) Three-way cognitive concept learning via multi-granularity. Inform Sci 378:244–263CrossRefMATH Li J, Huang C, Qi J, Qian Y, Liu W (2017) Three-way cognitive concept learning via multi-granularity. Inform Sci 378:244–263CrossRefMATH
39.
go back to reference Qian Y, Liang J, Wu W-Z, Dang C (2010) Information granularity in fuzzy binary grc model. IEEE Trans Fuzzy Syst 19(2):253–264CrossRef Qian Y, Liang J, Wu W-Z, Dang C (2010) Information granularity in fuzzy binary grc model. IEEE Trans Fuzzy Syst 19(2):253–264CrossRef
40.
go back to reference Jia X, Lu Y, Zhang F (2021) Label enhancement by maintaining positive and negative label relation. IEEE Trans Knowledge Data Eng 1(1):1–1 Jia X, Lu Y, Zhang F (2021) Label enhancement by maintaining positive and negative label relation. IEEE Trans Knowledge Data Eng 1(1):1–1
Metadata
Title
Label-dependent feature exploration for label distribution learning
Authors
Run-Ting Bai
Heng-Ru Zhang
Fan Min
Publication date
12-06-2023
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 11/2023
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-023-01858-x

Other articles of this Issue 11/2023

International Journal of Machine Learning and Cybernetics 11/2023 Go to the issue