Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 4/2022

13-10-2021 | Original Article

Multi-label space reshape for semantic-rich label-specific features learning

Authors: Yusheng Cheng, Chao Zhang, Shufang Pang

Published in: International Journal of Machine Learning and Cybernetics | Issue 4/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Existing label-specific features learning techniques mainly use embedding-based researching methods. However, there exist many problems such as inadequate consideration of label semantics, the sparseness of selected features and so on. Herein, the LSR-LSF (multi-label space reshape for semantic-rich label-specific features learning) algorithm is proposed in this paper to solve these problems. Firstly, the sparse logical matrix is constructed into a numerical label matrix through the label propagation dependency matrix. Secondly, constraint propagation is added to avoid the differences that may exist in the label matrix before or after the reshaping process. The alternate iteration method is used to obtain the numerical label vector. At the same time, the reshaped label correlation matrix is constructed by the cosine similarity to constrain the solution space. Then, measuring whether the learning ability of label-specific features has been improved. Finally, extensive experiments on benchmark datasets show the superiority of LSR-LSF over other state-of-the-art label-specific features learning methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Yang D, Qiu NJ, Cong L, Yang HM (2019) Research on multi-channel semantic fusion classification model. J Adv Comput Intell Intell Inform 23(6):1044CrossRef Yang D, Qiu NJ, Cong L, Yang HM (2019) Research on multi-channel semantic fusion classification model. J Adv Comput Intell Intell Inform 23(6):1044CrossRef
2.
go back to reference Chen M, Hao Y, Gharavi H (2019) Cognitive information measurements: a new perspective. Inf Sci 505:487–497 Chen M, Hao Y, Gharavi H (2019) Cognitive information measurements: a new perspective. Inf Sci 505:487–497
3.
go back to reference Kumar V, Pujari AK, Padmanabhan V (2019) Group preserving label embedding for multi-label classification. Pattern Recognit 90:23–34CrossRef Kumar V, Pujari AK, Padmanabhan V (2019) Group preserving label embedding for multi-label classification. Pattern Recognit 90:23–34CrossRef
4.
go back to reference Tang YM, Ren FJ, Pedrycz W (2020) Fuzzy C-means clustering through SSIM and patch for image segmentation. Appl Soft Comput 87:1–16 Tang YM, Ren FJ, Pedrycz W (2020) Fuzzy C-means clustering through SSIM and patch for image segmentation. Appl Soft Comput 87:1–16
5.
go back to reference Askari S, Montazerin N, Zarandi F, Hakimi E (2017) Generalized entropy based possibilistic fuzzy C-means for clustering noisy data and its convergence proof. Neurocomputing 219:186–201CrossRef Askari S, Montazerin N, Zarandi F, Hakimi E (2017) Generalized entropy based possibilistic fuzzy C-means for clustering noisy data and its convergence proof. Neurocomputing 219:186–201CrossRef
8.
go back to reference Rabiee HR, Kwok JT, Barezi EJ (2017) Multi-Label learning in the independent label sub-spaces. Pattern Recognit Lett 97:8–12CrossRef Rabiee HR, Kwok JT, Barezi EJ (2017) Multi-Label learning in the independent label sub-spaces. Pattern Recognit Lett 97:8–12CrossRef
9.
go back to reference Ji SW, Tang L, Yu SP, Ye JP (2010) A shared-subspace learning framework for multi-label classification. ACM Trans Knowl Discov Data 4(2):1–29CrossRef Ji SW, Tang L, Yu SP, Ye JP (2010) A shared-subspace learning framework for multi-label classification. ACM Trans Knowl Discov Data 4(2):1–29CrossRef
10.
go back to reference Huang SJ, Gao W, Zhou ZH (2019) Fast multi-instance multi-label learning. IEEE Trans Pattern Anal Mach Intell 41(11):2614–2627CrossRef Huang SJ, Gao W, Zhou ZH (2019) Fast multi-instance multi-label learning. IEEE Trans Pattern Anal Mach Intell 41(11):2614–2627CrossRef
11.
go back to reference Zhang ML, Wu L (2015) Lift: multi-label learning with label-specific features. IEEE Trans Pattern Anal Mach Intell 37(1):107–120CrossRef Zhang ML, Wu L (2015) Lift: multi-label learning with label-specific features. IEEE Trans Pattern Anal Mach Intell 37(1):107–120CrossRef
12.
go back to reference Cheng YS, Zhao DW, Wang YB, Pei GS (2019) Multi-label learning with kernel extreme learning machine autoencoder. Knowl Based Syst 178:1–10CrossRef Cheng YS, Zhao DW, Wang YB, Pei GS (2019) Multi-label learning with kernel extreme learning machine autoencoder. Knowl Based Syst 178:1–10CrossRef
13.
go back to reference Han HR, Huang MX, Zhang Y, Yang XG, Feng WG (2019) Multi-label learning with label specific features using correlation information. IEEE Access 19(7):11474–11484CrossRef Han HR, Huang MX, Zhang Y, Yang XG, Feng WG (2019) Multi-label learning with label specific features using correlation information. IEEE Access 19(7):11474–11484CrossRef
14.
go back to reference Huang J, Li G, Huang Q, Wu X (2015). Learning label specific features for multi-label classification. In: 2015 IEEE international conference on data mining. IEEE, pp 181–190 Huang J, Li G, Huang Q, Wu X (2015). Learning label specific features for multi-label classification. In: 2015 IEEE international conference on data mining. IEEE, pp 181–190
15.
go back to reference Weng W, Chen YN, Chen CL, Wu SX, Liu JH (2020) Non-sparse label specific features selection for multi-label classification. Neurocomputing 377:85–94CrossRef Weng W, Chen YN, Chen CL, Wu SX, Liu JH (2020) Non-sparse label specific features selection for multi-label classification. Neurocomputing 377:85–94CrossRef
16.
go back to reference Wang YB, Pei GS, Cheng YS (2020) Group-label-specific features learning based on Label-density classification margin. J Electron Inf Technol 42(05):1179–1187 Wang YB, Pei GS, Cheng YS (2020) Group-label-specific features learning based on Label-density classification margin. J Electron Inf Technol 42(05):1179–1187
17.
go back to reference Tang YM, Ren FJ, Pedrycz W, Song XC (2019) Possibilistic fuzzy clustering with high-density viewpoint. Neurocomputing 329:407–423CrossRef Tang YM, Ren FJ, Pedrycz W, Song XC (2019) Possibilistic fuzzy clustering with high-density viewpoint. Neurocomputing 329:407–423CrossRef
18.
go back to reference Kovařík V, Lisý V (2020) Analysis of Hannan consistent selection for Monte Carlo tree search in simultaneous move games. Mach Learn 109(1):1–50MathSciNetCrossRef Kovařík V, Lisý V (2020) Analysis of Hannan consistent selection for Monte Carlo tree search in simultaneous move games. Mach Learn 109(1):1–50MathSciNetCrossRef
19.
go back to reference Zhang CQ, Yu ZW, Fu HZ, Zhu PF, Chen L, Hu QH (2019) Hybrid Noise-oriented Multi-Label learning. IEEE Transactions on Cybernetics 50(6):2837–2850 Zhang CQ, Yu ZW, Fu HZ, Zhu PF, Chen L, Hu QH (2019) Hybrid Noise-oriented Multi-Label learning. IEEE Transactions on Cybernetics 50(6):2837–2850
20.
go back to reference Zhang X, Wang ZY (2020) Entity labeling visualization based on knowledge graphs. Command Inf Syst Technol 11(03):1–9 Zhang X, Wang ZY (2020) Entity labeling visualization based on knowledge graphs. Command Inf Syst Technol 11(03):1–9
21.
go back to reference Zhong Y, Liu HK, Chen TZ (2020) Concept drift detection of multi-label data stream based on hierarchical verification. Pattern Recognit Artif Intell 33(03):202–210 Zhong Y, Liu HK, Chen TZ (2020) Concept drift detection of multi-label data stream based on hierarchical verification. Pattern Recognit Artif Intell 33(03):202–210
22.
go back to reference Zhang QW, Zhong Y, Zhang ML (2018) Feature-induced labeling information enrichment for multi-label learning. In: Proceedings of the 32nd AAAI conference on artificial intelligence, 2018, pp 4446–4453 Zhang QW, Zhong Y, Zhang ML (2018) Feature-induced labeling information enrichment for multi-label learning. In: Proceedings of the 32nd AAAI conference on artificial intelligence, 2018, pp 4446–4453
23.
go back to reference Hou P, Geng X, Zhang ML (2016) Multi-label manifold learning. In: Thirtieth AAAI conference on artificial intelligence, 2016, pp 1680–1686 Hou P, Geng X, Zhang ML (2016) Multi-label manifold learning. In: Thirtieth AAAI conference on artificial intelligence, 2016, pp 1680–1686
24.
go back to reference Ye T, Cao J (2017) A recommendation algorithm with labels semantic normalization based on network segmentation clustering. Comput Appl Softw 34(11):64–69 Ye T, Cao J (2017) A recommendation algorithm with labels semantic normalization based on network segmentation clustering. Comput Appl Softw 34(11):64–69
25.
go back to reference Zhou ZH, Zhang ML (2016) Multi-label learning. Encyclopedia of machine learning and data mining. Springer, Berlin, pp 875–881 Zhou ZH, Zhang ML (2016) Multi-label learning. Encyclopedia of machine learning and data mining. Springer, Berlin, pp 875–881
26.
go back to reference Wang YB, Zheng WJ, Cheng YS, Zhao DW (2020) Joint label completion and label-specific features for multi-label learning algorithm. Soft Comput 24:6553–6569CrossRef Wang YB, Zheng WJ, Cheng YS, Zhao DW (2020) Joint label completion and label-specific features for multi-label learning algorithm. Soft Comput 24:6553–6569CrossRef
27.
go back to reference Li F, Yang YL (2019) Multi-label classification algorithm based on label-specific features and label correlation. Comput Eng Appl 055(004):48–55 Li F, Yang YL (2019) Multi-label classification algorithm based on label-specific features and label correlation. Comput Eng Appl 055(004):48–55
29.
go back to reference Xia SY, Wang GY, Chen ZZ, Duan YL, Liu Q (2019) Complete Random Forest based class Noise Filtering learning for Improving the Generalizability of Classifiers. IEEE Transactions on Knowledge & Data Engineering 31(11):2063–2078 Xia SY, Wang GY, Chen ZZ, Duan YL, Liu Q (2019) Complete Random Forest based class Noise Filtering learning for Improving the Generalizability of Classifiers. IEEE Transactions on Knowledge & Data Engineering 31(11):2063–2078
30.
go back to reference Beck A, Teboulle M (2009) Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE Trans Image Process 18(11):2419–2434MathSciNetCrossRef Beck A, Teboulle M (2009) Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE Trans Image Process 18(11):2419–2434MathSciNetCrossRef
31.
go back to reference Liu GC, Lin ZC, Yu Y (2010) Robust subspace segmentation by low-rank representation. In: Proceeding twenty-seventh international conference on machine learning (ICML 2010), 2010, pp 663–670 Liu GC, Lin ZC, Yu Y (2010) Robust subspace segmentation by low-rank representation. In: Proceeding twenty-seventh international conference on machine learning (ICML 2010), 2010, pp 663–670
32.
go back to reference Lin ZC, Ganesh A, Wright J, Wu LQ, Chen M, Ma Y (2009) Fast convex optimization algorithms for exact recovery of a corrupted low-rank matrix. UIUC technical report 2009, 09, p 2214 Lin ZC, Ganesh A, Wright J, Wu LQ, Chen M, Ma Y (2009) Fast convex optimization algorithms for exact recovery of a corrupted low-rank matrix. UIUC technical report 2009, 09, p 2214
33.
go back to reference Huang J, Qin F, Zheng X (2019) Improving multi-label classification with missing labels by learning label-specific features. Inf Sci 492:124–146MathSciNetCrossRef Huang J, Qin F, Zheng X (2019) Improving multi-label classification with missing labels by learning label-specific features. Inf Sci 492:124–146MathSciNetCrossRef
34.
go back to reference Zhou ZH, Zhang ML (2014) A review on multi-label learning algorithms. IEEE Trans Knowl Data Eng 26(8):1819–1837CrossRef Zhou ZH, Zhang ML (2014) A review on multi-label learning algorithms. IEEE Trans Knowl Data Eng 26(8):1819–1837CrossRef
35.
go back to reference Weng W, Lin YJ, Li YW (2018) Online multi-label streaming feature selection based on neighborhood rough set. Pattern Recognit 84:273–287CrossRef Weng W, Lin YJ, Li YW (2018) Online multi-label streaming feature selection based on neighborhood rough set. Pattern Recognit 84:273–287CrossRef
36.
go back to reference Shen Y-Y, Wang HZ (2014) Recent advances on supervised distance metric learning algorithms. Acta Automatica Sinica 40(12):2673–2686MATH Shen Y-Y, Wang HZ (2014) Recent advances on supervised distance metric learning algorithms. Acta Automatica Sinica 40(12):2673–2686MATH
37.
go back to reference Demiar J, Schuurmans D (2006) Statistical comparisons of classifiers over multiple datasets. J Mach Learn Res 7(1):1–30MathSciNet Demiar J, Schuurmans D (2006) Statistical comparisons of classifiers over multiple datasets. J Mach Learn Res 7(1):1–30MathSciNet
38.
go back to reference Cheng YS, Qian K, Wang YB, Zhao DW (2019) Multi-label lazy learning approach based on firefly method. J Comput Appl 039(005):1305–1311 Cheng YS, Qian K, Wang YB, Zhao DW (2019) Multi-label lazy learning approach based on firefly method. J Comput Appl 039(005):1305–1311
39.
go back to reference Li KW, Xie P, Lu SQ (2019) Feature selection method by label distribution learning based on imbalanced data. Comput Numer Eng 47(09):2257–2261 (+2272) Li KW, Xie P, Lu SQ (2019) Feature selection method by label distribution learning based on imbalanced data. Comput Numer Eng 47(09):2257–2261 (+2272)
Metadata
Title
Multi-label space reshape for semantic-rich label-specific features learning
Authors
Yusheng Cheng
Chao Zhang
Shufang Pang
Publication date
13-10-2021
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 4/2022
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-021-01432-3

Other articles of this Issue 4/2022

International Journal of Machine Learning and Cybernetics 4/2022 Go to the issue