Skip to main content
Erschienen in: Cognitive Computation 6/2021

31.08.2021

A Graph-based Semi-supervised Multi-label Learning Method Based on Label Correlation Consistency

verfasst von: Qin Zhang, Guoqiang Zhong, Junyu Dong

Erschienen in: Cognitive Computation | Ausgabe 6/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Multi-label learning deals with the problem which each data example can be represented by an instance and associated with a set of labels, i.e., every example can be classified into multiple classes simultaneously. Most of the existing multi-label learning methods are supervised which cannot deal with such application scenarios where manually labeling the data is very expensive and time-consuming while the unlabeled data are very cheap and easy to obtain. This paper proposes an ensemble learning method which integrates multi-label learning and graph-based semi-supervised learning into one framework. The label correlation consistency is introduced to deal with the multi-label learning. The proposed method has been evaluated on five public multi-label datasets by comparing it with state-of-the-art supervised and semi-supervised multi-label methods according to multiple evaluation metrics to confirm its effectiveness. Experimental results show that the proposed method can achieve the comparable performance compared with the state-of-the-art methods. Furthermore, it is more confident on every single predicted label.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
http://mulan.sourceforge.net/datasets-mlc.html
 
Literatur
1.
Zurück zum Zitat Abbasi, M., Rabiee, H. R., and Gagné, C. Monocular 3d human pose estimation with a semi-supervised graph-based method. In 2015 International Conference on 3D Vision (2015), IEEE, pp. 518–526. Abbasi, M., Rabiee, H. R., and Gagné, C. Monocular 3d human pose estimation with a semi-supervised graph-based method. In 2015 International Conference on 3D Vision (2015), IEEE, pp. 518–526.
2.
Zurück zum Zitat Arthur, D., and Vassilvitskii, S. k-means++: The advantages of careful seeding. Tech. rep., Stanford, 2006.MATH Arthur, D., and Vassilvitskii, S. k-means++: The advantages of careful seeding. Tech. rep., Stanford, 2006.MATH
3.
Zurück zum Zitat Boutell, M. R., Luo, J., Shen, X., and Brown, C. M. Learning multi-label scene classification. Pattern recognition 37, 9 (2004), 1757–1771.CrossRef Boutell, M. R., Luo, J., Shen, X., and Brown, C. M. Learning multi-label scene classification. Pattern recognition 37, 9 (2004), 1757–1771.CrossRef
4.
5.
Zurück zum Zitat Chen, Z.-M., Wei, X.-S., Wang, P., and Guo, Y. Multi-label image recognition with graph convolutional networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2019), pp. 5177–5186. Chen, Z.-M., Wei, X.-S., Wang, P., and Guo, Y. Multi-label image recognition with graph convolutional networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2019), pp. 5177–5186.
6.
Zurück zum Zitat Chung, F. R., and Graham, F. C. Spectral graph theory. No. 92. American Mathematical Soc., 1997. Chung, F. R., and Graham, F. C. Spectral graph theory. No. 92. American Mathematical Soc., 1997.
7.
Zurück zum Zitat Clare, A., and King, R. Knowledge discovery in multi-label phenotype data. Principles of data mining and knowledge discovery (2001), 42–53. Clare, A., and King, R. Knowledge discovery in multi-label phenotype data. Principles of data mining and knowledge discovery (2001), 42–53.
8.
Zurück zum Zitat Demšar, J. Statistical comparisons of classifiers over multiple data sets. The Journal of Machine Learning Research 7 (2006), 1–30.MathSciNetMATH Demšar, J. Statistical comparisons of classifiers over multiple data sets. The Journal of Machine Learning Research 7 (2006), 1–30.MathSciNetMATH
9.
Zurück zum Zitat Elisseeff, A., and Weston, J. A kernel method for multi-labelled classification. In Advances in neural information processing systems (2002), pp. 681–687. Elisseeff, A., and Weston, J. A kernel method for multi-labelled classification. In Advances in neural information processing systems (2002), pp. 681–687.
10.
Zurück zum Zitat Erhan, D., Bengio, Y., Courville, A., Manzagol, P.-A., Vincent, P., and Bengio, S. Why does unsupervised pre-training help deep learning? The Journal of Machine Learning Research 11 (2010), 625–660.MathSciNetMATH Erhan, D., Bengio, Y., Courville, A., Manzagol, P.-A., Vincent, P., and Bengio, S. Why does unsupervised pre-training help deep learning? The Journal of Machine Learning Research 11 (2010), 625–660.MathSciNetMATH
11.
Zurück zum Zitat Fürnkranz, J., Hüllermeier, E., Mencía, E. L., and Brinker, K. Multilabel classification via calibrated label ranking. Machine learning 73, 2 (2008), 133–153.CrossRef Fürnkranz, J., Hüllermeier, E., Mencía, E. L., and Brinker, K. Multilabel classification via calibrated label ranking. Machine learning 73, 2 (2008), 133–153.CrossRef
12.
Zurück zum Zitat Ghamrawi, N., and McCallum, A. Collective multi-label classification. In Proceedings of the 14th ACM international conference on Information and knowledge management (2005), ACM, pp. 195–200. Ghamrawi, N., and McCallum, A. Collective multi-label classification. In Proceedings of the 14th ACM international conference on Information and knowledge management (2005), ACM, pp. 195–200.
13.
Zurück zum Zitat Han, A. L.-F., Zeng, X., Wong, D. F., and Chao, L. S. Chinese named entity recognition with graph-based semi-supervised learning model. In Proceedings of the Eighth SIGHAN Workshop on Chinese Language Processing (2015), pp. 15–20. Han, A. L.-F., Zeng, X., Wong, D. F., and Chao, L. S. Chinese named entity recognition with graph-based semi-supervised learning model. In Proceedings of the Eighth SIGHAN Workshop on Chinese Language Processing (2015), pp. 15–20.
14.
Zurück zum Zitat Hastie, T., Tibshirani, R., and Friedman, J. The elements of statistical learning: data mining, inference, and prediction. Springer Science & Business Media, 2009. Hastie, T., Tibshirani, R., and Friedman, J. The elements of statistical learning: data mining, inference, and prediction. Springer Science & Business Media, 2009.
15.
Zurück zum Zitat Huang, S. J., and Zhou, Z. H. Multi-label learning by exploiting label correlations locally. In Twenty-Sixth AAAI Conference on Artificial Intelligence (2012), pp. 949–955. Huang, S. J., and Zhou, Z. H. Multi-label learning by exploiting label correlations locally. In Twenty-Sixth AAAI Conference on Artificial Intelligence (2012), pp. 949–955.
16.
Zurück zum Zitat Katakis, I., Tsoumakas, G., and Vlahavas, I. Multilabel text classification for automated tag suggestion. In Proceedings of the ECML/PKDD (2008), vol. 18, p. 5. Katakis, I., Tsoumakas, G., and Vlahavas, I. Multilabel text classification for automated tag suggestion. In Proceedings of the ECML/PKDD (2008), vol. 18, p. 5.
17.
Zurück zum Zitat Kazawa, H., Izumitani, T., Taira, H., and Maeda, E. Maximal margin labeling for multi-topic text categorization. In Advances in neural information processing systems (2005), pp. 649–656. Kazawa, H., Izumitani, T., Taira, H., and Maeda, E. Maximal margin labeling for multi-topic text categorization. In Advances in neural information processing systems (2005), pp. 649–656.
18.
Zurück zum Zitat Kong, X., Ng, M. K., and Zhou, Z. H. Transductive multilabel learning via label set propagation. IEEE Transactions on Knowledge & Data Engineering 25, 3 (2013), 704–719.CrossRef Kong, X., Ng, M. K., and Zhou, Z. H. Transductive multilabel learning via label set propagation. IEEE Transactions on Knowledge & Data Engineering 25, 3 (2013), 704–719.CrossRef
19.
Zurück zum Zitat Li, C. X. Exploiting label correlations for multi-label classification. PhD Thesis, University of California (2011). Li, C. X. Exploiting label correlations for multi-label classification. PhD Thesis, University of California (2011).
20.
Zurück zum Zitat Liu, W., He, J., and Chang, S.-F. Large graph construction for scalable semi-supervised learning. In ICML (2010). Liu, W., He, J., and Chang, S.-F. Large graph construction for scalable semi-supervised learning. In ICML (2010).
21.
Zurück zum Zitat Ma, L., Ma, A., Ju, C., and Li, X. Graph-based semi-supervised learning for spectral-spatial hyperspectral image classification. pattern recognition letters 83 (2016), 133–142. Ma, L., Ma, A., Ju, C., and Li, X. Graph-based semi-supervised learning for spectral-spatial hyperspectral image classification. pattern recognition letters 83 (2016), 133–142.
22.
Zurück zum Zitat Madjarov, G., Kocev, D., Gjorgjevikj, D., and Džeroski, S. An extensive experimental comparison of methods for multi-label learning. Pattern Recognition 45, 9 (2012), 3084–3104.CrossRef Madjarov, G., Kocev, D., Gjorgjevikj, D., and Džeroski, S. An extensive experimental comparison of methods for multi-label learning. Pattern Recognition 45, 9 (2012), 3084–3104.CrossRef
23.
Zurück zum Zitat Read, J., Pfahringer, B., Holmes, G., and Frank, E. Classifier chains for multi-label classification. Machine learning 85, 3 (2011), 333–359.MathSciNetCrossRef Read, J., Pfahringer, B., Holmes, G., and Frank, E. Classifier chains for multi-label classification. Machine learning 85, 3 (2011), 333–359.MathSciNetCrossRef
24.
Zurück zum Zitat Schapire, R. E., and Singer, Y. Boostexter: A boosting-based system for text categorization. Machine learning 39, 2–3 (2000), 135–168.CrossRef Schapire, R. E., and Singer, Y. Boostexter: A boosting-based system for text categorization. Machine learning 39, 2–3 (2000), 135–168.CrossRef
25.
Zurück zum Zitat Sun, J., Yu, H., Zhong, G., Dong, J., Zhang, S., and Yu, H. Random shapley forests: cooperative game-based random forests with consistency. IEEE transactions on cybernetics (2020). Sun, J., Yu, H., Zhong, G., Dong, J., Zhang, S., and Yu, H. Random shapley forests: cooperative game-based random forests with consistency. IEEE transactions on cybernetics (2020).
26.
Zurück zum Zitat Tang, J., Li, H., Qi, G.-J., and Chua, T.-S. Image annotation by graph-based inference with integrated multiple/single instance representations. IEEE Transactions on Multimedia 12, 2 (2009), 131–141.CrossRef Tang, J., Li, H., Qi, G.-J., and Chua, T.-S. Image annotation by graph-based inference with integrated multiple/single instance representations. IEEE Transactions on Multimedia 12, 2 (2009), 131–141.CrossRef
27.
Zurück zum Zitat Trohidis, K., Tsoumakas, G., Kalliris, G., and Vlahavas, I. P. Multi-label classification of music into emotions. In ISMIR (2008), vol. 8, pp. 325–330. Trohidis, K., Tsoumakas, G., Kalliris, G., and Vlahavas, I. P. Multi-label classification of music into emotions. In ISMIR (2008), vol. 8, pp. 325–330.
28.
Zurück zum Zitat Tsoumakas, G., Katakis, I., and Vlahavas, I. Mining multi-label data. In Data mining and knowledge discovery handbook. Springer, 2009, pp. 667–685. Tsoumakas, G., Katakis, I., and Vlahavas, I. Mining multi-label data. In Data mining and knowledge discovery handbook. Springer, 2009, pp. 667–685.
29.
Zurück zum Zitat Tsoumakas, G., and Vlahavas, I. Random k-labelsets: An ensemble method for multilabel classification. Machine learning: ECML 2007 (2007), 406–417. Tsoumakas, G., and Vlahavas, I. Random k-labelsets: An ensemble method for multilabel classification. Machine learning: ECML 2007 (2007), 406–417.
30.
Zurück zum Zitat Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., and Manzagol, P.-A. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. The Journal of Machine Learning Research 11 (2010), 3371–3408.MathSciNetMATH Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., and Manzagol, P.-A. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. The Journal of Machine Learning Research 11 (2010), 3371–3408.MathSciNetMATH
31.
Zurück zum Zitat Zha, Z. J., Mei, T., Wang, J., Wang, Z., and Hua, X. S. Graph-based semi-supervised learning with multiple labels. Journal of Visual Communication & Image Representation 20, 2 (2009), 97–103.CrossRef Zha, Z. J., Mei, T., Wang, J., Wang, Z., and Hua, X. S. Graph-based semi-supervised learning with multiple labels. Journal of Visual Communication & Image Representation 20, 2 (2009), 97–103.CrossRef
32.
Zurück zum Zitat Zhang, J., Wu, Q., Shen, C., Zhang, J., and Lu, J. Multilabel image classification with regional latent semantic dependencies. IEEE Transactions on Multimedia 20, 10 (2018), 2801–2813.CrossRef Zhang, J., Wu, Q., Shen, C., Zhang, J., and Lu, J. Multilabel image classification with regional latent semantic dependencies. IEEE Transactions on Multimedia 20, 10 (2018), 2801–2813.CrossRef
33.
Zurück zum Zitat Zhang, M.-L., and Zhang, K. Multi-label learning by exploiting label dependency. In Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining (2010), ACM, pp. 999–1008. Zhang, M.-L., and Zhang, K. Multi-label learning by exploiting label dependency. In Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining (2010), ACM, pp. 999–1008.
34.
Zurück zum Zitat Zhang, M.-L., and Zhou, Z.-H. Ml-knn: A lazy learning approach to multi-label learning. Pattern recognition 40, 7 (2007), 2038–2048.CrossRef Zhang, M.-L., and Zhou, Z.-H. Ml-knn: A lazy learning approach to multi-label learning. Pattern recognition 40, 7 (2007), 2038–2048.CrossRef
35.
Zurück zum Zitat Zhang, M. L., and Zhou, Z. H. Multi-label learning by instance differentiation. In National Conference on Artificial Intelligence (2007), pp. 669–674. Zhang, M. L., and Zhou, Z. H. Multi-label learning by instance differentiation. In National Conference on Artificial Intelligence (2007), pp. 669–674.
36.
Zurück zum Zitat Zhang, M.-L., and Zhou, Z.-H. A review on multi-label learning algorithms. IEEE transactions on knowledge and data engineering 26, 8 (2014), 1819–1837.CrossRef Zhang, M.-L., and Zhou, Z.-H. A review on multi-label learning algorithms. IEEE transactions on knowledge and data engineering 26, 8 (2014), 1819–1837.CrossRef
37.
Zurück zum Zitat Zhang, Q., Sun, J., Zhong, G., and Dong, J. Random multi-graphs: a semi-supervised learning framework for classification of high dimensional data. Image and Vision Computing 60 (2017), 30–37.CrossRef Zhang, Q., Sun, J., Zhong, G., and Dong, J. Random multi-graphs: a semi-supervised learning framework for classification of high dimensional data. Image and Vision Computing 60 (2017), 30–37.CrossRef
38.
Zurück zum Zitat Zhao, Y., Ball, R., Mosesian, J., de Palma, J.-F., and Lehman, B. Graph-based semi-supervised learning for fault detection and classification in solar photovoltaic arrays. IEEE Transactions on Power Electronics 30, 5 (2014), 2848–2858.CrossRef Zhao, Y., Ball, R., Mosesian, J., de Palma, J.-F., and Lehman, B. Graph-based semi-supervised learning for fault detection and classification in solar photovoltaic arrays. IEEE Transactions on Power Electronics 30, 5 (2014), 2848–2858.CrossRef
39.
Zurück zum Zitat Zhu, X., and Goldberg, A. B. Introduction to semi-supervised learning. Synthesis lectures on artificial intelligence and machine learning 3, 1 (2009), 1–130.CrossRef Zhu, X., and Goldberg, A. B. Introduction to semi-supervised learning. Synthesis lectures on artificial intelligence and machine learning 3, 1 (2009), 1–130.CrossRef
Metadaten
Titel
A Graph-based Semi-supervised Multi-label Learning Method Based on Label Correlation Consistency
verfasst von
Qin Zhang
Guoqiang Zhong
Junyu Dong
Publikationsdatum
31.08.2021
Verlag
Springer US
Erschienen in
Cognitive Computation / Ausgabe 6/2021
Print ISSN: 1866-9956
Elektronische ISSN: 1866-9964
DOI
https://doi.org/10.1007/s12559-021-09912-y

Weitere Artikel der Ausgabe 6/2021

Cognitive Computation 6/2021 Zur Ausgabe

Premium Partner