Skip to main content

2016 | OriginalPaper | Buchkapitel

A Non-linear Label Compression Coding Method Based on Five-Layer Auto-Encoder for Multi-label Classification

verfasst von : Jiapeng Luo, Lei Cao, Jianhua Xu

Erschienen in: Neural Information Processing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In multi-label classification, high-dimensional and sparse binary label vectors usually make existing multi-label classifiers perform unsatisfactorily, which induces a group of label compression coding (LCC) techniques particularly. So far, several linear LCC methods have been introduced via considering linear relations among labels. In this paper, we extend traditional three-layer auto-encoder to construct a five-layer one (i.e., five-layer symmetrical neural network), and then apply the training principle in extreme learning machine to determine all network weights. Therefore, a non-linear LCC approach is proposed to capture non-linear relations of labels, where the first three-layer network is regarded as a encoder and the last two layers act as a decoder. The experimental results on three benchmark data sets show that our proposed method performs better than four existing linear LCC methods according to five performance measures.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Tsoumakas, G., Katakis, I.: Multi-label classification: an overview. Int. J. Data Warehouse. Min. 3(3), 1–13 (2007)CrossRef Tsoumakas, G., Katakis, I.: Multi-label classification: an overview. Int. J. Data Warehouse. Min. 3(3), 1–13 (2007)CrossRef
2.
Zurück zum Zitat Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26(8), 1338–1351 (2014)CrossRef Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26(8), 1338–1351 (2014)CrossRef
3.
Zurück zum Zitat Gibaji, E., Ventura, S.: A tutorial on multilabel learning. ACM Comput. Surv. 47(3), 52:1–52:38 (2015) Gibaji, E., Ventura, S.: A tutorial on multilabel learning. ACM Comput. Surv. 47(3), 52:1–52:38 (2015)
4.
Zurück zum Zitat Boutell, M.R., Luo, J., Shen, X., Brown, C.M.: Learning multi-label scene classification. Pattern Recogn. 37(9), 1757–1771 (2004)CrossRef Boutell, M.R., Luo, J., Shen, X., Brown, C.M.: Learning multi-label scene classification. Pattern Recogn. 37(9), 1757–1771 (2004)CrossRef
5.
Zurück zum Zitat Zhang, M.L., Zhou, Z.H.: ML-kNN: a lazy learning approach to multi-label learning. Pattern Recogn. 40(5), 2038–2048 (2007)CrossRefMATH Zhang, M.L., Zhou, Z.H.: ML-kNN: a lazy learning approach to multi-label learning. Pattern Recogn. 40(5), 2038–2048 (2007)CrossRefMATH
6.
Zurück zum Zitat Xu, J.: Multi-label core vector machine with a zero label. Pattern Recogn. 47(7), 2542–2557 (2014)CrossRefMATH Xu, J.: Multi-label core vector machine with a zero label. Pattern Recogn. 47(7), 2542–2557 (2014)CrossRefMATH
7.
Zurück zum Zitat Hsu, D., Kakade, S.M., Langfors, J.L., Zhang, T.: Multi-label prediction via compressed sensing. In: Proceedings of the 24th Conference on Neural Information Processing Systems (NIPS2009), pp. 772–780. MIT Press, Cambridge (2010) Hsu, D., Kakade, S.M., Langfors, J.L., Zhang, T.: Multi-label prediction via compressed sensing. In: Proceedings of the 24th Conference on Neural Information Processing Systems (NIPS2009), pp. 772–780. MIT Press, Cambridge (2010)
8.
Zurück zum Zitat Zhou, T., Tao, D., Wu, X.: Compressed labeling on distilled labelsets for multi-label learning. Mach. Learn. 88(1/2), 69–126 (2012)MathSciNetCrossRefMATH Zhou, T., Tao, D., Wu, X.: Compressed labeling on distilled labelsets for multi-label learning. Mach. Learn. 88(1/2), 69–126 (2012)MathSciNetCrossRefMATH
9.
Zurück zum Zitat Tai, F., Lin, H.T.: Multi-label classification with principal label space transformation. Neural Comput. 24(9), 2508–2542 (2012)MathSciNetCrossRefMATH Tai, F., Lin, H.T.: Multi-label classification with principal label space transformation. Neural Comput. 24(9), 2508–2542 (2012)MathSciNetCrossRefMATH
10.
Zurück zum Zitat Wicker, J., Pfahringer, B., Kramer, S.: Multi-label classification using Boolean matrix decomposition. In: Proceedings of the 27th Annual ACM Symposium on Applied Computing (SAC2012), pp. 179–186. ACM, New York (2012) Wicker, J., Pfahringer, B., Kramer, S.: Multi-label classification using Boolean matrix decomposition. In: Proceedings of the 27th Annual ACM Symposium on Applied Computing (SAC2012), pp. 179–186. ACM, New York (2012)
11.
Zurück zum Zitat Chen, Y., Lin, H.T.: Feature-aware label ppace dimension reduction for multi-label classification. In: Proceedings of the 27th Conference on Neural Information Processing Systems (NIPS2012), pp. 1538–1546. MIT Press, Cambridge (2012) Chen, Y., Lin, H.T.: Feature-aware label ppace dimension reduction for multi-label classification. In: Proceedings of the 27th Conference on Neural Information Processing Systems (NIPS2012), pp. 1538–1546. MIT Press, Cambridge (2012)
12.
Zurück zum Zitat Lin, Z., Ding, G., Hu, M., Wang, J.: Multi-label classification via feature-aware implicit label space encoding. In: Proceedings of the 31th International Conference on Machine Learning (ICML2014), pp. 325–333. Microtome Publishing, Brookline (2014) Lin, Z., Ding, G., Hu, M., Wang, J.: Multi-label classification via feature-aware implicit label space encoding. In: Proceedings of the 31th International Conference on Machine Learning (ICML2014), pp. 325–333. Microtome Publishing, Brookline (2014)
13.
Zurück zum Zitat Cao, L., Xu, J.: A label compression coding approach through maximizing dependence between features and labels for multi-label classification. In: Proceedings of the 2015 International Joint Conference on Neural Networks (IJCNN2015), pp. 1–8. IEEE Press, New York (2015) Cao, L., Xu, J.: A label compression coding approach through maximizing dependence between features and labels for multi-label classification. In: Proceedings of the 2015 International Joint Conference on Neural Networks (IJCNN2015), pp. 1–8. IEEE Press, New York (2015)
14.
Zurück zum Zitat Zhang, J.J., Fang, M., Wang, H., Li, X.: Dependence maximization based label space dimension reduction for multi-label classification. Eng. Appl. Artif. Intell. 45, 453–463 (2015)CrossRef Zhang, J.J., Fang, M., Wang, H., Li, X.: Dependence maximization based label space dimension reduction for multi-label classification. Eng. Appl. Artif. Intell. 45, 453–463 (2015)CrossRef
15.
Zurück zum Zitat Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Leraning representations by back-propagating error. Nature 323, 533–536 (1986)CrossRef Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Leraning representations by back-propagating error. Nature 323, 533–536 (1986)CrossRef
17.
Zurück zum Zitat Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1798–1828 (2013)CrossRef Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1798–1828 (2013)CrossRef
18.
Zurück zum Zitat LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521, 436–444 (2015)CrossRef LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521, 436–444 (2015)CrossRef
19.
Zurück zum Zitat Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: theory and applications. Neurocomputing 70(1–3), 489–501 (2006)CrossRef Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: theory and applications. Neurocomputing 70(1–3), 489–501 (2006)CrossRef
20.
Zurück zum Zitat Huang, G.B., Wang, D.H., Lan, Y.: Extreme learning machine: a survey. Int. J. Mach. Learn. Cybern. 2(2), 107–122 (2011)CrossRef Huang, G.B., Wang, D.H., Lan, Y.: Extreme learning machine: a survey. Int. J. Mach. Learn. Cybern. 2(2), 107–122 (2011)CrossRef
21.
Zurück zum Zitat Huang, G., Huang, G.B., Song, S., You, K.: Trends in extreme learning machines: a review. Neural Netw. 61, 32–48 (2015)CrossRefMATH Huang, G., Huang, G.B., Song, S., You, K.: Trends in extreme learning machines: a review. Neural Netw. 61, 32–48 (2015)CrossRefMATH
23.
Zurück zum Zitat Brazdil, P.B., Soares, C.: A comparison of ranking methods for classification algorithm selection. In: Lopez de Mantaras, R., Plaza, E. (eds.) ECML 2000. LNCS (LNAI), vol. 1810, pp. 63–74. Springer, Heidelberg (2000)CrossRef Brazdil, P.B., Soares, C.: A comparison of ranking methods for classification algorithm selection. In: Lopez de Mantaras, R., Plaza, E. (eds.) ECML 2000. LNCS (LNAI), vol. 1810, pp. 63–74. Springer, Heidelberg (2000)CrossRef
Metadaten
Titel
A Non-linear Label Compression Coding Method Based on Five-Layer Auto-Encoder for Multi-label Classification
verfasst von
Jiapeng Luo
Lei Cao
Jianhua Xu
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46675-0_45

Premium Partner