Skip to main content

2017 | OriginalPaper | Buchkapitel

Online Multi-label Passive Aggressive Active Learning Algorithm Based on Binary Relevance

verfasst von : Xizhi Guo, Yongwei Zhang, Jianhua Xu

Erschienen in: Neural Information Processing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Online multi-label learning is an efficient classification paradigm in machine learning. However, traditional online multi-label methods often need requesting all class labels of each incoming sample, which is often human cost and time-consuming in labeling classification problem. In order to tackle these problems, in this paper, we present online multi-label passive aggressive active (MLPAA) learning algorithm by combining binary relevance (BR) decomposition strategy with online passive aggressive active (PAA) method. The proposed MLPAA algorithm not only uses the misclassified labels to update the classifier, but also exploits correctly classified examples with low prediction confidence. We perform extensive experimental comparison for our algorithm and the other methods using nine benchmark data sets. The encouraging results of our experiments validate the effectiveness of our proposed method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hoi, S.C.H., Wang, J.L., Zhao, P.: LIBOL: a library for online learning algorithms. J. Mach. Learn. Res. 15, 495–499 (2014)MATH Hoi, S.C.H., Wang, J.L., Zhao, P.: LIBOL: a library for online learning algorithms. J. Mach. Learn. Res. 15, 495–499 (2014)MATH
2.
Zurück zum Zitat Rosenblatt, F.: The perceptron: a probabilistic model for information storage and organization in the brain. Psychol. Rev. 65(1), 386–408 (1958)CrossRef Rosenblatt, F.: The perceptron: a probabilistic model for information storage and organization in the brain. Psychol. Rev. 65(1), 386–408 (1958)CrossRef
3.
Zurück zum Zitat Crammer, K., Dekel, O., Keshet, J., et al.: Online passive-aggressive algorithms. J. Mach. Learn. Res. 7, 551–585 (2006)MathSciNetMATH Crammer, K., Dekel, O., Keshet, J., et al.: Online passive-aggressive algorithms. J. Mach. Learn. Res. 7, 551–585 (2006)MathSciNetMATH
4.
5.
Zurück zum Zitat Crammer, K., Dredze, M., Pereira, F.: Exact convex confidence-weighted learning. In: Proceedings of the NIPS, pp. 345–352 (2008) Crammer, K., Dredze, M., Pereira, F.: Exact convex confidence-weighted learning. In: Proceedings of the NIPS, pp. 345–352 (2008)
6.
Zurück zum Zitat Liu, D., Zhang, P., Zheng, Q.: An efficient online active learning algorithm for binary classification. Pattern Recogn. Lett. 68(1), 22–26 (2015)CrossRef Liu, D., Zhang, P., Zheng, Q.: An efficient online active learning algorithm for binary classification. Pattern Recogn. Lett. 68(1), 22–26 (2015)CrossRef
7.
Zurück zum Zitat Dasgupta, S., Kalai, A., Monteleoni, C.: Analysis of perceptron-based active learning. J. Mach. Learn. Res. 10, 281–299 (2009)MathSciNetMATH Dasgupta, S., Kalai, A., Monteleoni, C.: Analysis of perceptron-based active learning. J. Mach. Learn. Res. 10, 281–299 (2009)MathSciNetMATH
8.
Zurück zum Zitat Lu, J., Zhao, P., Hoi, S.C.H.: Online passive aggressive active learning and its applications. In: Proceedings of the ACML, pp. 266–282 (2014) Lu, J., Zhao, P., Hoi, S.C.H.: Online passive aggressive active learning and its applications. In: Proceedings of the ACML, pp. 266–282 (2014)
9.
Zurück zum Zitat Zhao, P., Hoi, S.C.H., Jin, R.: Double updating online learning. J. Mach. Learn. Res. 12, 1587–1615 (2011)MathSciNetMATH Zhao, P., Hoi, S.C.H., Jin, R.: Double updating online learning. J. Mach. Learn. Res. 12, 1587–1615 (2011)MathSciNetMATH
10.
Zurück zum Zitat Crammer, K., Dredze, M., Kulesza, A.: Multi-class confidence weighted algorithms. In: Proceedings of the EMNLP, pp. 496–504 (2009) Crammer, K., Dredze, M., Kulesza, A.: Multi-class confidence weighted algorithms. In: Proceedings of the EMNLP, pp. 496–504 (2009)
11.
Zurück zum Zitat Fink, M., Shwartz, S.S.; Singer, Y., et al.: Online multiclass learning by interclass hypothesis sharing. In: Proceedings of the ICML, pp. 313–320 (2006) Fink, M., Shwartz, S.S.; Singer, Y., et al.: Online multiclass learning by interclass hypothesis sharing. In: Proceedings of the ICML, pp. 313–320 (2006)
12.
Zurück zum Zitat Crammer, K., Singer, Y.: A family of additive online algortihtms for category ranking. J. Mach. Learn. Res. 3, 1025–1058 (2003)MathSciNetMATH Crammer, K., Singer, Y.: A family of additive online algortihtms for category ranking. J. Mach. Learn. Res. 3, 1025–1058 (2003)MathSciNetMATH
13.
Zurück zum Zitat Higuchi, D., Ozawa, S.: A neural network model for online multi-task multi-label pattern recognition. In: Mladenov, V., Koprinkova-Hristova, P., Palm, G., Villa, A.E.P., Appollini, B., Kasabov, N. (eds.) ICANN 2013. LNCS, vol. 8131, pp. 162–169. Springer, Heidelberg (2013). doi:10.1007/978-3-642-40728-4_21 CrossRef Higuchi, D., Ozawa, S.: A neural network model for online multi-task multi-label pattern recognition. In: Mladenov, V., Koprinkova-Hristova, P., Palm, G., Villa, A.E.P., Appollini, B., Kasabov, N. (eds.) ICANN 2013. LNCS, vol. 8131, pp. 162–169. Springer, Heidelberg (2013). doi:10.​1007/​978-3-642-40728-4_​21 CrossRef
14.
Zurück zum Zitat Park, S., Choi, S.: Online multi-label learning with accelerated nonsmooth stochastic gradient descent. In: ICASSP, pp. 3322–3326 (2013) Park, S., Choi, S.: Online multi-label learning with accelerated nonsmooth stochastic gradient descent. In: ICASSP, pp. 3322–3326 (2013)
15.
Zurück zum Zitat Zhang, X., Graepel, T., Herbrich, R.: Bayesian online learning for multi-label and multi-variate performance measures. In: Proceedings of the AISTATS, pp. 956–963 (2013) Zhang, X., Graepel, T., Herbrich, R.: Bayesian online learning for multi-label and multi-variate performance measures. In: Proceedings of the AISTATS, pp. 956–963 (2013)
16.
Zurück zum Zitat Hua, X.S., et al.: Two-dimensional multi-label active learning with an efficient online adaptation model for image classification. IEEE Trans. Pattern Anal. Mach. Intell. 31(10), 1880–1897 (2009)CrossRef Hua, X.S., et al.: Two-dimensional multi-label active learning with an efficient online adaptation model for image classification. IEEE Trans. Pattern Anal. Mach. Intell. 31(10), 1880–1897 (2009)CrossRef
18.
Zurück zum Zitat Gibaja, E., Ventura, S.: A tutorial on multi-label learning. ACM Comput. Surv. 47(3), 1–38 (2015). Article No. 51CrossRef Gibaja, E., Ventura, S.: A tutorial on multi-label learning. ACM Comput. Surv. 47(3), 1–38 (2015). Article No. 51CrossRef
19.
Zurück zum Zitat Herbrich, R., Minka, T., Graepel, T.: TrueskillTM: a Bayesian skill ranking system. In: Proceedings of the NIPS, pp. 569–576 (2006) Herbrich, R., Minka, T., Graepel, T.: TrueskillTM: a Bayesian skill ranking system. In: Proceedings of the NIPS, pp. 569–576 (2006)
20.
Zurück zum Zitat Cesa-Bianchi, N., Gentile, C., Zaniboni, L.: Worst-case analysis of selective sampling for linear classification. J. Mach. Learn. Res. 7, 1205–1230 (2006)MathSciNetMATH Cesa-Bianchi, N., Gentile, C., Zaniboni, L.: Worst-case analysis of selective sampling for linear classification. J. Mach. Learn. Res. 7, 1205–1230 (2006)MathSciNetMATH
21.
Zurück zum Zitat Cesa-Bianchi, N., Lugosi, G.: Prediction, Learning, and Games. Cambridge University Press, Cambridge (2006)CrossRefMATH Cesa-Bianchi, N., Lugosi, G.: Prediction, Learning, and Games. Cambridge University Press, Cambridge (2006)CrossRefMATH
22.
Zurück zum Zitat Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26(8), 1819–1837 (2014)CrossRef Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26(8), 1819–1837 (2014)CrossRef
Metadaten
Titel
Online Multi-label Passive Aggressive Active Learning Algorithm Based on Binary Relevance
verfasst von
Xizhi Guo
Yongwei Zhang
Jianhua Xu
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-70139-4_26