Skip to main content

2020 | OriginalPaper | Buchkapitel

PP-PLL: Probability Propagation for Partial Label Learning

verfasst von : Kaiwei Sun, Zijian Min, Jin Wang

Erschienen in: Machine Learning and Knowledge Discovery in Databases

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Partial label learning (PLL) is a weakly supervised learning framework which learns from the data where each example is associated with a set of candidate labels, among which only one is correct. Most existing approaches are based on the disambiguation strategy, which either identifies the valid label iteratively or treats each candidate label equally based on the averaging strategy. In both cases, the disambiguation strategy shares a common shortcoming that the ground-truth label may be overwhelmed by the false positive candidate labels, especially when the number of candidate labels becomes large. In this paper, a probability propagation method for partial label learning (PP-PLL) is proposed. Specifically, based on the manifold assumption, a biconvex regular function is proposed to model the linear mapping relationships between input features and output true labels. In PP-PLL, the topological relations among training samples are used as additional information to strengthen the mutual exclusiveness among candidate labels, which helps to prevent the ground-truth label from being overwhelmed by a large number of candidate labels. Experimental studies on both artificial and real-world data sets demonstrate that the proposed PP-PLL method can achieve superior or comparable performance against the state-of-the-art methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Briggs, F., Fern, X.Z., Raich, R.: Rank-loss support instance machines for MIML instance annotation. In: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 534–542. ACM (2012) Briggs, F., Fern, X.Z., Raich, R.: Rank-loss support instance machines for MIML instance annotation. In: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 534–542. ACM (2012)
2.
Zurück zum Zitat Cour, T., Sapp, B., Taskar, B.: Learning from partial labels. J. Mach. Learn. Res. 12(May), 1501–1536 (2011)MathSciNetMATH Cour, T., Sapp, B., Taskar, B.: Learning from partial labels. J. Mach. Learn. Res. 12(May), 1501–1536 (2011)MathSciNetMATH
3.
Zurück zum Zitat Cour, T., Sapp, B., Jordan, C., Taskar, B.: Learning from ambiguously labeled images. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 919–926. IEEE (2009) Cour, T., Sapp, B., Jordan, C., Taskar, B.: Learning from ambiguously labeled images. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 919–926. IEEE (2009)
4.
Zurück zum Zitat Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Stat. Soc. Ser. B (Methodological) 39(1), 1–22 (1977)MathSciNetMATH Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Stat. Soc. Ser. B (Methodological) 39(1), 1–22 (1977)MathSciNetMATH
5.
Zurück zum Zitat Gong, C., Liu, T., Tang, Y., Yang, J., Yang, J., Tao, D.: A regularization approach for instance-based superset label learning. IEEE Trans. Cybern. 48(3), 967–978 (2018)CrossRef Gong, C., Liu, T., Tang, Y., Yang, J., Yang, J., Tao, D.: A regularization approach for instance-based superset label learning. IEEE Trans. Cybern. 48(3), 967–978 (2018)CrossRef
6.
Zurück zum Zitat Gorski, J., Pfeuffer, F., Klamroth, K.: Biconvex sets and optimization with biconvex functions: a survey and extensions. Math. Methods Oper. Res. 66(3), 373–407 (2007)MathSciNetMATHCrossRef Gorski, J., Pfeuffer, F., Klamroth, K.: Biconvex sets and optimization with biconvex functions: a survey and extensions. Math. Methods Oper. Res. 66(3), 373–407 (2007)MathSciNetMATHCrossRef
7.
Zurück zum Zitat Grandvalet, Y., Bengio, Y.: Learning from partial labels with minimum entropy (2004) Grandvalet, Y., Bengio, Y.: Learning from partial labels with minimum entropy (2004)
9.
Zurück zum Zitat Hüllermeier, E., Beringer, J.: Learning from ambiguously labeled examples. Intell. Data Anal. 10(5), 419–439 (2006)MATHCrossRef Hüllermeier, E., Beringer, J.: Learning from ambiguously labeled examples. Intell. Data Anal. 10(5), 419–439 (2006)MATHCrossRef
10.
Zurück zum Zitat Jin, R., Ghahramani, Z.: Learning with multiple labels. Adv. Neural Inf. Process. Syst. 921–928 (2003) Jin, R., Ghahramani, Z.: Learning with multiple labels. Adv. Neural Inf. Process. Syst. 921–928 (2003)
11.
Zurück zum Zitat Liu, D.C., Nocedal, J.: On the limited memory BFGS method for large scale optimization. Math. Program. 45(1–3), 503–528 (1989)MathSciNetMATHCrossRef Liu, D.C., Nocedal, J.: On the limited memory BFGS method for large scale optimization. Math. Program. 45(1–3), 503–528 (1989)MathSciNetMATHCrossRef
12.
Zurück zum Zitat Liu, L., Dietterich, T.G.: A conditional multinomial mixture model for superset label learning. Adv. Neural Inf. Process. Syst. 548–556 (2012) Liu, L., Dietterich, T.G.: A conditional multinomial mixture model for superset label learning. Adv. Neural Inf. Process. Syst. 548–556 (2012)
13.
Zurück zum Zitat Luo, J., Orabona, F.: Learning from candidate labeling sets. Adv. Neural Inf. Process. Syst. 1504–1512 (2010) Luo, J., Orabona, F.: Learning from candidate labeling sets. Adv. Neural Inf. Process. Syst. 1504–1512 (2010)
14.
Zurück zum Zitat Lyu, G., Feng, S., Wang, T., Lang, C., Li, Y.: GM-Pll: Graph matching based partial label learning. arXiv preprint arXiv:1901.03073 (2019) Lyu, G., Feng, S., Wang, T., Lang, C., Li, Y.: GM-Pll: Graph matching based partial label learning. arXiv preprint arXiv:​1901.​03073 (2019)
15.
Zurück zum Zitat Nguyen, N., Caruana, R.: Classification with partial labels. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 551–559. ACM (2008) Nguyen, N., Caruana, R.: Classification with partial labels. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 551–559. ACM (2008)
16.
Zurück zum Zitat Panis, G., Lanitis, A., Tsapatsoulis, N., Cootes, T.F.: Overview of research on facial ageing using the FG-net ageing database. IET Biometrics 5(2), 37–46 (2016)CrossRef Panis, G., Lanitis, A., Tsapatsoulis, N., Cootes, T.F.: Overview of research on facial ageing using the FG-net ageing database. IET Biometrics 5(2), 37–46 (2016)CrossRef
17.
Zurück zum Zitat Yi-Chen, C., Patel, V.M., Chellappa, R., Phillips, P.J.: Ambiguously labeled learning using dictionaries. IEEE Trans. Inf. Foren. Secur. 9(12), 2076–2088 (2014)CrossRef Yi-Chen, C., Patel, V.M., Chellappa, R., Phillips, P.J.: Ambiguously labeled learning using dictionaries. IEEE Trans. Inf. Foren. Secur. 9(12), 2076–2088 (2014)CrossRef
18.
Zurück zum Zitat Yu, F., Zhang, M.L.: Maximum margin partial label learning. In: Asian Conference on Machine Learning, pp. 96–111 (2016) Yu, F., Zhang, M.L.: Maximum margin partial label learning. In: Asian Conference on Machine Learning, pp. 96–111 (2016)
19.
Zurück zum Zitat Zhang, M.L., Yu, F.: Solving the partial label learning problem: an instance-based approach. In: Twenty-Fourth International Joint Conference on Artificial Intelligence (2015) Zhang, M.L., Yu, F.: Solving the partial label learning problem: an instance-based approach. In: Twenty-Fourth International Joint Conference on Artificial Intelligence (2015)
20.
Zurück zum Zitat Zhang, M.L., Yu, F., Tang, C.Z.: Disambiguation-free partial label learning. IEEE Trans. Knowl. Data Eng. 29(10), 2155–2167 (2017)CrossRef Zhang, M.L., Yu, F., Tang, C.Z.: Disambiguation-free partial label learning. IEEE Trans. Knowl. Data Eng. 29(10), 2155–2167 (2017)CrossRef
21.
Zurück zum Zitat Zhang, M.L., Zhou, B.B., Liu, X.Y.: Partial label learning via feature-aware disambiguation. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1335–1344. ACM (2016) Zhang, M.L., Zhou, B.B., Liu, X.Y.: Partial label learning via feature-aware disambiguation. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1335–1344. ACM (2016)
22.
Zurück zum Zitat Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Schölkopf, B.: Learning with local and global consistency. Adv. Neural Inf. Process. syst. 16, 321–328 (2004) Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Schölkopf, B.: Learning with local and global consistency. Adv. Neural Inf. Process. syst. 16, 321–328 (2004)
23.
Zurück zum Zitat Zhou, Y., He, J., Gu, H.: Partial label learning via gaussian processes. IEEE Trans. Cybern. 47(12), 4443–4450 (2017)CrossRef Zhou, Y., He, J., Gu, H.: Partial label learning via gaussian processes. IEEE Trans. Cybern. 47(12), 4443–4450 (2017)CrossRef
24.
Zurück zum Zitat Zhu, X., Goldberg, A.B.: Introduction to semi-supervised learning. Synthesis Lect. Artif. Intell. Mach. Learn. 3(1), 1–130 (2009)MATHCrossRef Zhu, X., Goldberg, A.B.: Introduction to semi-supervised learning. Synthesis Lect. Artif. Intell. Mach. Learn. 3(1), 1–130 (2009)MATHCrossRef
Metadaten
Titel
PP-PLL: Probability Propagation for Partial Label Learning
verfasst von
Kaiwei Sun
Zijian Min
Jin Wang
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-46147-8_8