Skip to main content
Top
Published in: Pattern Analysis and Applications 3/2020

19-02-2020 | Theoretical advances

Transductive multi-label learning from missing data using smoothed rank function

Authors: Ashkan Esmaeili, Kayhan Behdin, Mohammad Amin Fakharian, Farokh Marvasti

Published in: Pattern Analysis and Applications | Issue 3/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we propose two new algorithms for transductive multi-label learning from missing data. In transductive matrix completion (MC), the challenge is prediction while the data matrix is partially observed. The joint MC and prediction tasks are addressed simultaneously to enhance accuracy in comparison with separate tackling of each. In this setting, the labels to be predicted are modeled as missing entries inside a stacked matrix along the feature-instance data. Assuming the data matrix is of low rank, we propose a new recommendation method for transductive MC by posing the problem as a minimization of the smoothed rank function with non-affine constraints, rather than its convex surrogate. We provide convergence analysis for the proposed algorithms and illustrate their low computational complexity and robustness in comparison with other methods. The simulations are conducted on well-known real datasets in two different scenarios of randomly missing pattern with and without block-loss. The simulations reveal our methods accuracy is superior to state-of-the-art methods up to 10% in low observation rates for the scenario without block-loss. The accuracy of the proposed methods in the scenario with block-loss is comparable to the state-of-the-art while the complexity is reduced up to four times.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Alameda-Pineda X, Yan Y, Ricci E, Lanz O, Sebe N (2015) Analyzing free-standing conversational groups: a multimodal approach. In: Proceedings of the 23rd ACM international conference on multimedia Alameda-Pineda X, Yan Y, Ricci E, Lanz O, Sebe N (2015) Analyzing free-standing conversational groups: a multimodal approach. In: Proceedings of the 23rd ACM international conference on multimedia
2.
go back to reference Aste M, Boninsegna M, Freno A, Trentin E (2015) Techniques for dealing with incomplete data: a tutorial and survey. Pattern Anal Appl 18(1):1–29MathSciNetCrossRef Aste M, Boninsegna M, Freno A, Trentin E (2015) Techniques for dealing with incomplete data: a tutorial and survey. Pattern Anal Appl 18(1):1–29MathSciNetCrossRef
3.
go back to reference Bertsekas DP (1999) Nonlinear programming. Athena Scientific, BelmontMATH Bertsekas DP (1999) Nonlinear programming. Athena Scientific, BelmontMATH
4.
go back to reference Birgin EG, Martínez JM, Raydan M (2000) Nonmonotone spectral projected gradient methods on convex sets. SIAM J Optim 10(4):1196–1211MathSciNetCrossRef Birgin EG, Martínez JM, Raydan M (2000) Nonmonotone spectral projected gradient methods on convex sets. SIAM J Optim 10(4):1196–1211MathSciNetCrossRef
6.
go back to reference Dvijotham K, Fazel M (2010) A nullspace analysis of the nuclear norm heuristic for rank minimization. In: IEEE international conference on acoustics speech and signal processing (ICASSP) Dvijotham K, Fazel M (2010) A nullspace analysis of the nuclear norm heuristic for rank minimization. In: IEEE international conference on acoustics speech and signal processing (ICASSP)
7.
go back to reference Elisseeff A, Weston J (2002) A kernel method for multi-labelled classification. In: Advances in neural information processing systems, pp 681–687 Elisseeff A, Weston J (2002) A kernel method for multi-labelled classification. In: Advances in neural information processing systems, pp 681–687
8.
go back to reference Farhangfar A, Kurgan L, Dy J (2008) Impact of imputation of missing values on classification error for discrete data. Pattern Recognit 41(12):3692–3705CrossRef Farhangfar A, Kurgan L, Dy J (2008) Impact of imputation of missing values on classification error for discrete data. Pattern Recognit 41(12):3692–3705CrossRef
9.
go back to reference Goldberg A, Recht B, Xu J, Nowak R, Zhu X (2010) Transduction with matrix completion: three birds with one stone. In: Advances in neural information processing systems, pp 757–765 Goldberg A, Recht B, Xu J, Nowak R, Zhu X (2010) Transduction with matrix completion: three birds with one stone. In: Advances in neural information processing systems, pp 757–765
10.
go back to reference Kiasari MA, Jang G-J, Lee M (2017) Novel iterative approach using generative and discriminative models for classification with missing features. Neurocomputing 225:23–30CrossRef Kiasari MA, Jang G-J, Lee M (2017) Novel iterative approach using generative and discriminative models for classification with missing features. Neurocomputing 225:23–30CrossRef
11.
go back to reference Lin Z, Ding G, Hu M, Wang J, Ye X (2013) Image tag completion via image-specific and tag-specific linear sparse reconstructions. In: IEEE conference on computer vision and pattern recognition (CVPR) Lin Z, Ding G, Hu M, Wang J, Ye X (2013) Image tag completion via image-specific and tag-specific linear sparse reconstructions. In: IEEE conference on computer vision and pattern recognition (CVPR)
12.
go back to reference Little RJA, Rubin DB (2014) Statistical analysis with missing data, vol 333. Wiley, New YorkMATH Little RJA, Rubin DB (2014) Statistical analysis with missing data, vol 333. Wiley, New YorkMATH
13.
go back to reference Liu Y, Wen K, Gao Q, Gao X, Nie F (2018) SVM based multi-label learning with missing labels for image annotation. Pattern Recognit 78:307–317CrossRef Liu Y, Wen K, Gao Q, Gao X, Nie F (2018) SVM based multi-label learning with missing labels for image annotation. Pattern Recognit 78:307–317CrossRef
14.
go back to reference Liu Z, Pan Q, Dezert J, Martin A (2016) Adaptive imputation of missing values for incomplete pattern classification. Pattern Recognit 52:85–95CrossRef Liu Z, Pan Q, Dezert J, Martin A (2016) Adaptive imputation of missing values for incomplete pattern classification. Pattern Recognit 52:85–95CrossRef
15.
go back to reference Luo Y, Liu T, Tao D, Xu C (2015) Multiview matrix completion for multilabel image classification. IEEE Trans Image Process 24(8):2355–2368MathSciNetCrossRef Luo Y, Liu T, Tao D, Xu C (2015) Multiview matrix completion for multilabel image classification. IEEE Trans Image Process 24(8):2355–2368MathSciNetCrossRef
16.
go back to reference Malek-Mohammadi M, Babaie-Zadeh M, Amini A, Jutten C (2014) Recovery of low-rank matrices under affine constraints via a smoothed rank function. IEEE Trans Signal Process 62(4):981–992MathSciNetCrossRef Malek-Mohammadi M, Babaie-Zadeh M, Amini A, Jutten C (2014) Recovery of low-rank matrices under affine constraints via a smoothed rank function. IEEE Trans Signal Process 62(4):981–992MathSciNetCrossRef
17.
go back to reference Marvasti F (2012) Nonuniform sampling: theory and practice. Springer, BerlinMATH Marvasti F (2012) Nonuniform sampling: theory and practice. Springer, BerlinMATH
18.
go back to reference Moradipari A, Shahsavari S, Esmaeili A, Marvasti F (2017) Using empirical covariance matrix in enhancing prediction accuracy of linear models with missing information. In: 2017 International conference on sampling theory and applications (SampTA) Moradipari A, Shahsavari S, Esmaeili A, Marvasti F (2017) Using empirical covariance matrix in enhancing prediction accuracy of linear models with missing information. In: 2017 International conference on sampling theory and applications (SampTA)
19.
go back to reference Natarajan N, Dhillon IS (2014) Inductive matrix completion for predicting gene disease associations. Bioinformatics 30(12):i60–i68CrossRef Natarajan N, Dhillon IS (2014) Inductive matrix completion for predicting gene disease associations. Bioinformatics 30(12):i60–i68CrossRef
20.
go back to reference Shang F, Jiao LC, Liu Y, Tong H (2013) Semi-supervised learning with nuclear norm regularization. Pattern Recognit 46(8):2323–2336CrossRef Shang F, Jiao LC, Liu Y, Tong H (2013) Semi-supervised learning with nuclear norm regularization. Pattern Recognit 46(8):2323–2336CrossRef
21.
go back to reference Song Y, Zhang C, Lee J, Wang F, Xiang S, Zhang D (2009) Semi-supervised discriminative classification with application to tumorous tissues segmentation of MR brain images. Pattern Anal Appl 12(2):99–115MathSciNetCrossRef Song Y, Zhang C, Lee J, Wang F, Xiang S, Zhang D (2009) Semi-supervised discriminative classification with application to tumorous tissues segmentation of MR brain images. Pattern Anal Appl 12(2):99–115MathSciNetCrossRef
22.
go back to reference Trohidis K, Tsoumakas G, Kalliris G, Vlahavas IP (2008) Multi-label classification of music into emotions. In: ISMIR, vol 8 Trohidis K, Tsoumakas G, Kalliris G, Vlahavas IP (2008) Multi-label classification of music into emotions. In: ISMIR, vol 8
23.
24.
go back to reference Turnbull D, Barrington L, Torres D, Lanckriet G (2008) Semantic annotation and retrieval of music and sound effects. IEEE Trans Audio Speech Lang Process 16(2):467–476CrossRef Turnbull D, Barrington L, Torres D, Lanckriet G (2008) Semantic annotation and retrieval of music and sound effects. IEEE Trans Audio Speech Lang Process 16(2):467–476CrossRef
25.
go back to reference Wang Q, Ruan L, Zhang Z, Si L (2013) Learning compact hashing codes for efficient tag completion and prediction. In: Proceedings of the 22nd ACM international conference on information and knowledge management Wang Q, Ruan L, Zhang Z, Si L (2013) Learning compact hashing codes for efficient tag completion and prediction. In: Proceedings of the 22nd ACM international conference on information and knowledge management
26.
go back to reference Wu B, Lyu S, Ghanem B (2016) Constrained submodular minimization for missing labels and class imbalance in multi-label learning. In: AAAI Wu B, Lyu S, Ghanem B (2016) Constrained submodular minimization for missing labels and class imbalance in multi-label learning. In: AAAI
27.
go back to reference Xu M, Jin R, Zhou Z-H (2013) Speedup matrix completion with side information: application to multi-label learning. In: Advances in neural information processing systems, pp 2301–2309 Xu M, Jin R, Zhou Z-H (2013) Speedup matrix completion with side information: application to multi-label learning. In: Advances in neural information processing systems, pp 2301–2309
Metadata
Title
Transductive multi-label learning from missing data using smoothed rank function
Authors
Ashkan Esmaeili
Kayhan Behdin
Mohammad Amin Fakharian
Farokh Marvasti
Publication date
19-02-2020
Publisher
Springer London
Published in
Pattern Analysis and Applications / Issue 3/2020
Print ISSN: 1433-7541
Electronic ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-020-00869-6

Other articles of this Issue 3/2020

Pattern Analysis and Applications 3/2020 Go to the issue

Premium Partner