Skip to main content

2014 | OriginalPaper | Buchkapitel

Robust PCA: Optimization of the Robust Reconstruction Error Over the Stiefel Manifold

verfasst von : Anastasia Podosinnikova, Simon Setzer, Matthias Hein

Erschienen in: Pattern Recognition

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

It is well known that Principal Component Analysis (PCA) is strongly affected by outliers and a lot of effort has been put into robustification of PCA. In this paper we present a new algorithm for robust PCA minimizing the trimmed reconstruction error. By directly minimizing over the Stiefel manifold, we avoid deflation as often used by projection pursuit methods. In distinction to other methods for robust PCA, our method has no free parameter and is computationally very efficient. We illustrate the performance on various datasets including an application to background modeling and subtraction. Our method performs better or similar to current state-of-the-art methods while being faster.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The breakdown point [8] of a statistical estimator is informally speaking the fraction of points which can be arbitrarily changed and the estimator is still well defined.
 
2
Note, that the LLD algorithm [14] and the OPRPCA algorithm [20] are equivalent.
 
Literatur
1.
Zurück zum Zitat Bouwmans, T.: Recent advanced statistical background modeling for foreground detection: a systematic survey. Recent Pat. Comput. Sci. 4(3), 147–176 (2011) Bouwmans, T.: Recent advanced statistical background modeling for foreground detection: a systematic survey. Recent Pat. Comput. Sci. 4(3), 147–176 (2011)
2.
Zurück zum Zitat Candès, E., Li, X., Ma, Y., Wright, J.: Robust principal component analysis? J. ACM 58(3), 11:1–11:37 (2011)CrossRef Candès, E., Li, X., Ma, Y., Wright, J.: Robust principal component analysis? J. ACM 58(3), 11:1–11:37 (2011)CrossRef
3.
Zurück zum Zitat Croux, C., Pilzmoser, P., Oliveira, M.R.: Algorithms for projection-pursuit robust principal component analysis. Chemometr. Intell. Lab. Syst. 87, 218–225 (2007)CrossRef Croux, C., Pilzmoser, P., Oliveira, M.R.: Algorithms for projection-pursuit robust principal component analysis. Chemometr. Intell. Lab. Syst. 87, 218–225 (2007)CrossRef
4.
Zurück zum Zitat Hampel, F.R., Ronchetti, E.M., Rousseeuw, P.J., Stahel, W.A.: Robust Statistics: The Approach Based on Influence Functions. John Wiley and Sons, New York (1986)MATH Hampel, F.R., Ronchetti, E.M., Rousseeuw, P.J., Stahel, W.A.: Robust Statistics: The Approach Based on Influence Functions. John Wiley and Sons, New York (1986)MATH
5.
6.
Zurück zum Zitat Horn, R., Johnson, C.: Matrix Analysis. Cambridge University Press, Cambridge (1990)MATH Horn, R., Johnson, C.: Matrix Analysis. Cambridge University Press, Cambridge (1990)MATH
8.
Zurück zum Zitat Huber, P., Ronchetti, E.: Robust Statistics, 2nd edn. John Wiley and Sons, New York (2009)CrossRefMATH Huber, P., Ronchetti, E.: Robust Statistics, 2nd edn. John Wiley and Sons, New York (2009)CrossRefMATH
9.
Zurück zum Zitat Jolliffe, I.: Principal Component Analysis. Springer Series in Statistics, 2nd edn. Springer, New York (2002)MATH Jolliffe, I.: Principal Component Analysis. Springer Series in Statistics, 2nd edn. Springer, New York (2002)MATH
10.
Zurück zum Zitat Journée, M., Nesterov, Y., Richtárik, P., Sepulchre, R.: Generalized power method for sparse principal component analysis. J. Mach. Learn. Res. 1(1), 517–553 (2010) Journée, M., Nesterov, Y., Richtárik, P., Sepulchre, R.: Generalized power method for sparse principal component analysis. J. Mach. Learn. Res. 1(1), 517–553 (2010)
11.
Zurück zum Zitat Li, G., Chen, Z.: Projection-pursuit approach to robust dispersion matrices and principal components: primary theory and Monte Carlo. J. Am. Stat. Assoc. 80(391), 759–766 (1985)CrossRefMATH Li, G., Chen, Z.: Projection-pursuit approach to robust dispersion matrices and principal components: primary theory and Monte Carlo. J. Am. Stat. Assoc. 80(391), 759–766 (1985)CrossRefMATH
12.
Zurück zum Zitat Mackey, L.: Deflation methods for sparse PCA. In: 24th Conference on Neural Information Processing Systems, pp. 1017–1024 (2009) Mackey, L.: Deflation methods for sparse PCA. In: 24th Conference on Neural Information Processing Systems, pp. 1017–1024 (2009)
13.
Zurück zum Zitat Mateos, G., Giannakis, G.: Robust PCA as bilinear decomposition with outlier-sparsity regularization. IEEE Trans. Signal Process. 60(10), 5176–5190 (2012)MathSciNetCrossRef Mateos, G., Giannakis, G.: Robust PCA as bilinear decomposition with outlier-sparsity regularization. IEEE Trans. Signal Process. 60(10), 5176–5190 (2012)MathSciNetCrossRef
14.
Zurück zum Zitat McCoy, M., Tropp, J.A.: Two proposals for robust PCA using semidefinite programming. Electron. J. Stat. 5, 1123–1160 (2011)MathSciNetCrossRefMATH McCoy, M., Tropp, J.A.: Two proposals for robust PCA using semidefinite programming. Electron. J. Stat. 5, 1123–1160 (2011)MathSciNetCrossRefMATH
17.
Zurück zum Zitat De la Torre, F., Black, M.: Robust principal component analysis for computer vision. In: 8th IEEE International Conference on Computer Vision, pp. 362–369 (2001) De la Torre, F., Black, M.: Robust principal component analysis for computer vision. In: 8th IEEE International Conference on Computer Vision, pp. 362–369 (2001)
18.
Zurück zum Zitat Wright, J., Peng, Y., Ma, Y., Ganesh, A., Rao, S.: Robust principal component analysis: exact recovery of corrupted low-rank matrices by convex optimization. In: 24th Conference on Neural Information Processing Systems, pp. 2080–2088 (2009) Wright, J., Peng, Y., Ma, Y., Ganesh, A., Rao, S.: Robust principal component analysis: exact recovery of corrupted low-rank matrices by convex optimization. In: 24th Conference on Neural Information Processing Systems, pp. 2080–2088 (2009)
19.
Zurück zum Zitat Xu, H., Caramanis, C., Mannor, S.: Outlier-robust PCA: the high dimensional case. IEEE Trans. Inf. Theory 59(1), 546–572 (2013)MathSciNetCrossRef Xu, H., Caramanis, C., Mannor, S.: Outlier-robust PCA: the high dimensional case. IEEE Trans. Inf. Theory 59(1), 546–572 (2013)MathSciNetCrossRef
20.
Zurück zum Zitat Xu, H., Caramanis, C., Sanghavi, S.: Robust PCA via outlier pursuit. IEEE Trans. Inf. Theory 58(5), 3047–3064 (2012)MathSciNetCrossRef Xu, H., Caramanis, C., Sanghavi, S.: Robust PCA via outlier pursuit. IEEE Trans. Inf. Theory 58(5), 3047–3064 (2012)MathSciNetCrossRef
21.
Zurück zum Zitat Xu, L., Yuille, A.L.: Robust principal component analysis by self-organizing rules based on statistical physics approach. IEEE Trans. Neural Networks 6, 131–143 (1995)CrossRef Xu, L., Yuille, A.L.: Robust principal component analysis by self-organizing rules based on statistical physics approach. IEEE Trans. Neural Networks 6, 131–143 (1995)CrossRef
Metadaten
Titel
Robust PCA: Optimization of the Robust Reconstruction Error Over the Stiefel Manifold
verfasst von
Anastasia Podosinnikova
Simon Setzer
Matthias Hein
Copyright-Jahr
2014
DOI
https://doi.org/10.1007/978-3-319-11752-2_10