Skip to main content
Erschienen in: International Journal of Computer Vision 3/2013

01.02.2013

Euler Principal Component Analysis

verfasst von: Stephan Liwicki, Georgios Tzimiropoulos, Stefanos Zafeiriou, Maja Pantic

Erschienen in: International Journal of Computer Vision | Ausgabe 3/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Principal Component Analysis (PCA) is perhaps the most prominent learning tool for dimensionality reduction in pattern recognition and computer vision. However, the 2-norm employed by standard PCA is not robust to outliers. In this paper, we propose a kernel PCA method for fast and robust PCA, which we call Euler-PCA (e-PCA). In particular, our algorithm utilizes a robust dissimilarity measure based on the Euler representation of complex numbers. We show that Euler-PCA retains PCA’s desirable properties while suppressing outliers. Moreover, we formulate Euler-PCA in an incremental learning framework which allows for efficient computation. In our experiments we apply Euler-PCA to three different computer vision applications for which our method performs comparably with other state-of-the-art approaches.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
Without loss of generality we assume zero mean.
 
2
We set α=1.9, as will be discussed later, in Sect. 4.
 
3
The fingerspelling alphabet is a subset of sign language which is utilized for spelling names. Examples can be found at http://​asl.​ms/​.
 
4
The Matlab implementation is publicly available at http://​www.​cs.​toronto.​edu/​~dross/​ivt/​.
 
5
The Matlab implementation of the IKPCA was kindly provided by the authors of the paper.
 
7
The implementation (only for translation motion model) is publicly available at http://​vision.​ucsd.​edu/​~bbabenko/​project_​miltrack.​shtml, we carefully modified it in order to support an affine motion model in a particle filter framework.
 
9
MATLAB implementations on a desktop computer with Intel Core i7 870 at 2.93 GHz and 8 GB RAM.
 
Literatur
Zurück zum Zitat Babenko, B., Yang, M., & Belongie, S. (2009). Visual tracking with online multiple instance learning. In CVPR’09 (pp. 983–990). Babenko, B., Yang, M., & Belongie, S. (2009). Visual tracking with online multiple instance learning. In CVPR’09 (pp. 983–990).
Zurück zum Zitat Babenko, B., Yang, M., & Belongie, S. (2011). Robust object tracking with online multiple instance learning. IEEE Transactions on Pattern Analysis and Machine Intelligence. doi:10.1109/TPAMI.2010.226. Babenko, B., Yang, M., & Belongie, S. (2011). Robust object tracking with online multiple instance learning. IEEE Transactions on Pattern Analysis and Machine Intelligence. doi:10.​1109/​TPAMI.​2010.​226.
Zurück zum Zitat Chin, T., Schindler, K., & Suter, D. (2006). Incremental kernel SVD for face recognition with image sets. In FG’06 (pp. 461–466). Chin, T., Schindler, K., & Suter, D. (2006). Incremental kernel SVD for face recognition with image sets. In FG’06 (pp. 461–466).
Zurück zum Zitat Cohn, J., Zlochower, A., Lien, J., & Kanade, T. (1999). Automated face analysis by feature point tracking has high concurrent validity with manual FACS coding. Psychophysiology, 35–43. doi:10.1017/S0048577299971184. Cohn, J., Zlochower, A., Lien, J., & Kanade, T. (1999). Automated face analysis by feature point tracking has high concurrent validity with manual FACS coding. Psychophysiology, 35–43. doi:10.​1017/​S004857729997118​4.
Zurück zum Zitat Collins, R., Lipton, J., Fujiyoshi, H., & Kanade, T. (2001). Algorithms for cooperative multisensor surveillance. In The IEEE (p. 89). doi:10.1109/5.959341. Collins, R., Lipton, J., Fujiyoshi, H., & Kanade, T. (2001). Algorithms for cooperative multisensor surveillance. In The IEEE (p. 89). doi:10.​1109/​5.​959341.
Zurück zum Zitat Ding, D., Zhou, D., He, X., & Zha, H. (2006). R1-PCA: rotational invariant L1-norm principal component analysis for robust subspace factorization. In ACM (pp. 281–288). doi:10.1145/1143844.1143880. Ding, D., Zhou, D., He, X., & Zha, H. (2006). R1-PCA: rotational invariant L1-norm principal component analysis for robust subspace factorization. In ACM (pp. 281–288). doi:10.​1145/​1143844.​1143880.
Zurück zum Zitat Fraundorfer, F., Engels, C., & Nistér, D. (2007). Topological mapping, localization and navigation using image collections. In Intell. robots and systems (pp. 3872–3877). Fraundorfer, F., Engels, C., & Nistér, D. (2007). Topological mapping, localization and navigation using image collections. In Intell. robots and systems (pp. 3872–3877).
Zurück zum Zitat Gunawan, H., Neswan, O., & Budhi, W. (2005). A formula for angles between subspaces of inner product spaces. Contributions to Algebra and Geometry, 46(2), 311–320. MathSciNetMATH Gunawan, H., Neswan, O., & Budhi, W. (2005). A formula for angles between subspaces of inner product spaces. Contributions to Algebra and Geometry, 46(2), 311–320. MathSciNetMATH
Zurück zum Zitat Gunes, H., & Pantic, M. (2010). Automatic, dimensional and continuous emotion recognition. International Journal of Synthetic Emotion, 68–99. doi:10.4018/jse.2010101605. Gunes, H., & Pantic, M. (2010). Automatic, dimensional and continuous emotion recognition. International Journal of Synthetic Emotion, 68–99. doi:10.​4018/​jse.​2010101605.
Zurück zum Zitat Handmann, U., Kalinke, T., & Tzomakas, C. (1998). Computer vision for driver assistance systems. Proc. SPIE, 136–147. doi:10.1117/12.317463. Handmann, U., Kalinke, T., & Tzomakas, C. (1998). Computer vision for driver assistance systems. Proc. SPIE, 136–147. doi:10.​1117/​12.​317463.
Zurück zum Zitat Haritaoglu, I., Harwood, D., & Davis, L. (2000). W4: real-time surveillance of people and their activities. IEEE Transactions on Pattern Analysis and Machine Intelligence, 809–830. doi:10.1109/34.868683. Haritaoglu, I., Harwood, D., & Davis, L. (2000). W4: real-time surveillance of people and their activities. IEEE Transactions on Pattern Analysis and Machine Intelligence, 809–830. doi:10.​1109/​34.​868683.
Zurück zum Zitat Hashima, M., Hasegawa, F., Kanda, S., Maruyama, T., & Uchiyama, T. (1997). Localization and obstacle detection for a robot for carrying food trays. In Intell. robots and systems (pp. 345–351). Hashima, M., Hasegawa, F., Kanda, S., Maruyama, T., & Uchiyama, T. (1997). Localization and obstacle detection for a robot for carrying food trays. In Intell. robots and systems (pp. 345–351).
Zurück zum Zitat He, R., Hu, B., Zheng, W., & Kong, X. (2011). Robust principal component analysis based on maximum correntropy criterion. IEEE Transactions on Image Processing, 1485–1494. doi:10.1109/TIP.2010.2103949. He, R., Hu, B., Zheng, W., & Kong, X. (2011). Robust principal component analysis based on maximum correntropy criterion. IEEE Transactions on Image Processing, 1485–1494. doi:10.​1109/​TIP.​2010.​2103949.
Zurück zum Zitat Honeine, P., & Richard, C. (2011). Preimage problem in kernel-based machine learning. IEEE Signal Processing Magazine, 28(2), 77–88. CrossRef Honeine, P., & Richard, C. (2011). Preimage problem in kernel-based machine learning. IEEE Signal Processing Magazine, 28(2), 77–88. CrossRef
Zurück zum Zitat Hsieh, J., Yu, S., Chen, Y., & Hu, W. (2006). Automatic traffic surveillance system for vehicle tracking and classification. IEEE Transactions on Intelligent Transportation Systems, 175–187. doi:10.1109/TITS.2006.874722. Hsieh, J., Yu, S., Chen, Y., & Hu, W. (2006). Automatic traffic surveillance system for vehicle tracking and classification. IEEE Transactions on Intelligent Transportation Systems, 175–187. doi:10.​1109/​TITS.​2006.​874722.
Zurück zum Zitat Jolliffe, T. (2002). Principal component analysis (2nd edn.). Berlin: Springer. MATH Jolliffe, T. (2002). Principal component analysis (2nd edn.). Berlin: Springer. MATH
Zurück zum Zitat Kamijo, S., Matsushita, Y., Ikeuchi, K., & Sakauchi, M. (2000). Traffic monitoring and accident detection at intersections. IEEE Transactions on Intelligent Transportation Systems, 108–118. doi:10.1109/6979.880968. Kamijo, S., Matsushita, Y., Ikeuchi, K., & Sakauchi, M. (2000). Traffic monitoring and accident detection at intersections. IEEE Transactions on Intelligent Transportation Systems, 108–118. doi:10.​1109/​6979.​880968.
Zurück zum Zitat Ke, Q., & Kanade, T. (2003). Robust subspace computation using L1 norm (Tech. Rep. CMU-CS-03-172). Computer Science Department, Carnegie Mellon University. Ke, Q., & Kanade, T. (2003). Robust subspace computation using L1 norm (Tech. Rep. CMU-CS-03-172). Computer Science Department, Carnegie Mellon University.
Zurück zum Zitat Ke, Q., & Kanade, T. (2005). Robust L1 norm factorization in the presence of outliers and missing data by alternative convex programming. In CVPR’05 (pp. 739–746). Ke, Q., & Kanade, T. (2005). Robust L1 norm factorization in the presence of outliers and missing data by alternative convex programming. In CVPR’05 (pp. 739–746).
Zurück zum Zitat Kwak, N. (2008). Principal component analysis based on L1-norm maximization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1672–1680. doi:10.1109/TPAMI.2008.114. Kwak, N. (2008). Principal component analysis based on L1-norm maximization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1672–1680. doi:10.​1109/​TPAMI.​2008.​114.
Zurück zum Zitat Kwok, J., & Tsang, I. (2004). The pre-image problem in kernel methods. IEEE Transactions on Neural Networks, 15(6), 1517–1525. CrossRef Kwok, J., & Tsang, I. (2004). The pre-image problem in kernel methods. IEEE Transactions on Neural Networks, 15(6), 1517–1525. CrossRef
Zurück zum Zitat Levy, A., & Lindenbaum, M. (2000). Sequential Karhunen-Loeve basis extraction and its application to images. IEEE Transactions on Image Processing, 1371–1374. doi:10.1109/83.855432. Levy, A., & Lindenbaum, M. (2000). Sequential Karhunen-Loeve basis extraction and its application to images. IEEE Transactions on Image Processing, 1371–1374. doi:10.​1109/​83.​855432.
Zurück zum Zitat Li, L., Huang, W., Gu, I., & Tian, Q. (2004). Statistical modeling of complex backgrounds for foreground object detection. IEEE Transactions on Image Processing, 13(11), 1459–1472. CrossRef Li, L., Huang, W., Gu, I., & Tian, Q. (2004). Statistical modeling of complex backgrounds for foreground object detection. IEEE Transactions on Image Processing, 13(11), 1459–1472. CrossRef
Zurück zum Zitat Liu, W., Pokharel, P., & Principe, J. (2007). Correntropy: properties and applications in non-Gaussian signal processing. IEEE Transactions on Signal Processing, 5286–5298. doi:10.1109/TSP.2007.896065. Liu, W., Pokharel, P., & Principe, J. (2007). Correntropy: properties and applications in non-Gaussian signal processing. IEEE Transactions on Signal Processing, 5286–5298. doi:10.​1109/​TSP.​2007.​896065.
Zurück zum Zitat Liwicki, S., & Everingham, M. (2009). Automatic recognition of fingerspelled words in British sign language. In CVPR4HB’09, in conj. with CVPR’09 (pp. 50–57). Liwicki, S., & Everingham, M. (2009). Automatic recognition of fingerspelled words in British sign language. In CVPR4HB’09, in conj. with CVPR’09 (pp. 50–57).
Zurück zum Zitat Luo, Y., Wu, T., & Hwang, J. (2003). Object-based analysis and interpretation of human motion in sports video sequences by dynamic Bayesian networks. Computer Vision and Image Understanding, 196–216. doi:10.1016/j.cviu.2003.08.001. Luo, Y., Wu, T., & Hwang, J. (2003). Object-based analysis and interpretation of human motion in sports video sequences by dynamic Bayesian networks. Computer Vision and Image Understanding, 196–216. doi:10.​1016/​j.​cviu.​2003.​08.​001.
Zurück zum Zitat Maddalena, L., & Petrosino, A. (2008). A self-organizing approach to background subtraction for visual surveillance applications. IEEE Transactions on Image Processing, 1168–1177. doi:10.1109/TIP.2008.924285. Maddalena, L., & Petrosino, A. (2008). A self-organizing approach to background subtraction for visual surveillance applications. IEEE Transactions on Image Processing, 1168–1177. doi:10.​1109/​TIP.​2008.​924285.
Zurück zum Zitat Martinez, A., & Benavente, R. (1998). The AR face database (Tech. Rep. #24). The Ohio State University. Martinez, A., & Benavente, R. (1998). The AR face database (Tech. Rep. #24). The Ohio State University.
Zurück zum Zitat Mei, X., & Ling, H. (2009). Robust visual tracking using L1 minimization. In ICCV’09. Mei, X., & Ling, H. (2009). Robust visual tracking using L1 minimization. In ICCV’09.
Zurück zum Zitat Mika, S., Schölkopf, B., Smola, A., Müller, K., Scholz, M., & Rätsch, G. (1999). Kernel pca and de-noising in feature spaces. Advances in Neural Information Processing Systems, 11(1), 536–542. Mika, S., Schölkopf, B., Smola, A., Müller, K., Scholz, M., & Rätsch, G. (1999). Kernel pca and de-noising in feature spaces. Advances in Neural Information Processing Systems, 11(1), 536–542.
Zurück zum Zitat Nguyen, M., & de la Torre, F. (2009). Robust kernel principal component analysis. In Advances in NIPS (pp. 1185–1192). Nguyen, M., & de la Torre, F. (2009). Robust kernel principal component analysis. In Advances in NIPS (pp. 1185–1192).
Zurück zum Zitat Oliver, N., Rosario, B., & Pentland, A. (2000). A Bayesian computer vision system for modeling human interactions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 831–843. doi:10.1109/34.868684. Oliver, N., Rosario, B., & Pentland, A. (2000). A Bayesian computer vision system for modeling human interactions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 831–843. doi:10.​1109/​34.​868684.
Zurück zum Zitat Ross, D., Lim, J., Lin, R., & Yang, M. (2008). Incremental learning for robust visual tracking. International Journal of Computer Vision, 125–141. doi:10.1007/s11263-007-0075-7. Ross, D., Lim, J., Lin, R., & Yang, M. (2008). Incremental learning for robust visual tracking. International Journal of Computer Vision, 125–141. doi:10.​1007/​s11263-007-0075-7.
Zurück zum Zitat Wren, C., Azarbayejani, A., Darrel, T., & Pentland, A. (1997). Pfinder: real-time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence, 780–785. doi:10.1109/34.598236. Wren, C., Azarbayejani, A., Darrel, T., & Pentland, A. (1997). Pfinder: real-time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence, 780–785. doi:10.​1109/​34.​598236.
Metadaten
Titel
Euler Principal Component Analysis
verfasst von
Stephan Liwicki
Georgios Tzimiropoulos
Stefanos Zafeiriou
Maja Pantic
Publikationsdatum
01.02.2013
Verlag
Springer US
Erschienen in
International Journal of Computer Vision / Ausgabe 3/2013
Print ISSN: 0920-5691
Elektronische ISSN: 1573-1405
DOI
https://doi.org/10.1007/s11263-012-0558-z

Weitere Artikel der Ausgabe 3/2013

International Journal of Computer Vision 3/2013 Zur Ausgabe