Skip to main content

2015 | OriginalPaper | Buchkapitel

Two-Step Greedy Subspace Clustering

verfasst von : Lingxiao Song, Man Zhang, Zhenan Sun, Jian Liang, Ran He

Erschienen in: Advances in Multimedia Information Processing -- PCM 2015

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Greedy subspace clustering methods provide an efficient way to cluster large-scale multimedia datasets. However, these methods do not guarantee a global optimum and their clustering performance mainly depends on their initializations. To alleviate this initialization problem, this paper proposes a two-step greedy strategy by exploring proper neighbors that span an initial subspace. Firstly, for each data point, we seek a sparse representation with respect to its nearest neighbors. The data points corresponding to nonzero entries in the learning representation form an initial subspace, which potentially rejects bad or redundant data points. Secondly, the subspace is updated by adding an orthogonal basis involved with the newly added data points. Experimental results on real-world applications demonstrate that our method can significantly improve the clustering accuracy of greedy subspace clustering methods without scarifying much computational time.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
The Hopkins155 database is available online at http://​www.​vision.​jhu.​edu/​data/​hopkins155/​.
 
2
 
Literatur
1.
Zurück zum Zitat Yang, A., Wright, J., Ma, Y., Sastry, S.: Unsupervised segmentation of natural images via lossy data compression. Computer Vis. Image Underst. (CVIU) 110(2), 212–225 (2008)CrossRef Yang, A., Wright, J., Ma, Y., Sastry, S.: Unsupervised segmentation of natural images via lossy data compression. Computer Vis. Image Underst. (CVIU) 110(2), 212–225 (2008)CrossRef
2.
Zurück zum Zitat Vidal, R., Tron, R., Hartley, R.: Multiframe motion segmentation with missing data using powerfactorization and GPCA. Int. J. Comput. Vis. (IJCV) 79(1), 85–105 (2008)CrossRef Vidal, R., Tron, R., Hartley, R.: Multiframe motion segmentation with missing data using powerfactorization and GPCA. Int. J. Comput. Vis. (IJCV) 79(1), 85–105 (2008)CrossRef
3.
Zurück zum Zitat Ho, J., Yang, M.H., Lim, J., Lee, K.C., Kriegman, D.: Clustering appearances of objects under varying illumination conditions. In: Computer Vision and Pattern Recognition (CVPR) (2003) Ho, J., Yang, M.H., Lim, J., Lee, K.C., Kriegman, D.: Clustering appearances of objects under varying illumination conditions. In: Computer Vision and Pattern Recognition (CVPR) (2003)
4.
Zurück zum Zitat Hong, W., Wright, J., Huang, K., Ma, Y.: Multi-scale hybrid linear models for lossy image representation. IEEE Trans. Image Process. (TIP) 15(12), 3655–3671 (2006)CrossRef Hong, W., Wright, J., Huang, K., Ma, Y.: Multi-scale hybrid linear models for lossy image representation. IEEE Trans. Image Process. (TIP) 15(12), 3655–3671 (2006)CrossRef
5.
Zurück zum Zitat Chaudhuri, K., Kakade, S.M., Livescu, K., Sridharan, K.: Multi-view clustering via canonical correlation analysis. In: International Conference on Machine Learning (ICML) (2009) Chaudhuri, K., Kakade, S.M., Livescu, K., Sridharan, K.: Multi-view clustering via canonical correlation analysis. In: International Conference on Machine Learning (ICML) (2009)
6.
Zurück zum Zitat Zhao, X., Evans, N., Dugelay, J.L.: A subspace co-training framework for multi-view clustering. Pattern Recogn. Lett. (PRL) 41, 73–82 (2014)CrossRef Zhao, X., Evans, N., Dugelay, J.L.: A subspace co-training framework for multi-view clustering. Pattern Recogn. Lett. (PRL) 41, 73–82 (2014)CrossRef
7.
Zurück zum Zitat Vidal, R.: Subspace clustering. Sign. Process. Mag. 28(2), 52–68 (2011)CrossRef Vidal, R.: Subspace clustering. Sign. Process. Mag. 28(2), 52–68 (2011)CrossRef
8.
Zurück zum Zitat Costeira, J., Kanade, T.: A multibody factorization method for independently moving objects. Int. J. Comput. Vis. (IJCV) 29(3), 159–179 (1998)CrossRef Costeira, J., Kanade, T.: A multibody factorization method for independently moving objects. Int. J. Comput. Vis. (IJCV) 29(3), 159–179 (1998)CrossRef
9.
Zurück zum Zitat Kanatani, K.: Motion segmentation by subspace separation and model selection. In: International Conference on Computer Vision (ICCV) (2001) Kanatani, K.: Motion segmentation by subspace separation and model selection. In: International Conference on Computer Vision (ICCV) (2001)
10.
Zurück zum Zitat Vidal, R., Ma, Y., Sastry, S.: Generalized principal component analysis (GPCA). IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 27(12), 1945–1959 (2005)CrossRef Vidal, R., Ma, Y., Sastry, S.: Generalized principal component analysis (GPCA). IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 27(12), 1945–1959 (2005)CrossRef
11.
Zurück zum Zitat Zhang, T., Szlam, A., Lerman, G.: Median K-flats for hybrid linear modeling with many outliers. In: Proceedings of 2nd IEEE International Workshop on Subspace Methods, pp. 234–241 (2009) Zhang, T., Szlam, A., Lerman, G.: Median K-flats for hybrid linear modeling with many outliers. In: Proceedings of 2nd IEEE International Workshop on Subspace Methods, pp. 234–241 (2009)
12.
Zurück zum Zitat Tipping, M., Bishop, C.: Mixtures of probabilistic principal component analyzers. Neural Comput. 11(2), 443–482 (1999)CrossRef Tipping, M., Bishop, C.: Mixtures of probabilistic principal component analyzers. Neural Comput. 11(2), 443–482 (1999)CrossRef
13.
Zurück zum Zitat Yang, A.Y., Rao, S., Ma, Y.: Robust statistical estimation and segmentation of multiple subspaces. In: Computer Vision and Pattern Recognition Workshop (CVPRW) (2006) Yang, A.Y., Rao, S., Ma, Y.: Robust statistical estimation and segmentation of multiple subspaces. In: Computer Vision and Pattern Recognition Workshop (CVPRW) (2006)
14.
Zurück zum Zitat Elhamifar, E., Vidal, R.: Sparse subspace clustering. In: Computer Vision and Pattern Recognition (CVPR) (2009) Elhamifar, E., Vidal, R.: Sparse subspace clustering. In: Computer Vision and Pattern Recognition (CVPR) (2009)
15.
Zurück zum Zitat Elhamifar, E., Vidal, R.: Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 35(11), 2765–2781 (2013)CrossRef Elhamifar, E., Vidal, R.: Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 35(11), 2765–2781 (2013)CrossRef
16.
Zurück zum Zitat Liu, G., Lin, Z., Yan, S., Sun, J., Yu, Y., Ma, Y.: Robust recovery of subspace structures by low-rank representation. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 35(1), 171–184 (2013)CrossRef Liu, G., Lin, Z., Yan, S., Sun, J., Yu, Y., Ma, Y.: Robust recovery of subspace structures by low-rank representation. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 35(1), 171–184 (2013)CrossRef
17.
Zurück zum Zitat Zhang, Y., Sun, Z., He, R., Tan, T.: Robust subspace clustering via half-quadratic minimization. In: International Conference on Computer Vision (ICCV) (2013) Zhang, Y., Sun, Z., He, R., Tan, T.: Robust subspace clustering via half-quadratic minimization. In: International Conference on Computer Vision (ICCV) (2013)
18.
Zurück zum Zitat Zhang, Y., Sun, Z., He, R., Tan, T.: Robust low-rank representation via correntropy. In: Asian Conference on Pattern Recognition (ACPR) (2013) Zhang, Y., Sun, Z., He, R., Tan, T.: Robust low-rank representation via correntropy. In: Asian Conference on Pattern Recognition (ACPR) (2013)
19.
Zurück zum Zitat Wang, Y., Xu, H., Leng, C.: Provable subspace clustering: when LRR meets SSC. In: Advances in Neural Information Processing Systems (NIPS) (2013) Wang, Y., Xu, H., Leng, C.: Provable subspace clustering: when LRR meets SSC. In: Advances in Neural Information Processing Systems (NIPS) (2013)
20.
Zurück zum Zitat Chen, G., Lerman, G.: Spectral curvature clustering. Int. J. Comput. Vis. (IJCV) 81(3), 317–330 (2009)CrossRef Chen, G., Lerman, G.: Spectral curvature clustering. Int. J. Comput. Vis. (IJCV) 81(3), 317–330 (2009)CrossRef
21.
Zurück zum Zitat Dyer, E.L., Sankaranarayanan, A.C., Baraniuk, R.G.: Greedy feature selection for subspace clustering. J. Mach. Learn. Res. (JMLR) 14(1), 2487–2517 (2013)MathSciNetMATH Dyer, E.L., Sankaranarayanan, A.C., Baraniuk, R.G.: Greedy feature selection for subspace clustering. J. Mach. Learn. Res. (JMLR) 14(1), 2487–2517 (2013)MathSciNetMATH
22.
Zurück zum Zitat Heckel, R., Bölcskei, H.: Subspace clustering via thresholding and spectral clustering. In: Acoustics, Speech, and Signal Processing (ICASSP) (2013) Heckel, R., Bölcskei, H.: Subspace clustering via thresholding and spectral clustering. In: Acoustics, Speech, and Signal Processing (ICASSP) (2013)
23.
Zurück zum Zitat Park, D., Caramanis, C.: Greedy subspace clustering. In: Advances in Neural Information Processing Systems (NIPS) (2014) Park, D., Caramanis, C.: Greedy subspace clustering. In: Advances in Neural Information Processing Systems (NIPS) (2014)
24.
Zurück zum Zitat Donoho, D.L.: For most large underdetermined systems of linear equations the minimal \(l\)1-norm solution is also the sparsest solution. Commun. Pure Appl. Aathematics (CPAA) 59(6), 797–829 (2006)MathSciNetCrossRefMATH Donoho, D.L.: For most large underdetermined systems of linear equations the minimal \(l\)1-norm solution is also the sparsest solution. Commun. Pure Appl. Aathematics (CPAA) 59(6), 797–829 (2006)MathSciNetCrossRefMATH
25.
Zurück zum Zitat Tibshirani, R.: Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Series B (Methodological) 58, 267–288 (1996)MathSciNetMATH Tibshirani, R.: Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Series B (Methodological) 58, 267–288 (1996)MathSciNetMATH
26.
Zurück zum Zitat Tron, R., Vidal, R.: A benchmark for the comparison of 3-D motion segmentation algorithms. In: Computer Vision and Pattern Recognition (CVPR) (2007) Tron, R., Vidal, R.: A benchmark for the comparison of 3-D motion segmentation algorithms. In: Computer Vision and Pattern Recognition (CVPR) (2007)
27.
Zurück zum Zitat Lee, K.C., Ho, J., Kriegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 27(5), 684–698 (2005)CrossRef Lee, K.C., Ho, J., Kriegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 27(5), 684–698 (2005)CrossRef
Metadaten
Titel
Two-Step Greedy Subspace Clustering
verfasst von
Lingxiao Song
Man Zhang
Zhenan Sun
Jian Liang
Ran He
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-24075-6_5

Neuer Inhalt