Skip to main content
Erschienen in: Machine Vision and Applications 6/2018

28.02.2018 | Special Issue Paper

Rank–sparsity balanced representation for subspace clustering

verfasst von: Yuqing Xia, Zhenyue Zhang

Erschienen in: Machine Vision and Applications | Ausgabe 6/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Subspace learning has many applications such as motion segmentation and image recognition. The existing algorithms based on self-expressiveness of samples for subspace learning may suffer from the unsuitable balance between the rank and sparsity of the expressive matrix. In this paper, a new model is proposed that can balance the rank and sparsity well. This model adopts the log-determinant function to control the rank of solution. Meanwhile, the diagonals are penalized, rather than the strict zero-restriction on diagonals. This strategy makes the rank–sparsity balance more tunable. We furthermore give a new graph construction from the low-rank and sparse solution, which absorbs the advantages of the graph constructions in the sparse subspace clustering and the low-rank representation for further clustering. Numerical experiments show that the new method, named as RSBR, can significantly increase the accuracy of subspace clustering on the real-world data sets that we tested.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
We say \(\mathbf{C}_k\) is connected if a undirected graph having the adjoint matrix \(|\mathbf{C}_k|+|\mathbf{C}_k^T|\) is connected.
 
6
In this case, \(\mathbf{C}\) should be a block-diagonal matrix of K connected blocks under a permutation.
 
Literatur
1.
Zurück zum Zitat Beck, A., Teboulle, M.: A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J. Imaging Sci. 2(1), 183–202 (2009)MathSciNetCrossRefMATH Beck, A., Teboulle, M.: A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J. Imaging Sci. 2(1), 183–202 (2009)MathSciNetCrossRefMATH
2.
Zurück zum Zitat Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3(1), 1–122 (2011)CrossRefMATH Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3(1), 1–122 (2011)CrossRefMATH
4.
Zurück zum Zitat Elhamifar, E.: High-rank matrix completion and clustering under self-expressive models. In: Lee, D.D., Sugiyama, M., Luxburg, U.V., Guyon, I., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 29, pp. 73–81. Curran Associates, Inc. (2016) Elhamifar, E.: High-rank matrix completion and clustering under self-expressive models. In: Lee, D.D., Sugiyama, M., Luxburg, U.V., Guyon, I., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 29, pp. 73–81. Curran Associates, Inc. (2016)
5.
Zurück zum Zitat Elhamifar, E., Vidal, R.: Sparse subspace clustering. In: Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pp. 2790–2797 (2009) Elhamifar, E., Vidal, R.: Sparse subspace clustering. In: Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pp. 2790–2797 (2009)
6.
Zurück zum Zitat Elhamifar, E., Vidal, R.: Clustering disjoint subspaces via sparse representation. In: IEEE International Conference on Acoustics Speech and Signal Processing, pp. 1926–1929 (2010) Elhamifar, E., Vidal, R.: Clustering disjoint subspaces via sparse representation. In: IEEE International Conference on Acoustics Speech and Signal Processing, pp. 1926–1929 (2010)
7.
Zurück zum Zitat Elhamifar, E., Vidal, R.: Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans. Softw. Eng. 35(11), 2765–2781 (2013) Elhamifar, E., Vidal, R.: Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans. Softw. Eng. 35(11), 2765–2781 (2013)
8.
Zurück zum Zitat Han, J., Xiong, K., Nie, F.: Orthogonal and nonnegative graph reconstruction for large scale clustering. In: Twenty-Sixth International Joint Conference on Artificial Intelligence, pp. 1809–1815 (2017) Han, J., Xiong, K., Nie, F.: Orthogonal and nonnegative graph reconstruction for large scale clustering. In: Twenty-Sixth International Joint Conference on Artificial Intelligence, pp. 1809–1815 (2017)
10.
Zurück zum Zitat Kang, Z., Peng, C., Cheng, Q.: Robust subspace clustering via smoothed rank approximation. IEEE Signal Process. Lett. 22(11), 2088–2092 (2015)CrossRef Kang, Z., Peng, C., Cheng, Q.: Robust subspace clustering via smoothed rank approximation. IEEE Signal Process. Lett. 22(11), 2088–2092 (2015)CrossRef
12.
Zurück zum Zitat Li, C.G., Vidal, R.: Structured sparse subspace clustering: a unified optimization framework. In: Computer Vision and Pattern Recognition, pp. 277–286 (2015) Li, C.G., Vidal, R.: Structured sparse subspace clustering: a unified optimization framework. In: Computer Vision and Pattern Recognition, pp. 277–286 (2015)
13.
Zurück zum Zitat Li, C.G., Vidal, R.: A structured sparse plus structured low-rank framework for subspace clustering and completion. IEEE Trans. Signal Process. 64(24), 6557–6570 (2016)MathSciNetCrossRef Li, C.G., Vidal, R.: A structured sparse plus structured low-rank framework for subspace clustering and completion. IEEE Trans. Signal Process. 64(24), 6557–6570 (2016)MathSciNetCrossRef
15.
Zurück zum Zitat Liu, G., Lin, Z., Yu, Y.: Robust subspace segmentation by low-rank representation. In: International Conference on Machine Learning, pp. 663–670 (2010) Liu, G., Lin, Z., Yu, Y.: Robust subspace segmentation by low-rank representation. In: International Conference on Machine Learning, pp. 663–670 (2010)
16.
Zurück zum Zitat Nasihatkon, B., Hartley, R.: Graph connectivity in sparse subspace clustering. In: Computer Vision and Pattern Recognition, pp. 2137–2144 (2011) Nasihatkon, B., Hartley, R.: Graph connectivity in sparse subspace clustering. In: Computer Vision and Pattern Recognition, pp. 2137–2144 (2011)
17.
Zurück zum Zitat Nene, S.A., Nayar, S.K., Murase, H.: Columbia Object Image Library (COIL-20). Technical Report CUCS-005-96 (1996) Nene, S.A., Nayar, S.K., Murase, H.: Columbia Object Image Library (COIL-20). Technical Report CUCS-005-96 (1996)
18.
Zurück zum Zitat Nie, F., Huang, H.: Subspace clustering via new low-rank model with discrete group structure constraint. In: IJCAI International Joint Conference on Artificial Intelligence 2016-January, pp. 1874–1880 (2016) Nie, F., Huang, H.: Subspace clustering via new low-rank model with discrete group structure constraint. In: IJCAI International Joint Conference on Artificial Intelligence 2016-January, pp. 1874–1880 (2016)
19.
Zurück zum Zitat Oh, T.H., Matsushita, Y., Tai, Y.W., Kweon, I.S.: Fast randomized singular value thresholding for nuclear norm minimization. In: Computer Vision and Pattern Recognition, pp. 4484–4493 (2015) Oh, T.H., Matsushita, Y., Tai, Y.W., Kweon, I.S.: Fast randomized singular value thresholding for nuclear norm minimization. In: Computer Vision and Pattern Recognition, pp. 4484–4493 (2015)
20.
Zurück zum Zitat Park, D., Caramanis, C., Sanghavi, S.: Greedy subspace clustering. In: International Conference on Neural Information Processing Systems, pp. 2753–2761 (2014) Park, D., Caramanis, C., Sanghavi, S.: Greedy subspace clustering. In: International Conference on Neural Information Processing Systems, pp. 2753–2761 (2014)
21.
Zurück zum Zitat Rahmani, M., Atia, G.K.: Innovation pursuit: a new approach to subspace clustering. IEEE Trans. Signal Process. 65(23), 6276–6291 (2017)MathSciNetCrossRef Rahmani, M., Atia, G.K.: Innovation pursuit: a new approach to subspace clustering. IEEE Trans. Signal Process. 65(23), 6276–6291 (2017)MathSciNetCrossRef
22.
Zurück zum Zitat Soltanolkotabi, M., Cands, E.J.: A geometric analysis of subspace clustering with outliers. Ann. Stat. 40(4), 2012 (2012)MathSciNetCrossRef Soltanolkotabi, M., Cands, E.J.: A geometric analysis of subspace clustering with outliers. Ann. Stat. 40(4), 2012 (2012)MathSciNetCrossRef
24.
Zurück zum Zitat Tron, R., Vidal, R.: A benchmark for the comparison of 3D motion segmentation algorithms. In: Computer Vision and Pattern Recognition, 2007. CVPR ’07. IEEE Conference on, pp. 1–8 (2007) Tron, R., Vidal, R.: A benchmark for the comparison of 3D motion segmentation algorithms. In: Computer Vision and Pattern Recognition, 2007. CVPR ’07. IEEE Conference on, pp. 1–8 (2007)
26.
Zurück zum Zitat Vidal, R., Ma, Y., Sastry, S.: Generalized principal component analysis (GPCA). IEEE Trans. Pattern Anal. Mach. Intell. 27(12), 1945–1959 (2005)CrossRef Vidal, R., Ma, Y., Sastry, S.: Generalized principal component analysis (GPCA). IEEE Trans. Pattern Anal. Mach. Intell. 27(12), 1945–1959 (2005)CrossRef
28.
Zurück zum Zitat Wang, J., Shi, D., Cheng, D., Zhang, Y., Gao, J.: LRSR: low-rank-sparse representation for subspace clustering. Neurocomputing 214, 1026–1037 (2016)CrossRef Wang, J., Shi, D., Cheng, D., Zhang, Y., Gao, J.: LRSR: low-rank-sparse representation for subspace clustering. Neurocomputing 214, 1026–1037 (2016)CrossRef
29.
Zurück zum Zitat Wang, Y.X., Xu, H.: Noisy sparse subspace clustering J. Mach. Learn. Res. (2013) Wang, Y.X., Xu, H.: Noisy sparse subspace clustering J. Mach. Learn. Res. (2013)
30.
Zurück zum Zitat Wang, Y.X., Xu, H., Leng, C.: Provable subspace clustering: when LRR meets SSC. In: International Conference on Neural Information Processing Systems, pp 64–72 (2013) Wang, Y.X., Xu, H., Leng, C.: Provable subspace clustering: when LRR meets SSC. In: International Conference on Neural Information Processing Systems, pp 64–72 (2013)
31.
Zurück zum Zitat Wang, Y., Yin, W., Zeng, J.: Global convergence of ADMM in nonconvex nonsmooth optimization. UCLA CAM Report 15–62 (2015) Wang, Y., Yin, W., Zeng, J.: Global convergence of ADMM in nonconvex nonsmooth optimization. UCLA CAM Report 15–62 (2015)
32.
Zurück zum Zitat Wei, S., Lin, Z.: Analysis and improvement of low rank representation for subspace segmentation. Computer Vision and Pattern Recognition. arXiv:1107.1561v1 (2011) Wei, S., Lin, Z.: Analysis and improvement of low rank representation for subspace segmentation. Computer Vision and Pattern Recognition. arXiv:​1107.​1561v1 (2011)
33.
Zurück zum Zitat Wu, F., Zhou, Y., Yang, Y., Tang, S., Zhang, Y., Zhuang, Y.: Sparse multi-modal hashing. IEEE Trans. Multimed. 16(2), 427–439 (2014)CrossRef Wu, F., Zhou, Y., Yang, Y., Tang, S., Zhang, Y., Zhuang, Y.: Sparse multi-modal hashing. IEEE Trans. Multimed. 16(2), 427–439 (2014)CrossRef
34.
Zurück zum Zitat Xu, Y., Fang, X., Wu, J., Li, X., Zhang, D.: Discriminative transfer subspace learning via low-rank and sparse representation. IEEE Trans. Image Process. A Publ. IEEE Signal Process. Soc. 25(2), 850 (2016)MathSciNetCrossRef Xu, Y., Fang, X., Wu, J., Li, X., Zhang, D.: Discriminative transfer subspace learning via low-rank and sparse representation. IEEE Trans. Image Process. A Publ. IEEE Signal Process. Soc. 25(2), 850 (2016)MathSciNetCrossRef
35.
Zurück zum Zitat Yan, S., Xu, D., Zhang, B., Zhang, H.J., Yang, Q., Lin, S.: Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 29(1), 40 (2007)CrossRef Yan, S., Xu, D., Zhang, B., Zhang, H.J., Yang, Q., Lin, S.: Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 29(1), 40 (2007)CrossRef
36.
Zurück zum Zitat Yang, J., Yin, W., Zhang, Y., Wang, Y.: A fast algorithm for edge-preserving variational multichannel image restoration. SIAM J. Imaging Sci. 2(2), 569–592 (2011)MathSciNetCrossRefMATH Yang, J., Yin, W., Zhang, Y., Wang, Y.: A fast algorithm for edge-preserving variational multichannel image restoration. SIAM J. Imaging Sci. 2(2), 569–592 (2011)MathSciNetCrossRefMATH
37.
Zurück zum Zitat Yang, Y., Feng, J., Jojic, N., Yang, J., Huang, T.S.: \(\ell ^{0}\) -sparse subspace clustering. In: European Conference on Computer Vision, pp. 731–747 (2016) Yang, Y., Feng, J., Jojic, N., Yang, J., Huang, T.S.: \(\ell ^{0}\) -sparse subspace clustering. In: European Conference on Computer Vision, pp. 731–747 (2016)
38.
Zurück zum Zitat Yu, J., Hong, C., Rui, Y., Tao, D.: Multitask autoencoder model for recovering human poses. IEEE Trans Ind Electron 65(6), 5060–5068 (2018)CrossRef Yu, J., Hong, C., Rui, Y., Tao, D.: Multitask autoencoder model for recovering human poses. IEEE Trans Ind Electron 65(6), 5060–5068 (2018)CrossRef
39.
Zurück zum Zitat Yu, Z., Wu, F., Yang, Y., Tian, Q., Luo, J., Zhuang, Y.: Discriminative coupled dictionary hashing for fast cross-media retrieval. In: International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 395–404 (2014) Yu, Z., Wu, F., Yang, Y., Tian, Q., Luo, J., Zhuang, Y.: Discriminative coupled dictionary hashing for fast cross-media retrieval. In: International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 395–404 (2014)
Metadaten
Titel
Rank–sparsity balanced representation for subspace clustering
verfasst von
Yuqing Xia
Zhenyue Zhang
Publikationsdatum
28.02.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
Machine Vision and Applications / Ausgabe 6/2018
Print ISSN: 0932-8092
Elektronische ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-018-0918-y

Weitere Artikel der Ausgabe 6/2018

Machine Vision and Applications 6/2018 Zur Ausgabe