Skip to main content
Erschienen in: Journal of Computer and Systems Sciences International 4/2019

01.07.2019 | COMPUTER METHODS

Semi-Paired Multiview Clustering Based on Nonnegative Matrix Factorization

verfasst von: X. Yao, X. Chen, I. A. Matveev, H. Xue, L. Yu

Erschienen in: Journal of Computer and Systems Sciences International | Ausgabe 4/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

As data that have multiple views become widely available, the clusterization of such data based on nonnegative matrix factorization has been attracting greater attention. In the majority of studies, the statement in which all objects have images in all representations is considered. However, this is often not the case in practical problems. To resolve this issue, a novel semi-paired multiview clustering algorithm is proposed. For incomplete data, it is assumed that their views have the same indicator vector, and the paired matrix is introduced. The objects that are close to each other in each view must have identical indicators, which makes regularization and reconstruction of the manifold geometric structure possible. The proposed algorithm can work both with incomplete and complete data having multiple views. The experimental results obtained on four datasets prove its effectiveness compared to other modern algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat L. Wang and S. Chen, “Joint representation classification for collective face recognition,” Pattern Recognit. 63, 182–192 (2017).CrossRef L. Wang and S. Chen, “Joint representation classification for collective face recognition,” Pattern Recognit. 63, 182–192 (2017).CrossRef
2.
Zurück zum Zitat T. Scheffer and S. Bickel, “Multi-view clustering,” in Proceedings of the IEEE International Conference on Data Mining (IEEE Computer Soc., Washington, DC, 2004), pp. 19–26. T. Scheffer and S. Bickel, “Multi-view clustering,” in Proceedings of the IEEE International Conference on Data Mining (IEEE Computer Soc., Washington, DC, 2004), pp. 19–26.
3.
Zurück zum Zitat D. D. Lee and H. S. Seung, “Learning the parts of objects by non-negative matrix factorization,” Nature (London, U.K.) 401, 788–791 (1999).CrossRefMATH D. D. Lee and H. S. Seung, “Learning the parts of objects by non-negative matrix factorization,” Nature (London, U.K.) 401, 788–791 (1999).CrossRefMATH
4.
Zurück zum Zitat D. D. Lee and H. S. Seung, “Algorithms for non-negative matrix factorization,” in Proceedings of the 13th International Conference on Neural Information Processing Systems (MIT Press, Cambridge, MA, 2000), pp. 535–541. D. D. Lee and H. S. Seung, “Algorithms for non-negative matrix factorization,” in Proceedings of the 13th International Conference on Neural Information Processing Systems (MIT Press, Cambridge, MA, 2000), pp. 535–541.
5.
Zurück zum Zitat W. Xu, X. Liu, and Y. Gong, “Document clustering based on non-negative matrix factorization,” in Proceedings of the 26th Annual International ACM SIGIR Conference Research and Development in Information Retrieval, Canada, Toronto, 2003, pp. 267–273. W. Xu, X. Liu, and Y. Gong, “Document clustering based on non-negative matrix factorization,” in Proceedings of the 26th Annual International ACM SIGIR Conference Research and Development in Information Retrieval, Canada, Toronto, 2003, pp. 267–273.
6.
Zurück zum Zitat J. Qiang, Y. Li, Y. Yuan, and W. Liu, “Snapshot ensembles of non-negative matrix factorization for stability of topic modelling,” Appl. Intell. 48, 3963–3975 (2018).CrossRef J. Qiang, Y. Li, Y. Yuan, and W. Liu, “Snapshot ensembles of non-negative matrix factorization for stability of topic modelling,” Appl. Intell. 48, 3963–3975 (2018).CrossRef
8.
Zurück zum Zitat C. Y. Sang and D. H. Sun, “Co-clustering over multiple dynamic data streams based on non-negative matrix factorization,” Appl. Intell. 41, 487–502 (2014).CrossRef C. Y. Sang and D. H. Sun, “Co-clustering over multiple dynamic data streams based on non-negative matrix factorization,” Appl. Intell. 41, 487–502 (2014).CrossRef
9.
Zurück zum Zitat J. Liu, C. Wang, J. Gao, and J. Han, “Multi-view clustering via joint nonnegative matrix factorization,” in Proceedings of the SIAM International Conference on Data Mining, Austin, TX, 2013, pp. 252–260. J. Liu, C. Wang, J. Gao, and J. Han, “Multi-view clustering via joint nonnegative matrix factorization,” in Proceedings of the SIAM International Conference on Data Mining, Austin, TX, 2013, pp. 252–260.
10.
Zurück zum Zitat L. Wang, S. Chen, and Y. Wang, “A unified algorithm for mixed l 2, p-minimizations and its application in feature selection,” Comput. Optimiz. Appl. 58, 409–421 (2014).CrossRefMATH L. Wang, S. Chen, and Y. Wang, “A unified algorithm for mixed l 2, p-minimizations and its application in feature selection,” Comput. Optimiz. Appl. 58, 409–421 (2014).CrossRefMATH
11.
Zurück zum Zitat K. Liu, H. Wang, S. Risacher, A. Saykin, and L. Shen, “Multiple incomplete views clustering via non-negative matrix factorization with its application in Alzheimer’s disease analysis,” in Proceedings of the IEEE 15th International Symposium on Biomedical Imaging, Washington, DC, 2018, pp. 1402–1405. K. Liu, H. Wang, S. Risacher, A. Saykin, and L. Shen, “Multiple incomplete views clustering via non-negative matrix factorization with its application in Alzheimer’s disease analysis,” in Proceedings of the IEEE 15th International Symposium on Biomedical Imaging, Washington, DC, 2018, pp. 1402–1405.
12.
Zurück zum Zitat Y. Ling, X. Pan, G. Li, and X. Hu, “Clinical documents clustering based on medication/symptom names using multi-view nonnegative matrix factorization,” IEEE Trans. Nanobiosci. 14, 500–504 (2015).CrossRef Y. Ling, X. Pan, G. Li, and X. Hu, “Clinical documents clustering based on medication/symptom names using multi-view nonnegative matrix factorization,” IEEE Trans. Nanobiosci. 14, 500–504 (2015).CrossRef
13.
Zurück zum Zitat M. M. Kalayeh, H. Idrees, and M. Shah, “NMF-KNN: image annotation using weighted multi-view non-negative matrix factorization,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, 2014, pp. 184–191. M. M. Kalayeh, H. Idrees, and M. Shah, “NMF-KNN: image annotation using weighted multi-view non-negative matrix factorization,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, 2014, pp. 184–191.
14.
Zurück zum Zitat R. Rad and M. Jamzad, “Image annotation using multi-view non-negative matrix factorization with different number of basis vectors,” J. Visual Commun. Image Repres. 46, 1–12 (2017).CrossRef R. Rad and M. Jamzad, “Image annotation using multi-view non-negative matrix factorization with different number of basis vectors,” J. Visual Commun. Image Repres. 46, 1–12 (2017).CrossRef
15.
Zurück zum Zitat F. Zhong and L. Ma, “Image annotation using multi-view non-negative matrix factorization and semantic co-occurrence,” in Proceedings of the IEEE Region 10 Conference TENCON, Singapore, 2016, pp. 2453–2456. F. Zhong and L. Ma, “Image annotation using multi-view non-negative matrix factorization and semantic co-occurrence,” in Proceedings of the IEEE Region 10 Conference TENCON, Singapore, 2016, pp. 2453–2456.
16.
Zurück zum Zitat X. Zhang, H. Gao, G. Li, J. Zhao, J. Huo, J. Yin, Y. Liu, and L. Zheng, “Multi-view clustering based on graph-regularized nonnegative matrix factorization for object recognition,” Inform. Sci. 432, 463–478 (2018).MathSciNetCrossRef X. Zhang, H. Gao, G. Li, J. Zhao, J. Huo, J. Yin, Y. Liu, and L. Zheng, “Multi-view clustering based on graph-regularized nonnegative matrix factorization for object recognition,” Inform. Sci. 432, 463–478 (2018).MathSciNetCrossRef
17.
Zurück zum Zitat W. Shao, L. He, C. Lu, and P. S. Yu, “Online multi-view clustering with incomplete views,” in Proceedings of the IEEE International Conference on Big Data, Washington, DC, 2016, pp. 1012–1017. W. Shao, L. He, C. Lu, and P. S. Yu, “Online multi-view clustering with incomplete views,” in Proceedings of the IEEE International Conference on Big Data, Washington, DC, 2016, pp. 1012–1017.
18.
Zurück zum Zitat W. Shao, L. He, C. Lu, X. Wei, and P. S. Yu, “Online unsupervised multi-view feature selection,” in Proceedings of the 16th IEEE International Conference on Data Mining, Barcelona, Spain, 2016, pp. 1203–1208. W. Shao, L. He, C. Lu, X. Wei, and P. S. Yu, “Online unsupervised multi-view feature selection,” in Proceedings of the 16th IEEE International Conference on Data Mining, Barcelona, Spain, 2016, pp. 1203–1208.
19.
Zurück zum Zitat S. T. Roweis and L. K. Saul, “Nonlinear dimensionality reduction by locally linear embedding,” Science (Washington, DC, U. S.) 290 (5500), 2323–2326 (2000).CrossRef S. T. Roweis and L. K. Saul, “Nonlinear dimensionality reduction by locally linear embedding,” Science (Washington, DC, U. S.) 290 (5500), 2323–2326 (2000).CrossRef
20.
Zurück zum Zitat J. B. Tenenbaum, V. de Silva, and J. C. Langford, “A global geometric framework for nonlinear dimensionality reduction,” Science (Washington, DC, U. S.) 290 (5500), 2319–2323 (2000).CrossRef J. B. Tenenbaum, V. de Silva, and J. C. Langford, “A global geometric framework for nonlinear dimensionality reduction,” Science (Washington, DC, U. S.) 290 (5500), 2319–2323 (2000).CrossRef
21.
Zurück zum Zitat M. Belkin and P. Niyogi, “Laplacian eigenmaps and spectral techniques for embedding and clustering,” in Proceedings of the 14th International Conference on Neural Information Processing Systems: Natural and Synthetic, Vancouver, Canada, 2001, pp. 585–591. M. Belkin and P. Niyogi, “Laplacian eigenmaps and spectral techniques for embedding and clustering,” in Proceedings of the 14th International Conference on Neural Information Processing Systems: Natural and Synthetic, Vancouver, Canada, 2001, pp. 585–591.
22.
Zurück zum Zitat L. Tao, H. H. Ip, Y. Wang, and X. Shu, “Low rank approximation with sparse integration of multiple manifolds for data representation,” Appl. Intell. 42, 430–446 (2015).CrossRef L. Tao, H. H. Ip, Y. Wang, and X. Shu, “Low rank approximation with sparse integration of multiple manifolds for data representation,” Appl. Intell. 42, 430–446 (2015).CrossRef
23.
Zurück zum Zitat R. Hadsell, S. Chopra, and Y. LeCun, “Dimensionality reduction by learning an invariant mapping,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, 2006, pp. 1735–1742. R. Hadsell, S. Chopra, and Y. LeCun, “Dimensionality reduction by learning an invariant mapping,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, 2006, pp. 1735–1742.
24.
Zurück zum Zitat D. Cai, X. He, J. Han, and T. S. Huang, “Graph regularized nonnegative matrix factorization for data representation,” IEEE TPAMI 33, 1548–1560 (2011).CrossRef D. Cai, X. He, J. Han, and T. S. Huang, “Graph regularized nonnegative matrix factorization for data representation,” IEEE TPAMI 33, 1548–1560 (2011).CrossRef
25.
Zurück zum Zitat L. Zong, X. Zhang, L. Zhao, H. Yu, and Q. Zhao, “Multi-view clustering via multi-manifold regularized non-negative matrix factorization,” Neuron Networks 88, 74–89 (2017).CrossRef L. Zong, X. Zhang, L. Zhao, H. Yu, and Q. Zhao, “Multi-view clustering via multi-manifold regularized non-negative matrix factorization,” Neuron Networks 88, 74–89 (2017).CrossRef
26.
Zurück zum Zitat W. Yang, Y. Gao, L. Cao, M. Yang, and Y. Shi, “mPadal: a joint local-and-global multi-view feature selection method for activity recognition,” Appl. Intell. 41, 776–790 (2014).CrossRef W. Yang, Y. Gao, L. Cao, M. Yang, and Y. Shi, “mPadal: a joint local-and-global multi-view feature selection method for activity recognition,” Appl. Intell. 41, 776–790 (2014).CrossRef
27.
Zurück zum Zitat H. Zhao, Z. Ding, and Y. Fu, “Multi-view clustering via deep matrix factorization,” in Proceedings of the 31st AAAI Conference on Artificial Intelligence, San Francisco, CA, 2017, pp. 2921–2927. H. Zhao, Z. Ding, and Y. Fu, “Multi-view clustering via deep matrix factorization,” in Proceedings of the 31st AAAI Conference on Artificial Intelligence, San Francisco, CA, 2017, pp. 2921–2927.
28.
Zurück zum Zitat X. Xie and S. Sun, “Multi-view laplacian twin support vector machines,” Appl. Intell. 41, 1059–1068 (2014).CrossRef X. Xie and S. Sun, “Multi-view laplacian twin support vector machines,” Appl. Intell. 41, 1059–1068 (2014).CrossRef
29.
Zurück zum Zitat W. Shao, L. He, and S. Y. Philip, Multiple Incomplete Views Clustering via Weighted Nonnegative Matrix Factorization with L 2, 1 Regularization, Vol. 9284 of Lecture Notes in Computer Science, Ed. by A. Appice, P. Rodrigues, V. Santos Costa, C. Soares, J. Gama, and A. Jorge (Springer, Cham, 2015). W. Shao, L. He, and S. Y. Philip, Multiple Incomplete Views Clustering via Weighted Nonnegative Matrix Factorization with L 2, 1 Regularization, Vol. 9284 of Lecture Notes in Computer Science, Ed. by A. Appice, P. Rodrigues, V. Santos Costa, C. Soares, J. Gama, and A. Jorge (Springer, Cham, 2015).
30.
Zurück zum Zitat S. Y. Zhi and H. Zhou, “Partial multi-view clustering,” in Proceedings of the 28th AAAI Conference on Artificial Intelligence, Quebec, Canada, 2014, pp. 1968–1974. S. Y. Zhi and H. Zhou, “Partial multi-view clustering,” in Proceedings of the 28th AAAI Conference on Artificial Intelligence, Quebec, Canada, 2014, pp. 1968–1974.
31.
Zurück zum Zitat N. Rai, S. Negi, S. Chaudhury, and O. Deshmukh, “Partial multi-view clustering using graph regularized NMF,” in Proceedings of the 23rd International Conference on Pattern Recognition, Cancun, Mexico, 2016, pp. 2192–2197. N. Rai, S. Negi, S. Chaudhury, and O. Deshmukh, “Partial multi-view clustering using graph regularized NMF,” in Proceedings of the 23rd International Conference on Pattern Recognition, Cancun, Mexico, 2016, pp. 2192–2197.
32.
Zurück zum Zitat H. Zhao, H. Liu, and Y. Fu, “Incomplete multi-modal visual data grouping,” in Proceedings of the 25th International Joint Conference on Artificial Intelligence, New York, 2016, pp. 2392–2398. H. Zhao, H. Liu, and Y. Fu, “Incomplete multi-modal visual data grouping,” in Proceedings of the 25th International Joint Conference on Artificial Intelligence, New York, 2016, pp. 2392–2398.
33.
Zurück zum Zitat M. Hu and S. Chen, “Doubly aligned incomplete multi-view clustering,” in Proceedings of the 27th International Joint Conference on Artificial Intelligence, Macao, China, 2018, pp. 2262–2268. M. Hu and S. Chen, “Doubly aligned incomplete multi-view clustering,” in Proceedings of the 27th International Joint Conference on Artificial Intelligence, Macao, China, 2018, pp. 2262–2268.
34.
Zurück zum Zitat J. Wang, F. Tian, H. Yu, C. H. Liu, K. Zhan, and X. Wang, “Diverse non-negative matrix factorization for multiview data representation,” IEEE Trans. Cybern. 48, 2620–2632 (2018).CrossRef J. Wang, F. Tian, H. Yu, C. H. Liu, K. Zhan, and X. Wang, “Diverse non-negative matrix factorization for multiview data representation,” IEEE Trans. Cybern. 48, 2620–2632 (2018).CrossRef
Metadaten
Titel
Semi-Paired Multiview Clustering Based on Nonnegative Matrix Factorization
verfasst von
X. Yao
X. Chen
I. A. Matveev
H. Xue
L. Yu
Publikationsdatum
01.07.2019
Verlag
Pleiades Publishing
Erschienen in
Journal of Computer and Systems Sciences International / Ausgabe 4/2019
Print ISSN: 1064-2307
Elektronische ISSN: 1555-6530
DOI
https://doi.org/10.1134/S1064230719040117

Weitere Artikel der Ausgabe 4/2019

Journal of Computer and Systems Sciences International 4/2019 Zur Ausgabe

SYSTEMS ANALYSIS AND OPERATIONS RESEARCH

Selection of Priority Areas in Research and Development