Skip to main content
Erschienen in: Neural Processing Letters 3/2020

28.05.2020

Local Structure Preservation for Nonlinear Clustering

verfasst von: Linjun Chen, Guangquan Lu, Yangding Li, Jiaye Li, Malong Tan

Erschienen in: Neural Processing Letters | Ausgabe 3/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we propose a new nonlinear clustering method to preserve local structure of the features. Specifically, our method applies the gaussian kernel function to achieve high dimensional projection so as to make the original data linearly separable. Our method establishes the similarity matrix of data features in low-dimensional space to conduct local structure learning, as a result, it can avoid the divergence of sample sets and retain the original nearest neighbor structural relations. Furthermore, our method uses the sparse learning to remove the redundant features to make the model more robust in the process of learning. Experimental results on eight benchmark datasets show that our proposed method was superior to the state-of-the-art clustering methods in terms of clustering performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
3.
Zurück zum Zitat Shen F, Xu Y, Liu L, Yang Y, Huang Z, Shen HT (2018) Unsupervised deep hashing with similarity-adaptive and discrete optimization. IEEE Trans Pattern Anal Mach Intell 40(12):3034CrossRef Shen F, Xu Y, Liu L, Yang Y, Huang Z, Shen HT (2018) Unsupervised deep hashing with similarity-adaptive and discrete optimization. IEEE Trans Pattern Anal Mach Intell 40(12):3034CrossRef
4.
Zurück zum Zitat Bu Z, Li HJ, Cao J, Wang Z, Gao G (2019) Dynamic cluster formation game for attributed graph clusteringdynamic cluster formation game for attributed graph clustering. IEEE Trans Cybern 49(1):328CrossRef Bu Z, Li HJ, Cao J, Wang Z, Gao G (2019) Dynamic cluster formation game for attributed graph clusteringdynamic cluster formation game for attributed graph clustering. IEEE Trans Cybern 49(1):328CrossRef
5.
Zurück zum Zitat Li CC, Dong Y, Herrera F (2019) A consensus model for large-scale linguistic group decision making with a feedback recommendation based on clustered personalized individual semantics and opposing consensus groups. IEEE Trans Fuzzy Syst 27(2):1CrossRef Li CC, Dong Y, Herrera F (2019) A consensus model for large-scale linguistic group decision making with a feedback recommendation based on clustered personalized individual semantics and opposing consensus groups. IEEE Trans Fuzzy Syst 27(2):1CrossRef
6.
Zurück zum Zitat Feng Z, Fan J, Liu H, Rong L, Chen CW (2019) Noise robust multiobjective evolutionary clustering image segmentation motivated by the intuitionistic fuzzy information. IEEE Trans Fuzzy Syst 27(2):1CrossRef Feng Z, Fan J, Liu H, Rong L, Chen CW (2019) Noise robust multiobjective evolutionary clustering image segmentation motivated by the intuitionistic fuzzy information. IEEE Trans Fuzzy Syst 27(2):1CrossRef
7.
Zurück zum Zitat Zhu W, Lu J, Jie Z (2018) Nonlinear subspace clustering for image clustering. Pattern Recognit Lett 107:131–136 Zhu W, Lu J, Jie Z (2018) Nonlinear subspace clustering for image clustering. Pattern Recognit Lett 107:131–136
9.
Zurück zum Zitat Gu F, Cheung YM (2018) Self-organizing map-based weight design for decomposition-based many-objective evolutionary algorithm. IEEE Trans Evol Comput 22(2):211CrossRef Gu F, Cheung YM (2018) Self-organizing map-based weight design for decomposition-based many-objective evolutionary algorithm. IEEE Trans Evol Comput 22(2):211CrossRef
10.
Zurück zum Zitat Ferles C, Papanikolaou Y, Naidoo KJ (2018) Denoising autoencoder self-organizing map (DASOM). Neural Netw 105:S0893608018301382CrossRef Ferles C, Papanikolaou Y, Naidoo KJ (2018) Denoising autoencoder self-organizing map (DASOM). Neural Netw 105:S0893608018301382CrossRef
11.
Zurück zum Zitat Matić F, Kalinić H, Vilibić I (2018) Interpreting self-organizing map errors in the classification of ocean patterns. Comput Geosci 119:9–17CrossRef Matić F, Kalinić H, Vilibić I (2018) Interpreting self-organizing map errors in the classification of ocean patterns. Comput Geosci 119:9–17CrossRef
12.
Zurück zum Zitat Fathi-Hafshejani S, Mansouri H, Peyghami MR, Chen S (2018) Primal-dual interior-point method for linear optimization based on a kernel function with trigonometric growth term. Optimization 67:1605–1630MathSciNetMATHCrossRef Fathi-Hafshejani S, Mansouri H, Peyghami MR, Chen S (2018) Primal-dual interior-point method for linear optimization based on a kernel function with trigonometric growth term. Optimization 67:1605–1630MathSciNetMATHCrossRef
13.
Zurück zum Zitat Gang L, Li H, Ling Z (2018) Novel model using kernel function and local intensity information for noise image segmentation novel model using kernel function and local intensity information for noise image segmentation. Tsinghua Sci Technol 23(3):303CrossRef Gang L, Li H, Ling Z (2018) Novel model using kernel function and local intensity information for noise image segmentation novel model using kernel function and local intensity information for noise image segmentation. Tsinghua Sci Technol 23(3):303CrossRef
14.
Zurück zum Zitat Tolic D, Antulov-Fantulin N, Kopriva I (2018) A nonlinear orthogonal non-negative matrix factorization approach to subspace clustering. Pattern Recognit 82:40–55CrossRef Tolic D, Antulov-Fantulin N, Kopriva I (2018) A nonlinear orthogonal non-negative matrix factorization approach to subspace clustering. Pattern Recognit 82:40–55CrossRef
15.
16.
Zurück zum Zitat Piciarelli C, Micheloni C, Foresti GL (2013) Kernel-based clustering. Electron Lett 49(2):113CrossRef Piciarelli C, Micheloni C, Foresti GL (2013) Kernel-based clustering. Electron Lett 49(2):113CrossRef
17.
Zurück zum Zitat Ben-Hur A, Horn D, Siegelmann HT, Vapnik V (2001) Support vector clustering. J Mach Learn Res 2(2):125MATH Ben-Hur A, Horn D, Siegelmann HT, Vapnik V (2001) Support vector clustering. J Mach Learn Res 2(2):125MATH
18.
Zurück zum Zitat Jiang M, Liu F, Wang Y, Shou G, Huang W, Zhang H (2012) A hybrid model of maximum margin clustering method and support vector regression for noninvasive electrocardiographic imaging. Comput Math Methods Med 2012:436281MathSciNetMATH Jiang M, Liu F, Wang Y, Shou G, Huang W, Zhang H (2012) A hybrid model of maximum margin clustering method and support vector regression for noninvasive electrocardiographic imaging. Comput Math Methods Med 2012:436281MathSciNetMATH
19.
Zurück zum Zitat Chen L, Lu G, Wen G, Li J, Tan M (2019) A nonlinear clustering algorithm via kernel function and locality structure learning. In: 2019 IEEE Symposium Series on Computational Intelligence (SSCI), pp 2603-2607 Chen L, Lu G, Wen G, Li J, Tan M (2019) A nonlinear clustering algorithm via kernel function and locality structure learning. In: 2019 IEEE Symposium Series on Computational Intelligence (SSCI), pp 2603-2607
20.
Zurück zum Zitat Wagstaff K, Cardie C, Rogers S (2001) Constrained K-means clustering with background knowledge. In: Icml, vol 1, pp 577–584 Wagstaff K, Cardie C, Rogers S (2001) Constrained K-means clustering with background knowledge. In: Icml, vol 1, pp 577–584
21.
Zurück zum Zitat Bradley PS, Fayyad UM (1998) Refining initial points for K-means clustering. In: ICML, vol 98, pp 91–99 Bradley PS, Fayyad UM (1998) Refining initial points for K-means clustering. In: ICML, vol 98, pp 91–99
22.
Zurück zum Zitat Zhao W, Ma H, He Q (2009) Parallel K-means clustering based on MapReduce. In: IEEE international conference on cloud computing, pp 674–679 Zhao W, Ma H, He Q (2009) Parallel K-means clustering based on MapReduce. In: IEEE international conference on cloud computing, pp 674–679
23.
Zurück zum Zitat He X, Niyogi P (2004) Locality preserving projections. In: Advances in neural information processing systems, pp 153–160 He X, Niyogi P (2004) Locality preserving projections. In: Advances in neural information processing systems, pp 153–160
24.
Zurück zum Zitat Nie F, Zhang R, Li X (2017) A generalized power iteration method for solving quadratic problem on the Stiefel manifold. Sci China Inf Sci 60(11):112101MathSciNetCrossRef Nie F, Zhang R, Li X (2017) A generalized power iteration method for solving quadratic problem on the Stiefel manifold. Sci China Inf Sci 60(11):112101MathSciNetCrossRef
25.
Zurück zum Zitat Jiwen L, Yap-Peng T (2010) Regularized locality preserving projections and its extensions for face recognition. IEEE Trans Syst Man Cybern Part B Cybern 40(3):958CrossRef Jiwen L, Yap-Peng T (2010) Regularized locality preserving projections and its extensions for face recognition. IEEE Trans Syst Man Cybern Part B Cybern 40(3):958CrossRef
26.
Zurück zum Zitat Zhang S, Li X, Zong M, Zhu X, Wang R (2018) Efficient knn classification with different numbers of nearest neighbors. IEEE Trans Neural Netw Learn Syst 29(5):1774MathSciNetCrossRef Zhang S, Li X, Zong M, Zhu X, Wang R (2018) Efficient knn classification with different numbers of nearest neighbors. IEEE Trans Neural Netw Learn Syst 29(5):1774MathSciNetCrossRef
27.
Zurück zum Zitat Luo Y, Yang Y, Shen F, Huang Z, Zhou P, Shen HT (2018) Robust discrete code modeling for supervised hashing. Pattern Recognit 75:128CrossRef Luo Y, Yang Y, Shen F, Huang Z, Zhou P, Shen HT (2018) Robust discrete code modeling for supervised hashing. Pattern Recognit 75:128CrossRef
28.
Zurück zum Zitat Hu M, Yang Y, Shen F, Xie N, Shen HT (2018) Hashing with angular reconstructive embeddings. IEEE Trans Image Process 27(2):545MathSciNetMATHCrossRef Hu M, Yang Y, Shen F, Xie N, Shen HT (2018) Hashing with angular reconstructive embeddings. IEEE Trans Image Process 27(2):545MathSciNetMATHCrossRef
29.
Zurück zum Zitat Wei Z, Kang P, Fang X, Teng L, Na H (2019) Joint sparse representation and locality preserving projection for feature extraction. Int J Mach Learn Cybernet 10:1731–1745CrossRef Wei Z, Kang P, Fang X, Teng L, Na H (2019) Joint sparse representation and locality preserving projection for feature extraction. Int J Mach Learn Cybernet 10:1731–1745CrossRef
30.
Zurück zum Zitat Albadareen B, Ismail N (2018) Adaptive kernel function using line transect sampling. In: AIP Conference Proceedings, vol 1940, pp 020112 Albadareen B, Ismail N (2018) Adaptive kernel function using line transect sampling. In: AIP Conference Proceedings, vol 1940, pp 020112
31.
Zurück zum Zitat Zhang K, Tsang IW, Kwok JT (2009) Maximum margin clustering made practical. IEEE Trans Neural Netw 20(4):583CrossRef Zhang K, Tsang IW, Kwok JT (2009) Maximum margin clustering made practical. IEEE Trans Neural Netw 20(4):583CrossRef
33.
Zurück zum Zitat Zhu X, Zhang S, Li Y, Zhang J, Yang L, Fang Y (2019) Low-rank sparse subspace for spectral clustering. IEEE Trans Knowl Data Eng 31(8):1532CrossRef Zhu X, Zhang S, Li Y, Zhang J, Yang L, Fang Y (2019) Low-rank sparse subspace for spectral clustering. IEEE Trans Knowl Data Eng 31(8):1532CrossRef
34.
Zurück zum Zitat Zhu X, Li X, Zhang S, Xu Z, Yu L, Wang C (2017) Graph pca hashing for similarity search. IEEE Trans Multimed 19(9):2033CrossRef Zhu X, Li X, Zhang S, Xu Z, Yu L, Wang C (2017) Graph pca hashing for similarity search. IEEE Trans Multimed 19(9):2033CrossRef
35.
Zurück zum Zitat Zhang Z, Liu L, Shen F, Shen HT, Shao L (2019) Binary multi-view clustering. IEEE Trans Pattern Anal Mach Intell 41(7):1774CrossRef Zhang Z, Liu L, Shen F, Shen HT, Shao L (2019) Binary multi-view clustering. IEEE Trans Pattern Anal Mach Intell 41(7):1774CrossRef
36.
Zurück zum Zitat Zhang Z, Lai Z, Huang Z, Wong W, Xie G, Liu L, Shao L (2019) Scalable supervised asymmetric hashing with semantic and latent factor embedding. IEEE Trans Image Process 28(10):4803MathSciNetMATHCrossRef Zhang Z, Lai Z, Huang Z, Wong W, Xie G, Liu L, Shao L (2019) Scalable supervised asymmetric hashing with semantic and latent factor embedding. IEEE Trans Image Process 28(10):4803MathSciNetMATHCrossRef
37.
Zurück zum Zitat Xie GS, Zhang Z, Liu L, Zhu F, Zhang XY, Shao L, Li X (2019) SRSC: selective, robust, and supervised constrained feature representation for image classification. IEEE Trans Neural Netw Learn Syst 99(1):1–14 Xie GS, Zhang Z, Liu L, Zhu F, Zhang XY, Shao L, Li X (2019) SRSC: selective, robust, and supervised constrained feature representation for image classification. IEEE Trans Neural Netw Learn Syst 99(1):1–14
39.
Zurück zum Zitat Wang B, Yang Y, Xu X, Hanjalic A, Shen HT (2017) Adversarial cross-modal retrieval. In: Proceedings of the 2017 ACM on multimedia conference, pp 154–162 Wang B, Yang Y, Xu X, Hanjalic A, Shen HT (2017) Adversarial cross-modal retrieval. In: Proceedings of the 2017 ACM on multimedia conference, pp 154–162
40.
Zurück zum Zitat Lin Y, Zhu X, Zheng Z, Dou Z, Zhou R (2019) The individual identification method of wireless device based on dimensionality reduction and machine learning. J Supercomput 75:3010–3027CrossRef Lin Y, Zhu X, Zheng Z, Dou Z, Zhou R (2019) The individual identification method of wireless device based on dimensionality reduction and machine learning. J Supercomput 75:3010–3027CrossRef
41.
Zurück zum Zitat Lu J, Rui L, Shiwei M, Liu L (2017) A novel locality constrained dictionary learning for nonlinear dimensionality reduction and classification. IET Comput Vision 11(1):60CrossRef Lu J, Rui L, Shiwei M, Liu L (2017) A novel locality constrained dictionary learning for nonlinear dimensionality reduction and classification. IET Comput Vision 11(1):60CrossRef
42.
Zurück zum Zitat Wang R, Nie F, Hong R, Chang X, Yang X, Yu W (2017) Fast and orthogonal locality preserving projections for dimensionality reduction. IEEE Trans Image Process 26(10):5019MathSciNetMATHCrossRef Wang R, Nie F, Hong R, Chang X, Yang X, Yu W (2017) Fast and orthogonal locality preserving projections for dimensionality reduction. IEEE Trans Image Process 26(10):5019MathSciNetMATHCrossRef
43.
Zurück zum Zitat Chun H, Keleş S (2010) Sparse partial least squares regression for simultaneous dimension reduction and variable selection. J R Stat Soc 72(1):3–25MathSciNetMATHCrossRef Chun H, Keleş S (2010) Sparse partial least squares regression for simultaneous dimension reduction and variable selection. J R Stat Soc 72(1):3–25MathSciNetMATHCrossRef
44.
Zurück zum Zitat Li Z, Zhang Z, Qin J, Zhang Z, Shao L (2019) Discriminative Fisher embedding dictionary learning algorithm for object recognition. IEEE Trans Neural Netw Learn Syst 99(1):1 Li Z, Zhang Z, Qin J, Zhang Z, Shao L (2019) Discriminative Fisher embedding dictionary learning algorithm for object recognition. IEEE Trans Neural Netw Learn Syst 99(1):1
47.
Zurück zum Zitat Zhu X, Zhang S, Hu R, He W, Lei C, Zhu P (2019) One-step multi-view spectral clustering. IEEE Trans Knowl Data Eng 31(10):2022CrossRef Zhu X, Zhang S, Hu R, He W, Lei C, Zhu P (2019) One-step multi-view spectral clustering. IEEE Trans Knowl Data Eng 31(10):2022CrossRef
49.
Zurück zum Zitat Gordon G, Tibshirani R (2012) Karush-kuhn-tucker conditions. Optimization 10(725/36):725 Gordon G, Tibshirani R (2012) Karush-kuhn-tucker conditions. Optimization 10(725/36):725
50.
Zurück zum Zitat Nesterov Y (2013) Introductory lectures on convex optimization: a basic course (applied optimization). Springer, vol 87, pp xviii, 236 Nesterov Y (2013) Introductory lectures on convex optimization: a basic course (applied optimization). Springer, vol 87, pp xviii, 236
51.
Zurück zum Zitat Jain AK (2010) Data clustering: 50 years beyond K-means. Pattern Recognit Lett 31(8):651–666 Jain AK (2010) Data clustering: 50 years beyond K-means. Pattern Recognit Lett 31(8):651–666
52.
Zurück zum Zitat Liu X, Wang L, Zhang J, Yin J, Liu H (2017) Global and local structure preservation for feature selection. IEEE Trans Neural Netw Learn Syst 25(6):1083 Liu X, Wang L, Zhang J, Yin J, Liu H (2017) Global and local structure preservation for feature selection. IEEE Trans Neural Netw Learn Syst 25(6):1083
53.
Zurück zum Zitat Wang S, Yuan X, Yao T, Yan S, Shen J (2011) Efficient subspace segmentation via quadratic programming. In: Twenty-Fifth AAAI Conference on Artificial Intelligence, vol 1, pp 519–524 Wang S, Yuan X, Yao T, Yan S, Shen J (2011) Efficient subspace segmentation via quadratic programming. In: Twenty-Fifth AAAI Conference on Artificial Intelligence, vol 1, pp 519–524
54.
Zurück zum Zitat Xu L, Li W, Schuurmans D (2009) Fast normalized cut with linear constraints. In: IEEE conference on computer vision and pattern recognition, pp 2866–2873 Xu L, Li W, Schuurmans D (2009) Fast normalized cut with linear constraints. In: IEEE conference on computer vision and pattern recognition, pp 2866–2873
55.
Zurück zum Zitat Elhamifar E, Vidal R (2013) Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell 35(11):2765CrossRef Elhamifar E, Vidal R (2013) Sparse subspace clustering: algorithm, theory, and applications. IEEE Trans Pattern Anal Mach Intell 35(11):2765CrossRef
Metadaten
Titel
Local Structure Preservation for Nonlinear Clustering
verfasst von
Linjun Chen
Guangquan Lu
Yangding Li
Jiaye Li
Malong Tan
Publikationsdatum
28.05.2020
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 3/2020
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-020-10251-6

Weitere Artikel der Ausgabe 3/2020

Neural Processing Letters 3/2020 Zur Ausgabe

Neuer Inhalt