Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 6/2019

27.03.2018 | Original Article

Semi-supervised discriminant Isomap with application to visualization, image retrieval and classification

verfasst von: Rui Huang, Guopeng Zhang, Junli Chen

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 6/2019

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

As one of the most promising nonlinear unsupervised dimensionality reduction (DR) technique, the Isomap reveals the intrinsic geometric structure of manifold by preserving geodesic distance of all data pairs. Recently, some supervised versions of Isomap have been presented to guide the manifold learning and increase the discriminating capability. However, the performance may deteriorate when there is no sufficient prior information available. Hence, a novel semi-supervised discriminant Isomap (SSD-Isomap) is proposed in the paper. First, two pairwise constraints including must-link and likely-link (LL) are used to depict the neighborhoods of data points. Then, two graphs are constructed based on the two constraints, and distances between points belonging to the LL constraint are modified by a scale parameter. Finally, the geodesic distance metric is obtained based on the graphs, and the corresponding optimal nonlinear subspace is sought. The performance of SSD-Isomap is evaluated by extensive experiments of data visualization, image retrieval and classification. Compared with other state-of-the-art DR methods, SSD-Isomap presents more accurate and robust results.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Musa AB (2014) A comparison of ℓ1-regularizion, PCA, KPCA and ICA for dimensionality reduction in logistic regression. Int J Mach Learn Cybern 5(6):861–873CrossRef Musa AB (2014) A comparison of ℓ1-regularizion, PCA, KPCA and ICA for dimensionality reduction in logistic regression. Int J Mach Learn Cybern 5(6):861–873CrossRef
2.
Zurück zum Zitat Sharma A, Paliwal KK (2015) Linear discriminant analysis for the small sample size problem: an overview. Int J Mach Learn Cybern 6(3):443–454CrossRef Sharma A, Paliwal KK (2015) Linear discriminant analysis for the small sample size problem: an overview. Int J Mach Learn Cybern 6(3):443–454CrossRef
3.
Zurück zum Zitat Cai D, He X, Han J (2008) Training linear discriminant analysis in linear time. In: IEEE 24th international conference on data engineering, Cancun, pp 209–217 Cai D, He X, Han J (2008) Training linear discriminant analysis in linear time. In: IEEE 24th international conference on data engineering, Cancun, pp 209–217
5.
Zurück zum Zitat Belkin M, Niyogi P (2002) Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering. Adv Neural Inf Process Syst 14(6):585–591 Belkin M, Niyogi P (2002) Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering. Adv Neural Inf Process Syst 14(6):585–591
6.
Zurück zum Zitat Raducanu B, Dornaika F (2012) A supervised non-linear dimensionality reduction approach for manifold learning. Pattern Recognit 45(6):2432–2444CrossRefMATH Raducanu B, Dornaika F (2012) A supervised non-linear dimensionality reduction approach for manifold learning. Pattern Recognit 45(6):2432–2444CrossRefMATH
7.
Zurück zum Zitat Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef
8.
Zurück zum Zitat Laurens VDM (2014) Accelerateing t-SNE using tree-based algorithms. J Mach Learn Res 15(1):3221–3245MathSciNetMATH Laurens VDM (2014) Accelerateing t-SNE using tree-based algorithms. J Mach Learn Res 15(1):3221–3245MathSciNetMATH
9.
Zurück zum Zitat Tenenbaum JB, De SV, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef Tenenbaum JB, De SV, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef
10.
Zurück zum Zitat Silva VD, Tenenbaum JB (2003) Global versus local approaches to nonlinear dimensionality reduction. In: Advances in neural information processing systems, pp 705–712 Silva VD, Tenenbaum JB (2003) Global versus local approaches to nonlinear dimensionality reduction. In: Advances in neural information processing systems, pp 705–712
11.
Zurück zum Zitat Vlachos M, Domenicon C, Gunopulos D (2002) Non-linear dimensionality reduction techniques for classification and visualization. In: Proceeding of 8th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 645–651 Vlachos M, Domenicon C, Gunopulos D (2002) Non-linear dimensionality reduction techniques for classification and visualization. In: Proceeding of 8th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 645–651
12.
Zurück zum Zitat Geng X, Zhan DC, Zhou ZH (2005) Supervised nonlinear dimensionality reduction for visualization and classification. IEEE Trans Syst Man Cybern Part B Cybern 35(6):1098–1107CrossRef Geng X, Zhan DC, Zhou ZH (2005) Supervised nonlinear dimensionality reduction for visualization and classification. IEEE Trans Syst Man Cybern Part B Cybern 35(6):1098–1107CrossRef
13.
Zurück zum Zitat Zhang Z, Chow TW, Zhao M (2012) M-Isomap: orthogonal constrained marginal isomap for nonlinear dimensionality reduction. IEEE Trans Syst Man Cybern Part B Cybern 43(1):180–191 Zhang Z, Chow TW, Zhao M (2012) M-Isomap: orthogonal constrained marginal isomap for nonlinear dimensionality reduction. IEEE Trans Syst Man Cybern Part B Cybern 43(1):180–191
14.
Zurück zum Zitat Yang B, Xiang M, Zhang Y (2016) Multi-manifold discriminant Isomap for visualization and classification. Pattern Recognit 55:215–230CrossRef Yang B, Xiang M, Zhang Y (2016) Multi-manifold discriminant Isomap for visualization and classification. Pattern Recognit 55:215–230CrossRef
15.
Zurück zum Zitat Meng M, Wei J, Wang J et al (2015) Adaptive semi-supervised dimensionality reduction based on pairwise constraints weighting and graph optimizing. Int J Mach Learn Cybern 8(3):793–805CrossRef Meng M, Wei J, Wang J et al (2015) Adaptive semi-supervised dimensionality reduction based on pairwise constraints weighting and graph optimizing. Int J Mach Learn Cybern 8(3):793–805CrossRef
16.
Zurück zum Zitat Chen WJ, Shao YH, Hong N (2013) Laplacian smooth twin support vector machine for semi-supervised classification. Int J Mach Learn Cybern 5(3):459–468CrossRef Chen WJ, Shao YH, Hong N (2013) Laplacian smooth twin support vector machine for semi-supervised classification. Int J Mach Learn Cybern 5(3):459–468CrossRef
17.
Zurück zum Zitat Wang R, Wang XZ, Kwong S et al (2017) Incorporating diversity and informativeness in multiple-instance active learning. IEEEE Trans Fuzzy Syst 25(6):1460–1475CrossRef Wang R, Wang XZ, Kwong S et al (2017) Incorporating diversity and informativeness in multiple-instance active learning. IEEEE Trans Fuzzy Syst 25(6):1460–1475CrossRef
18.
Zurück zum Zitat Luo Y, Tao D, Xu C (2013) Vector-valued multi-view semi-supervised learning for multi-label image classification. In: Proceeding of 27th AAAI conference on artificial intelligence, pp 647–653 Luo Y, Tao D, Xu C (2013) Vector-valued multi-view semi-supervised learning for multi-label image classification. In: Proceeding of 27th AAAI conference on artificial intelligence, pp 647–653
19.
Zurück zum Zitat Zhu S, Sun X, Jin D (2016) Multi-view semi-supervised learning for image classification. Neurocomputing 208:136–142CrossRef Zhu S, Sun X, Jin D (2016) Multi-view semi-supervised learning for image classification. Neurocomputing 208:136–142CrossRef
20.
Zurück zum Zitat Zhu H, Wang X (2017) A cost-sensitive semi-supervised learning model based on uncertainty. Neurocomputing 251:106–114CrossRef Zhu H, Wang X (2017) A cost-sensitive semi-supervised learning model based on uncertainty. Neurocomputing 251:106–114CrossRef
21.
Zurück zum Zitat Ashfaq RAR, Wang XZ, Huang JZ et al (2017) Fuzziness based semi-supervised learning approach for intrusion detection system. Inf Sci 378:484–497CrossRef Ashfaq RAR, Wang XZ, Huang JZ et al (2017) Fuzziness based semi-supervised learning approach for intrusion detection system. Inf Sci 378:484–497CrossRef
22.
Zurück zum Zitat Cai D, He X, Han J (2007) Semi-supervised discriminant analysis. In: IEEE 11th international conference on computer vision, pp 1–7 Cai D, He X, Han J (2007) Semi-supervised discriminant analysis. In: IEEE 11th international conference on computer vision, pp 1–7
23.
Zurück zum Zitat Yang X, Fu H, Zha H, Barlow J (2006) Semi-supervised nonlinear dimensionality reduction. In: Proceeding of 23th international conference on machine learning, pp 1065–1072 Yang X, Fu H, Zha H, Barlow J (2006) Semi-supervised nonlinear dimensionality reduction. In: Proceeding of 23th international conference on machine learning, pp 1065–1072
24.
Zurück zum Zitat Hou V, Zhang C, Wu Y, Nie F (2010) Multiple view semi-supervised dimensionality reduction. Pattern Recognit 43(3):720–730CrossRefMATH Hou V, Zhang C, Wu Y, Nie F (2010) Multiple view semi-supervised dimensionality reduction. Pattern Recognit 43(3):720–730CrossRefMATH
25.
Zurück zum Zitat Zhang D, Zhou ZH, Chen S (2007) Semi-supervised dimensional reduction. In: Proceeding of the 7th SIAM international conference on data mining (SDM’07), pp 629–634 Zhang D, Zhou ZH, Chen S (2007) Semi-supervised dimensional reduction. In: Proceeding of the 7th SIAM international conference on data mining (SDM’07), pp 629–634
26.
Zurück zum Zitat Xing EP, Ng AY, Jordan MI (2003) Distance metric learning with application to clustering with side-information. In: Advances in neural information processing systems, pp 505–512 Xing EP, Ng AY, Jordan MI (2003) Distance metric learning with application to clustering with side-information. In: Advances in neural information processing systems, pp 505–512
27.
Zurück zum Zitat Hoi SCH, Liu W, Lyu MR, Ma WY (2006) Learning distance metrics with contextual constraints for image retrieval. In: IEEE Computer Society conference on computer vision and pattern recognition (CVPR’06), pp 2072–2078 Hoi SCH, Liu W, Lyu MR, Ma WY (2006) Learning distance metrics with contextual constraints for image retrieval. In: IEEE Computer Society conference on computer vision and pattern recognition (CVPR’06), pp 2072–2078
28.
Zurück zum Zitat Xia H, Hoi SCH, Jin R, Zhao P (2014) Online multiple kernel similarity learning for visual search. IEEE Trans Pattern Anal Mach Intell 36(3):536–549CrossRef Xia H, Hoi SCH, Jin R, Zhao P (2014) Online multiple kernel similarity learning for visual search. IEEE Trans Pattern Anal Mach Intell 36(3):536–549CrossRef
29.
Zurück zum Zitat Oliveira GL, Vieira AW, Vieira AW (2014) Sparse spatial coding: a novel approach to visual recognition. IEEE Trans Image Process 23(6):2719–2731MathSciNetCrossRefMATH Oliveira GL, Vieira AW, Vieira AW (2014) Sparse spatial coding: a novel approach to visual recognition. IEEE Trans Image Process 23(6):2719–2731MathSciNetCrossRefMATH
30.
Zurück zum Zitat Yang Y, Newsam S (2010) Bag-of-visual-words and spatial extensions for land-use classification. In: Sigspatial international conference on advances in geographic information systems. ACM, pp 270–279 Yang Y, Newsam S (2010) Bag-of-visual-words and spatial extensions for land-use classification. In: Sigspatial international conference on advances in geographic information systems. ACM, pp 270–279
31.
Zurück zum Zitat Li F-F, Fergus R, Perona P (2004) Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. In: Conference on computer vision and pattern recognition workshop, pp 178–178 Li F-F, Fergus R, Perona P (2004) Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. In: Conference on computer vision and pattern recognition workshop, pp 178–178
32.
Zurück zum Zitat Georghiades AS, Belhumeur PN, Kriegman DJ (2001) From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23(6):643–660CrossRef Georghiades AS, Belhumeur PN, Kriegman DJ (2001) From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23(6):643–660CrossRef
33.
Zurück zum Zitat Peng X, Yu Z, Yi Z (2017) Constructing the L2-graph for robust subspace learning and subspace clustering. IEEE Trans Cybern 47(4):1053–1066CrossRef Peng X, Yu Z, Yi Z (2017) Constructing the L2-graph for robust subspace learning and subspace clustering. IEEE Trans Cybern 47(4):1053–1066CrossRef
34.
Zurück zum Zitat Samaria FS, Harter AC (1994) Parameterization of a stochastic model for human face identification. In: Proceedings of IEEE workshop on applications of computer vision, pp 138–142 Samaria FS, Harter AC (1994) Parameterization of a stochastic model for human face identification. In: Proceedings of IEEE workshop on applications of computer vision, pp 138–142
35.
Zurück zum Zitat Lecun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef Lecun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef
37.
Zurück zum Zitat Yu J, Tao D, Li J (2014) Semantic preserving distance metric learning and applications. Inf Sci 281:674–686MathSciNetCrossRef Yu J, Tao D, Li J (2014) Semantic preserving distance metric learning and applications. Inf Sci 281:674–686MathSciNetCrossRef
38.
Zurück zum Zitat Wu P, Hoi SCH, Zhao P, Miao C, Liu Z. Y (2016) Online multi-modal distance metric learning with application to image retrieval. IEEE Trans Knowl Data Eng 28 (2):454–467CrossRef Wu P, Hoi SCH, Zhao P, Miao C, Liu Z. Y (2016) Online multi-modal distance metric learning with application to image retrieval. IEEE Trans Knowl Data Eng 28 (2):454–467CrossRef
Metadaten
Titel
Semi-supervised discriminant Isomap with application to visualization, image retrieval and classification
verfasst von
Rui Huang
Guopeng Zhang
Junli Chen
Publikationsdatum
27.03.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 6/2019
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-018-0809-6

Weitere Artikel der Ausgabe 6/2019

International Journal of Machine Learning and Cybernetics 6/2019 Zur Ausgabe