Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Discovering High Utility Itemsets Based on the Artificial Bee Colony Algorithm Read chapter Read first chapter

2018 | OriginalPaper | Chapter

Shared Deep Kernel Learning for Dimensionality Reduction

Authors : Xinwei Jiang, Junbin Gao, Xiaobo Liu, Zhihua Cai, Dongmei Zhang, Yuanxing Liu

Published in: Advances in Knowledge Discovery and Data Mining

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Deep Kernel Learning (DKL) has been proven to be an effective method to learn complex feature representation by combining the structural properties of deep learning with the nonparametric flexibility of kernel methods, which can be naturally used for supervised dimensionality reduction. However, if limited training data are available its performance could be compromised because parameters of the deep structure embedded into the model are large and difficult to be efficiently optimized. In order to address this issue, we propose the Shared Deep Kernel Learning model by combining DKL with shared Gaussian Process Latent Variable Model. The novel method could not only bring the improved performance without increasing model complexity but also learn the hierarchical features by sharing the deep kernel. The comparison with some supervised dimensionality reduction methods and deep learning approach verify the advantages of the proposed model.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Denoising Time Series Data Using Asymmetric Generative Adversarial Networks
next chapter CDSSD: Refreshing Single Shot Object Detection Using a Conv-Deconv Network
Footnotes
Literature
1.
Bilmes, J.A., Malkin, J., Li, X., Harada, S., Kilanski, K., Kirchhoff, K., Wright, R.: The vocal joystick. In: IEEE Conference on Acoustics, Speech and Signal Processing (2006)
2.
Damianou, A.C., Lawrence, N.D.: Deep Gaussian processes. In: Artificial Intelligence and Statistics (AISTATS) (2013)
3.
Ek, C.H.: Shared Gaussian process latent variables models. Ph.D. thesis, Oxford Brookes University (2009)
4.
Eleftheriadis, S., Rudovic, O., Pantic, M.: Discriminative shared Gaussian processes for multiview and view-invariant facial expression recognition. IEEE Trans. Image Process. 24(1), 189–204 (2015)MathSciNetCrossRef
5.
Gao, J., Zhang, J., Tien, D.: Relevance units latent variable model and nonlinear dimensionality reduction. IEEE Trans. Neural Netw. 21, 123–135 (2010)CrossRef
6.
Gao, X., Wang, X., Tao, D., Li, X.: Supervised Gaussian process latent variable model for dimensionality reduction. IEEE Trans. Syst. Man Cybern. Part B Cybern. 41(99), 425–434 (2011)
7.
He, X., Yan, S., Hu, Y., Niyogi, P., Zhang, H.J.: Face recognition using laplacianfaces. IEEE Trans. Pattern Anal. Mach. Intell. 27(3), 328–340 (2005)CrossRef
8.
Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRef
9.
Jiang, X., Fang, X., Chen, Z., Gao, J., Jiang, J., Cai, Z.: Supervised Gaussian process latent variable model for hyperspectral image classification. IEEE Geosci. Remote Sens. Lett. 14(10), 1760–1764 (2017)CrossRef
10.
Jiang, X., Gao, J., Wang, T., Shi, D.: TPSLVM: a dimensionality reduction algorithm based on thin plate splines. IEEE Trans. Cybern. 44(10), 1795–1807 (2014)CrossRef
11.
Jiang, X., Gao, J., Wang, T., Zheng, L.: Supervised latent linear Gaussian process latent variable model for dimensionality reduction. IEEE Trans. Syst. Man Cybern. Part B Cybern. 42(6), 1620–1632 (2012)CrossRef
12.
Kouropteva, O., Okun, O., Pietikäinen, M.: Supervised locally linear embedding algorithm for pattern recognition. Pattern Recogn. Image Anal. 2652, 386–394 (2003)CrossRef
13.
Lawrence, N.: Probabilistic non-linear principal component analysis with gaussian process latent variable models. J. Mach. Learn. Res. 6, 1783–1816 (2005)MathSciNetMATH
14.
Li, J., Zhang, B., Zhang, D.: Shared autoencoder Gaussian process latent variable model for visual classificatio. IEEE Trans. Neural Netw. Learn. Syst. (2017, in Press)
15.
Li, X., Shu, L.: Kernel based nonlinear dimensionality reduction for microarray gene expression data analysis. Expert Syst. Appl. 36, 7644–7650 (2009)CrossRef
16.
17.
van der Maaten, L., Postma, E.O., van den Herik, H.J.: Dimensionality reduction: a comparative review. Technical report, Tilburg University (2008)
18.
Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. The MIT Press, Cambridge (2006)MATH
19.
Rue, H., Held, L.: Gaussian Markov Random Fields: Theory and Applications. Chapman and Hall/CRC, Boca Raton (2005)CrossRef
20.
Scholkopf, B., Smola, A., Muller, K.R.: Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 10(5), 1299–1319 (1998)CrossRef
21.
Snoek, J., Adams, R.P., Larochelle, H.: Nonparametric guidance of autoencoder representations using label information. J. Mach. Learn. Res. 13, 2567–2588 (2012)MathSciNetMATH
22.
Urtasun, R., Darrell, T.: Discriminative Gaussian process latent variable model for classification. In: International Conference on Machine learning (ICML), pp. 927–934. ACM (2007)
23.
Wang, W., Huang, Y., Wang, Y., Wang, L.: Generalized autoencoder: a neural network framework for dimensionality reduction. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshops), pp. 496–503 (2014)
24.
Wilson, A.G., Hu, Z., Salakhutdinov, R., Xing, E.P.: Deep kernel learning. In: The 19th International Conference on Artificial Intelligence and Statistics (AISTATS) (2016)
25.
Wilson, A.G., Nickisch, H.: Kernel interpolation for scalable structured Gaussian processes (KISS-GP). In: International Conference on Machine Learning (2015)
26.
Yang, J., Jin, Z., Yang, J.Y., Zhang, D., Frangi, A.F.: Essence of kernel fisher discriminant: KPCA plus LDA. Pattern Recogn. 37, 2097–2100 (2004)CrossRef
27.
Yu, S., Yu, K., Tresp, V., Kriegel, H.P., Wu, M.: Supervised probabilistic principal component analysis. In: International Conference on Knowledge Discovery and Data Mining (KDD), pp. 464–473. ACM Press (2006)
Metadata
Title
Shared Deep Kernel Learning for Dimensionality Reduction
Authors
Xinwei Jiang
Junbin Gao
Xiaobo Liu
Zhihua Cai
Dongmei Zhang
Yuanxing Liu
Copyright Year
2018
Book
Advances in Knowledge Discovery and Data Mining

Print ISBN: 978-3-319-93039-8

Electronic ISBN: 978-3-319-93040-4

Copyright Year: 2018

DOI
https://doi.org/10.1007/978-3-319-93040-4_24

Premium Partner

    Image Credits