Skip to main content
Erschienen in: Artificial Intelligence Review 3/2019

04.08.2017

Domain adaptation network based on hypergraph regularized denoising autoencoder

verfasst von: Xuesong Wang, Yuting Ma, Yuhu Cheng

Erschienen in: Artificial Intelligence Review | Ausgabe 3/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Domain adaptation learning aims to solve the classification problems of unlabeled target domain by using rich labeled samples in source domain, but there are three main problems: negative transfer, under adaptation and under fitting. Aiming at these problems, a domain adaptation network based on hypergraph regularized denoising autoencoder (DAHDA) is proposed in this paper. To better fit the data distribution, the network is built with denoising autoencoder which can extract more robust feature representation. In the last feature and classification layers, the marginal and conditional distribution matching terms between domains are obtained via maximum mean discrepancy measurement to solve the under adaptation problem. To avoid negative transfer, the hypergraph regularization term is introduced to explore the high-order relationships among data. The classification performance of the model can be improved by preserving the statistical property and geometric structure simultaneously. Experimental results of 16 cross-domain transfer tasks verify that DAHDA outperforms other state-of-the-art methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Bellaachia A, AI-Dhelaan M (2015) Short text keyphrase extraction with hypergraphs. Prog Artif Intell 3(2):73–87CrossRef Bellaachia A, AI-Dhelaan M (2015) Short text keyphrase extraction with hypergraphs. Prog Artif Intell 3(2):73–87CrossRef
Zurück zum Zitat Bickel S, Brückner M, Scheffer T (2009) Discriminative learning under covariate shift. J Mach Learn Res 10:2137–2155MathSciNetMATH Bickel S, Brückner M, Scheffer T (2009) Discriminative learning under covariate shift. J Mach Learn Res 10:2137–2155MathSciNetMATH
Zurück zum Zitat Bruzzone L, Marconcini M (2010) Domain adaptation problems: a DASVM classification technique and a circular validation strategy. IEEE Trans Pattern Anal Mach Intell 32(5):770–787CrossRef Bruzzone L, Marconcini M (2010) Domain adaptation problems: a DASVM classification technique and a circular validation strategy. IEEE Trans Pattern Anal Mach Intell 32(5):770–787CrossRef
Zurück zum Zitat Cao B, Pan SJ, Zhang Y, Yeung DY, Yang Q (2010) Adaptive transfer learning. In: AAAI, pp 407–412 Cao B, Pan SJ, Zhang Y, Yeung DY, Yang Q (2010) Adaptive transfer learning. In: AAAI, pp 407–412
Zurück zum Zitat Chen HY, Chien JT (2015) Deep semi-supervised learning for domain adaptation. In: MLSP, pp 1–6 Chen HY, Chien JT (2015) Deep semi-supervised learning for domain adaptation. In: MLSP, pp 1–6
Zurück zum Zitat Chen XJ, Zhan YZ, Ke J, Chen XB (2015) Complex video event detection via pairwise fusion of trajectory and multi-label hypergraphs. Multimedia Tools Appl 75(22):15079–15100CrossRef Chen XJ, Zhan YZ, Ke J, Chen XB (2015) Complex video event detection via pairwise fusion of trajectory and multi-label hypergraphs. Multimedia Tools Appl 75(22):15079–15100CrossRef
Zurück zum Zitat Chen M, Xu Z, Weinberger KQ, Sha F (2012) Marginalized denoising autoencoders for domain adaptation. In: ICML, pp 767–774 Chen M, Xu Z, Weinberger KQ, Sha F (2012) Marginalized denoising autoencoders for domain adaptation. In: ICML, pp 767–774
Zurück zum Zitat Chu WS, Torre FDL, Cohn JF (2013) Selective transfer machine for personalized facial action unit detection. In: CVPR, pp 3515–3522 Chu WS, Torre FDL, Cohn JF (2013) Selective transfer machine for personalized facial action unit detection. In: CVPR, pp 3515–3522
Zurück zum Zitat Dai W, Yang Q, Xue GR, Yu Y (2007) Boosting for transfer learning. In: ICML, pp 193–200 Dai W, Yang Q, Xue GR, Yu Y (2007) Boosting for transfer learning. In: ICML, pp 193–200
Zurück zum Zitat Donahue J, Jia Y, Vinyals O, Hoffman J, Zhang N, Tzeng E, Darrell T (2014) DeCAF: a deep convolutional activation feature for generic visual recognition. In: ICML, pp 988–996 Donahue J, Jia Y, Vinyals O, Hoffman J, Zhang N, Tzeng E, Darrell T (2014) DeCAF: a deep convolutional activation feature for generic visual recognition. In: ICML, pp 988–996
Zurück zum Zitat Friedman J, Hastie T, Tibshirani R (2010) Regularization paths for generalized linear models via coordinate descent. J Stat Softw 33(1):1–22CrossRef Friedman J, Hastie T, Tibshirani R (2010) Regularization paths for generalized linear models via coordinate descent. J Stat Softw 33(1):1–22CrossRef
Zurück zum Zitat Ganin Y, Lempitsky V (2015) Unsupervised domain adaptation by backpropatation. In: ICML Ganin Y, Lempitsky V (2015) Unsupervised domain adaptation by backpropatation. In: ICML
Zurück zum Zitat Gong BQ, Shi Y, Sha F, Grauman K (2012) Geodesic flow kernel for unsupervised domain adaptation. In: CVPR, pp 2066–2073 Gong BQ, Shi Y, Sha F, Grauman K (2012) Geodesic flow kernel for unsupervised domain adaptation. In: CVPR, pp 2066–2073
Zurück zum Zitat Gretton A, Borgwardt KM, Rasch M, Schölkopf B, CSmola AJ (2006) A kernel method for the two-sample-problem. In: NIPS, pp 513–520 Gretton A, Borgwardt KM, Rasch M, Schölkopf B, CSmola AJ (2006) A kernel method for the two-sample-problem. In: NIPS, pp 513–520
Zurück zum Zitat Huang J, Smola AJ, Gretton A, Borgwardt KM, Schölkopf B (2006) Correcting sample selection bias by unlabeled data. In: NIPS, pp 601–608 Huang J, Smola AJ, Gretton A, Borgwardt KM, Schölkopf B (2006) Correcting sample selection bias by unlabeled data. In: NIPS, pp 601–608
Zurück zum Zitat Lee SI, Chatalbashev V, Vickrey D, Koller D (2007) Learning a meta-level prior for feature relevance from multiple related tasks. In: ICML, pp 489–496 Lee SI, Chatalbashev V, Vickrey D, Koller D (2007) Learning a meta-level prior for feature relevance from multiple related tasks. In: ICML, pp 489–496
Zurück zum Zitat Long MS, Cao Y, Wang JM, Jordan MI (2015) Learning transferable features with deep adaptation networks. In: ICML, pp 97–105 Long MS, Cao Y, Wang JM, Jordan MI (2015) Learning transferable features with deep adaptation networks. In: ICML, pp 97–105
Zurück zum Zitat Long MS, Wang JM, Ding GG, Sun JJ, Yu PS (2013) Transfer feature learning with joint distribution adaptation. In: ICCV, pp 2200–2207 Long MS, Wang JM, Ding GG, Sun JJ, Yu PS (2013) Transfer feature learning with joint distribution adaptation. In: ICCV, pp 2200–2207
Zurück zum Zitat Long MS, Wang JM, Ding GG, Sun JJ, Yu PS (2014a) Transfer joint matching for unsupervised domain adaptation. In: CVPR, pp 1410–1417 Long MS, Wang JM, Ding GG, Sun JJ, Yu PS (2014a) Transfer joint matching for unsupervised domain adaptation. In: CVPR, pp 1410–1417
Zurück zum Zitat Long MS, Wang JM, Ding GG, Shen D, Yang Q (2014b) Transfer learning with graph co-regularization. IEEE Trans Knowl Data Eng 26(7):1805–1818CrossRef Long MS, Wang JM, Ding GG, Shen D, Yang Q (2014b) Transfer learning with graph co-regularization. IEEE Trans Knowl Data Eng 26(7):1805–1818CrossRef
Zurück zum Zitat Lore KG, Akintayo A, Sarkar S (2016) LLNet: a deep autoencoder approach to natural low-light image enhancement. Pattern Recognit 61:650–662CrossRef Lore KG, Akintayo A, Sarkar S (2016) LLNet: a deep autoencoder approach to natural low-light image enhancement. Pattern Recognit 61:650–662CrossRef
Zurück zum Zitat Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRef Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRef
Zurück zum Zitat Pan SJ, Tsang IW, Kwok JT, Yang Q (2011) Domain adaptation via transfer component analysis. IEEE Trans Neural Netw 22(2):199–210CrossRef Pan SJ, Tsang IW, Kwok JT, Yang Q (2011) Domain adaptation via transfer component analysis. IEEE Trans Neural Netw 22(2):199–210CrossRef
Zurück zum Zitat Peng Y, Wang SH, Long XZ, Lu BL (2015) Discriminative graph regularized extreme learning machine and its application to face recognition. Neurocomputing 149:340–353CrossRef Peng Y, Wang SH, Long XZ, Lu BL (2015) Discriminative graph regularized extreme learning machine and its application to face recognition. Neurocomputing 149:340–353CrossRef
Zurück zum Zitat Raina R, Battle A, Lee H, Packer B, Ng AY (2007) Self-taught learning: transfer learning from unlabeled data. In: ICML, pp 759–766 Raina R, Battle A, Lee H, Packer B, Ng AY (2007) Self-taught learning: transfer learning from unlabeled data. In: ICML, pp 759–766
Zurück zum Zitat Raina R, Ng AY, Koller D (2006) Constructing informative priors using transfer learning. In: ICML, pp 713–720 Raina R, Ng AY, Koller D (2006) Constructing informative priors using transfer learning. In: ICML, pp 713–720
Zurück zum Zitat Schwaighofer A, Tresp V, Yu K (2004) Learning Gaussian process kernels via hierarchical Bayes. In: NIPS, pp 1209–1216 Schwaighofer A, Tresp V, Yu K (2004) Learning Gaussian process kernels via hierarchical Bayes. In: NIPS, pp 1209–1216
Zurück zum Zitat Sugiyama M, Nakajima S, Kashima H, Von BP, Kawanabe M (2008) Direct importance estimation with model selection and its application to covariate shift adaptation. In: NIPS, pp 1433–1440 Sugiyama M, Nakajima S, Kashima H, Von BP, Kawanabe M (2008) Direct importance estimation with model selection and its application to covariate shift adaptation. In: NIPS, pp 1433–1440
Zurück zum Zitat Sun BC, Feng JS, Saenko K (2016a) Return of frustratingly easy domain adaptation. In: AAAI, pp 2058–2065 Sun BC, Feng JS, Saenko K (2016a) Return of frustratingly easy domain adaptation. In: AAAI, pp 2058–2065
Zurück zum Zitat Sun BC, Saenko K (2016b) Deep CORAL: correlation alignment for deep domain adaptaion. In: ECCV, pp 443–450 Sun BC, Saenko K (2016b) Deep CORAL: correlation alignment for deep domain adaptaion. In: ECCV, pp 443–450
Zurück zum Zitat Tsai YHH, Yeh YR, Wang YCF (2016) Learning cross-domain landmarks for heterogeneous domain adaptation. In: CVPR, pp 5081–5090 Tsai YHH, Yeh YR, Wang YCF (2016) Learning cross-domain landmarks for heterogeneous domain adaptation. In: CVPR, pp 5081–5090
Zurück zum Zitat Van DML, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res 9:2579–2605MATH Van DML, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res 9:2579–2605MATH
Zurück zum Zitat Vincent P, Larochelle H, Lajoie I, Bengio Y, Mangozal PA (2010) Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11:3371–3408MathSciNetMATH Vincent P, Larochelle H, Lajoie I, Bengio Y, Mangozal PA (2010) Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11:3371–3408MathSciNetMATH
Zurück zum Zitat Vincent P, Larochelle H, Bengio Y, Mangozal PA (2008) Extracting and composing robust features with denoising autoencoders. In: ICML, pp 1096–1103 Vincent P, Larochelle H, Bengio Y, Mangozal PA (2008) Extracting and composing robust features with denoising autoencoders. In: ICML, pp 1096–1103
Zurück zum Zitat Yang B, Chen SC (2010) Sample-dependent graph construction with application to dimensionality reduction. Neurocomputing 74(1–3):301–314CrossRef Yang B, Chen SC (2010) Sample-dependent graph construction with application to dimensionality reduction. Neurocomputing 74(1–3):301–314CrossRef
Zurück zum Zitat Yu J, Tao D, Wang M (2012a) Adaptive hypergraph learning and its application in image classification. IEEE Trans Image Process 21(7):3262–3272MathSciNetCrossRefMATH Yu J, Tao D, Wang M (2012a) Adaptive hypergraph learning and its application in image classification. IEEE Trans Image Process 21(7):3262–3272MathSciNetCrossRefMATH
Zurück zum Zitat Yu J, Wang M, Tao D (2012b) Semisupervised multiview distance metric learning for cartoon synthesis. IEEE Trans Image Process 21(11):4636–4648MathSciNetCrossRefMATH Yu J, Wang M, Tao D (2012b) Semisupervised multiview distance metric learning for cartoon synthesis. IEEE Trans Image Process 21(11):4636–4648MathSciNetCrossRefMATH
Zurück zum Zitat Yu J, Rui Y, Tao D (2014) Click prediction for web image reranking using multimodal sparse coding. IEEE Trans Image Process 23(5):2019–2032MathSciNetCrossRefMATH Yu J, Rui Y, Tao D (2014) Click prediction for web image reranking using multimodal sparse coding. IEEE Trans Image Process 23(5):2019–2032MathSciNetCrossRefMATH
Zurück zum Zitat Yuan H, Tang YY (2015) Learning with hypergraph for hyperspectral image feature extraction. IEEE Trans Geosci Remote Sens Lett 12(8):1695–1699CrossRef Yuan H, Tang YY (2015) Learning with hypergraph for hyperspectral image feature extraction. IEEE Trans Geosci Remote Sens Lett 12(8):1695–1699CrossRef
Zurück zum Zitat Zhan Y, Sun J, Niu D, Mao Q, Fan J (2015) A semi-supervised incremental learning method based on adaptive probabilistic hypergraph for video semantic detection. Multimedia Tools AppI 74(15):5513–5531CrossRef Zhan Y, Sun J, Niu D, Mao Q, Fan J (2015) A semi-supervised incremental learning method based on adaptive probabilistic hypergraph for video semantic detection. Multimedia Tools AppI 74(15):5513–5531CrossRef
Zurück zum Zitat Zhao DB, Zhang QC, Wang D, Zhu YH (2016) Experience replay for optimal control of nonzero-sum game systems with unknown dynamics. IEEE Trans Cybern 46(3):1–12CrossRef Zhao DB, Zhang QC, Wang D, Zhu YH (2016) Experience replay for optimal control of nonzero-sum game systems with unknown dynamics. IEEE Trans Cybern 46(3):1–12CrossRef
Zurück zum Zitat Zhou DY, Huang JY, Schölkopf B (2006) Learning with hypergraphs: clustering, classification, and embedding. In: NIPS, pp 1601–1608 Zhou DY, Huang JY, Schölkopf B (2006) Learning with hypergraphs: clustering, classification, and embedding. In: NIPS, pp 1601–1608
Zurück zum Zitat Zhuang FZ, Cheng XH, Luo P, Pan SJ, He Q (2015) Supervised representation learning: transfer learning with deep autoencoders. In: IJCAI, pp 4119–4125 Zhuang FZ, Cheng XH, Luo P, Pan SJ, He Q (2015) Supervised representation learning: transfer learning with deep autoencoders. In: IJCAI, pp 4119–4125
Metadaten
Titel
Domain adaptation network based on hypergraph regularized denoising autoencoder
verfasst von
Xuesong Wang
Yuting Ma
Yuhu Cheng
Publikationsdatum
04.08.2017
Verlag
Springer Netherlands
Erschienen in
Artificial Intelligence Review / Ausgabe 3/2019
Print ISSN: 0269-2821
Elektronische ISSN: 1573-7462
DOI
https://doi.org/10.1007/s10462-017-9576-0

Weitere Artikel der Ausgabe 3/2019

Artificial Intelligence Review 3/2019 Zur Ausgabe