Skip to main content
Erschienen in: Knowledge and Information Systems 2/2017

07.05.2016 | Regular Paper

Visual domain adaptation via transfer feature learning

verfasst von: Jafar Tahmoresnezhad, Sattar Hashemi

Erschienen in: Knowledge and Information Systems | Ausgabe 2/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

One of the serious challenges in computer vision and image classification is learning an accurate classifier for a new unlabeled image dataset, considering that there is no available labeled training data. Transfer learning and domain adaptation are two outstanding solutions that tackle this challenge by employing available datasets, even with significant difference in distribution and properties, and transfer the knowledge from a related domain to the target domain. The main difference between these two solutions is their primary assumption about change in marginal and conditional distributions where transfer learning emphasizes on problems with same marginal distribution and different conditional distribution, and domain adaptation deals with opposite conditions. Most prior works have exploited these two learning strategies separately for domain shift problem where training and test sets are drawn from different distributions. In this paper, we exploit joint transfer learning and domain adaptation to cope with domain shift problem in which the distribution difference is significantly large, particularly vision datasets. We therefore put forward a novel transfer learning and domain adaptation approach, referred to as visual domain adaptation (VDA). Specifically, VDA reduces the joint marginal and conditional distributions across domains in an unsupervised manner where no label is available in test set. Moreover, VDA constructs condensed domain invariant clusters in the embedding representation to separate various classes alongside the domain transfer. In this work, we employ pseudo target labels refinement to iteratively converge to final solution. Employing an iterative procedure along with a novel optimization problem creates a robust and effective representation for adaptation across domains. Extensive experiments on 16 real vision datasets with different difficulties verify that VDA can significantly outperform state-of-the-art methods in image classification problem.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Gopalan R, Li R, Chellappa R (2014) Unsupervised adaptation across domain shifts by generating intermediate data representations. IEEE Trans Pattern Anal Mach Intell 36(11):2288–2302CrossRef Gopalan R, Li R, Chellappa R (2014) Unsupervised adaptation across domain shifts by generating intermediate data representations. IEEE Trans Pattern Anal Mach Intell 36(11):2288–2302CrossRef
2.
Zurück zum Zitat Gong B, Grauman K, Sha F (2013) Connecting the dots with landmarks: Discriminatively learning domain-invariant features for unsupervised domain adaptation. In: Proceedings of the 30th international conference on machine learning, pp 222–230 Gong B, Grauman K, Sha F (2013) Connecting the dots with landmarks: Discriminatively learning domain-invariant features for unsupervised domain adaptation. In: Proceedings of the 30th international conference on machine learning, pp 222–230
3.
Zurück zum Zitat Bergamo A, Torresani L (2010) Exploiting weakly-labeled web images to improve object classification: a domain adaptation approach. In: Advances in neural information processing systems, pp 181–189 Bergamo A, Torresani L (2010) Exploiting weakly-labeled web images to improve object classification: a domain adaptation approach. In: Advances in neural information processing systems, pp 181–189
4.
Zurück zum Zitat Hoffman J, Kulis B, Darrell T, Saenko K (2012) Discovering latent domains for multisource domain adaptation. In: Computer Vision–ECCV 2012, pp 702–715. Springer Hoffman J, Kulis B, Darrell T, Saenko K (2012) Discovering latent domains for multisource domain adaptation. In: Computer Vision–ECCV 2012, pp 702–715. Springer
5.
Zurück zum Zitat Chen M, Weinberger KQ, Blitzer J (2011) Co-training for domain adaptation. In: Advances in neural information processing systems, pp 2456–2464 Chen M, Weinberger KQ, Blitzer J (2011) Co-training for domain adaptation. In: Advances in neural information processing systems, pp 2456–2464
6.
Zurück zum Zitat Baktashmotlagh M, Harandi MT, Lovell BC, Salzmann M (2013) Unsupervised domain adaptation by domain invariant projection. In: 2013 IEEE international conference on computer vision (ICCV), pp 769–776 Baktashmotlagh M, Harandi MT, Lovell BC, Salzmann M (2013) Unsupervised domain adaptation by domain invariant projection. In: 2013 IEEE international conference on computer vision (ICCV), pp 769–776
7.
Zurück zum Zitat Gheisari M, Baghshah MS (2015) Unsupervised domain adaptation via representation learning and adaptive classifier learning. Neurocomputing 165:300–311CrossRef Gheisari M, Baghshah MS (2015) Unsupervised domain adaptation via representation learning and adaptive classifier learning. Neurocomputing 165:300–311CrossRef
8.
Zurück zum Zitat Tahmoresnezhad J, Hashemi S (2015) Common feature extraction in multi-source domains for transfer learning. In IEEE 2015 7th Conference on information and knowledge technology (IKT), pp 1–5 Tahmoresnezhad J, Hashemi S (2015) Common feature extraction in multi-source domains for transfer learning. In IEEE 2015 7th Conference on information and knowledge technology (IKT), pp 1–5
9.
Zurück zum Zitat Fernando B, Habrard A, Sebban M, Tuytelaars T (2013) Unsupervised visual domain adaptation using subspace alignment. In: 2013 IEEE international conference on computer vision (ICCV), pp 2960–2967 Fernando B, Habrard A, Sebban M, Tuytelaars T (2013) Unsupervised visual domain adaptation using subspace alignment. In: 2013 IEEE international conference on computer vision (ICCV), pp 2960–2967
10.
Zurück zum Zitat Xiong C, McCloskey S, Hsieh S-H, Corso JJ (2014) Latent domains modeling for visual domain adaptation. In: Proceedings of AAAI conference on artificial intelligence (AAAI) Xiong C, McCloskey S, Hsieh S-H, Corso JJ (2014) Latent domains modeling for visual domain adaptation. In: Proceedings of AAAI conference on artificial intelligence (AAAI)
11.
Zurück zum Zitat Gong B, Grauman K, Sha F (2014) Learning kernels for unsupervised domain adaptation with applications to visual object recognition. Int J Comput Vision 109(1–2):3–27MathSciNetCrossRefMATH Gong B, Grauman K, Sha F (2014) Learning kernels for unsupervised domain adaptation with applications to visual object recognition. Int J Comput Vision 109(1–2):3–27MathSciNetCrossRefMATH
12.
Zurück zum Zitat Cuong V, Duin RPW, Piqueras-Salazar I, Loog M (2013) A generalized fisher based feature extraction method for domain shift. Pattern Recognit 46(9):2510–2518CrossRef Cuong V, Duin RPW, Piqueras-Salazar I, Loog M (2013) A generalized fisher based feature extraction method for domain shift. Pattern Recognit 46(9):2510–2518CrossRef
13.
Zurück zum Zitat Gopalan R, Li R, Chellappa R (2011) Domain adaptation for object recognition: an unsupervised approach. In: 2011 IEEE international conference on computer vision (ICCV), pp 999–1006 Gopalan R, Li R, Chellappa R (2011) Domain adaptation for object recognition: an unsupervised approach. In: 2011 IEEE international conference on computer vision (ICCV), pp 999–1006
14.
Zurück zum Zitat Ben-David S, Blitzer J, Crammer K, Pereira F et al (2007) Analysis of representations for domain adaptation. Adv Neural Inf Process Syst 19:137 Ben-David S, Blitzer J, Crammer K, Pereira F et al (2007) Analysis of representations for domain adaptation. Adv Neural Inf Process Syst 19:137
15.
Zurück zum Zitat Uguroglu S, Carbonell J (2011) Feature selection for transfer learning. In: Machine learning and knowledge discovery in databases, pp 430–442. Springer Uguroglu S, Carbonell J (2011) Feature selection for transfer learning. In: Machine learning and knowledge discovery in databases, pp 430–442. Springer
16.
Zurück zum Zitat Pan SJ, Kwok JT, Yang Q (2008) Transfer learning via dimensionality reduction. AAAI 8:677–682 Pan SJ, Kwok JT, Yang Q (2008) Transfer learning via dimensionality reduction. AAAI 8:677–682
17.
Zurück zum Zitat Quanz B, Huan J, Mishra M (2012) Knowledge transfer with low-quality data: a feature extraction issue. IEEE Trans Knowl Data Eng 24(10):1789–1802CrossRef Quanz B, Huan J, Mishra M (2012) Knowledge transfer with low-quality data: a feature extraction issue. IEEE Trans Knowl Data Eng 24(10):1789–1802CrossRef
18.
Zurück zum Zitat Zhong E, Fan W, Peng J, Zhang K, Ren J, Turaga D, Verscheure O (2009) Cross domain distribution adaptation via kernel mapping. In: Proceedings of the 15th ACMSIGKDD international conference on Knowledge discovery and data mining, pp 1027–1036 Zhong E, Fan W, Peng J, Zhang K, Ren J, Turaga D, Verscheure O (2009) Cross domain distribution adaptation via kernel mapping. In: Proceedings of the 15th ACMSIGKDD international conference on Knowledge discovery and data mining, pp 1027–1036
19.
Zurück zum Zitat Sun Q, Chattopadhyay R, Panchanathan S, Ye J (2011) A two-stage weighting framework for multi-source domain adaptation. In: Advances in neural information processing systems, pp 505–513 Sun Q, Chattopadhyay R, Panchanathan S, Ye J (2011) A two-stage weighting framework for multi-source domain adaptation. In: Advances in neural information processing systems, pp 505–513
20.
Zurück zum Zitat Long M, Wang J, Ding G, Sun J, YuPhilip S (2013) Transfer feature learning with joint distribution adaptation. In: 2013 IEEE international conference on computer vision (ICCV), pp 2200–2207 Long M, Wang J, Ding G, Sun J, YuPhilip S (2013) Transfer feature learning with joint distribution adaptation. In: 2013 IEEE international conference on computer vision (ICCV), pp 2200–2207
21.
Zurück zum Zitat Tahmoresnezhad J, Hashemi S (2015) A generalized kernel-based random k-sample sets method for transfer learning. Iran J Sci Technol Trans Electrical Eng 39:193–207 Tahmoresnezhad J, Hashemi S (2015) A generalized kernel-based random k-sample sets method for transfer learning. Iran J Sci Technol Trans Electrical Eng 39:193–207
22.
Zurück zum Zitat Gretton A, Borgwardt KM, Rasch M, Schölkopf B, Smola AJ (2006) A kernel method for the two-sample-problem. In: Advances in neural information processing systems, pp 513–520 Gretton A, Borgwardt KM, Rasch M, Schölkopf B, Smola AJ (2006) A kernel method for the two-sample-problem. In: Advances in neural information processing systems, pp 513–520
23.
Zurück zum Zitat Jolliffe I (2002) Principal component analysis. Wiley, New YorkMATH Jolliffe I (2002) Principal component analysis. Wiley, New YorkMATH
24.
Zurück zum Zitat Jie L, Behbood V, Hao P, Zuo H, Xue S, Zhang G (2015) Transfer learning using computational intelligence: a survey. Knowl Based Syst 80:14–23CrossRef Jie L, Behbood V, Hao P, Zuo H, Xue S, Zhang G (2015) Transfer learning using computational intelligence: a survey. Knowl Based Syst 80:14–23CrossRef
25.
Zurück zum Zitat Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRef Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRef
26.
Zurück zum Zitat Blitzer J, McDonald R, Pereira F (2006) Domain adaptation with structural correspondence learning. In: Proceedings of the 2006 conference on empirical methods in natural language processing, Association for Computational Linguistics, pp 120–128 Blitzer J, McDonald R, Pereira F (2006) Domain adaptation with structural correspondence learning. In: Proceedings of the 2006 conference on empirical methods in natural language processing, Association for Computational Linguistics, pp 120–128
27.
Zurück zum Zitat Pan SJ, Ni X, Sun J-T, Yang Q, Chen Z (2010) Cross-domain sentiment classification via spectral feature alignment. In: Proceedings of the 19th international conference on World wide web, ACM, pp 751–760 Pan SJ, Ni X, Sun J-T, Yang Q, Chen Z (2010) Cross-domain sentiment classification via spectral feature alignment. In: Proceedings of the 19th international conference on World wide web, ACM, pp 751–760
28.
Zurück zum Zitat Huang J, Gretton A, Borgwardt KM, Schölkopf B, Smola AJ (2006) Correcting sample selection bias by unlabeled data. In: Advances in neural information processing systems, pp 601–608 Huang J, Gretton A, Borgwardt KM, Schölkopf B, Smola AJ (2006) Correcting sample selection bias by unlabeled data. In: Advances in neural information processing systems, pp 601–608
29.
Zurück zum Zitat Pan SJ, Tsang IW, Kwok JT, Yang Q (2011) Domain adaptation via transfer component analysis. Neural Netw 22(2):199–210CrossRef Pan SJ, Tsang IW, Kwok JT, Yang Q (2011) Domain adaptation via transfer component analysis. Neural Netw 22(2):199–210CrossRef
31.
Zurück zum Zitat Duan L, Tsang IW, Xu D, Maybank SJ (2009)Domain transfer SVM for video concept detection. In: IEEE Conference on computer vision and pattern recognition, CVPR 2009, pp 1375–1381 Duan L, Tsang IW, Xu D, Maybank SJ (2009)Domain transfer SVM for video concept detection. In: IEEE Conference on computer vision and pattern recognition, CVPR 2009, pp 1375–1381
32.
Zurück zum Zitat Gong B, Shi Y, Sha F, Grauman K (2012) Geodesic flow kernel for unsupervised domain adaptation. In: 2012 IEEE Conference on computer vision and pattern recognition (CVPR), pp 2066–2073 Gong B, Shi Y, Sha F, Grauman K (2012) Geodesic flow kernel for unsupervised domain adaptation. In: 2012 IEEE Conference on computer vision and pattern recognition (CVPR), pp 2066–2073
33.
Zurück zum Zitat Saenko K, Kulis B, Fritz M, Darrell T (2010)Adapting visual category models to new domains. In: Computer vision–ECCV 2010, pp 213–226. Springer Saenko K, Kulis B, Fritz M, Darrell T (2010)Adapting visual category models to new domains. In: Computer vision–ECCV 2010, pp 213–226. Springer
34.
Zurück zum Zitat Chen Q, Xue B, Zhang M (2015) Generalisation and domain adaptation in GP with gradient descent for symbolic regression. In: 2015 IEEE congress on evolutionary computation (CEC), pp 1137–1144 Chen Q, Xue B, Zhang M (2015) Generalisation and domain adaptation in GP with gradient descent for symbolic regression. In: 2015 IEEE congress on evolutionary computation (CEC), pp 1137–1144
35.
Zurück zum Zitat Iqbal M, Browne WN, Zhang M (2014) Reusing building blocks of extracted knowledge to solve complex, large-scale Boolean problems. IEEE Trans Evol Comput 18(4):465–480CrossRef Iqbal M, Browne WN, Zhang M (2014) Reusing building blocks of extracted knowledge to solve complex, large-scale Boolean problems. IEEE Trans Evol Comput 18(4):465–480CrossRef
36.
Zurück zum Zitat Jiang J, Zhai CX (2007) Instance weighting for domain adaptation in NLP. ACL 7:264–271CrossRef Jiang J, Zhai CX (2007) Instance weighting for domain adaptation in NLP. ACL 7:264–271CrossRef
38.
Zurück zum Zitat Duan L, Tsang IW, Xu D, Chua T-S (2009) Domain adaptation from multiple sources via auxiliary classifiers. In: Proceedings of the 26th annual international conference on machine learning, ACM, pp 289–296 Duan L, Tsang IW, Xu D, Chua T-S (2009) Domain adaptation from multiple sources via auxiliary classifiers. In: Proceedings of the 26th annual international conference on machine learning, ACM, pp 289–296
39.
Zurück zum Zitat Long M, Wang J, Ding G, Pan SJ, Yu PS (2014) Adaptation regularization: a general framework for transfer learning. IEEE Trans Knowl Data Eng 26(5):1076–1089CrossRef Long M, Wang J, Ding G, Pan SJ, Yu PS (2014) Adaptation regularization: a general framework for transfer learning. IEEE Trans Knowl Data Eng 26(5):1076–1089CrossRef
40.
Zurück zum Zitat Bruzzone L, Marconcini M (2010) Domain adaptation problems: a DASVM classification technique and a circular validation strategy. IEEE Trans Pattern Anal Mach Intell 32(5):770–787CrossRef Bruzzone L, Marconcini M (2010) Domain adaptation problems: a DASVM classification technique and a circular validation strategy. IEEE Trans Pattern Anal Mach Intell 32(5):770–787CrossRef
41.
Zurück zum Zitat Satpal S, Sarawagi S (2007) Domain adaptation of conditional probability models via feature subsetting. In: Knowledge discovery in databases: PKDD 2007, pp 224–235. Springer Satpal S, Sarawagi S (2007) Domain adaptation of conditional probability models via feature subsetting. In: Knowledge discovery in databases: PKDD 2007, pp 224–235. Springer
42.
Zurück zum Zitat Si S, Tao D, Geng B (2010) Bregman divergence-based regularization for transfer subspace learning. IEEE Trans Knowl Data Eng 22(7):929–942CrossRef Si S, Tao D, Geng B (2010) Bregman divergence-based regularization for transfer subspace learning. IEEE Trans Knowl Data Eng 22(7):929–942CrossRef
43.
Zurück zum Zitat Jhuo I-H, Liu D, Lee DT, Chang S-F et al (2012) Robust visual domain adaptation with low-rank reconstruction. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR), pp 2168–2175 Jhuo I-H, Liu D, Lee DT, Chang S-F et al (2012) Robust visual domain adaptation with low-rank reconstruction. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR), pp 2168–2175
44.
Zurück zum Zitat Qiu Q, Patel VM, Turaga P, Chellappa R (2012) Domain adaptive dictionary learning. In: Computer vision–ECCV2012, pp 631–645. Springer Qiu Q, Patel VM, Turaga P, Chellappa R (2012) Domain adaptive dictionary learning. In: Computer vision–ECCV2012, pp 631–645. Springer
45.
Zurück zum Zitat Roy SD, Mei T, Zeng W, Li S (2012) Social transfer: cross-domain transfer learning from social streams for media applications. In: Proceedings of the 20th ACM international conference on multimedia, pp 649–658 Roy SD, Mei T, Zeng W, Li S (2012) Social transfer: cross-domain transfer learning from social streams for media applications. In: Proceedings of the 20th ACM international conference on multimedia, pp 649–658
46.
Zurück zum Zitat Long M, Wang J, Ding G, Sun J, Yu PS (2014) Transfer joint matching for unsupervised domain adaptation. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR), pp 1410–1417 Long M, Wang J, Ding G, Sun J, Yu PS (2014) Transfer joint matching for unsupervised domain adaptation. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR), pp 1410–1417
47.
Zurück zum Zitat Long M, Wang J, Sun J, Yu PS (2015) Domain invariant transfer kernel learning. IEEE Trans Knowl Data Eng 27(6):1519–1532CrossRef Long M, Wang J, Sun J, Yu PS (2015) Domain invariant transfer kernel learning. IEEE Trans Knowl Data Eng 27(6):1519–1532CrossRef
48.
Zurück zum Zitat Griffin G, Holub A, Perona P (2007) Caltech-256 object category dataset Griffin G, Holub A, Perona P (2007) Caltech-256 object category dataset
49.
Zurück zum Zitat Bay H, Tuytelaars T, Van Gool L (2006) Surf: speeded up robust features. In: Computer vision–ECCV 2006, pp 404–417. Springer Bay H, Tuytelaars T, Van Gool L (2006) Surf: speeded up robust features. In: Computer vision–ECCV 2006, pp 404–417. Springer
50.
Zurück zum Zitat Nene SA, Nayar SK, Murase H et al (1996) Columbia object image library (coil-20). Technical report, TechnicalReport CUCS-005-96 Nene SA, Nayar SK, Murase H et al (1996) Columbia object image library (coil-20). Technical report, TechnicalReport CUCS-005-96
Metadaten
Titel
Visual domain adaptation via transfer feature learning
verfasst von
Jafar Tahmoresnezhad
Sattar Hashemi
Publikationsdatum
07.05.2016
Verlag
Springer London
Erschienen in
Knowledge and Information Systems / Ausgabe 2/2017
Print ISSN: 0219-1377
Elektronische ISSN: 0219-3116
DOI
https://doi.org/10.1007/s10115-016-0944-x

Weitere Artikel der Ausgabe 2/2017

Knowledge and Information Systems 2/2017 Zur Ausgabe

Premium Partner