Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 3/2021

20.09.2020 | Original Article

A transductive transfer learning approach for image classification

verfasst von: Samaneh Rezaei, Jafar Tahmoresnezhad, Vahid Solouk

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 3/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Among machine learning paradigms, unsupervised transductive transfer learning is useful when no labeled data from the target domain are available at training time, but there is accessible unlabeled target data during training phase instead. The current paper proposes a novel unsupervised transductive transfer learning method to find the specific and shared features across the source and the target domains. The proposed learning method then maps both domains into the respective subspaces with minimum marginal and conditional distribution divergences. It is shown that the discriminative learning across domains leads to boost the model performance. Hence, the proposed method discriminates the classes of both domains via maximizing the distance between each sample-pairs with different labels and via minimizing the distance between each instance-pairs of the same classes. We verified our approach using standard visual benchmarks, with the average accuracy of 46 experiments as 76.5%, which rates rather high in comparison with other state-of-the-art transfer learning methods through various cross-domain tasks.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Gammerman A, Vovk V, Vapnik V (1998) Learning by transduction. In: Proceedings of the fourteenth conference on uncertainty in artificial intelligence, UAI’98, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc, pp 148–155 Gammerman A, Vovk V, Vapnik V (1998) Learning by transduction. In: Proceedings of the fourteenth conference on uncertainty in artificial intelligence, UAI’98, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc, pp 148–155
2.
Zurück zum Zitat Tangirala K. Stanescu, A. Caragea D (2016) Study of transductive learning and unsupervised feature construction methods for biological sequence classification. In: 2016 IEEE/ACM international conference on advances in social networks analysis and mining (ASONAM), pp 999–1006, IEEE Tangirala K. Stanescu, A. Caragea D (2016) Study of transductive learning and unsupervised feature construction methods for biological sequence classification. In: 2016 IEEE/ACM international conference on advances in social networks analysis and mining (ASONAM), pp 999–1006, IEEE
3.
Zurück zum Zitat Wang J, Ding G, Pan SJ, Long M, Philip SY (2014) Adaptation regularization: a general framework for transfer learning. IEEE Trans Knowl Data Eng 26(5):1076–1089CrossRef Wang J, Ding G, Pan SJ, Long M, Philip SY (2014) Adaptation regularization: a general framework for transfer learning. IEEE Trans Knowl Data Eng 26(5):1076–1089CrossRef
4.
Zurück zum Zitat Bruzzone L, Marconcini M (2009) Domain adaptation problems: a dasvm classification technique and a circular validation strategy. IEEE Trans Pattern Anal Mach Intell 32(5):770–787CrossRef Bruzzone L, Marconcini M (2009) Domain adaptation problems: a dasvm classification technique and a circular validation strategy. IEEE Trans Pattern Anal Mach Intell 32(5):770–787CrossRef
5.
Zurück zum Zitat Gong Grauman K, Sha BF (2013) Connecting the dots with landmarks: Discriminatively learning domain-invariant features for unsupervised domain adaptation. Int Conf Mach Learn 28(1):222–230 Gong Grauman K, Sha BF (2013) Connecting the dots with landmarks: Discriminatively learning domain-invariant features for unsupervised domain adaptation. Int Conf Mach Learn 28(1):222–230
6.
Zurück zum Zitat Tahmoresnezhad J, Hashemi S (2017) Visual domain adaptation via transfer feature learning. Knowl Inf Syst 50(2):585–605CrossRef Tahmoresnezhad J, Hashemi S (2017) Visual domain adaptation via transfer feature learning. Knowl Inf Syst 50(2):585–605CrossRef
7.
Zurück zum Zitat Li J, Liu J, Lu K (2018) Coupled local-global adaptation for multi-source transfer learning. Neurocomputing 275:247–254CrossRef Li J, Liu J, Lu K (2018) Coupled local-global adaptation for multi-source transfer learning. Neurocomputing 275:247–254CrossRef
8.
Zurück zum Zitat Wu J, Fang X, Xu Li X, Zhang YD (2015) Discriminative transfer subspace learning via low-rank and sparse representation. IEEE Trans Image Process 25(2):850–863MathSciNetMATH Wu J, Fang X, Xu Li X, Zhang YD (2015) Discriminative transfer subspace learning via low-rank and sparse representation. IEEE Trans Image Process 25(2):850–863MathSciNetMATH
9.
Zurück zum Zitat Song S, Huang G, Ding Z, Li S, Wu C (2018) Domain invariant and class discriminative feature learning for visual domain adaptation. IEEE Trans Image Process 27(9):4260–4273MathSciNetCrossRef Song S, Huang G, Ding Z, Li S, Wu C (2018) Domain invariant and class discriminative feature learning for visual domain adaptation. IEEE Trans Image Process 27(9):4260–4273MathSciNetCrossRef
10.
Zurück zum Zitat Wang X, Hu S, Luo L, Chen L (2017) Robust data geometric structure aligned close yet discriminative domain adaptation. arXiv:1705.08620(arXiv preprint) Wang X, Hu S, Luo L, Chen L (2017) Robust data geometric structure aligned close yet discriminative domain adaptation. arXiv:​1705.​08620(arXiv preprint)
11.
Zurück zum Zitat Li W, Zhang J, Ogunbona P (2017) Joint geometrical and statistical alignment for visual domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1859–1867 Li W, Zhang J, Ogunbona P (2017) Joint geometrical and statistical alignment for visual domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1859–1867
12.
Zurück zum Zitat Tahmoresnezhad J, Hashemi S (2017) Exploiting kernel-based feature weighting and instance clustering to transfer knowledge across domains. Turk J Electr Eng Comput Sci 25(1):292–307CrossRef Tahmoresnezhad J, Hashemi S (2017) Exploiting kernel-based feature weighting and instance clustering to transfer knowledge across domains. Turk J Electr Eng Comput Sci 25(1):292–307CrossRef
13.
Zurück zum Zitat Shao L, Zhu F, Li X (2014) Transfer learning for visual categorization: a survey. IEEE Trans Neural Netw Learn Syst 26(5):1019–1034MathSciNetCrossRef Shao L, Zhu F, Li X (2014) Transfer learning for visual categorization: a survey. IEEE Trans Neural Netw Learn Syst 26(5):1019–1034MathSciNetCrossRef
14.
Zurück zum Zitat Borgwardt KM, Rasch MJ, Schölkopf B, Gretton A, Smola A (2012) A kernel two-sample test. J Mach Learn Rese Turk J Electr Eng Comput 13(1):723–773MathSciNetMATH Borgwardt KM, Rasch MJ, Schölkopf B, Gretton A, Smola A (2012) A kernel two-sample test. J Mach Learn Rese Turk J Electr Eng Comput 13(1):723–773MathSciNetMATH
15.
Zurück zum Zitat Wang J, Sun J Ding G, Long M, Yu PS (2014) Transfer joint matching for unsupervised domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1410–1417 Wang J, Sun J Ding G, Long M, Yu PS (2014) Transfer joint matching for unsupervised domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1410–1417
16.
Zurück zum Zitat Kulis B, Saenko Fritz M, K. Darrell T (2010) Adapting visual category models to new domains. In: European conference on computer vision, pp 213–226, Kulis B, Saenko Fritz M, K. Darrell T (2010) Adapting visual category models to new domains. In: European conference on computer vision, pp 213–226,
17.
Zurück zum Zitat Holub A, Griffin G, Perona P (2007) Caltech-256 object category dataset. 2007 Holub A, Griffin G, Perona P (2007) Caltech-256 object category dataset. 2007
18.
Zurück zum Zitat BakerS, Sim T, Bsat M (2002) The cmu pose, illumination, and expression (pie) database. In: Proceedings of fifth IEEE international conference on automatic face gesture recognition, pp 53–58 BakerS, Sim T, Bsat M (2002) The cmu pose, illumination, and expression (pie) database. In: Proceedings of fifth IEEE international conference on automatic face gesture recognition, pp 53–58
19.
Zurück zum Zitat Bottou L, LeCun Bengio Y, Haffner P (1998) Gradient based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef Bottou L, LeCun Bengio Y, Haffner P (1998) Gradient based learning applied to document recognition. Proc IEEE 86(11):2278–2324CrossRef
20.
Zurück zum Zitat Hull JJ (1994) A database for handwritten text recognition research. IEEE Trans Pattern Anal Mach Intell 16(5):550–554CrossRef Hull JJ (1994) A database for handwritten text recognition research. IEEE Trans Pattern Anal Mach Intell 16(5):550–554CrossRef
21.
Zurück zum Zitat Jia Y, Vinyals O, Hoffman J, Zhang N, Tzeng E, Donahue J, Darrell T (2014) Decaf: a deep convolutional activation feature for generic visual recognition. In: International conference on machine learning, pp 647–655 Jia Y, Vinyals O, Hoffman J, Zhang N, Tzeng E, Donahue J, Darrell T (2014) Decaf: a deep convolutional activation feature for generic visual recognition. In: International conference on machine learning, pp 647–655
22.
Zurück zum Zitat Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRef Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRef
23.
Zurück zum Zitat Hashemi S, Tahmoresnezhad J (2015) A generalized kernel-based random k-sample sets method for transfer learning. Iran J Sci Technol Trans Electr Eng 39(E2):193–207 Hashemi S, Tahmoresnezhad J (2015) A generalized kernel-based random k-sample sets method for transfer learning. Iran J Sci Technol Trans Electr Eng 39(E2):193–207
24.
Zurück zum Zitat Chen L, Hu S, Lu Y, Luo L, Wang X (2020) Discriminative and geometry aware unsupervised domain adaptation. IEEE Trans Cybern 20:20 Chen L, Hu S, Lu Y, Luo L, Wang X (2020) Discriminative and geometry aware unsupervised domain adaptation. IEEE Trans Cybern 20:20
25.
Zurück zum Zitat Habrard A, Sebban M. Fernando B, Tuytelaars T (2013) Unsupervised visual domain adaptation using subspace alignment. In: Proceedings of the IEEE international conference on computer vision, pp 2960–2967 Habrard A, Sebban M. Fernando B, Tuytelaars T (2013) Unsupervised visual domain adaptation using subspace alignment. In: Proceedings of the IEEE international conference on computer vision, pp 2960–2967
26.
Zurück zum Zitat Jolliffe IT (2002) Principle component analysis. Springer, New YorkMATH Jolliffe IT (2002) Principle component analysis. Springer, New YorkMATH
27.
Zurück zum Zitat Saenko K, Sun B (2015) Subspace distribution alignment for unsupervised domain adaptation. BMVC 4:24–1 Saenko K, Sun B (2015) Subspace distribution alignment for unsupervised domain adaptation. BMVC 4:24–1
28.
Zurück zum Zitat Rezaei S, Tahmoresnezhad J (2019) Discriminative and domain invariant subspace alignment for visual tasks. Iran J Comput Sci 2(4):219–230CrossRef Rezaei S, Tahmoresnezhad J (2019) Discriminative and domain invariant subspace alignment for visual tasks. Iran J Comput Sci 2(4):219–230CrossRef
29.
Zurück zum Zitat Gretton A. Song L. Smola A, Schölkopf B (2007) A hilbert space embedding for distributions. In: International conference on algorithmic learning theory, pp 13–31 Gretton A. Song L. Smola A, Schölkopf B (2007) A hilbert space embedding for distributions. In: International conference on algorithmic learning theory, pp 13–31
30.
Zurück zum Zitat Cover T, Hart P (1967) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13(1):21–27CrossRef Cover T, Hart P (1967) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13(1):21–27CrossRef
31.
Zurück zum Zitat Wang J, Ding G, Long M, Sun J, Yu PS (2013) Transfer feature learning with joint distribution adaptation. In: Proceedings of the IEEE international conference on computer vision, pp 2200–2207 Wang J, Ding G, Long M, Sun J, Yu PS (2013) Transfer feature learning with joint distribution adaptation. In: Proceedings of the IEEE international conference on computer vision, pp 2200–2207
32.
Zurück zum Zitat Tahmoresnezhad J, Gholenji E (2019) Joint local and statistical discriminant learning via feature alignment. Signal Image Video Process 20:1–8 Tahmoresnezhad J, Gholenji E (2019) Joint local and statistical discriminant learning via feature alignment. Signal Image Video Process 20:1–8
33.
Zurück zum Zitat Ding Z, Fu Y (2017) Robust transfer metric learning for image classification. IEEE Trans Image Process 26(2):660–670MathSciNetCrossRef Ding Z, Fu Y (2017) Robust transfer metric learning for image classification. IEEE Trans Image Process 26(2):660–670MathSciNetCrossRef
34.
35.
Zurück zum Zitat Lu K, Huang Z, Zhu L, Li J, Shen HT (2018) Transfer independently together: a generalized framework for domain adaptation. IEEE Trans Cybern 49(6):2144–2155 Lu K, Huang Z, Zhu L, Li J, Shen HT (2018) Transfer independently together: a generalized framework for domain adaptation. IEEE Trans Cybern 49(6):2144–2155
36.
Zurück zum Zitat Balduzzi D, Kleijn WB, Ghifary M, Zhang M (2017) Scatter component analysis: a unified framework for domain adaptation and domain generalization. IEEE Trans Pattern Anal Mach Intell 39(7):1414–1430CrossRef Balduzzi D, Kleijn WB, Ghifary M, Zhang M (2017) Scatter component analysis: a unified framework for domain adaptation and domain generalization. IEEE Trans Pattern Anal Mach Intell 39(7):1414–1430CrossRef
37.
Zurück zum Zitat Uzair M, Mian A (2016) Blind domain adaptation with augmented extreme learning machine features. IEEE Trans Cybern 47(3):651–660CrossRef Uzair M, Mian A (2016) Blind domain adaptation with augmented extreme learning machine features. IEEE Trans Cybern 47(3):651–660CrossRef
38.
Zurück zum Zitat Sutskever I, Krizhevsky A, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 20:1097–1105 Sutskever I, Krizhevsky A, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 20:1097–1105
39.
Zurück zum Zitat Hoffman J, Zhang N, Saenko K, Tzeng E, Darrell T (2014) Deep domain confusion: Maximizing for domain invariance. arXiv:1412.3474(arXiv preprint) Hoffman J, Zhang N, Saenko K, Tzeng E, Darrell T (2014) Deep domain confusion: Maximizing for domain invariance. arXiv:​1412.​3474(arXiv preprint)
40.
Zurück zum Zitat Zhang L, Cao Z, Wei W, Xian K, Shen C. Lu H, van den Hengel A (2017) When unsupervised domain adaptation meets tensor representations. In: Proceedings of the IEEE international conference on computer vision, pp 599–608 Zhang L, Cao Z, Wei W, Xian K, Shen C. Lu H, van den Hengel A (2017) When unsupervised domain adaptation meets tensor representations. In: Proceedings of the IEEE international conference on computer vision, pp 599–608
41.
Zurück zum Zitat Gholami B, Pavlovic V (2017) Punda: Probabilistic unsupervised domain adaptation for knowledge transfer across visual categories. In: Proceedings of the IEEE international conference on computer vision, pp 3581–3590 Gholami B, Pavlovic V (2017) Punda: Probabilistic unsupervised domain adaptation for knowledge transfer across visual categories. In: Proceedings of the IEEE international conference on computer vision, pp 3581–3590
42.
Zurück zum Zitat Sun B, Saenko K (2016) Deep coral: Correlation alignment for deep domain adaptation. In: European conference on computer vision Sun B, Saenko K (2016) Deep coral: Correlation alignment for deep domain adaptation. In: European conference on computer vision
43.
Zurück zum Zitat Shao M, Ding Z, Fu Y (2015) Missing modality transfer learning via latent low-rank constraint. IEEE Trans Image Process 24(11):4322–4334MathSciNetCrossRef Shao M, Ding Z, Fu Y (2015) Missing modality transfer learning via latent low-rank constraint. IEEE Trans Image Process 24(11):4322–4334MathSciNetCrossRef
Metadaten
Titel
A transductive transfer learning approach for image classification
verfasst von
Samaneh Rezaei
Jafar Tahmoresnezhad
Vahid Solouk
Publikationsdatum
20.09.2020
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 3/2021
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-020-01200-9

Weitere Artikel der Ausgabe 3/2021

International Journal of Machine Learning and Cybernetics 3/2021 Zur Ausgabe

Neuer Inhalt