Skip to main content
Top

2019 | OriginalPaper | Chapter

7. Multiview Transfer Learning and Multitask Learning

Authors : Shiliang Sun, Liang Mao, Ziang Dong, Lidan Wu

Published in: Multiview Machine Learning

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Transfer learning is proposed to transfer the learned knowledge from source domains to target domains where the target ones own fewer training data. Multitask learning learns multiple tasks simultaneously and makes use of the relationship among these tasks. Both of these learning methods can combine with the multiview learning, which exploits the information from the consistency of diverse views. In this chapter, we introduce four multiview transfer learning methods and three multiview multitask learning methods. We review research on multiview transfer learning under the large margin framework, discuss multiview discriminant transfer learning in detail, and introduce how to adapt Adaboost into multiview transfer learning. Three multiview multitask learning methods concentrate on the shared structures between tasks and views. The most natural way is to represent the relationships based on the bipartite graph and use an iterative algorithm to optimize its objective function. Another method constructs additional regularization function to ensure the view consistency. In general, convex shared structure learning algorithm provides structure parameters to share information. Besides, we introduce other methods; as supplements, where multi-transfer, multitask multiview discriminant analysis, and clustering are briefly mentioned.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Absil PA, Mahony R, Sepulchre R (2010) Optimization on manifolds: methods and applications. In: Recent advances in optimization and its applications in engineering, pp 125–144CrossRef Absil PA, Mahony R, Sepulchre R (2010) Optimization on manifolds: methods and applications. In: Recent advances in optimization and its applications in engineering, pp 125–144CrossRef
go back to reference Dhillon IS (2001) Co-clustering documents and words using bipartite spectral graph partitioning. In: Proceedings of the 7th ACM SIGKDD international conference on knowledge discovery and data mining, pp 269–274 Dhillon IS (2001) Co-clustering documents and words using bipartite spectral graph partitioning. In: Proceedings of the 7th ACM SIGKDD international conference on knowledge discovery and data mining, pp 269–274
go back to reference Diethe T, Hardoon DR, Shawe-Taylor J (2008) Multiview fisher discriminant analysis. In: Proceedings of NIPS workshop on learning from multiple sources Diethe T, Hardoon DR, Shawe-Taylor J (2008) Multiview fisher discriminant analysis. In: Proceedings of NIPS workshop on learning from multiple sources
go back to reference He J, Lawrence R (2011) A graphbased framework for multi-task multi-view learning. In: Proceedings of the 28th international conference on machine learning, pp 25–32 He J, Lawrence R (2011) A graphbased framework for multi-task multi-view learning. In: Proceedings of the 28th international conference on machine learning, pp 25–32
go back to reference Jin X, Zhuang F, Wang S, He Q, Shi Z (2013) Shared structure learning for multiple tasks with multiple views. In: Proceedings of joint european conference on machine learning and knowledge discovery in databases, Springer, pp 353–368 Jin X, Zhuang F, Wang S, He Q, Shi Z (2013) Shared structure learning for multiple tasks with multiple views. In: Proceedings of joint european conference on machine learning and knowledge discovery in databases, Springer, pp 353–368
go back to reference Jin X, Zhuang F, Xiong H, Du C, Luo P, He Q (2014) Multi-task multi-view learning for heterogeneous tasks. In: Proceedings of the 23rd ACM international conference on conference on information and knowledge management, pp 441–450 Jin X, Zhuang F, Xiong H, Du C, Luo P, He Q (2014) Multi-task multi-view learning for heterogeneous tasks. In: Proceedings of the 23rd ACM international conference on conference on information and knowledge management, pp 441–450
go back to reference Pan SJ, Yang Q et al (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRef Pan SJ, Yang Q et al (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359CrossRef
go back to reference Perkins DN, Salomon G et al (1992) Transfer of learning. Int Encycl Educ 2:6452–6457 Perkins DN, Salomon G et al (1992) Transfer of learning. Int Encycl Educ 2:6452–6457
go back to reference Tan B, Zhong E, Xiang EW, Yang Q (2014) Multi-transfer: transfer learning with multiple views and multiple sources. Statist Anal Data Min 7(4):282–293MathSciNetCrossRef Tan B, Zhong E, Xiang EW, Yang Q (2014) Multi-transfer: transfer learning with multiple views and multiple sources. Statist Anal Data Min 7(4):282–293MathSciNetCrossRef
go back to reference Xu Z, Sun S (2011) Multi-view transfer learning with adaboost. In: Proceedings of the 23rd IEEE international conference on tools with artificial intelligence, IEEE, pp 399–402 Xu Z, Sun S (2011) Multi-view transfer learning with adaboost. In: Proceedings of the 23rd IEEE international conference on tools with artificial intelligence, IEEE, pp 399–402
go back to reference Xu Z, Sun S (2012) Multi-source transfer learning with multi-view adaboost. In: Proceedings of the 19th international conference on neural information processing, Springer, pp 332–339 Xu Z, Sun S (2012) Multi-source transfer learning with multi-view adaboost. In: Proceedings of the 19th international conference on neural information processing, Springer, pp 332–339
go back to reference Yang P, Gao W (2013) Multi-view discriminant transfer learning. In: Proceedings of the 23rd international joint conference on artificial intelligence, pp 1848–1854 Yang P, Gao W (2013) Multi-view discriminant transfer learning. In: Proceedings of the 23rd international joint conference on artificial intelligence, pp 1848–1854
go back to reference Zhang D, He J, Liu Y, Si L, Lawrence R (2011) Multi-view transfer learning with a large margin approach. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 1208–1216 Zhang D, He J, Liu Y, Si L, Lawrence R (2011) Multi-view transfer learning with a large margin approach. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 1208–1216
go back to reference Zhang J, Huan J (2012) Inductive multi-task learning with multiple view data. In: Proceedings of the 18th ACM SIGKDD international conference on knowledge discovery and data mining, pp 543–551 Zhang J, Huan J (2012) Inductive multi-task learning with multiple view data. In: Proceedings of the 18th ACM SIGKDD international conference on knowledge discovery and data mining, pp 543–551
go back to reference Zhang X, Zhang X, Liu H (2015) Multi-task multi-view clustering for non-negative data. In: Proceedings of the 24th international joint conference on artificial intelligence, pp 4055–4061 Zhang X, Zhang X, Liu H (2015) Multi-task multi-view clustering for non-negative data. In: Proceedings of the 24th international joint conference on artificial intelligence, pp 4055–4061
Metadata
Title
Multiview Transfer Learning and Multitask Learning
Authors
Shiliang Sun
Liang Mao
Ziang Dong
Lidan Wu
Copyright Year
2019
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-13-3029-2_7

Premium Partner