Skip to main content
Erschienen in:
Buchtitelbild

2021 | OriginalPaper | Buchkapitel

Target Robust Discriminant Analysis

verfasst von : Wouter M. Kouw, Marco Loog

Erschienen in: Structural, Syntactic, and Statistical Pattern Recognition

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In practice, the data distribution at test time often differs, to a smaller or larger extent, from that of the original training data. Consequentially, the so-called source classifier, trained on the available labelled data, deteriorates on the test, or target, data. Domain adaptive classifiers aim to combat this problem, but typically assume some particular form of domain shift. Most are not robust to violations of domain shift assumptions and may even perform worse than their non-adaptive counterparts. We construct robust parameter estimators for discriminant analysis that guarantee performance improvements of the adaptive classifier over the non-adaptive source classifier.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bartlett, P.L., Jordan, M.I., McAuliffe, J.D.: Convexity, classification, and risk bounds. J. Am. Stat. Assoc. 101(473), 138–156 (2006)MathSciNetCrossRef Bartlett, P.L., Jordan, M.I., McAuliffe, J.D.: Convexity, classification, and risk bounds. J. Am. Stat. Assoc. 101(473), 138–156 (2006)MathSciNetCrossRef
3.
Zurück zum Zitat Cherukuri, A., Gharesifard, B., Cortes, J.: Saddle-point dynamics: conditions for asymptotic stability of saddle points. SIAM J. Control. Optim. 55(1), 486–511 (2017)MathSciNetCrossRef Cherukuri, A., Gharesifard, B., Cortes, J.: Saddle-point dynamics: conditions for asymptotic stability of saddle points. SIAM J. Control. Optim. 55(1), 486–511 (2017)MathSciNetCrossRef
4.
Zurück zum Zitat Condat, L.: Fast projection onto the simplex and the \(l_1\) ball. Math. Program. 158(1–2), 575–585 (2016)MathSciNetCrossRef Condat, L.: Fast projection onto the simplex and the \(l_1\) ball. Math. Program. 158(1–2), 575–585 (2016)MathSciNetCrossRef
5.
Zurück zum Zitat Cortes, C., Mohri, M.: Domain adaptation and sample bias correction theory and algorithm for regression. Theor. Comput. Sci. 519, 103–126 (2014)MathSciNetCrossRef Cortes, C., Mohri, M.: Domain adaptation and sample bias correction theory and algorithm for regression. Theor. Comput. Sci. 519, 103–126 (2014)MathSciNetCrossRef
6.
Zurück zum Zitat Dua, D., Graff, C.: UCI Machine Learning Repository (2017) Dua, D., Graff, C.: UCI Machine Learning Repository (2017)
7.
Zurück zum Zitat Huang, J., Smola, A.J., Gretton, A., Borgwardt, K.M., Schölkopf, B., et al.: Correcting sample selection bias by unlabeled data. In: Advances in Neural Information Processing Systems, p. 601 (2007) Huang, J., Smola, A.J., Gretton, A., Borgwardt, K.M., Schölkopf, B., et al.: Correcting sample selection bias by unlabeled data. In: Advances in Neural Information Processing Systems, p. 601 (2007)
8.
Zurück zum Zitat Kouw, W.M., Loog, M.: A review of domain adaptation without target labels. IEEE Trans. Pattern Anal. Mach. Intell. 43, 766–785 (2019)CrossRef Kouw, W.M., Loog, M.: A review of domain adaptation without target labels. IEEE Trans. Pattern Anal. Mach. Intell. 43, 766–785 (2019)CrossRef
9.
Zurück zum Zitat Liu, A., Ziebart, B.: Robust classification under sample selection bias. In: Advances in Neural Information Processing Systems, pp. 37–45 (2014) Liu, A., Ziebart, B.: Robust classification under sample selection bias. In: Advances in Neural Information Processing Systems, pp. 37–45 (2014)
10.
Zurück zum Zitat Loog, M.: Contrastive pessimistic likelihood estimation for semi-supervised classification. IEEE Trans. Pattern Anal. Mach. Intell. 38(3), 462–475 (2016)CrossRef Loog, M.: Contrastive pessimistic likelihood estimation for semi-supervised classification. IEEE Trans. Pattern Anal. Mach. Intell. 38(3), 462–475 (2016)CrossRef
11.
Zurück zum Zitat Loog, M., Krijthe, J.H., Jensen, A.C.: On measuring and quantifying performance: error rates, surrogate loss, and an example in semi-supervised learning. In: Chen, C.H. (ed.) Handbook of Pattern Recognition and Computer Vision, 5th edn., pp. 53–68. World Scientific, Singapore (2016). doi: https://doi.org/10.1142/9789814656535_0003 Loog, M., Krijthe, J.H., Jensen, A.C.: On measuring and quantifying performance: error rates, surrogate loss, and an example in semi-supervised learning. In: Chen, C.H. (ed.) Handbook of Pattern Recognition and Computer Vision, 5th edn., pp. 53–68. World Scientific, Singapore (2016). doi: https://​doi.​org/​10.​1142/​9789814656535_​0003
12.
Zurück zum Zitat McLachlan, G.J.: Discriminant Analysis and Statistical Pattern Recognition, 2nd edn. Wiley, Hoboken, New Jersey (2004)MATH McLachlan, G.J.: Discriminant Analysis and Statistical Pattern Recognition, 2nd edn. Wiley, Hoboken, New Jersey (2004)MATH
13.
Zurück zum Zitat McLachlan, G.J., Peel, D.: Finite Mixture Models. Wiley, Hoboken, New Jersey (2000)CrossRef McLachlan, G.J., Peel, D.: Finite Mixture Models. Wiley, Hoboken, New Jersey (2000)CrossRef
14.
Zurück zum Zitat Pan, S.J., Tsang, I.W., Kwok, J.T., Yang, Q.: Domain adaptation via transfer component analysis. IEEE Trans. Neural Netw. 22(2), 199–210 (2011)CrossRef Pan, S.J., Tsang, I.W., Kwok, J.T., Yang, Q.: Domain adaptation via transfer component analysis. IEEE Trans. Neural Netw. 22(2), 199–210 (2011)CrossRef
16.
Zurück zum Zitat Vapnik, V.: Statistical Learning Theory. Wiley, New York (1998)MATH Vapnik, V.: Statistical Learning Theory. Wiley, New York (1998)MATH
17.
Zurück zum Zitat Wen, J., Yu, C.N., Greiner, R.: Robust learning under uncertain test distributions: relating covariate shift to model misspecification. In: International Conference on Machine Learning, pp. 631–639 (2014) Wen, J., Yu, C.N., Greiner, R.: Robust learning under uncertain test distributions: relating covariate shift to model misspecification. In: International Conference on Machine Learning, pp. 631–639 (2014)
Metadaten
Titel
Target Robust Discriminant Analysis
verfasst von
Wouter M. Kouw
Marco Loog
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-73973-7_1

Premium Partner