Skip to main content
Erschienen in: Memetic Computing 3/2019

09.02.2019 | Regular Research Paper

A multi-level knee point based multi-objective evolutionary algorithm for AUC maximization

verfasst von: Jianfeng Qiu, Minghui Liu, Lei Zhang, Wei Li, Fan Cheng

Erschienen in: Memetic Computing | Ausgabe 3/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The area under receiver operating characteristic curve (AUC) is one of the widely used metrics for measuring imbalanced data classification results. Designing multi-objective evolutionary algorithms for AUC maximization problem has attracted much attention of researchers recently. However, most of these methods either search the Pareto front directly, or perform tailored convex hull search for AUC maximization. None of them take the advantage of multi-level knee points found in the process of evolution for AUC maximization. To this end, this paper proposes a multi-level knee point based multi-objective evolutionary algorithm (named MKnEA-AUC) for AUC maximization on the basis of a recently developed knee point driven evolutionary algorithm for multi/many-objective optimization. In MKnEA-AUC, an adaptive clustering strategy is proposed for automatically determining the knee points on the current population. By utilizing the preference of found knee points, the evolution of the population can converge quickly. We verify the effectiveness of the proposed algorithm MKnEA-AUC on 13 widely used benchmark data sets and the experimental results demonstrate that MKnEA-AUC is superior over the state-of-the-art algorithms for AUC maximization.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Yang Z, Zhang T, Lu J, Zhang D, Kalui D (2017) Optimizing area under the ROC curve via extreme learning machines. Knowl Based Syst 130(15):74–89CrossRef Yang Z, Zhang T, Lu J, Zhang D, Kalui D (2017) Optimizing area under the ROC curve via extreme learning machines. Knowl Based Syst 130(15):74–89CrossRef
2.
Zurück zum Zitat Welleck SJ (2016) Efficient AUC optimization for information ranking applications. In: European conference on information retrieval, pp 159–170 Welleck SJ (2016) Efficient AUC optimization for information ranking applications. In: European conference on information retrieval, pp 159–170
3.
Zurück zum Zitat Goin JE (1982) ROC curve estimation and hypothesis testing: applications to breast cancer detection. Pattern Recognit 15(3):263–269CrossRefMATH Goin JE (1982) ROC curve estimation and hypothesis testing: applications to breast cancer detection. Pattern Recognit 15(3):263–269CrossRefMATH
4.
Zurück zum Zitat Matey JR, Quinn GW, Grother P, Tabassi E, Watson C, Wayman JL (2015) Modest proposals for improving biometric recognition papers. In: IEEE International conference on biometrics theory, applications and systems, pp 1–7 Matey JR, Quinn GW, Grother P, Tabassi E, Watson C, Wayman JL (2015) Modest proposals for improving biometric recognition papers. In: IEEE International conference on biometrics theory, applications and systems, pp 1–7
5.
Zurück zum Zitat Hong W, Tang K (2016) Convex hull-based multi-objective evolutionary computation for maximizing receiver operating characteristics performance. Memet Comput 8:35–44CrossRef Hong W, Tang K (2016) Convex hull-based multi-objective evolutionary computation for maximizing receiver operating characteristics performance. Memet Comput 8:35–44CrossRef
6.
Zurück zum Zitat Cheng R, Jin Y, Narukawa K, Sendhoff B (2015) A multiobjective evolutionary algorithm using Gaussian process-based inverse modeling. IEEE Trans Evolut Comput 19(6):838–856CrossRef Cheng R, Jin Y, Narukawa K, Sendhoff B (2015) A multiobjective evolutionary algorithm using Gaussian process-based inverse modeling. IEEE Trans Evolut Comput 19(6):838–856CrossRef
7.
Zurück zum Zitat Zhang X, Tian Y, Cheng R, Jin Y (2018) A decision variable clustering-based evolutionary algorithm for large-scale many-objective optimization. IEEE Trans Evolut Comput 22(1):97–112CrossRef Zhang X, Tian Y, Cheng R, Jin Y (2018) A decision variable clustering-based evolutionary algorithm for large-scale many-objective optimization. IEEE Trans Evolut Comput 22(1):97–112CrossRef
8.
Zurück zum Zitat Sun C, Ding J, Zeng J, Jin Y (2016) A fitness approximation assisted competitive swarm optimizer for large scale expensive optimization problems. Memet Comput 10(2):123–134CrossRef Sun C, Ding J, Zeng J, Jin Y (2016) A fitness approximation assisted competitive swarm optimizer for large scale expensive optimization problems. Memet Comput 10(2):123–134CrossRef
9.
Zurück zum Zitat Tian Y, Cheng R, Zhang X, Cheng F, Jin Y (2018) An indicator based multi-objective evolutionary algorithm with reference point adaptation for better versatility. IEEE Trans Evolut Comput 22(4):609–622CrossRef Tian Y, Cheng R, Zhang X, Cheng F, Jin Y (2018) An indicator based multi-objective evolutionary algorithm with reference point adaptation for better versatility. IEEE Trans Evolut Comput 22(4):609–622CrossRef
10.
Zurück zum Zitat Kupinski MA, Anastasio MA (1999) Multiobjective genetic optimization of diagnostic classifiers with implications for generating receiver operating characteristic curves. IEEE Trans Med Imaging 18(8):675–685CrossRef Kupinski MA, Anastasio MA (1999) Multiobjective genetic optimization of diagnostic classifiers with implications for generating receiver operating characteristic curves. IEEE Trans Med Imaging 18(8):675–685CrossRef
11.
Zurück zum Zitat Gräning L, Jin Y, Sendhoff B (2006) Generalization improvement in multi-objective learning. In: International joint conference on neural networks, pp 4839–4846 Gräning L, Jin Y, Sendhoff B (2006) Generalization improvement in multi-objective learning. In: International joint conference on neural networks, pp 4839–4846
12.
Zurück zum Zitat Provost F, Fawcett T (2001) Robust classification for imprecise environments. Mach Learn 42(3):203–231CrossRefMATH Provost F, Fawcett T (2001) Robust classification for imprecise environments. Mach Learn 42(3):203–231CrossRefMATH
13.
Zurück zum Zitat Wang P, Tang K, Weise T, Tsang E, Yao X (2014) Multiobjective genetic programming for maximizing ROC performance. Neurocomputing 125(3):102–118CrossRef Wang P, Tang K, Weise T, Tsang E, Yao X (2014) Multiobjective genetic programming for maximizing ROC performance. Neurocomputing 125(3):102–118CrossRef
14.
Zurück zum Zitat Wang P, Emmerich M, Li R, Tang K, Bäck T, Yao X (2015) Convex hull-based multiobjective genetic programming for maximizing receiver operating characteristic performance. IEEE Trans Evolut Comput 19(2):188–200CrossRef Wang P, Emmerich M, Li R, Tang K, Bäck T, Yao X (2015) Convex hull-based multiobjective genetic programming for maximizing receiver operating characteristic performance. IEEE Trans Evolut Comput 19(2):188–200CrossRef
15.
Zurück zum Zitat Cococcioni M, Ducange P, Lazzerini B, Marcelloni F (2007) A new multi-objective evolutionary algorithm based on convex hull for binary classifier optimization. In: IEEE congress on evolutionary computation, pp 3150–3156 Cococcioni M, Ducange P, Lazzerini B, Marcelloni F (2007) A new multi-objective evolutionary algorithm based on convex hull for binary classifier optimization. In: IEEE congress on evolutionary computation, pp 3150–3156
16.
Zurück zum Zitat Wang P, Emmerich M, Li R, Tang K, Baeck T, Yao X (2013) Convex hull-based multi-objective genetic programming for maximizing ROC performance. Neurocomputing 125(3):102–118 Wang P, Emmerich M, Li R, Tang K, Baeck T, Yao X (2013) Convex hull-based multi-objective genetic programming for maximizing ROC performance. Neurocomputing 125(3):102–118
17.
Zurück zum Zitat Ducange P, Lazzerini B, Marcelloni F (2010) Multi-objective genetic fuzzy classifiers for imbalanced and cost-sensitive datasets. Soft Comput 14(7):713–728CrossRef Ducange P, Lazzerini B, Marcelloni F (2010) Multi-objective genetic fuzzy classifiers for imbalanced and cost-sensitive datasets. Soft Comput 14(7):713–728CrossRef
18.
Zurück zum Zitat Zhang X, Tian Y, Jin Y (2015) A knee point-driven evolutionary algorithm for many-objective optimization. IEEE Trans Evolut Comput 19(6):761–776CrossRef Zhang X, Tian Y, Jin Y (2015) A knee point-driven evolutionary algorithm for many-objective optimization. IEEE Trans Evolut Comput 19(6):761–776CrossRef
19.
Zurück zum Zitat Bhowan U, Johnston M, Zhang M, Yao X (2013) Evolving diverse ensembles using genetic programming for classification with unbalanced data. IEEE Trans Evolut Comput 17(3):368–386CrossRef Bhowan U, Johnston M, Zhang M, Yao X (2013) Evolving diverse ensembles using genetic programming for classification with unbalanced data. IEEE Trans Evolut Comput 17(3):368–386CrossRef
20.
Zurück zum Zitat Chatelain C, Adam S, Lecourtier Y, Heutte L, Paquet T (2010) A multi-model selection framework for unknown and/or evolutive misclassification cost problems. Pattern Recognit 43(3):815–823CrossRefMATH Chatelain C, Adam S, Lecourtier Y, Heutte L, Paquet T (2010) A multi-model selection framework for unknown and/or evolutive misclassification cost problems. Pattern Recognit 43(3):815–823CrossRefMATH
21.
Zurück zum Zitat While L, Hingston P, Barone L, Huband S (2006) A faster algorithm for calculating hypervolume. IEEE Trans Evolut Comput 10(1):29–38CrossRef While L, Hingston P, Barone L, Huband S (2006) A faster algorithm for calculating hypervolume. IEEE Trans Evolut Comput 10(1):29–38CrossRef
22.
Zurück zum Zitat Li M, Zheng J (2009) Spread assessment for evolutionary multi-objective optimization. In: International conference on evolutionary multi-criterion optimization, pp 216–230 Li M, Zheng J (2009) Spread assessment for evolutionary multi-objective optimization. In: International conference on evolutionary multi-criterion optimization, pp 216–230
23.
Zurück zum Zitat Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evolut Comput 6(2):182–197CrossRef Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evolut Comput 6(2):182–197CrossRef
24.
Zurück zum Zitat Zhang Q, Li H (2007) MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evolut Comput 11(6):712–731CrossRef Zhang Q, Li H (2007) MOEA/D: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans Evolut Comput 11(6):712–731CrossRef
25.
Zurück zum Zitat Joachims T (2005) A support vector method for multivariate performance measures. In: Proceedings of the 22nd international conference on machine learning, pp 377–384 Joachims T (2005) A support vector method for multivariate performance measures. In: Proceedings of the 22nd international conference on machine learning, pp 377–384
26.
Zurück zum Zitat Deb K, Agrawal RB (1995) Simulated binary crossover for continuous search space. Complex Syst 9(4):115–148MathSciNetMATH Deb K, Agrawal RB (1995) Simulated binary crossover for continuous search space. Complex Syst 9(4):115–148MathSciNetMATH
27.
Zurück zum Zitat Deb K, Goyal M (1996) A combined genetic adaptive search (geneas) for engineering design. Comput Sci Inform 26(4):30–45 Deb K, Goyal M (1996) A combined genetic adaptive search (geneas) for engineering design. Comput Sci Inform 26(4):30–45
28.
Zurück zum Zitat Deb K (2001) Multi-objective optimization using evolutionary algorithms. Wiley, New YorkMATH Deb K (2001) Multi-objective optimization using evolutionary algorithms. Wiley, New YorkMATH
29.
Zurück zum Zitat Zhang X, Tian Y, Cheng R, Jin Y (2015) An efficient approach to nondominated sorting for evolutionary multiobjective optimization. IEEE Trans Evolut Comput 19(2):201–213CrossRef Zhang X, Tian Y, Cheng R, Jin Y (2015) An efficient approach to nondominated sorting for evolutionary multiobjective optimization. IEEE Trans Evolut Comput 19(2):201–213CrossRef
30.
Zurück zum Zitat Tian Y, Cheng R, Zhang X, Jin Y (2017) PlatEMO: a matlab platform for evolutionary multi-objective optimization. IEEE Comput Intell Mag 12(4):73–87CrossRef Tian Y, Cheng R, Zhang X, Jin Y (2017) PlatEMO: a matlab platform for evolutionary multi-objective optimization. IEEE Comput Intell Mag 12(4):73–87CrossRef
Metadaten
Titel
A multi-level knee point based multi-objective evolutionary algorithm for AUC maximization
verfasst von
Jianfeng Qiu
Minghui Liu
Lei Zhang
Wei Li
Fan Cheng
Publikationsdatum
09.02.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
Memetic Computing / Ausgabe 3/2019
Print ISSN: 1865-9284
Elektronische ISSN: 1865-9292
DOI
https://doi.org/10.1007/s12293-019-00280-7

Weitere Artikel der Ausgabe 3/2019

Memetic Computing 3/2019 Zur Ausgabe

Editorial

Editorial