Skip to main content
Top
Published in: Pattern Analysis and Applications 4/2018

07-04-2018 | Original Article

Binary ranking for ordinal class imbalance

Authors: Ricardo Cruz, Kelwin Fernandes, Joaquim F. Pinto Costa, María Pérez Ortiz, Jaime S. Cardoso

Published in: Pattern Analysis and Applications | Issue 4/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Imbalanced classification has been extensively researched in the last years due to its prevalence in real-world datasets, ranging from very different topics such as health care or fraud detection. This literature has long been dominated by variations of the same family of solutions (e.g. mainly resampling and cost-sensitive learning). Recently, a new and promising way of tackling this problem has been introduced: learning with scoring pairwise ranking so that each pair of classes contribute in tandem to the decision boundary. In this sense, the paper addresses the problem of class imbalance in the context of ordinal regression, proposing two novel contributions: (a) approaching the imbalance by binary pairwise ranking using a well-known label decomposition ensemble, and (b) introducing a regularization into this ensemble so that parallel decision boundaries are favored. These are two independent contributions that synergize well. Our model is tested using linear Support Vector Machines and our results are compared against state-of-the-art models. Both approaches show promising performance in ordinal class imbalance, with an overall 15% improvement relative to the state-of-the-art, as evaluated by a balanced metric.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Cardoso JS, Costa JF (2007) Learning to classify ordinal data: the data replication method. J Mach Learn Res 8((Jul)):1393–1429MathSciNetMATH Cardoso JS, Costa JF (2007) Learning to classify ordinal data: the data replication method. J Mach Learn Res 8((Jul)):1393–1429MathSciNetMATH
3.
go back to reference Costa JFP, Sousa R, Cardoso JS (2010) An all-at-once unimodal svm approach for ordinal classification. In: 2010 Ninth international conference on machine learning and applications (ICMLA), IEEE, pp 59–64 Costa JFP, Sousa R, Cardoso JS (2010) An all-at-once unimodal svm approach for ordinal classification. In: 2010 Ninth international conference on machine learning and applications (ICMLA), IEEE, pp 59–64
4.
go back to reference Cruz R, Fernandes K, Cardoso JS, Costa JFP (2016) Tackling class imbalance with ranking. In: 2016 International joint conference on neural networks (IJCNN), IEEE, pp 2182–2187 Cruz R, Fernandes K, Cardoso JS, Costa JFP (2016) Tackling class imbalance with ranking. In: 2016 International joint conference on neural networks (IJCNN), IEEE, pp 2182–2187
5.
go back to reference Cruz R, Fernandes K, Costa JFP, Ortiz MP, Cardoso JS (2017) Combining ranking with traditional methods for ordinal class imbalance. In: International work-conference on artificial neural networks. Springer, Cham, pp 538–548CrossRef Cruz R, Fernandes K, Costa JFP, Ortiz MP, Cardoso JS (2017) Combining ranking with traditional methods for ordinal class imbalance. In: International work-conference on artificial neural networks. Springer, Cham, pp 538–548CrossRef
6.
go back to reference Cruz R, Fernandes K, Costa JFP, Ortiz MP, Cardoso JS (2017) Ordinal class imbalance with ranking. In: Iberian conference on pattern recognition and image analysis. Springer, Cham, pp 3–12CrossRef Cruz R, Fernandes K, Costa JFP, Ortiz MP, Cardoso JS (2017) Ordinal class imbalance with ranking. In: Iberian conference on pattern recognition and image analysis. Springer, Cham, pp 3–12CrossRef
7.
go back to reference Denil M, Trappenberg TP (2010) Overlap versus imbalance. In: Canadian conference on AI. Springer, pp 220–231 Denil M, Trappenberg TP (2010) Overlap versus imbalance. In: Canadian conference on AI. Springer, pp 220–231
8.
go back to reference Frank E, Hall M (2001) A simple approach to ordinal classification. In: Machine learning: ECML 2001, pp 145–156CrossRef Frank E, Hall M (2001) A simple approach to ordinal classification. In: Machine learning: ECML 2001, pp 145–156CrossRef
9.
go back to reference Gutiérrez PA, Pérez-Ortiz M, Sanchez-Monedero J, Fernández-Navarro F, Hervas-Martinez C (2016) Ordinal regression methods: survey and experimental study. IEEE Trans Knowl Data Eng 28(1):127–146CrossRef Gutiérrez PA, Pérez-Ortiz M, Sanchez-Monedero J, Fernández-Navarro F, Hervas-Martinez C (2016) Ordinal regression methods: survey and experimental study. IEEE Trans Knowl Data Eng 28(1):127–146CrossRef
10.
go back to reference Herbrich R, Graepel T, Obermayer K (1999) Support vector learning for ordinal regression. In: Ninth international conference on artificial neural networks ICANN 99, vol 1, Edinburgh, pp 97–102 Herbrich R, Graepel T, Obermayer K (1999) Support vector learning for ordinal regression. In: Ninth international conference on artificial neural networks ICANN 99, vol 1, Edinburgh, pp 97–102
11.
go back to reference Li L, Lin HT (2007) Ordinal regression by extended binary classification. In: Advances in neural information processing systems, pp 865–872 Li L, Lin HT (2007) Ordinal regression by extended binary classification. In: Advances in neural information processing systems, pp 865–872
12.
go back to reference Pérez-Ortiz M, Gutiérrez PA, Hervás-Martínez C, Yao X (2015) Graph-based approaches for over-sampling in the context of ordinal regression. IEEE Trans Knowl Data Eng 27(5):1233–1245CrossRef Pérez-Ortiz M, Gutiérrez PA, Hervás-Martínez C, Yao X (2015) Graph-based approaches for over-sampling in the context of ordinal regression. IEEE Trans Knowl Data Eng 27(5):1233–1245CrossRef
13.
go back to reference Shalev-Shwartz S, Singer Y, Srebro N, Cotter A (2011) Pegasos: primal estimated sub-gradient solver for svm. Math Program 127(1):3–30MathSciNetCrossRef Shalev-Shwartz S, Singer Y, Srebro N, Cotter A (2011) Pegasos: primal estimated sub-gradient solver for svm. Math Program 127(1):3–30MathSciNetCrossRef
14.
go back to reference Wang H, Shi Y, Niu L, Tian Y (2017) Nonparallel support vector ordinal regression. IEEE Trans Cybern 47(10):3306–3317CrossRef Wang H, Shi Y, Niu L, Tian Y (2017) Nonparallel support vector ordinal regression. IEEE Trans Cybern 47(10):3306–3317CrossRef
Metadata
Title
Binary ranking for ordinal class imbalance
Authors
Ricardo Cruz
Kelwin Fernandes
Joaquim F. Pinto Costa
María Pérez Ortiz
Jaime S. Cardoso
Publication date
07-04-2018
Publisher
Springer London
Published in
Pattern Analysis and Applications / Issue 4/2018
Print ISSN: 1433-7541
Electronic ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-018-0705-4

Other articles of this Issue 4/2018

Pattern Analysis and Applications 4/2018 Go to the issue

Premium Partner