Skip to main content
Top
Published in:
Cover of the book

2017 | OriginalPaper | Chapter

Ordinal Class Imbalance with Ranking

Authors : Ricardo Cruz, Kelwin Fernandes, Joaquim F. Pinto Costa, María Pérez Ortiz, Jaime S. Cardoso

Published in: Pattern Recognition and Image Analysis

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Classification datasets, which feature a skewed class distribution, are said to be class imbalance. Traditional methods favor the larger classes. We propose pairwise ranking as a method for imbalance classification so that learning compares pairs of observations from each class, and therefore both contribute equally to the decision boundary. In previous work, we suggested treating the binary classification as a ranking problem, followed by a threshold mapping to convert back the ranking score to the original classes. In this work, the method is extended to multi-class ordinal classification, and a new mapping threshold is proposed. Results are compared with traditional and ordinal SVMs, and ranking obtains competitive results.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Chawla, N.V., Bowyer, K.W., Hall, L.O., Philip Kegelmeyer, W.: SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16, 321–357 (2002)MATH Chawla, N.V., Bowyer, K.W., Hall, L.O., Philip Kegelmeyer, W.: SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16, 321–357 (2002)MATH
2.
go back to reference Pérez-Ortiz, M., Gutiérrez, P.A., Hervás-Martínez, C., Yao, X.: Graph-based approaches for over-sampling in the context of ordinal regression. IEEE Trans. Knowl. Data Eng. 27(5), 1233–1245 (2015)CrossRef Pérez-Ortiz, M., Gutiérrez, P.A., Hervás-Martínez, C., Yao, X.: Graph-based approaches for over-sampling in the context of ordinal regression. IEEE Trans. Knowl. Data Eng. 27(5), 1233–1245 (2015)CrossRef
3.
go back to reference Domingos, P.: MetaCost: a general method for making classifiers cost-sensitive. In: Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, vol. 55, pp. 155–164 (1999) Domingos, P.: MetaCost: a general method for making classifiers cost-sensitive. In: Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, vol. 55, pp. 155–164 (1999)
4.
go back to reference Hanley, J.A., McNeil, B.J.: The meaning and use of the area under a receiver operating characteristic (roc) curve. Radiology 143(1), 29–36 (1982)CrossRef Hanley, J.A., McNeil, B.J.: The meaning and use of the area under a receiver operating characteristic (roc) curve. Radiology 143(1), 29–36 (1982)CrossRef
5.
go back to reference Liu, X.-Y., Jianxin, W., Zhou, Z.-H.: Exploratory undersampling for class imbalance learning. IEEE Trans. Syst. Man Cybern. 39(2), 539–550 (2009)CrossRef Liu, X.-Y., Jianxin, W., Zhou, Z.-H.: Exploratory undersampling for class imbalance learning. IEEE Trans. Syst. Man Cybern. 39(2), 539–550 (2009)CrossRef
6.
go back to reference Cruz, R., Fernandes, K., Cardoso, J.S., Pinto Costa, J.F.: Tackling class imbalance with ranking. In: International Joint Conference on Neural Networks (IJCNN). IEEE (2016) Cruz, R., Fernandes, K., Cardoso, J.S., Pinto Costa, J.F.: Tackling class imbalance with ranking. In: International Joint Conference on Neural Networks (IJCNN). IEEE (2016)
7.
go back to reference Herbrich, R., Graepel, T., Obermayer, K.: Support vector learning for ordinal regression a risk formulation for ordinal regression. In: Proceedings of the Ninth International Conference on Artificial Neural Networks, pp. 97–102 (1999) Herbrich, R., Graepel, T., Obermayer, K.: Support vector learning for ordinal regression a risk formulation for ordinal regression. In: Proceedings of the Ninth International Conference on Artificial Neural Networks, pp. 97–102 (1999)
8.
go back to reference Herbrich, R., Graepel, T., Obermayer, K.: Support vector learning for ordinal regression. In: Ninth International Conference on Artificial Neural Networks, ICANN 1999 (Conf. Publ. No. 470), vol. 1, pp. 97–102. IET (1999) Herbrich, R., Graepel, T., Obermayer, K.: Support vector learning for ordinal regression. In: Ninth International Conference on Artificial Neural Networks, ICANN 1999 (Conf. Publ. No. 470), vol. 1, pp. 97–102. IET (1999)
9.
go back to reference Chu, W., Keerthi, S.S.: New approaches to support vector ordinal regression. In: Proceedings of the 22nd International Conference on Machine Learning, pp. 145–152. ACM (2005) Chu, W., Keerthi, S.S.: New approaches to support vector ordinal regression. In: Proceedings of the 22nd International Conference on Machine Learning, pp. 145–152. ACM (2005)
10.
go back to reference Cardoso, J.S., Costa, J.F.: Learning to classify ordinal data: the data replication method. J. Mach. Learn. Res. 8, 1393–1429 (2007)MathSciNetMATH Cardoso, J.S., Costa, J.F.: Learning to classify ordinal data: the data replication method. J. Mach. Learn. Res. 8, 1393–1429 (2007)MathSciNetMATH
11.
go back to reference Cruz-Ramírez, M., Hervás-Martínez, C., Sánchez-Monedero, J., Gutiérrez, P.A.: Metrics to guide a multi-objective evolutionary algorithm for ordinal classification. Neurocomputing 135, 21–31 (2014)CrossRef Cruz-Ramírez, M., Hervás-Martínez, C., Sánchez-Monedero, J., Gutiérrez, P.A.: Metrics to guide a multi-objective evolutionary algorithm for ordinal classification. Neurocomputing 135, 21–31 (2014)CrossRef
12.
go back to reference Pinto, J.F., Costa, R.S., Cardoso, J.S.: An all-at-once unimodal SVM approach for ordinal classification. In: 2010 Ninth International Conference on Machine Learning and Applications (ICMLA), pp. 59–64. IEEE (2010) Pinto, J.F., Costa, R.S., Cardoso, J.S.: An all-at-once unimodal SVM approach for ordinal classification. In: 2010 Ninth International Conference on Machine Learning and Applications (ICMLA), pp. 59–64. IEEE (2010)
Metadata
Title
Ordinal Class Imbalance with Ranking
Authors
Ricardo Cruz
Kelwin Fernandes
Joaquim F. Pinto Costa
María Pérez Ortiz
Jaime S. Cardoso
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-58838-4_1

Premium Partner