Skip to main content
Top
Published in: Neural Processing Letters 1/2017

24-01-2017

A Generalized Logistic Link Function for Cumulative Link Models in Ordinal Regression

Author: F. Fernández-Navarro

Published in: Neural Processing Letters | Issue 1/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Ordinal regression is a kind of regression analysis used for predicting an ordered response variable. In these problems, the patterns are labelled by a set of ranks with an ordering among the different categories. The most common type of ordinal regression model is the cumulative link model. The cumulative link model relates an unobserved continuous latent variable with a monotone link function. Logit and probit functions are examples of link functions used in cumulative link models. In this paper, a novel generalized link function based on a generalization of the logistic distribution is proposed. The generalized link function proposed is able to reproduce other different link functions by changing two real parameters: \(\alpha \) and \(\lambda \). The generalized link function has been included in a cumulative link model where the latent function is determined by a standard neural network in order to test the performance of the proposal. For this model, a reformulation of the tunable thresholds and distribution parameters was applied to convert the constrained optimization problem into an unconstrained optimization problem. Experimental results demonstrate that our proposed approach can achieve competitive generalization performance.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Agresti A (1984) Analysis of ordinal categorical data. Wiley Series in Probability and Statistics, New YorkMATH Agresti A (1984) Analysis of ordinal categorical data. Wiley Series in Probability and Statistics, New YorkMATH
2.
go back to reference Ahuja J, Nash SW (1967) The generalized gompertz-verhulst family of distributions. Sankhya 29(Ser.A.):141–156 Ahuja J, Nash SW (1967) The generalized gompertz-verhulst family of distributions. Sankhya 29(Ser.A.):141–156
3.
4.
go back to reference Anderson JA (1984) Regression and ordered categorical variables. J R Stat Soc Ser B (Methodological) 46(1):1–30MathSciNetMATH Anderson JA (1984) Regression and ordered categorical variables. J R Stat Soc Ser B (Methodological) 46(1):1–30MathSciNetMATH
7.
go back to reference Baccianella S, Esuli A, Sebastiani F (2009) Evaluation measures for ordinal regression. In: Proceedings of the 2009 9th international conference on intelligent systems design and applications, ISDA ’09, pp 283–287 Baccianella S, Esuli A, Sebastiani F (2009) Evaluation measures for ordinal regression. In: Proceedings of the 2009 9th international conference on intelligent systems design and applications, ISDA ’09, pp 283–287
8.
go back to reference Cardoso J, Pinto da Costa J (2007) Learning to classify ordinal data: the data replication method. J Mach Learn Res 8:1393–1429MathSciNetMATH Cardoso J, Pinto da Costa J (2007) Learning to classify ordinal data: the data replication method. J Mach Learn Res 8:1393–1429MathSciNetMATH
9.
go back to reference Caruana R, Baluja S, Mitchell T (1996) Using the future to sort out the present: rankprop and multitask learning for medical risk evaluation. Adv Neural Inf Process Syst 8:959–965 Caruana R, Baluja S, Mitchell T (1996) Using the future to sort out the present: rankprop and multitask learning for medical risk evaluation. Adv Neural Inf Process Syst 8:959–965
10.
go back to reference Cheng J, Wang Z, Pollastri G (2008) A neural network approach to ordinal regression. In: Proceedings of the IEEE international joint conference on neural networks (IJCNN2008, IEEE world congress on computational intelligence). IEEE Press, pp 1279–1284 Cheng J, Wang Z, Pollastri G (2008) A neural network approach to ordinal regression. In: Proceedings of the IEEE international joint conference on neural networks (IJCNN2008, IEEE world congress on computational intelligence). IEEE Press, pp 1279–1284
11.
go back to reference Chu W, Ghahramani Z (2005) Gaussian processes for ordinal regression. J Mach Learn Res 6:1019–1041MathSciNetMATH Chu W, Ghahramani Z (2005) Gaussian processes for ordinal regression. J Mach Learn Res 6:1019–1041MathSciNetMATH
12.
go back to reference Chu W, Keerthi SS (2005) New approaches to support vector ordinal regression. In: ICML 05: proceedings of the 22nd international conference on machine learning, pp 145–152 Chu W, Keerthi SS (2005) New approaches to support vector ordinal regression. In: ICML 05: proceedings of the 22nd international conference on machine learning, pp 145–152
14.
15.
go back to reference da Costa P, Alonso H, Cardoso JS (2008) The unimodal model for the classification of ordinal data. Neural Netw 21(1):78–91CrossRefMATH da Costa P, Alonso H, Cardoso JS (2008) The unimodal model for the classification of ordinal data. Neural Netw 21(1):78–91CrossRefMATH
16.
go back to reference Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MathSciNetMATH Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MathSciNetMATH
17.
go back to reference Deng WY, Zheng QH, Lian S, Chen L, Wang X (2010) Ordinal extreme learning machine. Neurocomputing 74(1–3):447–456CrossRef Deng WY, Zheng QH, Lian S, Chen L, Wang X (2010) Ordinal extreme learning machine. Neurocomputing 74(1–3):447–456CrossRef
18.
go back to reference Fahrmeir L, Tutz G (2001) Multivariate statistical modelling based on generalized linear models, 2nd edn. Springer, New YorkCrossRefMATH Fahrmeir L, Tutz G (2001) Multivariate statistical modelling based on generalized linear models, 2nd edn. Springer, New YorkCrossRefMATH
19.
go back to reference Fernández-Navarro F, Campoy P, De la Paz M, Hervás-Martínez C, Yao X (2013) Addressing the EU sovereign ratings using an ordinal regression approach. IEEE Trans Cybern 43(6):2228–2240CrossRef Fernández-Navarro F, Campoy P, De la Paz M, Hervás-Martínez C, Yao X (2013) Addressing the EU sovereign ratings using an ordinal regression approach. IEEE Trans Cybern 43(6):2228–2240CrossRef
20.
go back to reference Fernández-Navarro F, Hervás-Martínez C, Gutierrez PA (2013) Generalised gaussian radial basis function neural networks. Soft Comput 17(3):519–533CrossRef Fernández-Navarro F, Hervás-Martínez C, Gutierrez PA (2013) Generalised gaussian radial basis function neural networks. Soft Comput 17(3):519–533CrossRef
21.
go back to reference Fernandez-Navarro F, Riccardi A, Carloni S (2014) Ordinal neural networks without iterative tuning. IEEE Trans Neural Netw Learn Syst 25(11):2075–2085CrossRef Fernandez-Navarro F, Riccardi A, Carloni S (2014) Ordinal neural networks without iterative tuning. IEEE Trans Neural Netw Learn Syst 25(11):2075–2085CrossRef
22.
23.
go back to reference Genter FC, Farewell VT (1985) Goodness-of-link testing in ordinal regression models. Can J Stat 13(1):37–44CrossRefMATH Genter FC, Farewell VT (1985) Goodness-of-link testing in ordinal regression models. Can J Stat 13(1):37–44CrossRefMATH
25.
go back to reference Gutiérrez PA, Pérez-Ortiz M, Sánchez-Monedero J, Fernández-Navarro F, Hervás-Martínez C (2016) Ordinal regression methods: survey and experimental study. IEEE Trans Knowl Data Eng 28(1):127–146CrossRef Gutiérrez PA, Pérez-Ortiz M, Sánchez-Monedero J, Fernández-Navarro F, Hervás-Martínez C (2016) Ordinal regression methods: survey and experimental study. IEEE Trans Knowl Data Eng 28(1):127–146CrossRef
26.
go back to reference Hedeker D, Berbaum M, Mermelstein R (2006) Location-scale models for multilevel ordinal data: between and within subjects variance modeling. J Probab Stat Sci 1(4):1–20MathSciNet Hedeker D, Berbaum M, Mermelstein R (2006) Location-scale models for multilevel ordinal data: between and within subjects variance modeling. J Probab Stat Sci 1(4):1–20MathSciNet
27.
go back to reference Huang GB, Zhou H, Ding X, Zhang R (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern B Cybern 42(2):513–529CrossRef Huang GB, Zhou H, Ding X, Zhang R (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern B Cybern 42(2):513–529CrossRef
28.
go back to reference Igel C, Hüsken M (2003) Empirical evaluation of the improved rprop learning algorithms. Neurocomputing 50(6):105–123CrossRefMATH Igel C, Hüsken M (2003) Empirical evaluation of the improved rprop learning algorithms. Neurocomputing 50(6):105–123CrossRefMATH
29.
go back to reference Ishwaran H, Gatsonis CA (2000) A general class of hierarchical ordinal regression models with applications to correlated ROC analysis. Can J Stat 28(4):731–750MathSciNetCrossRefMATH Ishwaran H, Gatsonis CA (2000) A general class of hierarchical ordinal regression models with applications to correlated ROC analysis. Can J Stat 28(4):731–750MathSciNetCrossRefMATH
30.
31.
go back to reference Kosmidis I (2014) Improved estimation in cumulative link models. J R Stat Soc Ser B (Stat Methodol) 76(1):169–196MathSciNetCrossRef Kosmidis I (2014) Improved estimation in cumulative link models. J R Stat Soc Ser B (Stat Methodol) 76(1):169–196MathSciNetCrossRef
32.
go back to reference Li L, Lin HT (2007) Ordinal regression by extended binary classification. Adv Neural Inf Process Syst 19:865–872 Li L, Lin HT (2007) Ordinal regression by extended binary classification. Adv Neural Inf Process Syst 19:865–872
33.
go back to reference Lim TS, Loh WY, Shih YS (2000) A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms. Mach Learn 40(3):203–228CrossRefMATH Lim TS, Loh WY, Shih YS (2000) A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms. Mach Learn 40(3):203–228CrossRefMATH
34.
go back to reference Martínez-Estudillo FJ, Hervás-Martínez C, Peña PG, Martínez-Estudillo AC, Ventura-Soto S (2006) Evolutionary product-unit neural networks for classification. In: Intelligent data engineering and automated learning—IDEAL 2006. Springer, New York, pp 1320–1328 Martínez-Estudillo FJ, Hervás-Martínez C, Peña PG, Martínez-Estudillo AC, Ventura-Soto S (2006) Evolutionary product-unit neural networks for classification. In: Intelligent data engineering and automated learning—IDEAL 2006. Springer, New York, pp 1320–1328
35.
go back to reference Mathieson MJ (1996) Ordinal models for neural networks. In: Refenes APN, Abu-Mostafa Y, Weigend A (eds) Proceedings of the 3rd international conference on neural networks in the capital markets, neural networks in financial engineering. World Scientific, Singapore, pp 523–536 Mathieson MJ (1996) Ordinal models for neural networks. In: Refenes APN, Abu-Mostafa Y, Weigend A (eds) Proceedings of the 3rd international conference on neural networks in the capital markets, neural networks in financial engineering. World Scientific, Singapore, pp 523–536
39.
go back to reference Riccardi A, Fernandez-Navarro F, Carloni S (2014) Cost-sensitive adaboost algorithm for ordinal regression based on extreme learning machine. IEEE Trans Cybern 44(10):1898–1909CrossRef Riccardi A, Fernandez-Navarro F, Carloni S (2014) Cost-sensitive adaboost algorithm for ordinal regression based on extreme learning machine. IEEE Trans Cybern 44(10):1898–1909CrossRef
40.
go back to reference Seah CW, Tsang IW, Ong YS (2012) Transductive ordinal regression. IEEE Trans Neural Netw Learn Syst 23(7):1074–1086CrossRef Seah CW, Tsang IW, Ong YS (2012) Transductive ordinal regression. IEEE Trans Neural Netw Learn Syst 23(7):1074–1086CrossRef
41.
go back to reference Sun BY, Wang HL, Li WB, Wang HJ, Li J, Du ZQ (2014) Constructing and combining orthogonal projection vectors for ordinal regression. Neural Process Lett 41(1):139–155CrossRef Sun BY, Wang HL, Li WB, Wang HJ, Li J, Du ZQ (2014) Constructing and combining orthogonal projection vectors for ordinal regression. Neural Process Lett 41(1):139–155CrossRef
42.
go back to reference Sun P, Yao X (2010) Sparse approximation through boosting for learning large scale kernel machines. IEEE Trans Neural Netw 21(6):883–894CrossRef Sun P, Yao X (2010) Sparse approximation through boosting for learning large scale kernel machines. IEEE Trans Neural Netw 21(6):883–894CrossRef
43.
go back to reference Thomas P, Suhner MC (2015) A new multilayer perceptron pruning algorithm for classification and regression applications. Neural Process Lett 42(2):437–458CrossRef Thomas P, Suhner MC (2015) A new multilayer perceptron pruning algorithm for classification and regression applications. Neural Process Lett 42(2):437–458CrossRef
44.
go back to reference Verwaeren J, Waegeman W, De Baets B (2012) Learning partial ordinal class memberships with kernel-based proportional odds models. Comput Stat Data Anal 56(4):928–942MathSciNetCrossRefMATH Verwaeren J, Waegeman W, De Baets B (2012) Learning partial ordinal class memberships with kernel-based proportional odds models. Comput Stat Data Anal 56(4):928–942MathSciNetCrossRefMATH
Metadata
Title
A Generalized Logistic Link Function for Cumulative Link Models in Ordinal Regression
Author
F. Fernández-Navarro
Publication date
24-01-2017
Publisher
Springer US
Published in
Neural Processing Letters / Issue 1/2017
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-017-9589-3

Other articles of this Issue 1/2017

Neural Processing Letters 1/2017 Go to the issue