Skip to main content
Top

2020 | OriginalPaper | Chapter

On Improving the Efficiency of Majorization-Minorization for the Inference of Rank Aggregation Models

Author : Leonardo Ramos Emmendorfer

Published in: Intelligent Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The Plackett-Luce model represents discrete choices from a set of items and it is often applied to rank aggregation problems. The iterative majorization-minorization method is among the most relevant approaches for finding the maximum likelihood estimation of the parameters of the Plackett-Luce model, but its convergence might be slow. A noninformative initialization is usually adopted which assumes all items are equally relevant at the first step of the iterative inference process. This paper investigates the adoption of approximate inference methods which could allow a better initialization, leading to a smaller number of iterations required for the convergence of majorization-minorization. Two alternatives are adopted: a spectral inference method from the literature and also a novel approach based on a Poisson probabilistic model. Empirical evaluation is performed using synthetic and real-world datasets. It was revealed that initialization provided by an approximate method can lead to statistically significant reductions in both the number of iterations required and also in the overall computational time when compared to the scheme usually adopted for majorization-minorization.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Agarwal, A., Patil, P., Agarwal, S.: Accelerated spectral ranking. In: International Conference on Machine Learning, pp. 70–79 (2018) Agarwal, A., Patil, P., Agarwal, S.: Accelerated spectral ranking. In: International Conference on Machine Learning, pp. 70–79 (2018)
2.
go back to reference Bradley, R.A., Terry, M.E.: Rank analysis of incomplete block designs: I. The method of paired comparisons. Biometrika 39(3/4), 324–345 (1952)MathSciNetMATHCrossRef Bradley, R.A., Terry, M.E.: Rank analysis of incomplete block designs: I. The method of paired comparisons. Biometrika 39(3/4), 324–345 (1952)MathSciNetMATHCrossRef
3.
go back to reference Caron, F., Doucet, A.: Efficient Bayesian inference for generalized Bradley-Terry models. J. Comput. Graph. Stat. 21(1), 174–196 (2012)MathSciNetCrossRef Caron, F., Doucet, A.: Efficient Bayesian inference for generalized Bradley-Terry models. J. Comput. Graph. Stat. 21(1), 174–196 (2012)MathSciNetCrossRef
4.
go back to reference Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Stat. Soc. Ser. B (Methodol.) 39(1), 1–22 (1977)MathSciNetMATH Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Stat. Soc. Ser. B (Methodol.) 39(1), 1–22 (1977)MathSciNetMATH
5.
go back to reference Elo, A.E.: The Rating of Chessplayers, Past & Present. Arco, New York (1978) Elo, A.E.: The Rating of Chessplayers, Past & Present. Arco, New York (1978)
6.
go back to reference Guiver, J., Snelson, E.: Bayesian inference for Plackett-Luce ranking models. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 377–384 (2009) Guiver, J., Snelson, E.: Bayesian inference for Plackett-Luce ranking models. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 377–384 (2009)
7.
go back to reference Hajek, B., Oh, S., Xu, J.: Minimax-optimal inference from partial rankings. In: Advances in Neural Information Processing Systems, pp. 1475–1483 (2014) Hajek, B., Oh, S., Xu, J.: Minimax-optimal inference from partial rankings. In: Advances in Neural Information Processing Systems, pp. 1475–1483 (2014)
11.
go back to reference Kumar, R., Tomkins, A., Vassilvitskii, S., Vee, E.: Inverting a steady-state. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, pp. 359–368 (2015) Kumar, R., Tomkins, A., Vassilvitskii, S., Vee, E.: Inverting a steady-state. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, pp. 359–368 (2015)
12.
go back to reference Lange, K., Hunter, D.R., Yang, I.: Optimization transfer using surrogate objective functions. J. Comput. Graph. Stat. 9(1), 1–20 (2000)MathSciNet Lange, K., Hunter, D.R., Yang, I.: Optimization transfer using surrogate objective functions. J. Comput. Graph. Stat. 9(1), 1–20 (2000)MathSciNet
13.
go back to reference Luce, R.D.: Individual Choice Behavior: A Theoretical Analysis. Wiley, New York (1959)MATH Luce, R.D.: Individual Choice Behavior: A Theoretical Analysis. Wiley, New York (1959)MATH
14.
go back to reference Maystre, L., Grossglauser, M.: Fast and accurate inference of Plackett-Luce models. In: Advances in Neural Information Processing Systems, pp. 172–180 (2015) Maystre, L., Grossglauser, M.: Fast and accurate inference of Plackett-Luce models. In: Advances in Neural Information Processing Systems, pp. 172–180 (2015)
15.
go back to reference McFadden, D., et al.: Conditional logit analysis of qualitative choice behavior. In: Zarembka, P. (ed.) Frotiers in Econometrics, pp. 105–142. Academic Press, Cambridge (1973) McFadden, D., et al.: Conditional logit analysis of qualitative choice behavior. In: Zarembka, P. (ed.) Frotiers in Econometrics, pp. 105–142. Academic Press, Cambridge (1973)
16.
go back to reference Negahban, S., Oh, S., Shah, D.: Iterative ranking from pair-wise comparisons. In: Advances in Neural Information Processing Systems, pp. 2474–2482 (2012) Negahban, S., Oh, S., Shah, D.: Iterative ranking from pair-wise comparisons. In: Advances in Neural Information Processing Systems, pp. 2474–2482 (2012)
17.
go back to reference Negahban, S., Oh, S., Thekumparampil, K.K., Xu, J.: Learning from comparisons and choices. J. Mach. Learn. Res. 19(1), 1478–1572 (2018)MathSciNetMATH Negahban, S., Oh, S., Thekumparampil, K.K., Xu, J.: Learning from comparisons and choices. J. Mach. Learn. Res. 19(1), 1478–1572 (2018)MathSciNetMATH
18.
go back to reference Plackett, R.L.: The analysis of permutations. J. Roy. Stat. Soc. Ser. C (Appl. Stat.) 24(2), 193–202 (1975)MathSciNet Plackett, R.L.: The analysis of permutations. J. Roy. Stat. Soc. Ser. C (Appl. Stat.) 24(2), 193–202 (1975)MathSciNet
19.
go back to reference Rao, P., Kupper, L.L.: Ties in paired-comparison experiments: a generalization of the Bradley-Terry model. J. Am. Stat. Assoc. 62(317), 194–204 (1967)MathSciNetCrossRef Rao, P., Kupper, L.L.: Ties in paired-comparison experiments: a generalization of the Bradley-Terry model. J. Am. Stat. Assoc. 62(317), 194–204 (1967)MathSciNetCrossRef
20.
go back to reference Soufiani, H.A., Chen, W., Parkes, D.C., Xia, L.: Generalized method-of-moments for rank aggregation. In: Advances in Neural Information Processing Systems, pp. 2706–2714 (2013) Soufiani, H.A., Chen, W., Parkes, D.C., Xia, L.: Generalized method-of-moments for rank aggregation. In: Advances in Neural Information Processing Systems, pp. 2706–2714 (2013)
21.
go back to reference Thurstone, L.L.: The method of paired comparisons for social values. J. Abnorm. Soc. Psychol. 21(4), 384 (1927)CrossRef Thurstone, L.L.: The method of paired comparisons for social values. J. Abnorm. Soc. Psychol. 21(4), 384 (1927)CrossRef
22.
go back to reference Zermelo, E.: Die berechnung der turnier-ergebnisse als ein maximumproblem der wahrscheinlichkeitsrechnung. Math. Z. 29(1), 436–460 (1929)MathSciNetMATHCrossRef Zermelo, E.: Die berechnung der turnier-ergebnisse als ein maximumproblem der wahrscheinlichkeitsrechnung. Math. Z. 29(1), 436–460 (1929)MathSciNetMATHCrossRef
Metadata
Title
On Improving the Efficiency of Majorization-Minorization for the Inference of Rank Aggregation Models
Author
Leonardo Ramos Emmendorfer
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-61377-8_11

Premium Partner