Skip to main content
Top
Published in: Soft Computing 3/2013

01-03-2013 | Original Paper

Supervised rank aggregation based on query similarity for document retrieval

Authors: Yang Wang, Yalou Huang, Xiaodong Pang, Min Lu, Maoqiang Xie, Jie Liu

Published in: Soft Computing | Issue 3/2013

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper is concerned with supervised rank aggregation, which aims to improve the ranking performance by combining the outputs from multiple rankers. However, there are two main shortcomings in previous rank aggregation approaches. First, the learned weights for base rankers do not distinguish the differences among queries. This is suboptimal since queries vary significantly in terms of ranking. Besides, most current aggregation functions do not directly optimize the evaluation measures in ranking. In this paper, the differences among queries are taken into consideration, and a supervised rank aggregation function is proposed. This aggregation function is directly optimizing the evaluation measure NDCG, referred to as RankAgg.NDCG, We prove that RankAgg.NDCG can achieve better NDCG performance than the linear combination of the base rankers. Experimental results performed on benchmark datasets show our approach outperforms a number of baseline approaches.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Baeza-Yates RA, Ribeiro-Neto B (1999) Modern information retrieval. Addison-Wesley Longman Publishing Co., Inc., Boston Baeza-Yates RA, Ribeiro-Neto B (1999) Modern information retrieval. Addison-Wesley Longman Publishing Co., Inc., Boston
go back to reference Bian J, Li X, Li F et al (2010a) Ranking specialization for web search: a divide-and-conquer approach by using Topical RankSVM. In: Proceedings of the world wide web conference, Raleigh, pp 131–140 Bian J, Li X, Li F et al (2010a) Ranking specialization for web search: a divide-and-conquer approach by using Topical RankSVM. In: Proceedings of the world wide web conference, Raleigh, pp 131–140
go back to reference Bian J, Liu TY, Qin T, et al (2010b) Ranking with query-dependent loss for web search. In: Proceedings of the 3rd WSDM conference. New York, pp 141–150 Bian J, Liu TY, Qin T, et al (2010b) Ranking with query-dependent loss for web search. In: Proceedings of the 3rd WSDM conference. New York, pp 141–150
go back to reference Burges C, Shaked T, Renshaw E, Lazier A, Deeds M, Hamilton N, Hullender G (2005) Learning to rank using gradient descent. In: Proceedings of the 22nd international conference on machine learning, pp 89–96 Burges C, Shaked T, Renshaw E, Lazier A, Deeds M, Hamilton N, Hullender G (2005) Learning to rank using gradient descent. In: Proceedings of the 22nd international conference on machine learning, pp 89–96
go back to reference Cao Y, Xu J, Liu T, Li H, Huang Y, Hon HW (2006) Adapting Ranking SVM to document retrieval. In: Proceedings of the 29th ACM SIGIR conference, Seattle, pp 186–193 Cao Y, Xu J, Liu T, Li H, Huang Y, Hon HW (2006) Adapting Ranking SVM to document retrieval. In: Proceedings of the 29th ACM SIGIR conference, Seattle, pp 186–193
go back to reference Cao Z, Qin T, Liu T, Tsai M, Li H (2007) Learning to rank: from pairwise approach to listwise approach. In: Proceedings of the 24th international conference on machine learning Cao Z, Qin T, Liu T, Tsai M, Li H (2007) Learning to rank: from pairwise approach to listwise approach. In: Proceedings of the 24th international conference on machine learning
go back to reference Crammer K, Singer Y (2001) PRanking with ranking. In: Proceedings of the 14th conference on neural information processing systems, Vancouver, pp 641–647 Crammer K, Singer Y (2001) PRanking with ranking. In: Proceedings of the 14th conference on neural information processing systems, Vancouver, pp 641–647
go back to reference Freund Y, Iyer R, Schapire RE, Singer Y (2003) An efficient boosting algorithm for combining preferences. J Mach Learn Res 4:933–969MathSciNet Freund Y, Iyer R, Schapire RE, Singer Y (2003) An efficient boosting algorithm for combining preferences. J Mach Learn Res 4:933–969MathSciNet
go back to reference Geng XB, Liu TY, Qin T, Arnold A, Li H, Shum HY (2008) Query dependent ranking using K-nearest neighbor, In: Proceedings of the 31st ACM SIGIR conference, pp 115–122 Geng XB, Liu TY, Qin T, Arnold A, Li H, Shum HY (2008) Query dependent ranking using K-nearest neighbor, In: Proceedings of the 31st ACM SIGIR conference, pp 115–122
go back to reference Jarvelin K, Kekalainen J (2002) Cumulated gain-based evaluation of IR techniques. ACM Trans Info Syst 20(4):422–446CrossRef Jarvelin K, Kekalainen J (2002) Cumulated gain-based evaluation of IR techniques. ACM Trans Info Syst 20(4):422–446CrossRef
go back to reference Joachims T (2002) Optimizing search engines using click-through data. In: Proceedings of the 8th ACM SIGKDD conference, New York, pp 133–142 Joachims T (2002) Optimizing search engines using click-through data. In: Proceedings of the 8th ACM SIGKDD conference, New York, pp 133–142
go back to reference Liu YT, Liu TY, Qin T, Ma ZM, Li H (2007) Supervised rank aggregation. In: Proceedings of the world wide web Conference. Alberta, pp 481–490 Liu YT, Liu TY, Qin T, Ma ZM, Li H (2007) Supervised rank aggregation. In: Proceedings of the world wide web Conference. Alberta, pp 481–490
go back to reference Peng J, Macdonald C, Ounis I (2010) Learning to select a ranking function. In: Proceedings of the 32nd ECIR conference Peng J, Macdonald C, Ounis I (2010) Learning to select a ranking function. In: Proceedings of the 32nd ECIR conference
go back to reference Ponte J, Croft WB (1998) A language model approach to information retrieval. In: Proceedings of the 21st ACM SIGIR conference, pp 275–281 Ponte J, Croft WB (1998) A language model approach to information retrieval. In: Proceedings of the 21st ACM SIGIR conference, pp 275–281
go back to reference Qin T, Zhang XD, Tsai MF, Wang DS, Liu TY, Li H (2008) Query-level loss functions for information retrieval. J Info Process Manag Qin T, Zhang XD, Tsai MF, Wang DS, Liu TY, Li H (2008) Query-level loss functions for information retrieval. J Info Process Manag
go back to reference Qin T, Liu TY, Lai W et al (2007) Ranking with multiple hyperplanes. In: Proceedings of the 30st ACM SIGIR conference, The Netherlands, pp 279–286 Qin T, Liu TY, Lai W et al (2007) Ranking with multiple hyperplanes. In: Proceedings of the 30st ACM SIGIR conference, The Netherlands, pp 279–286
go back to reference Qin T, Liu T, Li H (2009) A general approximation framework for direct optimization of information retrieval measures. J Info Retr Qin T, Liu T, Li H (2009) A general approximation framework for direct optimization of information retrieval measures. J Info Retr
go back to reference Qin T, Liu T, Xu J, Li H (2009) LETOR: a benchmark collection for research on learning to rank for information retrieval. J Info Retr Qin T, Liu T, Xu J, Li H (2009) LETOR: a benchmark collection for research on learning to rank for information retrieval. J Info Retr
go back to reference Robertson SE, Walker S, Hancock-Beaulieu M, Gatford M (1994) Okapi in TREC3, In: Proceedings of text retrieval conference, Gaithersburg, pp 109–126 Robertson SE, Walker S, Hancock-Beaulieu M, Gatford M (1994) Okapi in TREC3, In: Proceedings of text retrieval conference, Gaithersburg, pp 109–126
go back to reference Shashua A, Levin A (2003) Ranking with large margin principle: two approaches. In: Proceedings of the 15th conference on neural information processing systems, pp 937–944 Shashua A, Levin A (2003) Ranking with large margin principle: two approaches. In: Proceedings of the 15th conference on neural information processing systems, pp 937–944
go back to reference Xia F, Liu T, Wang J et al (2008) Listwise approach to learning to rank—theory and algorithm. In: Proceedings of the 25th ICML conference, Finland, pp 1192–1199 Xia F, Liu T, Wang J et al (2008) Listwise approach to learning to rank—theory and algorithm. In: Proceedings of the 25th ICML conference, Finland, pp 1192–1199
go back to reference Xu J, Li H (2007) AdaRank: a boosting algorithm for information retrieval. In: Proceedings of the 30th ACM SIGIR conference, pp 391–398 Xu J, Li H (2007) AdaRank: a boosting algorithm for information retrieval. In: Proceedings of the 30th ACM SIGIR conference, pp 391–398
go back to reference Yue Y, Finley T, Radlinski F et al (2007) A support vector method for optimizing average precision. In: Proceedings of the 30th ACM SIGIR conference, The Netherlands Yue Y, Finley T, Radlinski F et al (2007) A support vector method for optimizing average precision. In: Proceedings of the 30th ACM SIGIR conference, The Netherlands
Metadata
Title
Supervised rank aggregation based on query similarity for document retrieval
Authors
Yang Wang
Yalou Huang
Xiaodong Pang
Min Lu
Maoqiang Xie
Jie Liu
Publication date
01-03-2013
Publisher
Springer-Verlag
Published in
Soft Computing / Issue 3/2013
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-012-0917-2

Other articles of this Issue 3/2013

Soft Computing 3/2013 Go to the issue

Premium Partner