Fred S. Annexstein
ABSTRACT
The existing literature on social choice and the theory of ranking has been particularly fruitful in applications to web search and online social networks. In addition, related techniques have been used to rank the importance of reviewers and critics on the web, by assigning weights associated with attributes such as influence, reach, status, or trust values. In applications of user opinion and preference data analysis, it should be considered paradoxical if users or critics with high weight values reflect opinions and preferences seen to be independent of, or in conflict with, the aggregate ranking of items. If rankings do not resonate, then that is an indication of inconsistencies, and thus the schemes used to determine rankings may need to be modified.
In this paper we present a new theoretical and algorithmic framework for formally investigating resonance between aggregate rankings of items and ratings of critics. In particular, we develop a new paradigm called synthesis ranking, which entails synthesizing an aggregate ranking and critic weighting scheme by computing resonant equilibrium points. In addition, we present an efficient, iterative technique called entrainment for computing resonant equilibrium points. Further we show that the synthesis framework can incorporate natural critic weighting attributes. Finally, we present a redundancy paradox that demonstrates support for a ranking model that uses critic weights.
- N. Ailon, M. Charikar, and A. Newman. Aggregating inconsistent information: ranking and clustering. In Proceedings of the thirty-seventh annual ACM Symposium on Theory of Computing, pages 684--693. ACM, 2005. Google Scholar
Digital Library
- I. Anger and C. Kittl. Measuring influence on twitter. In Proceedings of the 11th International Conference on Knowledge Management and Knowledge Technologies, page 31. ACM, 2011. Google ScholarDigital Library
- K. Arrow. Social choice and individual values. Number 12. Yale Univ Pr, 1963.Google Scholar
- E. Bakshy, J. Hofman, W. Mason, and D. Watts. Everyone's an influencer: quantifying influence on twitter. In Proceedings of the fourth ACM international conference on Web search and data mining, pages 65--74. ACM, 2011. Google ScholarDigital Library
- K. Berman. A graph theoretical approach to handicap ranking of tournaments and paired comparisons. SIAM Journal on Algebraic and Discrete Methods, 1:359, 1980.Google ScholarCross Ref
- R. Bradley and M. Terry. Rank analysis of incomplete block designs: The method of paired comparisons. Biometrika, 39(3--4):324, 1952.Google Scholar
- B. Carterette, P. Bennett, D. Chickering, and S. Dumais. Here or there: Preference judgments for relevance. In Proceedings of the IR research, 30th European conference on Advances in information retrieval, pages 16--27. Springer-Verlag, 2008. Google ScholarDigital Library
- M. Cha, H. Haddadi, F. Benevenuto, and K. Gummadi. Measuring user influence in twitter: The million follower fallacy. In 4th International AAAI Conference on Weblogs and Social Media (ICWSM), pages 10--17, 2010.Google Scholar
- H. Daniels. Round-robin tournament scores. Biometrika, 56(2):295, 1969.Google ScholarCross Ref
- A. Das Sarma, A. Das Sarma, S. Gollapudi, and R. Panigrahy. Ranking mechanisms in twitter-like forums. In Proceedings of the third ACM international conference on Web search and data mining, pages 21--30. ACM, 2010. Google ScholarDigital Library
- D. Dhyani, W. Ng, and S. Bhowmick. A survey of web metrics. ACM Computing Surveys (CSUR), 34(4):503, 2002. Google ScholarDigital Library
- R. Dittrich, W. Katzenbeisser, and H. Reisinger. The analysis of rank ordered preference data based on Bradley-Terry Type Models. OR Spectrum, 22(1):117--134, 2000.Google ScholarCross Ref
- C. Dwork, R. Kumar, M. Naor, and D. Sivakumar. Rank aggregation methods for the web. In Proceedings of the 10th international conference on World Wide Web, pages 613--622. ACM, 2001. Google ScholarDigital Library
- ESPN website. http://espn.go.com/college-football/bcs/.Google Scholar
- R. Fagin, R. Kumar, and D. Sivakumar. Efficient similarity search and classification via rank aggregation. In Proceedings of the 2003 ACM SIGMOD international conference on Management of data, pages 301--312. ACM, 2003. Google ScholarDigital Library
- P. Fishburn. The theory of social choice, volume 264. Princeton University Press Princeton, NJ, 1973.Google Scholar
- P. Green and V. Srinivasan. Conjoint analysis in consumer research: issues and outlook. Journal of consumer research, 5(2):103, 1978.Google Scholar
- D. Hochbaum and A. Levin. Methodologies and algorithms for group-rankings decision. Management Science, 52(9):1394, 2006. Google ScholarDigital Library
- J. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of the ACM (JACM), 46(5):604--632, 1999. Google ScholarDigital Library
- R. Kumar and S. Vassilvitskii. Generalized distances between rankings. In Proceedings of the 19th international conference on World wide web, pages 571--580. ACM, 2010. Google ScholarDigital Library
- A. Langville and C. Meyer. A survey of eigenvector methods for web information retrieval. SIAM review, pages 135--161, 2005. Google ScholarDigital Library
- J. Leskovec, A. Singh, and J. Kleinberg. Patterns of influence in a recommendation network. Advances in Knowledge Discovery and Data Mining, pages 380--389, 2006. Google ScholarDigital Library
- R. Luce. Individual choice behavior: A theoretical analysis. New York, 115:191--243, 1959.Google Scholar
- R. Luce. The choice axiom after twenty years. Journal of Mathematical Psychology, 15(3):215--233, 1977.Google ScholarCross Ref
- J. Moon and N. Pullman. Tournaments and handicaps. In Information Processing 68 (Proc. IFIP Congress, Edinburgh, 1968), pages 219--223, 1969.Google Scholar
- J. Moon and N. Pullman. On generalized tournament matrices. SIAM Review, pages 384--399, 1970.Google ScholarDigital Library
- L. Page, S. Brin, R. Motwani, and T. Winograd. The pagerank citation ranking: Bringing order to the web. Technical report, Stanford Digital Library Technologies Project, 1998.Google Scholar
- D. Pennock, E. Horvitz, and C. Giles. Social choice theory and recommender systems: Analysis of the axiomatic foundations of collaborative filtering. In Proceedings of National Conference on Artificial Intelligence, pages 729--734. AAAI Press; MIT Press; 1999, 2000. Google ScholarDigital Library
- T. Pinch and F. Kesler. How aunt ammy gets her free lunch: A study of the top-thousand customer reviewers at amazon.com. Technical report, 2011.Google Scholar
- D. Romero, W. Galuba, S. Asur, and B. Huberman. Influence and passivity in social media. In Proceedings of the 20th international conference companion on World wide web, pages 113--114. ACM, 2011. Google ScholarDigital Library
- B. Solis. Report: The rise of digital influence and how to measure it, 2012. http://www.briansolis.com/.Google Scholar
- L. Thurstone. A law of comparative judgment. Psychological review, 34(4):273--286, 1927.Google ScholarCross Ref
- L. Thurstone and E. Chave. The measurement of attitude. The University of Chicago Press Chicago, 1929.Google Scholar
- G. Tutz. Bradley-Terry-Luce models with an ordered response. Journal of mathematical psychology, 30(3):306--316, 1986. Google ScholarDigital Library
Index Terms
- Synthesis ranking with critic resonance
Recommendations
Image Retrieval by User-oriented Ranking
ICMR '15: Proceedings of the 5th ACM on International Conference on Multimedia RetrievalTag-based image search is an important method to process images contributed by social users in social media sharing websites like Flickr. However, existing ranking methods for tag-based image search frequently return results that are irrelevant, low-...
Re-ranking search results using query logs
CIKM '06: Proceedings of the 15th ACM international conference on Information and knowledge managementThis work addresses two common problems in search, frequently occurring with underspecified user queries: the top-ranked results for such queries may not contain documents relevant to the user's search intent, and fresh and relevant pages may not get ...
Challenges in personalized authority flow based ranking of social media
CIKM '10: Proceedings of the 19th ACM international conference on Information and knowledge managementAs the social interaction of Internet users increases, so does the need to effectively rank social media. We study the challenges of personalized ranking of blog posts. Web search techniques are inadequate since social media lack many of the ...
Comments