Khalil Klouche
Tuukka Ruotsalo
Salvatore Andolina
Giulio Jacucci
ABSTRACT
We present visual re-ranking, an interactive visualization technique for multi-aspect information retrieval. In multi-aspect search, the information need of the user consists of more than one aspect or query simultaneously. While visualization and interactive search user interface techniques for improving user interpretation of search results have been proposed, the current research lacks understanding on how useful these are for the user: whether they lead to quantifiable benefits in perceiving the result space and allow faster, and more precise retrieval. Our technique visualizes relevance and document density on a two-dimensional map with respect to the query phrases. Pointing to a location on the map specifies a weight distribution of the relevance to each of the query phrases, according to which search results are re-ranked. User experiments compared our technique to a uni-dimensional search interface with typed query and ranked result list, in perception and retrieval tasks. Visual re-ranking yielded improved accuracy in perception, higher precision in retrieval and overall faster task execution. Our findings demonstrate the utility of visual re-ranking, and can help designing search user interfaces that support multi-aspect search.
- C. Ahlberg and B. Shneiderman. Visual information seeking: Tight coupling of dynamic query filters with starfield displays. In Proc. CHI'94, pages 313--317. ACM, 1994. Google Scholar
Digital Library
- C. Ahlberg, C. Williamson, and B. Shneiderman. Dynamic queries for information exploration: An implementation and evaluation. In Proc. CHI'92, pages 619--626. ACM, 1992. Google ScholarDigital Library
- J.-W. Ahn and P. Brusilovsky. Adaptive visualization of search results: Bringing user models to visual analytics. Information Visualization, 8(3):167--179, 2009. Google ScholarDigital Library
- B. Alsallakh, L. Micallef, W. Aigner, H. Hauser, S. Miksch, and P. Rodgers. Visualizing sets and set-typed data: State-of-the-art and future challenges. In EuroVis- State of The Art Reports, pages 1--21. Eurographics, 2014.Google Scholar
- B. Amento, W. Hill, L. Terveen, D. Hix, and P. Ju. An empirical evaluation of user interfaces for topic management of web sites. In Proc. CHI'99, pages 552--559. ACM, 1999. Google ScholarDigital Library
- S. Andolina, K. Klouche, J. Peltonen, M. Hoque, T. Ruotsalo, D. Cabral, A. Klami, D. Głowacka, P. Floréen, and G. Jacucci. Intentstreams: smart parallel search streams for branching exploratory search. In Proc. IUI'15, pages 300--305. ACM, 2015. Google ScholarDigital Library
- S. Benford, D. Snowdon, C. Greenhalgh, R. Ingram, I. Knox, and C. Brown. Vr-vibe: A virtual environment for co-operative information retrieval. In Computer Graphics Forum, volume 14, pages 349--360. Wiley, 1995. Google ScholarDigital Library
- P. P. Bonissone, R. Subbu, and J. Lizzi. Multicriteria decision making (MCDM): a framework for research and applications. Computational Intelligence Magazine, 4(3):48--61, 2009. Google ScholarDigital Library
- K. W. Boyack, B. N. Wylie, and G. S. Davidson. Domain visualization using VxInsight® for science and technology management. JASIST, 53(9):764--774, 2002. Google ScholarDigital Library
- M. Chalmers and P. Chitson. Bead: Explorations in information visualization. In Proc. SIGIR'92, pages 330--337. ACM, 1992. Google ScholarDigital Library
- F. Das-Neves, E. A. Fox, and X. Yu. Connecting topics in document collections with stepping stones and pathways. In Proc. CIKM'05, pages 91--98. ACM, 2005. Google ScholarDigital Library
- B. Fortuna, M. Grobelnik, and D. Mladenic. Visualization of text document corpus. Informatica, 29(4):497--502, 2005.Google Scholar
- S. Gratzl, A. Lex, N. Gehlenborg, H. Pfister, and M. Streit. Lineup: Visual analysis of multi-attribute rankings. TVCG, 19(12):2277--2286, Dec 2013. Google ScholarDigital Library
- S. Havre, E. Hetzler, K. Perrine, E. Jurrus, and N. Miller. Interactive visualization of multiple query results. In Information Visualization, page 105. IEEE, 2001. Google ScholarDigital Library
- M. A. Hearst. Tilebars: Visualization of term distribution information in full text information access. In Proc. CHI'95, pages 59--66. ACM, 1995. Google ScholarDigital Library
- E. Hetzler and A. Turner. Analysis experiences using information visualization. IEEE CG&A, 24(5):22--26, 2004. Google ScholarDigital Library
- O. Hoeber and X. D. Yang. Interactive web information retrieval using wordbars. In International Conference on Web Intelligence, pages 875--882. IEEE, 2006. Google ScholarDigital Library
- O. Hoeber and X. D. Yang. The visual exploration of web search results using hotmap. In Proc. IV'06, pages 157--165. IEEE Computer Society, 2006. Google ScholarDigital Library
- C. Kang, X. Wang, Y. Chang, and B. Tseng. Learning to rank with multi-aspect relevance for vertical search. In Proc. WSDM'12, pages 453--462. ACM, 2012. Google ScholarDigital Library
- S. Kaski, T. Honkela, K. Lagus, and T. Kohonen. WEBSOM--self-organizing maps of document collections. Neurocomputing, 21(1):101--117, 1998.Google ScholarCross Ref
- A. Kerne, E. Koh, B. Dworaczyk, J. M. Mistrot, H. Choi, S. M. Smith, R. Graeber, D. Caruso, A. Webb, R. Hill, and J. Albea. combinformation: A mixed-initiative system for representing collections as compositions of image and text surrogates. In Proc. JCDL'06, pages 11--20. ACM, 2006. Google ScholarDigital Library
- P. Kidwell, G. Lebanon, and W. S. Cleveland. Visualizing incomplete and partially ranked data. volume 14, pages 1356--1363. IEEE, 2008. Google ScholarDigital Library
- K. Klouche, T. Ruotsalo, D. Cabral, S. Andolina, A. Bellucci, and G. Jacucci. Designing for exploratory search on touch devices. In Proc. CHI'15, pages 4189--4198. ACM, 2015. Google ScholarDigital Library
- K. Kucher and A. Kerren. Text visualization techniques: Taxonomy, visual survey, and community insights. In PacificVis'15, pages 117--121. IEEE Computer Society, 2015.Google ScholarCross Ref
- B. Kules and B. Shneiderman. Users can change their web search tactics: Design guidelines for categorized overviews. IPM, 44(2):463--484, 2008. Google ScholarDigital Library
- X. Lin. Map displays for information retrieval. JASIS, 48(1):40--54, 1997. Google ScholarDigital Library
- J. Mackinlay. Automating the design of graphical presentations of relational information. TOG, 5(2):110--141, 1986. Google ScholarDigital Library
- J. Matejka, F. Anderson, and G. Fitzmaurice. Dynamic opacity optimization for scatter plots. In Proc. CHI'15, pages 2707--2710. ACM, 2015. Google ScholarDigital Library
- N. E. Miller, P. C. Wong, M. Brewster, and H. Foote. Topic islands tm-a wavelet-based text visualization system. In Proc. VIS, pages 189--196. IEEE, 1998. Google ScholarDigital Library
- E. Morse and M. Lewis. Why information retrieval visualizations sometimes fail. In Proc. IEEE SMC'97, volume 2, pages 1680--1685, Oct 1997.Google ScholarCross Ref
- T. Munzner, F. Guimbretière, S. Tasiran, L. Zhang, and Y. Zhou. TreeJuxtaposer: scalable tree comparison using focus context with guaranteed visibility. TOG, 22(3):453--462, 2003. Google ScholarDigital Library
- A. Nuchprayoon and R. R. Korfhage. Guido, a visual tool for retrieving documents. In Proc. VL/HCC'94, pages 64--71. IEEE, 1994.Google ScholarCross Ref
- K. A. Olsen, R. R. Korfhage, K. M. Sochats, M. B. Spring, and J. G. Williams. Visualization of a document collection: The VIBE system. IPM, 29(1):69--81, 1993. Google ScholarDigital Library
- J. M. Ponte and W. B. Croft. A language modeling approach to information retrieval. In Proc. SIGIR'98, pages 275--281. ACM, 1998. Google ScholarDigital Library
- T. Porter and T. Duff. Compositing digital images. In Proc. SIGGRAPH'84, pages 253--259. ACM, 1984. Google ScholarDigital Library
- V. V. Raghavan and S. M. Wong. A critical analysis of vector space model for information retrieval. JASIS, 37(5):279--287, 1986.Google ScholarCross Ref
- S. E. Robertson. Readings in information retrieval. chapter The Probability Ranking Principle in IR, pages 281--286. Morgan Kaufmann Publishers Inc., 1997. Google ScholarDigital Library
- R. M. Rohrer, D. S. Ebert, and J. L. Sibert. The shape of Shakespeare: visualizing text using implicit surfaces. In Proc. InfoVis, pages 121--129. IEEE, 1998. Google ScholarDigital Library
- T. Ruotsalo, G. Jacucci, P. Myllym\"aki, and S. Kaski. Interactive intent modeling: Information discovery beyond search. Communications of the ACM, 58(1):86--92, 2015. Google ScholarDigital Library
- T. Ruotsalo, J. Peltonen, M. Eugster, D. Głowacka, K. Konyushkova, K. Athukorala, I. Kosunen, A. Reijonen, P. Myllymäki, G. Jacucci, et al. Directing exploratory search with interactive intent modeling. In Proc. CIKM'13, pages 1759--1764. ACM, 2013. Google ScholarDigital Library
- J. Seo and B. Shneiderman. A rank-by-feature framework for interactive exploration of multidimensional data. Information Visualization, 4(2):96--113, 2005. Google ScholarDigital Library
- C. Shi, W. Cui, S. Liu, P. Xu, W. Chen, and H. Qu. RankExplorer: Visualization of ranking changes in large time series data. TVCG, 18(12):2669--2678, 2012. Google ScholarDigital Library
- B. Shneiderman. Dynamic queries for visual information seeking. Software, 11(6):70--77, Nov 1994. Google ScholarDigital Library
- B. Shneiderman. The eyes have it: A task by data type taxonomy for information visualizations. In Proc. VL/HCC'96, pages 336--343. IEEE, 1996. Google ScholarDigital Library
- B. Shneiderman, D. Feldman, A. Rose, and X. F. Grau. Visualizing digital library search results with categorical and hierarchical axes. In Proc. DL'00, pages 57--66. ACM, 2000. Google ScholarDigital Library
- B. Shneiderman, C. Plaisant, M. Cohen, and S. Jacobs. Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison-Wesley Publishing Company, 5th edition, 2009. Google ScholarDigital Library
- W. Song, Q. Yu, Z. Xu, T. Liu, S. Li, and J.-R. Wen. Multi-aspect query summarization by composite query. In Proc. SIGIR'12, pages 325--334. ACM, 2012. Google ScholarDigital Library
- A. Spoerri. InfoCrystal: A visual tool for information retrieval & management. In Proc. CIKM'93, pages 11--20. ACM, 1993. Google ScholarDigital Library
- J. Wise, J. J. Thomas, K. Pennock, D. Lantrip, M. Pottier, A. Schur, V. Crow, et al. Visualizing the non-visual: spatial analysis and interaction with information from text documents. In Proc. Information Visualization, pages 51--58. IEEE, 1995. Google ScholarDigital Library
- D. Xin, J. Han, H. Cheng, and X. Li. Answering top-k queries with multi-dimensional selections: The ranking cube approach. In Proc. VLDB'06, pages 463--474. VLDB, 2006. Google ScholarDigital Library
- C. Zhai and J. Lafferty. A study of smoothing methods for language models applied to information retrieval. TOIS, 22(2):179--214, 2004. Google ScholarDigital Library
- J. Zhang. Tofir: A tool of facilitating information retrieval--introduce a visual retrieval model. IPM, 37(4):639--657, 2001. Google ScholarDigital Library
- J. Zhang and R. R. Korfhage. Dare: Distance and angle retrieval environment: A tale of the two measures. JASIS, 50(9):779--787, 1999. Google ScholarDigital Library
Index Terms
- Visual Re-Ranking for Multi-Aspect Information Retrieval
Recommendations
Empirical Study of a 3D Visualization for Information Retrieval Tasks
Special issue: A survey of research questions for intelligent information systems in educationThere are many challenges to visualizing information including choosing between 2D and 3D interfaces, navigation and interaction methods, and selecting an appropriate level of detail. Visualizing information retrieval (IR) search results, including Web ...
Interactive Information Retrieval Using Clustering and Spatial Proximity
A web-based search engine responds to a user's query with a list of documents. This list can be viewed as the engine's model of the user's idea of relevance--the engine `believes' that the first document is the most likely to be relevant, the second is ...
MapReduce Based Information Retrieval Algorithms for Efficient Ranking of Webpages
In this paper, the authors discuss the MapReduce implementation of crawler, indexer and ranking algorithms in search engines. The proposed algorithms are used in search engines to retrieve results from the World Wide Web. A crawler and an indexer in a ...
Comments