ABSTRACT
An important question for HCI is to understand how and why visual search strategy is adapted to the demands imposed by the task of searching the results of a search engine. There is emerging evidence that a key part of the answer concerns the expected information gain of each of the set of available information gathering actions. We build on previous research to show that people are acutely sensitive to differences in the spacing and in the number of items returned by the search engine. These factors cause shifts in the efficiency of the available information gathering actions. We focus on an image browsing task, and show that, as a consequence of changes to the efficiency of available actions, people make small but significant changes to eye-movement strategy.
- Anderson, J.R. The Adaptive Character of Thought. Lawrence Erlbaum Associates, 1990.Google Scholar
- Anderson, J.R., Bothell, D., Byrne, M.D., Douglass, S., Lebiere, C., and Qin, Y. An integrated theory of the mind. Psychological Review 111, 4 (2004), 1036--1060.Google ScholarCross Ref
- Araujo, C.C., Kowler, E.E., and Pavel, M.M. Eye movements during visual search: the costs of choosing the optimal path. Vision Research 41, 25-26 (2001), 3613--3625.Google ScholarCross Ref
- Bertera, J.H. and Rayner, K. Eye movements and the span of the effective visual stimulus in visual search. Perception & Psychophysics 62 (2000), 576--585.Google ScholarCross Ref
- Brumby, D.P. and Howes, A. Good enough but I'll just check: Web-page search as attentional refocusing. In Proc. ICCM 2004, Lawrence Erlbaum Associates (2004).Google Scholar
- Brumby, D.P. and Howes, A. Strategies for guiding interactive search: An empirical investigation into the consequences of label relevance for assessment and selection. Human-Computer Interaction (in press).Google Scholar
- Cockburn, A., Gutwin, C., and Alexander, J. Faster document navigation with space-filling thumbnails. In Proc. CHI 2006, ACM Press (2006), 1--10. Google ScholarDigital Library
- Cox, A.L. and Young, R.M. A Rational Model of the Effect of Information Scent on the Exploration of Menus. In Proc. ICCM 2004, Lawrence Erlbaum Associates (2004).Google Scholar
- Cutrell, E. and Guan, Z. What are you looking for? An eye-tracking study of information usage in Web search. In Proc. CHI 2007, ACM Press (2007). Google ScholarDigital Library
- Eng, K., Lewis, R.L., Tollinger, I., Chu, A., Howes, A., and Vera, A. Generating automated predictions of behavior strategically adapted to specific performance objectives. In Proc. CHI 2006, ACM Press (2006), 621--630. Google ScholarDigital Library
- Everett, S.P. and Byrne, M.D. Unintended effects: Varying icon spacing changes users' visual search strategy. In Proc. CHI 2004, ACM Press (2004), 695--702. Google ScholarDigital Library
- Findlay, J.M. and Gilchrist, I.D. Active vision-the psychology of looking and seeing. Oxford University Press, 2003.Google ScholarCross Ref
- Fu, W.-T. and Pirolli, P. SNIF-ACT: A Cognitive Model of User Navigation on the World Wide Web. Human-Computer Interaction 22 (2007). Google ScholarDigital Library
- Gray, W.D. and Boehm-Davis, D.A. Milliseconds Matter: An introduction to microstrategies and to their use in describing and predicting interactive behavior. Journal of Experiment Psychology: Applied 6, 4 (2000), 322--335.Google ScholarCross Ref
- Halverson, T. and Hornof, A.J. Explaining eye movements in the visual search of varying density layouts. In Proc. ICCM 2004, Lawrence Erlbaum Associates (2004), 124--129.Google Scholar
- Hooge, I.T.C., Vlaskamp, B.N.S., and Over, E.A.B. Saccadic search: the relation between fixation duration and saccade amplitude. Perception 31, ECVP Abstract Supplement (2002).Google Scholar
- Howes, A., Vera, A., and Lewis, R.L. Bounding rational analysis: Constraints on asymptotic performance. In W.D. Gray (Ed.), Integrated Models of Cognitive Systems, Oxford University Press (2006).Google Scholar
- Kieras, D.E. and Meyer, D.E. An overview of the EPIC architecture for cognition and performance with application to human-computer interaction. Human-Computer Interaction 12 (1997), 391--438. Google ScholarDigital Library
- Kieras, D.E. and Meyer, D.E. The role of cognitive task analysis in the application of predictive models of human performance. In J.M. Schraagen and S.F. Chipman (Eds.), Cognitive task analysis (2000), 237--260.Google Scholar
- Klöckner, K., Wirschum, N., and Jameson, A. Depth and breadth-first processing of search result lists. In Ext. Abstracts CHI 2004, ACM Press (2004), 1539--1539. Google ScholarDigital Library
- Lindberg, T. and Nasanen, R. The effect of icon spacing and size on the speed of icon processing in the human visual system. Displays 24, 3 (2003), 111--120.Google ScholarCross Ref
- Meyer, D.E. and Kieras, D.E. A computational theory of executive control processes and human multiple-task performance: Part 1. Basic Mechanisms. Psychological Review 104 (1997), 3--65.Google ScholarCross Ref
- Meyer, D.E. and Kieras, D.E. A computational theory of executive control processes and human multiple-task performance: Part 2. Accounts of Psychological Refractory-Period Phenomena. Psychological Review 104 (1997), 749--791.Google ScholarCross Ref
- Motter, B.C. and Belky, E.J. The zone of focal attention during active visual search. Vision Research 38 (1998), 1007--1022.Google ScholarCross Ref
- Najemnik, J. and Geisler, W.S. Optimal eye movement strategy in visual search. Nature 434 (2005), 387--391.Google ScholarCross Ref
- Ojanpää, H., Näsänen, R., and Kojo, I. Eye movements in the visual search of word lists. Vision Research 42, 12 (2002), 1499--1512.Google ScholarCross Ref
- Over, E.A.B., Hooge, I.T.C., Vlaskamp, B.N.S., and Erkelens, C.J. Coarse-to-fine eye movement strategy in visual search. Vision Research 47 (2007), 2272--2280.Google ScholarCross Ref
- Payne, S.J., Howes, A., and Reader, W.R. Adaptively distributing cognition: a decision-making perspective on human-computer interaction. Behaviour and Information Technology 20, 5 (2001), 339--346.Google ScholarCross Ref
- Pirolli, P. and Card, S.K. Information foraging. Psychological Review 106, 4 (1999), 643--675.Google ScholarCross Ref
- Pirolli, P., Card, S.K., and Van Der Wege, M. The effects of information scent on visual search in the hyperbolic tree browser. ACM Transactions on Computer Human Interaction 10, 1 (2003), 20--53. Google ScholarDigital Library
- Pirolli, P. and Fu, W.-T. SNIF-ACT: a model of information foraging on the world wide web. In Proc. Ninth International Conference on User Modeling, Springer (2003). Google ScholarDigital Library
- Pollatsek, A., Perea, M., and Binder, K.S. The Effecs of Neighborhood Size in Reading and Lexical Decision. Journal of Experimental Psychology: Human Perception and Performance 25, 4 (1999), 1142--1158.Google ScholarCross Ref
- Rao, R.P.N., Zelinsky, G., Hayhoe, M.M., and Ballard, D.H. Eye movements in iconic visual search. Vision Research 42, 11 (2002), 1447--1463.Google ScholarCross Ref
- Reiman, J., Young, M., and Howes, A. A dual-space model of interatively deepening exploratory learning. International Journal of Human-Computer Studies 44 (1996), 743--775. Google ScholarDigital Library
- Rele, R.S. and Duchowski, A.T. Using eye tracking to evaluate alternate search results interfaces. In Proc. HFES 49th Annual Conference (2005).Google Scholar
- Resnick, M.L., Maldonado, C.A., Santos, J.M., and Lergier, R. Modeling On-line Search Behavior Using Alternative Output Structures. In Proc. HFES 45th Annual Conference (2001), 1166--1171.Google ScholarCross Ref
- Ross, J., Morrone, M.C., Goldberg, M.E., and Burr, D.C. Changes in visual perception at the time of saccades. Trends in Neurosciences 24, 2 (2001), 113--121.Google ScholarCross Ref
- Simon, H.A. A behavioral model of rational choice. Quarterly Journal of Economics 69 (1955), 99--118.Google ScholarCross Ref
- Sperling, G. and Dosher, B.A. Strategy and optimization in human information processing. In K.R. Boff, L. Kaufman, and J.P. Thomas (Eds.), Handbook of perception and human performance, Vol. I, Sensory processes and perception, Wiley (1986).Google Scholar
- Vlaskamp, B.N.S., Over, E.A.B., and Hooge, I.T.C. Saccadic search performance: the effect of element spacing. Experimental Brain Research 3 (2005), 1--14.Google Scholar
- Woodruff, A., Faulring, A., Rosenholtz, R., Morrison, J., and Pirolli, P. Using Thumbnails to Search the Web. In Proc. CHI 2001, ACM Press (2001), 198--205. Google ScholarDigital Library
- Yee, K.P., Swearingen, K., Li, K., and Hearst, M. Faceted metadata for image search and browsing. In Proc. CHI 2003, ACM Press (2003), 401--408. Google ScholarDigital Library
Index Terms
- The adaptation of visual search strategy to expected information gain
Recommendations
A Study of Multi-target Visual Search by Eye Movement Behavior
Proceedings of the 12th International Conference on Engineering Psychology and Cognitive Ergonomics - Volume 9174The purpose of this study is to probe the characteristics of search time and eye movement behavior to the multi-objective search. Ten subjects participated in the experiment and they were asked to search three target characters at the same similarity ...
Strategy of visual search of targets on screen through eye movement of elderly person
UAHCI'07: Proceedings of the 4th international conference on Universal access in human computer interaction: coping with diversityIt is important that the operation characteristic of the elderly have to clear for designing information equipment that was deeply considered about influences of aging. Visual search tasks were imposed on the elderly in this study and found strategy for ...
Information Fusion in Visual-Task Inference
CRV '12: Proceedings of the 2012 Ninth Conference on Computer and Robot VisionEye movement is a rich modality that can provide us with a window into a person's mind. In a typical human-human interaction, we can get information about the behavioral state of the others by examining their eye movements. For instance, when a poker ...
Comments