Ville Lehtinen
Antti Oulasvirta
Antti Salovaara
ABSTRACT
Visual search in large real-world scenes is both time consuming and frustrating, because the search becomes serial when items are visually similar. Tactile guidance techniques can facilitate search by allowing visual attention to focus on a subregion of the scene. We present a technique for dynamic tactile cueing that couples hand position with a scene position and uses tactile feedback to guide the hand actively toward the target. We demonstrate substantial improvements in task performance over a baseline of visual search only, when the scene's complexity increases. Analyzing task performance, we demonstrate that the effect of visual complexity can be practically eliminated through improved spatial precision of the guidance.
- Ahmaniemi, T. T., & Lantz, V. Augmented reality target finding based on tactile cues. In Proc. ICMI-MLMI '09, ACM Press (2009). Google Scholar
Digital Library
- Bark, K., Khanna, P., Irwin, R., Kapur, P., Jax, S. A., Buxbaum, L. J., & Kuchenbecker, K. J. Lessons in using vibrotactile feedback to guide fast arm motions. In Proc. IEEE World Haptics Conference (2011), pp. 261--266.Google ScholarCross Ref
- Bolt, R. "Put-that-there": Voice and gesture at the graphics interface. ACM SIGGRAPH Computer Graphics 14, ACM (1980), pp. 262--270. Google ScholarDigital Library
- Brewster, S. A. & Brown, L. M. Tactons: Structured tactile messages for non-visual information display. In Proc. Australasian User Interface Conference (2004), pp. 18--22. Google ScholarDigital Library
- Cockburn, A., Gutwin, C., & Greenberg, S. A predictive model of menu performance. In Proc. CHI '07, ACM Press (2007), pp. 627--636. Google ScholarDigital Library
- Gehring, S., Löchtefeld, M., Daiber, F., Böhmer, M., & Krüger, A. Using intelligent natural user interfaces to support sales conversations. In Proc. IUI '12, ACM Press (2012), pp. 97--100. Google ScholarDigital Library
- Gunther, E., Davenport, G., & O'Modhrain, S. Cutaneous grooves: Composing for the sense of touch. In Proc. Conference on New Instruments for Musical Expression (2002), pp. 1--6. Google ScholarDigital Library
- Ho, C., Tan, H. Z., & Spence, C. The differential effect of vibrotactile and auditory cues on visual spatial attention. Ergonomics 49 (2006), pp. 724--738.Google ScholarCross Ref
- Jansen, C., Oving, A., & van Veen, H.-J. Vibrotactile movement initiation. In Proc. EuroHaptics (2004), pp. 110--117.Google Scholar
- Jansson, G. Tactile guidance of movement. International Journal of Neuroscience 19 (1983), pp. 37--46.Google ScholarCross Ref
- Jota, R., Nacenta, M. A., Jorge, J. A., Carpendale, S., & Greenberg, S. A comparison of ray pointing techniques for very large displays. In Proc. GI '10 (2010), pp. 269--276. Google ScholarDigital Library
- Kapur, P., Jensen, M., Buxbaum, L. J., Jax, S. A., & Kuchenbecker, K. J. Spatially distributed tactile feedback for kinesthetic motion guidance. In Proc. IEEE Haptics Symposium (2010), pp. 519--526. Google ScholarDigital Library
- Lieberman, J. & Breazeal, C. TIKL: Development of a wearable vibrotactile feedback suit for improved human motor learning. IEEE Transactions on Robotics 23:5 (2007), pp. 919--926. Google ScholarDigital Library
- Lindeman, R. W., Yanagida, Y., Sibert, J. L., & Lavine, R. Effective vibrotactile cueing in a visual search task. In Proc. INTERACT (2003).Google Scholar
- Löchtefeld, M., Gehring, S., Schöning, J., & Krüger, A. ShelfTorchlight: Augmenting a shelf using a camera projector unit. In Adj. Proc. PERVASIVE, Workshop on Personal Projection UBIPROJECTION, Springer Lecture Notes in Computer Science (2010).Google Scholar
- MacKenzie, I. & Buxton, W. Extending Fitts' law to two dimensional tasks. In Proc. CHI '92, ACM Press (1992), pp. 219--226. Google ScholarDigital Library
- MacKenzie, I. & Ware, C. Lag as a determinant of human performance in interactive systems. In Proc. INTERACT 1993, ACM (1993), pp. 488--493. Google ScholarDigital Library
- Ngo, M. K. & Spence, C. Auditory, tactile, and multi-sensory cues facilitate search for dynamic visual stimuli. Attention, Perception & Psychophysics 72 (2010), pp. 1654--1665.Google ScholarCross Ref
- Oron-Gilad, T., Downs, J. L., Gilson, R. D., & Hancock, P. A. Vibrotactile guidance cues for target acquisition. IEEE Transactions on Systems, Man, and Cybernetics: Part C, Applications and Reviews 27:5 (2007), pp. 993--1004. Google ScholarDigital Library
- Palmer, J. Attention in visual search: Distinguishing four causes of a set-size effect. Current Directions in Psychological Science 4:4 (1995), pp. 118--123.Google ScholarCross Ref
- Palmer, S. Vision Science: Photons to Phenomenology, vol. 1. Cambridge, MA: MIT Press (1999).Google Scholar
- Pelz, J., Hayhoe, M., & Loeber, R. The coordination of eye, head, and hand movements in a natural task. Experimental Brain Research 139:3 (2001), pp. 266--277.Google ScholarCross Ref
- Rayner, K. Understanding eye movements in reading. Scientific Studies of Reading 1:4 (1997), pp. 317--339.Google ScholarCross Ref
- Rohs, M. & Oulasvirta, A. Target acquisition with camera phones when used as magic lenses. In Proc. CHI '08, ACM Press (2008), pp. 1409--1418. Google ScholarDigital Library
- Tan, H. Z., Lu, I., & Pentland, A. The chair as a novel haptic user interface. In Proc. Workshop on Perceptual User Interfaces (1997), pp. 56--57.Google Scholar
- Van Erp, J. B. F., Van Veen, H. A. H. C., Jansen, C., & Dobbins, T. Waypoint navigation with a vibrotactile waist belt. ACM Transactions on Applied Perception 2:2 (2005), pp. 106--117. Google ScholarDigital Library
- Van Erp, J. & Verschoor, M. H. Cross-modal visual and vibrotactile tracking. Applied Ergonomics 35:2 (2004), pp. 105--112.Google ScholarCross Ref
- Vogel, D., & Balakrishnan, R. Distant freehand pointing and clicking on very large, high resolution displays. In Proc. UIST '05, ACM Press (2005), pp. 33--42. Google ScholarDigital Library
- Wolfe, J. M. What can 1 million trials tell us about visual search? Psychological Science 9:1 (1998), pp. 33--39.Google ScholarCross Ref
- Wolfe, J. M., Võ, M. L. H., Evans, K. K., & Greene, M. R. Visual search in scenes involves selective and nonselective pathways. Trends in Cognitive Sciences (2011).Google Scholar
- Zhai, S., Morimoto, C., & Ihde, S. Manual and gaze input cascaded (magic) pointing. In Proc. CHI '99, ACM Press (1999), pp. 246--253. Google ScholarDigital Library
Index Terms
- Dynamic tactile guidance for visual search tasks
Recommendations
Subtle cueing for visual search in augmented reality
ISMAR '12: Proceedings of the 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)Visual search in augmented reality environments is an important task that can be facilitated through different cueing methods. Current cueing methods rely on explicit cueing, which can potentially reduce visual search performance. In comparison, this ...
Audio and audiovisual cueing in visual search: effects of target uncertainty and auditory cue precision
EPCE'11: Proceedings of the 9th international conference on Engineering psychology and cognitive ergonomicsAuditory spatial cue accuracy and target uncertainty were examined within visual search. Participants identified a visual target to be present or absent under various target percentage conditions (25%, 50%, & 100%) with either an auditory cue which was ...
Visual Saliency Improves Autonomous Visual Search
CRV '14: Proceedings of the 2014 Canadian Conference on Computer and Robot VisionVisual search for a specific object in an unknown environment by autonomous robots is a complex task. The key challenge is to locate the object of interest while minimizing the cost of search in terms of time or energy consumption. Given the ...
Comments