skip to main content
10.1145/2638728.2641687acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
research-article

Guiding visual search tasks using gaze-contingent auditory feedback

Published:13 September 2014Publication History

ABSTRACT

In many applications it is necessary to guide humans' visual attention towards certain points in the environment. This can be to highlight certain attractions in a touristic application for smart glasses, to signal important events to the driver of a car or to draw the attention of a user of a desktop system to an important message of the user interface. The question we are addressing here is: How can we guide visual attention if we are not able to do it visually? In the presented approach we use gaze-contingent auditory feedback (sonification) to guide visual attention and show that people are able to make use of this guidance to speed up visual search tasks significantly.

References

  1. Begault, D. R., Wenzel, E. M., Shrum, R., and Miller, J. A virtual audio guidance and alert system for commercial aircraft operations. In Proceedings of the Third International Conference on Auditory Display (1996), 117122.Google ScholarGoogle Scholar
  2. Deville, B., Bologna, G., Vinckenbosch, M., and Pun, T. Guiding the focus of attention of blind people with visual saliency (2008). 00006.Google ScholarGoogle Scholar
  3. Duchowski, A. T. A breadth-first survey of eye-tracking applications. Behavior Research Methods, Instruments, & Computers 34, 4 (2002), 455--470.Google ScholarGoogle Scholar
  4. Flowers, J. H. Thirteen years of reflection on auditory graphing: Promises, pitfalls, and potential new directions. Faculty Publications, Department of Psychology (2005), 430.Google ScholarGoogle Scholar
  5. Greene, H. H., and Rayner, K. Eye-movement control in direction-coded visual search. Perception 30, 2 (2001), 147--158.Google ScholarGoogle ScholarCross RefCross Ref
  6. Hermann, T., Höner, O., and Ritter, H. Acoumotion--an interactive sonification system for acoustic motion control. In Gesture in Human-Computer Interaction and Simulation. Springer, 2006, 312--323. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Hornof, A., and Sato, L. Eyemusic: making music with the eyes. In Proceedings of the 2004 conference on New interfaces for musical expression, National University of Singapore (2004), 185--188. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Hunt, A., Hermann, T., and Pauletto, S. Interacting with sonification systems: closing the loop. In Information Visualisation, 2004. IV 2004. Proceedings. Eighth International Conference on, IEEE (2004), 879--884. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Neuhoff, J. G., Wayand, J., and Kramer, G. Pitch and loudness interact in auditory displays: Can the data get lost in the map? Journal of Experimental Psychology: Applied 8, 1 (2002), 17.Google ScholarGoogle ScholarCross RefCross Ref
  10. Roy, D., Ghitza, Y., Bartelma, J., and Kehoe, C. Visual memory augmentation: using eye gaze as an attention filter. In Wearable Computers, 2004. ISWC 2004. Eighth International Symposium on, vol. 1, IEEE (2004), 128--131. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Twardon, L., Koesling, H., Finke, A., and Ritter, H. Gaze-contingent audio-visual substitution for the blind and visually impaired. In Proceedings of the 7th International Conference on Pervasive Computing Technologies for Healthcare, ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering) (2013), 129--136. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Walker, B. N., and Kramer, G. Mappings and metaphors in auditory displays: An experimental assessment. ACM Transactions on Applied Perception (TAP) 2, 4 (2005), 407--412. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Wang, D.-Y. D., Pick, D. F., Proctor, R. W., and Ye, Y. Effect of a side collision-avoidance signal on simulated driving with a navigation system. In Proceedings of the 4th International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design (2007), 206--211.Google ScholarGoogle ScholarCross RefCross Ref
  14. Watson, M., and Sanderson, P. Sonification supports eyes-free respiratory monitoring and task time-sharing. Human Factors: The Journal of the Human Factors and Ergonomics Society 46, 3 (2004), 497--517.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Guiding visual search tasks using gaze-contingent auditory feedback

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication
      September 2014
      1409 pages
      ISBN:9781450330473
      DOI:10.1145/2638728

      Copyright © 2014 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 13 September 2014

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate764of2,912submissions,26%

      Upcoming Conference

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader