Eve E. Hoggan
Stephen A. Brewster
ABSTRACT
This paper describes a novel form of display using crossmodal output. A crossmodal icon is an abstract icon that can be instantiated in one of two equivalent forms (auditory or tactile). These can be used in interfaces as a means of non-visual output. This paper discusses how crossmodal icons can be constructed and the potential benefits they bring to mobile human computer interfaces.
- Adelstein, B.D., Begault, D.R., Anderson, M.R., and Wenzel, E.M. Sensitivity to Haptic-Audio Asynchrony. Proc. 5th International Conference on Multimodal Interfaces, ACM Press (2003), 73--76.]] Google Scholar
Digital Library
- Blattner, M.M., Sumikawa, D.A., and Greenberg, R.M., Earcons and Icons: Their Structure and Common Design Principles. Human Computer Interaction 4(1), (1989), 11--44.]] Google ScholarDigital Library
- Brewster, S.A. and Brown, L.M. Tactons: Structured Tactile Messages for Non-Visual Information Display. Proc. Australasian User Interface Conference, Australian Computer Society (2004), 15--23.]] Google ScholarDigital Library
- Brewster, S.A., Wright, P.C. & Edwards, A.D.N. An evaluation of earcons for use in auditory human-computer interfaces. Proc. InterCHI'93, ACM Press (1993), 222--227.]] Google ScholarDigital Library
- Brown, L.M., Brewster, S.A., and Purchase, H.C. A First Investigation into the Effectiveness of Tactons. Proc. World Haptics 2005, IEEE Press (2005), 167--176.]] Google ScholarDigital Library
- Calvert, G.A., Brammer, M.J., and Iversen, S.D. Crossmodal Identification. Trends Cognit. Sci. 2 (1998), 247--253.]]Google ScholarCross Ref
- Immersion: http://www.immersion.com/mobility/docs/VibeTonz_Mobile_Player_0305_v1.pdf]]Google Scholar
- van Veen, H.A.H.C, and van Erp, J.B.F. Tactile information-presentation in the cockpit. Haptic Human-Computer Interaction. Lecture notes in computer science Vol. 2058, Springer Verlag (2001), 174--181.]] Google ScholarDigital Library
- Wendahl, R.W. Some Parameters of Auditory Roughness. Folia Phoniatr 18 (1966), 26--32.]]Google ScholarCross Ref
Index Terms
- Crossmodal icons for information display
Recommendations
Crossmodal congruence: the look, feel and sound of touchscreen widgets
ICMI '08: Proceedings of the 10th international conference on Multimodal interfacesOur research considers the following question: how can visual, audio and tactile feedback be combined in a congruent manner for use with touchscreen graphical widgets? For example, if a touchscreen display presents different styles of visual buttons, ...
Designing audio and tactile crossmodal icons for mobile devices
ICMI '07: Proceedings of the 9th international conference on Multimodal interfacesThis paper reports an experiment into the design of crossmodal icons which can provide an alternative form of output for mobile devices using audio and tactile modalities to communicate information. A complete set of crossmodal icons was created by ...
Crossmodal Audio and Tactile Interaction with Mobile Touchscreens
This article asserts that using crossmodal auditory and tactile interaction can aid mobile touchscreen users in accessing data non-visually and, by providing a choice of modalities, can help to overcome problems that occur in different mobile situations ...
Comments