Frank Chun Yat Li
David Dearman
Khai N. Truong
ABSTRACT
Accessing the advanced functions of a mobile phone is not a trivial task for users with visual impairments. They rely on screen readers and voice commands to discover and execute functions. In mobile situations, however, screen readers are not ideal because users may depend on their hearing for safety, and voice commands are difficult for a system to recognize in noisy environments. In this paper, we extend Virtual Shelves--an interaction technique that leverages proprioception to access application shortcuts--for visually impaired users. We measured the directional accuracy of visually impaired participants and found that they were less accurate than people with vision. We then built a functional prototype that uses an accelerometer and a gyroscope to sense its position and orientation. Finally, we evaluated the interaction and prototype by allowing participants to customize the placement of seven shortcuts within 15 regions. Participants were able to access shortcuts in their personal layout with 88.3% accuracy in an average of 1.74 seconds.
- Adamo D.E., Alexander N.B., Brown S.H. 2009. The influence of age and physical activity on upper limb proprioceptive ability. Journal of Aging and Physical Activity. 17, 3 (July 2009), 272--293.Google Scholar
Cross Ref
- Amar, R., Dow, S., Gordon, R., Hamid, M. R., and Sellers, C. 2003. Mobile ADVICE: an accessible device for visually impaired capability enhancement. In Proc of CHI '03 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 918--919. Google ScholarDigital Library
- Biggs, J. and Srinivasan, M.A. 2002. Haptic Interfaces. In Stanney, K (ed.), Handbook of Virtual Environments Design, Implementation, and Applications. Lawrence Erlbaum Associates.Google Scholar
- Blasko, G., Narayanaswami, C., and Feiner, S. 2006. Prototyping retractable string-based interaction techniques for dual-display mobile devices. In Proc of CHI'06. ACM Press, New York, NY, 369--372. Google ScholarDigital Library
- Brewster, S., Lumsden, J., Bell, M., Hall, M., and Tasker, S. 2003. Multimodal 'eyes-free' interaction techniques for wearable devices. In Proc of CHI'03. ACM, New York, NY, 473--480. Google ScholarDigital Library
- Cao, X., Massimi, M., and Balakrishnan, R. 2008. Flashlight jigsaw: an exploratory study of an ad-hoc multi-player game on public displays. In Proc of CSCW'08. ACM Press, New York, NY, 77--86. Google ScholarDigital Library
- Clark, F.J. 1992. How accurately can we perceive positions of our limbs? Behavior and Brain Sciences, 15, 4 (December 1992), 725--726.Google Scholar
- Feiner, S. and Shamash, A. 1991. Hybrid user interfaces: Breeding virtually bigger interfaces for physically smaller computers. In Proc of UIST'91. ACM, New York, NY, 9--17. Google ScholarDigital Library
- Foxlin, E. 1996. Inertial Head-Tracker Sensor Fusion by a Complimentary Separate-Bias Kalman Filter. In Proc of VRAIS 96. VRAIS. IEEE, Washington, DC, 185. Google ScholarDigital Library
- Hansen, T.R., Eriksson, E., and Lykke-Olesen, A. 2006. Use your head: exploring face tracking for mobile interaction. In CHI'06 Extended Abstracts on Human Factors in Computing Systems. ACM Press, New York, NY, 845--850. Google ScholarDigital Library
- Harrison, C. and Hudson, S. E. 2009. Abracadabra: Wireless, High-Precision, and Unpowered Finger Input for Very Small Mobile Devices. In Proc of UIST '09. ACM, New York, NY, 121--124. Google ScholarDigital Library
- Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. 2000. Sensing Techniques for Mobile Interaction. In Proc of UIST '00. ACM Press, New York, NY, 91--100. Google ScholarDigital Library
- Hsieh, T., Wang, Q.Y., and Paepcke A. 2009. Piles across space: Breaking the real-estate barrier on small-display devices. International Journal of Human-Computer Studies. 67, 4 (April 2009), 349--365. Google ScholarDigital Library
- Kane, S. K., Bigham, J. P., and Wobbrock, J. O. 2008. Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques. In Proc of Assets '08. ACM, New York, NY, 73--80. Google ScholarDigital Library
- Li, F.C.Y., Dearman, D., and Truong, K. Virtual Shelves. 2009. Interactions with Orientation Aware Devices. In Proc of UIST '09. ACM Press, New York, NY, 125--128. Google ScholarDigital Library
- Li, K. A., Baudisch, P., and Hinckley, K. 2008. Blindsight: eyes-free access to mobile phones. In Proc of CHI '08. ACM, New York, NY, 1389--1398. Google ScholarDigital Library
- Miller, G. A. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review. 63, 2 (1956), 81--97.Google Scholar
- O'Neill, E., Kaenampornpan, M., Kostakos, V., Warr, A., and Woodgate, D. 2006. Can we do without GUIs? Gesture and speech interaction with a patient information system. Personal Ubiquitous Comput. 10, 5 (Jul. 2006), 269--283. Google ScholarDigital Library
- Oakley, I. and Park, J. A motion-based marking menu system. 2007. In Proc of CHI'07 Extended Abstracts on Human Factors in Computing Systems. ACM Press, New York, NY, 2597--2602. Google ScholarDigital Library
- Pirhonen, A., Brewster, S., and Holguin, C. 2002. Gestural and audio metaphors as a means of control for mobile devices. In Proc of CHI '02. ACM, New York, NY, 291--298. Google ScholarDigital Library
- Rekimoto, J. 1996. Tilting operations for small screen interfaces. In Proc of UIST '96. ACM, New York, NY, 167--168. Google ScholarDigital Library
- Roumeliotis S. I. and Bekey, G.A. 1997. An Extended Kalman Filter for frequent local and infrequent global sensor data fusion. In Proc of the Sensor Fusion and Decentralized Control in Autonomous Robotic Systems. SPIE, Bellingham WA, 11--22.Google Scholar
- Sawhney, N. and Schmandt, C. 2000. Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments. ACM Trans. Comput.-Hum. Interact. 7, 3 (Sep. 2000), 353--383. Google ScholarDigital Library
- Stifelman, L. J., Arons, B., Schmandt, C., and Hulteen, E. A. 1993. VoiceNotes: a speech interface for a hand-held voice notetaker. In Proc of the INTERACT '93 and CHI '93. ACM, New York, NY, 179--186. Google ScholarDigital Library
- Suzuki, Y., Nakadai, Y., Shimamura, Y., Nishino, Y. 1998. Development of an Integrated Wristwatch-type PHS Telephone. NTT Review, Vol.10, No.6, 93--101.Google Scholar
- Vaganay, J., Aldon, M.J., Fournier, A. 1993. Mobile robot attitude estimation by fusion of inertial data. In Proc of the 1993 IEEE International Conference on Robotics and Automation. IEEE, Washington, DC, 277--282.Google ScholarCross Ref
- Wilson, A. and Shafer, S. 2003. XWand: UI for intelligent spaces. In Proc of the SIGCHI Conference on Human Factors in Computing Systems. CHI '03. ACM, New York, NY, 545--552. Google ScholarDigital Library
- Yee, K.P. 2003. Peephole Displays: Pen Interaction on Spatially Aware Handheld Computers. In Proc of CHI '03. ACM Press, New York, NY, 1--8. Google ScholarDigital Library
- Yfantidis, G. and Evreinov, G. 2006. Adaptive blind interaction technique for touchscreens. Univers. Access Inf. Soc. 4, 4 (May. 2006), 328--337. Google ScholarDigital Library
- Zhao, S., Dragicevic, P., Chignell, M., Balakrishnan, R. and Baudisch, P. 2007. EarPod: eyes-free menu selection using touch input and reactive audio feedback. In Proc of CHI'07. ACM Press, New York, NY, 1395--1404. Google ScholarDigital Library
Index Terms
- Leveraging proprioception to make mobile phones more accessible to users with visual impairments
Recommendations
Current and future mobile and wearable device use by people with visual impairments
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWith the increasing popularity of mainstream wearable devices, it is critical to assess the accessibility implications of such technologies. For people with visual impairments, who do not always need the visual display of a mobile phone, alternative ...
Accessible Touchscreen Technology for People with Visual Impairments: A Survey
Touchscreens have become a de facto standard of input for mobile devices as they most optimally use the limited input and output space that is imposed by their form factor. In recent years, people who are blind and visually impaired have been increasing ...
Investigating touchscreen accessibility for people with visual impairments
NordiCHI '08: Proceedings of the 5th Nordic conference on Human-computer interaction: building bridgesTouchscreen computing devices such as the iPhone are becoming more common. However this technology is largely inaccessible to people with visual impairments. We present the results of a requirements capture study that illustrates the problems with ...
Comments