Yu Zhong
ABSTRACT
In this paper we introduce JustSpeak, a universal voice control solution for non-visual access to the Android operating system. JustSpeak offers two contributions as compared to existing systems. First, it enables system wide voice control on Android that can accommodate any application. JustSpeak constructs the set of available voice commands based on application context; these commands are directly synthesized from on-screen labels and accessibility metadata, and require no further intervention from the application developer. Second, it provides more efficient and natural interaction with support of multiple voice commands in the same utterance. We present the system design of JustSpeak and describe its utility in various use cases. We then discuss the system level supports required by a service like JustSpeak on other platforms. By eliminating the target locating and pointing tasks, JustSpeak can significantly improve experience of graphic interface interaction for blind and motion-impaired users.
- Apple Inc. VoiceOver. http://goo.gl/crav6rGoogle Scholar
- Apple Inc. Siri. http://www.apple.com/ios/siri/Google Scholar
- Azenkot, S., Nicole B. L. Exploring the use of speech input by blind people on mobile devices. In Proc. of ASSETS 2013. Google ScholarDigital Library
- Bigham, J. P., Craig M. P., and Richard E. L. WebAnywhere: a screen reader on-the-go. In Proc. of W4A 2008, pp. 73--82. Google ScholarDigital Library
- Borodin, Yevgen, et al. More than meets the eye: a survey of screen-reader browsing strategies. In Proc. of W4A 2010. Google ScholarDigital Library
- Google Inc. Google Now. http://goo.gl/ohPzMtGoogle Scholar
- Google Inc. TalkBack: An Open Source Screenreader For Android. http://goo.gl/D3ck4MGoogle Scholar
- Guerreiro, T., et al. Towards accessible touch interfaces. In Proc. ASSETS 2010. Google ScholarDigital Library
- JAWS Screenreader. http://goo.gl/XwWVNIGoogle Scholar
- Kane S., Jeffrey P. B., and Jacob O. W. Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques. In Proc. ASSETS 2008. Google ScholarDigital Library
- Lei X., Andrew S., Alexander G., and Jeffrey S. Accurate and Compact Large Vocabulary Speech Recognition on Mobile Devices. INTERSPEECH, 2013.Google Scholar
- Mackenzie, I. S. Fitts' law as a performance model in human-computer interaction. (1992).Google Scholar
- Raman T. V., Charles L. C., Tim C. Leveraging Android accessibility APIs to create an accessible experience. Google I/O, May 2011.Google Scholar
- Vigo M., and Simon H. Coping tactics employed by visually disabled users on the web. International Journal of Human-Computer Studies 71.11 (2013): 1013--1025. Google ScholarDigital Library
- Voice Command Device. http://goo.gl/x5HjvMGoogle Scholar
Index Terms
- JustSpeak: enabling universal voice control on Android
Recommendations
What can I say?: addressing user experience challenges of a mobile voice user interface for accessibility
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and ServicesVoice interactions on mobile phones are most often used to augment or supplement touch based interactions for users' convenience. However, for people with limited hand dexterity caused by various forms of motor-impairments voice interactions can have a ...
Too Much Accessibility is Harmful! Automated Detection and Analysis of Overly Accessible Elements in Mobile Apps
ASE '22: Proceedings of the 37th IEEE/ACM International Conference on Automated Software EngineeringMobile apps, an essential technology in today’s world, should provide equal access to all, including 15% of the world population with disabilities. Assistive Technologies (AT), with the help of Accessibility APIs, provide alternative ways of ...
WakeScope: runtime WakeLock anomaly management scheme for Android platform
EMSOFT '13: Proceedings of the Eleventh ACM International Conference on Embedded SoftwareAndroid provides a WakeLock mechanism for application developers to ensure the proper execution of applications without having to enter the sleep state of a device. When using the WakeLock mechanism, application developers should bear the responsibility ...
Comments