Leah Findlater
Ruofei Du
Uran Oh
Rama Chellappa
Jon Froehlich
ABSTRACT
The HandSight project investigates how wearable micro-cameras can be used to augment a blind or visually impaired user--s sense of touch with computer vision. Our goal is to support an array of activities of daily living by sensing and feeding back non-tactile information (e.g., color, printed text, patterns) about an object as it is touched. In this poster paper, we provide an overview of the project, our current proof-of-concept prototype, and a summary of findings from finger-based text reading studies. As this is an early-stage project, we also enumerate current open questions.
- Dakopoulos, D. and Bourbakis, N.G. Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey. IEEE SMC, Part C (Applications and Reviews) 40, 1 (2010), 25--35. Google Scholar
Digital Library
- Goldreich, D. and Kanics, I.M. Tactile Acuity is Enhanced in Blindness. J. Neurosci. 23, 8 (2003), 3439--3445.Google ScholarCross Ref
- Khambadkar, V., Folmer, E. GIST: A Gestural Interface for Remote Nonvisual Spatial Perception. Proc. ACM UIST'13, (2013), 301--310. Google ScholarDigital Library
- Shilkrot, R., Huber, J., Liu, C., Maes, P., and Chandima, N.S. FingerReader: a wearable device to support text reading on the go. CHI --14 Extended Abstracts, (2014), 2359--2364. Google ScholarDigital Library
- Shilkrot, R., Huber, J., Wong, M.E., Maes, P., and Nanayakkara, S. FingerReader: a wearable device to explore printed text on the go. Proc. ACM CHI'15, (2015), 2363--2372. Google ScholarDigital Library
- Stearns, L., Du, R., Oh, U., et al. Evaluating Haptic and Auditory Directional Guidance to Assist Blind Persons in Reading Printed Text Using Finger-Mounted Cameras. In submission.Google Scholar
- Stearns, L., Du, R., et al. The design and preliminary evaluation of a finger-mounted camera and feedback system to enable reading of printed text for the blind. ACVR--14 Workshop at ECCV'14, (2014).Google Scholar
- Yang, X.-D., Grossman, T., Wigdor, D., and Fitzmaurice, G. Magic finger: always-available input through finger instrumentation. Proc. ACM UIST '12, (2012), 147--156. Google ScholarDigital Library
Index Terms
- Supporting Everyday Activities for Persons with Visual Impairments Through Computer Vision-Augmented Touch
Recommendations
Groupware Accessibility for Persons with Disabilities
UAHCI '09: Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and ServicesThe accessibility issues of Groupware applications prevent visually impaired and other persons with disabilities access to these highly graphical interfaces. To address the accessibility issues persons with disabilities have with Groupware, a recent ...
Assistive Robots for Persons with Visual Impairments: Current Research and Open Challenges
PETRA '23: Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive EnvironmentsRobots have the potential to support persons with different abilities, including individuals with blindness or visual impairments (BVI). This paper aims to investigate the current developments in robotic research that focus on BVI robotic users and ...
Computer vision-based object recognition for the visually impaired in an indoors environment: a survey
Though several electronic assistive devices have been developed for the visually impaired in the past few decades, however, relatively few solutions have been devised to aid them in recognizing generic objects in their environment, particularly indoors. ...
Comments