Roberto Manduchi
ABSTRACT
Smartphone apps can use object recognition software to provide information to blind or low vision users about objects in the visual environment. A crucial challenge for these users is aiming the camera properly to take a well-framed picture of the desired target object. We investigate the effects of two fundamental constraints of object recognition -- frame rate and camera field of view -- on a blind person's ability to use an object recognition smartphone app. The app was used by 18 blind participants to find visual targets beyond arm's reach and approach them to within 30 cm. While we expected that a faster frame rate or wider camera field of view should always improve search performance, our experimental results show that in many cases increasing the field of view does not help, and may even hurt, performance. These results have important implications for the design of object recognition systems for blind users.
- KNFB reading technology. http://www.knfbreader.com.Google Scholar
- Sight On Call. Blindsight, Inc. http://blindsight.com/ sight-on-call-tm.Google Scholar
- Text Detective. http://blindsight.com/textdetective.Google Scholar
- H. Bagherinia, R. Manduchi. Robust real-time detection of multi-color markers on a cell phone. Journal of RealTime Image Processing, 6, 2011. Google ScholarDigital Library
- J. Bigham, et al. Vizwiz::LocateIt -- Enabling blind people to locate objects in their environment. In Proc. CVAVI'10.Google Scholar
- J. P. Bigham, et al. VizWiz: Nearly real-time answers to visual questions. In Proc. ACM UIST '10. Google ScholarDigital Library
- J. Coughlan and R. Manduchi. Functional assessment of a camera phone-based wayfinding system operated by blind and visually impaired users. International Journal on Artificial Intelligence Tools 18.03 (2009): 379--397.Google ScholarCross Ref
- W. Crandall and J. Marston. Development, evaluation, and lessons learned: A case study of Talking Signs remote infrared audible signage. In R. Manduchi and S. Kurniawan, editors, Assistive Technology for Blindness and Low Vision. CRC Press, 2013.Google Scholar
- R. Golledge, J. Marston, J. Loomis, and R. Klatzky. Stated preferences for components of a personal guidance system for nonvisual navigation. Journal of Visual Impairment and Blindness, pages 135--47, 1998.Google Scholar
- C. Jayant, H. Ji, S. White, and J. P. Bigham. Supporting blind photography. Proc. ACM ASSETS '11. Google ScholarDigital Library
- A. Kutiyanawala, V. Kulyukin, and J. Nicholson. Teleassistance in accessible shopping for the blind. In Proc. ICOMP'11, 2011.Google Scholar
- C. Magnusson, K. Rassmus-Grohn, D. Szymczak. The influence of angle size in navigation applications using pointing gestures. In Proc. HAID'10. Google ScholarDigital Library
- R. Manduchi. Mobile vision as assistive technology for the blind: An experimental study. In Proc. ICCHP'12. Google ScholarDigital Library
- R. Manduchi and S. Kurniawan, eds. Assistive technology for blindness and low vision. CRC Press, 2013.Google Scholar
- J. R. Marston et al. Evaluation of spatial displays for navigation without sight. ACM Trans. on Applied Perception, 3(2):110--124, 2006. Google ScholarDigital Library
- K. O. McGraw, S. P., Wong. Forming inferences about some intraclass correlation coefficients. Psychological Methods, Vol. 1, No. 1, pp. 30--46, 1996Google ScholarCross Ref
- E. Tekin and J. Coughlan. A mobile phone application enabling visually impaired users to find and read product barcodes. In Proc. ICCHP'10. Google ScholarDigital Library
- M. Vázquez and A. Steinfeld. Helping visually impaired users properly aim a camera. Proc. ACM ASSETS 12. Google ScholarDigital Library
Index Terms
- The last meter: blind visual guidance to a target
Recommendations
Towards a real-time system for finding and reading signs for visually impaired users
ICCHP'12: Proceedings of the 13th international conference on Computers Helping People with Special Needs - Volume Part IIPrinted text is a ubiquitous form of information that is inaccessible to many blind and visually impaired people unless it is represented in a non-visual form such as Braille. OCR (optical character recognition) systems have been used by blind and ...
TalkingCane: Designing Interactive White Cane for Visually Impaired People's Bus Usage
MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services AdjunctIn this paper, we redesigned a white cane into TalkingCane, an interactive instrument for communication between visually impaired people and the world. Our research goal is to facilitate bus usage by blind people and hence increase their ability to ...
Implementing Assistive Technology on Wearable Computers
The article presents the author's work in developing assistive technology for disabled users. He makes a case for wearable computers and focuses on design strategies that accommodate the users' changing needs. He points out that what might seem ...
Comments