Annika Muehlbradt
Darren Guinness
Shaun K. Kane
ABSTRACT
Creating tactile representations of visual information, especially moving images, is difficult due to a lack of available tactile computing technology and a lack of tools for authoring tactile information. To address these limitations, we developed a software framework that enables educators and other subject experts to create graphical representations that combine audio descriptions with kinetic motion. These audio-kinetic graphics can be played back using off-the-shelf computer hardware. We report on a study in which 10 educators developed content using our framework, and in which 18 people with vision impairments viewed these graphics on our output device. Our findings provide insights on how to translate knowledge of visual information to non-visual formats.
Supplemental Material
- Black, J. A., & Hayden, D. S. (2010, June). The Note-Taker: An assistive technology that allows students who are legally blind to take notes in the classroom. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on (pp. 1--8). IEEE.Google Scholar
- Braier, J., Lattenkamp, K., Räthel, B., Schering, S., Wojatzki, M., & Weyers, B. (2015). Haptic 3D surface representation of table-based data for people with visual impairments. ACM Transactions on Accessible Computing (TACCESS), 6(1), 1. Google ScholarDigital Library
- Brown, C., & Hurst, A. (2012, February). VizTouch: automatically generated tactile visualizations of coordinate spaces. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (pp. 131--138). ACM. Google ScholarDigital Library
- Capovilla, D., Krugel, J., & Hubwieser, P. (2013, March). Teaching algorithmic thinking using haptic models for visually impaired students. In Learning and Teaching in Computing and Engineering (LaTiCE), 2013 (pp. 167--171). IEEE. Google ScholarDigital Library
- Cavender, A. C., Bigham, J. P., & Ladner, R. E. (2009, October). ClassInFocus: enabling improved visual attention strategies for deaf and hard of hearing students. In Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility (pp. 67--74). ACM. Google ScholarDigital Library
- Crombie, D., Lenoir, R., McKenzie, N., & Ioannidis, G. (2004, July). The bigger picture: Automated production tools for tactile graphics. In International Conference on Computers for Handicapped Persons (pp. 713--720). Springer, Berlin, Heidelberg.Google Scholar
- Follmer, S., Leithinger, D., Olwal, A., Hogge, A., & Ishii, H. (2013, October). inFORM: dynamic physical affordances and constraints through shape and object actuation. In Uist (Vol. 13, pp. 417--426). Google ScholarDigital Library
- Freire, A. P., Linhalis, F., Bianchini, S. L., Fortes, R. P., & Maria da Graça, C. P. (2010). Revealing the whiteboard to blind students: An inclusive approach to provide mediation in synchronous e-learning activities. Computers & Education, 54(4), 866--876. Google ScholarDigital Library
- Guinness, D. (2018). Using robots to improve the accessibility of online videos. ACM SIGACCESS Accessibility and Computing, (120), 20--23. Google ScholarDigital Library
- Guinness, D., Szafir, D., & Kane, S. K. (2017, June). GUI Robots: Using off-the-shelf robots as tangible input and output devices for unmodified GUI applications. In Proceedings of the 2017 Conference on Designing Interactive Systems (pp. 767--778). ACM. Google ScholarDigital Library
- Hornecker, E., & Buur, J. (2006, April). Getting a grip on tangible interaction: a framework on physical space and social interaction. In Proceedings of the SIGCHI conference on Human Factors in computing systems (pp. 437--446). ACM. Google ScholarDigital Library
- Horstmann*, M., Lorenz, M., Watkowski, A., Ioannidis, G., Herzog, O., King, A., ... & King, N. (2004). Automated interpretation and accessible presentation of technical diagrams for blind people. New Review of Hypermedia and Multimedia, 10(2), 141--163. Google ScholarDigital Library
- Hughes, G., & Robinson, P. (2007, October). Photonote evaluation: aiding students with disabilities in a lecture environment. In Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility (pp. 99--106). ACM. Google ScholarDigital Library
- Ishii, H., & Ullmer, B. (1997, March). Tangible bits: towards seamless interfaces between people, bits and atoms. In Proceedings of the ACM SIGCHI Conference on Human factors in computing systems (pp. 234--241). ACM. Google ScholarDigital Library
- Jacobsson, M., Fernaeus, Y., & Holmquist, L. E. (2008). Glowbots: Designing and implementing engaging human-robot interaction.Google Scholar
- Jayant, C., Renzelmann, M., Wen, D., Krisnandi, S., Ladner, R., & Comden, D. (2007, October). Automated tactile graphics translation: in the field. In Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility(pp. 75--82). ACM. Google ScholarDigital Library
- Jeon, M., Smith, M. T., Walker, J. W., & Kuhl, S. A. (2014, June). Constructing the immersive interactive sonification platform (iISoP). In International Conference on Distributed, Ambient, and Pervasive Interactions (pp. 337--348). Springer, Cham.Google ScholarCross Ref
- Kane, S. K., & Bigham, J. P. (2014, March). Tracking @stemxcomet: teaching programming to blind students via 3D printing, crisis management, and twitter. In Proceedings of the 45th ACM technical symposium on Computer science education (pp. 247--252). ACM. Google ScholarDigital Library
- Kelly, R. (2000). Working with WebQuests: Making the web accessible to students with disabilities. Teaching Exceptional Children, 32(6), 4--13.Google ScholarCross Ref
- Kushalnagar, R. S., Ludie, S. A., & Kushalnagar, P. (2011, October). Multi-view platform: an accessible live classroom viewing approach for low vision students. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility (pp. 267--268). ACM. Google ScholarDigital Library
- Ladner, R. E., Ivory, M. Y., Rao, R., Burgstahler, S., Comden, D., Hahn, S., ... & Martin, A. (2005, October). Automating tactile graphics translation. In Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility (pp. 150--157). ACM. Google ScholarDigital Library
- Manshad, M. S., Pontelli, E., & Manshad, S. J. (2011, October). MICOO (multimodal interactive cubes for object orientation): a tangible user interface for the blind and visually impaired. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility (pp. 261--262). ACM. Google ScholarDigital Library
- McGookin, D., Robertson, E., & Brewster, S. (2010, April). Clutching at straws: using tangible interaction to provide non-visual access to graphs. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 1715--1724). ACM. Google ScholarDigital Library
- Pangaro, G., Maynes-Aminzade, D., & Ishii, H. (2003). The actuated workbench: computer-controlled actuation in tabletop tangible interfaces. ACM Transactions on Graphics, 22(3), 699--699. Google ScholarDigital Library
- Stangl, A., Hsu, C. L., & Yeh, T. (2015, October). Transcribing across the senses: community efforts to create 3D printable accessible tactile pictures for young children with visual impairments. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (pp. 127--137). ACM. Google ScholarDigital Library
- Suzuki, R., Stangl, A., Gross, M. D., & Yeh, T. (2017, October). FluxMarker: Enhancing Tactile Graphics with Dynamic Tactile Markers. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (pp. 190--199). ACM. Google ScholarDigital Library
- Swaminathan, S., Roumen, T., Kovacs, R., Stangl, D., Mueller, S., & Baudisch, P. (2016, May). Linespace: A sensemaking platform for the blind. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 2175--2185). ACM. Google ScholarDigital Library
- Völkel, T., Weber, G., & Baumann, U. (2008, July). Tactile graphics revised: the novel brailledis 9000 pin-matrix device with multitouch input. In International Conference on Computers for Handicapped Persons (pp. 835--842). Springer, Berlin, Heidelberg. Google ScholarDigital Library
- Wang, Z., Li, B., Hedgpeth, T., & Haven, T. (2009, October). Instant tactile-audio map: enabling access to digital maps for people with visual impairment. In Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility (pp. 43--50). ACM. Google ScholarDigital Library
- Way, T. P., & Barner, K. E. (1997). Automatic visual to tactile translation. II. Evaluation of the TACTile image creation system. IEEE Transactions on Rehabilitation Engineering, 5(1), 95--105.Google ScholarCross Ref
- Yeh, T., & Kim, J. (2018). CraftML: Where 3D Modeling is Web Programming.Google Scholar
Index Terms
- Exploring the Design of Audio-Kinetic Graphics for Education
Recommendations
What's in an ALT Tag? Exploring Caption Content Priorities through Collaborative Captioning
Evaluating the quality of accessible image captions with human raters is difficult, as it may be difficult for a visually impaired user to know how comprehensive a caption is, whereas a sighted assistant may not know what information a user will need from ...
"I can do everything but see!" -- How People with Vision Impairments Negotiate their Abilities in Social Contexts
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsThis research takes an orientation to visual impairment (VI) that does not regard it as fixed or determined alone in or through the body. Instead, we consider (dis)ability as produced through interactions with the environment and configured by the ...
BrailleBlocks: Computational Braille Toys for Collaborative Learning
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing SystemsBraille literacy has fallen in recent years, and many blind children now grow up without learning Braille. However, learning Braille can increase employment chances and improve literacy skills. We introduce BrailleBlocks, a system to help visually ...
Comments