Giuseppe Melfi
ABSTRACT
A lot of information is nowadays presented graphically. However, students with blindness do not have access to visual information. Providing an alternative text is not always the appropriate solution as exploring graphics to discover information independently is a fundamental part of the learning process. In this work, we introduce a mobile audio-tactile learning environment, which facilitates the incorporation of real educational material. We evaluate our system by comparing three methods of interaction with tactile graphics: A tactile graphic augmented by (1) a document with key index information in Braille, (2) a digital document with key index information and (3) the TPad system, an audio-tactile solution meeting the specific needs within the school context. Our study shows that the TPad system is suitable for educational environments. Moreover, compared to the other methods TPad is faster to explore tactile graphics and it suggests a promising effect on the memorization of information.
Supplemental Material
- Frances K. Aldrich, Linda Sheppard and Yvonne Hindle. 2002. First steps towards a model of tactile graphicacy. The British Journal of Visual Impairment, 2002, 20:2, 62--67Google Scholar
- Frances K. Aldrich and Linda Sheppard. 2001. Tactile graphics in school education: perspectives from pupils. The British Journal of Visual Impairment, 2001, 19:2, 69--73Google Scholar
- Peter Anderson, Xiaodong He, Chris Buehler, Damien Teney, Mark Johnson, Stephen Gould, Lei Zhang. 2018. Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering. 60776086. 10.1109/CVPR.2018.00636Google Scholar
- C. M. Baker, L. R. Milne, J. Scofield, C. L. Bennett, and R. E. Ladner. Tactile graphics with a voice: using QR codes to access text in tactile graphics. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS '14, pages 75--82. ACM, 2014.Google ScholarDigital Library
- Anke M. Brock, Christophe Jouffrais. 2015. Interactive audio-tactile maps for visually impaired people. ACM SIGACCESS Accessibility and Computing (ACM Digital Library). Association for Computing Machinery (ACM). 3--12.Google Scholar
- Anke M. Brock, Philippe Truillet, Bernard Oriola, Delphine Picard and Christophe Jouffrais. 2015. Interactivity Improves Usability of Geographic Maps for Visually Impaired People. Human-Computer Interaction. 30:2, 156--194.Google ScholarDigital Library
- Julie Ducasse, Anke Brock and Christophe Jouffrais. 2017. Accessible Interactive Maps for Visually Impaired Users.Google Scholar
- Giovanni Fusco and Valerie S. Morash. 2015. The Tactile Graphics Helper: Providing Audio Clarification for Tactile Graphics Using Machine Vision. ASSETS 2015, 97--106Google ScholarDigital Library
- J. A. Gardner and V. Bulatov. Scientific diagrams made easy with IVEO TM. In Computers Helping People with Special Needs, pages 1243--1250. Springer, 2006.Google ScholarDigital Library
- Stéphanie Giraud, Anke M. Brock, Marc J.-M. Macé and Christophe Jouffrais. 2017. Map Learning with a 3D Printed Interactive Small-Scale Model: Improvement of Space and Text Memorization in Visually Impaired Students. In Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2017.00930Google ScholarCross Ref
- Timo Götzelmann. 2018. Visually Augmented AudioTactile Graphics for Visually Impaired People. ACM Transactions on Accessible Computing. 11. 1--31. 10.1145/3186894.Google Scholar
- Mihail Ivanchev, Francis Zinke and Ulrike Lucke. 2014. Pre-journey Visualization of Travel Routes for the Blind on Refreshable Interactive Tactile Displays. ICCHP 2014, Part II, LNCS 8548, 81--88.Google Scholar
- Chandrika Jayant, Matthew Renzelmann, Dana Wen, Satria Krisnandi, R.E. Ladner and Dan Comden. 2007. Automated Tactile Graphics Translation: In the Field. 75--82. 10.1145/1296843.1296858.Google Scholar
- Ernst Klett. 2010. Prisma Biologie Berufsfachschule 9./10. Schuljahr. ISBN: 978--3--12-068450--3Google Scholar
- S. Landau, G. Bourquin, J. Miele, and A. Van Schaack. Demonstration of a universally accessible audio-haptic transit map built on a digital pen-based platform. In Proceedings of the 3rd International Workshop on Haptic and Audio Interaction Design, pages 23--24, 2008.Google Scholar
- S. Landau, R. Holborow and E. Jane. The Use of the Talking Tactile Tablet for Delivery of Standardized Tests. In Proc. CSUN 2004Google Scholar
- Steven Landau and Lesley Wells. 2003. Merging tactile sensory input and audio data by means of the talking tactile tablet. In Proceedings of the European Conference on Haptics (EuroHaptics'03). 414--418.Google Scholar
- K. Minatani. 2014. A Proposal for an Automated Method to Produce Embossed Graphics for Blind Persons. In: Stephanidis C., Antona M. (eds) Universal Access in Human-Computer Interaction. Universal Access to Information and Knowledge. UAHCI 2014. Lecture Notes in Computer Science, vol 8514. Springer, ChamGoogle ScholarCross Ref
- Liam O'Sullivan, Lorenzo Picinali, Andrea Gerino and Douglas Cawthrone. 2015. A Prototye Audio-Tactile Map System with an Advanced Auditory Display. International Journal of Mobile Human Computer Interaction, 7(4), 53--75Google ScholarDigital Library
- Grégory Petit, Aude Dufresne, Vincent Levesque, Vincent Hayward and Nicole Trudeau. 2008. Refreshable Tactile Graphics Applied to Schoolbook Illustrations for Students with Visual Impairment. In Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility. 89--96.Google ScholarDigital Library
- D. Prescher, J. Bornschein and G. Weber. 2014. Production of Accessible Tactile Graphics. In: Miesenberger K., Fels D., Archambault D., Pe?áz P., Zagler W. (eds) Computers Helping People with Special Needs. ICCHP 2014. Lecture Notes in Computer Science, vol 8548. Springer, ChamGoogle Scholar
- Andreas Reichinger, Anton Fuhrmann, Stefan Maierhofer and Werner Purgathofer. 2016. GestureBased Interactive Audio Guide on Tactile Reliefs. 10.1145/2982142.2982176.Google Scholar
- Claus Reinhardt. 2012. Biologie Natura - Biologie für berufliche Gymnasien, berufliche Oberstufe. ISBN: 978--3--12-045306--2Google Scholar
- L. Penny Rosenblum, Li Cheng, and Carole R. Beal. 2018. Teachers of Students with Visual Impairments Share Experiences and Advice for Supporting Students in Understanding Graphics. Journal of Visual Impairment & Blindness. October 2018, 475--487.Google ScholarCross Ref
- Linda Sheppard and Frances K. Aldrich. 2001. Tactile graphics in school education: perspectives from teachers. The British Journal of Visual Impairment, 2001 19:3, 93--97.Google Scholar
- Sarit Szpiro, Shafeka Hashash, Yuhang Zhao and Shiri Azenkot. 2016. How People with Low Vision Access Computing Devices: Understanding Challenges and Opportunities. 171--180. 10.1145/2982142.2982168.Google Scholar
- Lauren Thevin and Anke Brock. 2018). Augmented Reality for People with Visual Impairments: Designing and Creating Audio-Tactile Content from Existing Objects. 10.1007/978--3--319--94274--2_26.Google Scholar
- Zheshen Wang, Baoxin Li, Terri Hedgpeth and Teresa Haven. 2009. Instant Tactiled-Audio Map: Enabling Access to Digital Maps for People with Visual Impairment. ASSETS, 43--50Google Scholar
- Kelvin Xu, Jimmy Ba, Ryan Kiros, Cho Kyunghyun, Aaron Courville, Ruslan Salakhutdinov, Richard Zemel and Y. Bengio. 2015. Show, Attend and Tell: Neural Image Caption Generation with Visual Attention.Google Scholar
- Kim T. Zebehazy and Adam P. Wilton. 2014. Quality, importance, and instruction: the perspectives of teachers of students with visual impairments on graphics use by students. Journal of Visual Impairment & Blindness, July-August 2014, 275--286Google Scholar
- Limin Zeng and Gerhard Weber. 2011. Accessible Maps for the Visually Impaired. CEUR Workshop Proceedings. 792.Google Scholar
Index Terms
- Understanding what you feel: A Mobile Audio-Tactile System for Graphics Used at Schools with Students with Visual Impairment
Recommendations
Visually Augmented Audio-Tactile Graphics for Visually Impaired People
Paper from ASSETS 2016 and Regular PapersTactile graphics play an essential role in knowledge transfer for blind people. The tactile exploration of these graphics is often challenging because of the cognitive load caused by physiological constraints and their complexity. The coupling of ...
Tactile graphics with a voice: using QR codes to access text in tactile graphics
ASSETS '14: Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibilityTextbook figures are often converted into a tactile format for access by blind students. These figures are not truly accessible unless the text within the figures is also made accessible. A common solution to access text in a tactile image is to use ...
Tactile graphics with a voice demonstration
ASSETS '14: Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibilityTextbook images are converted into tactile graphics to be made accessible to blind and low vision students. The text labels on these graphics are an important part of the image and must be made accessible as well. The graphics usually have the labels ...
Comments