Skip to main content
Top

Hint

Swipe to navigate through the chapters of this book

2013 | OriginalPaper | Chapter

5. Intelligent Interaction in Accessible Applications

Authors : Sina Bahram, Arpan Chakraborty, Srinath Ravindran, Robert St. Amant

Published in: A Multimodal End-2-End Approach to Accessible Computing

Publisher: Springer London

share
SHARE

Abstract

Advances in artificial intelligence over the past decade, combined with increasingly affordable computing power, have made new approaches to accessibility possible. In this chapter we describe three ongoing projects in the Department of Computer Science at North Carolina State University. CAVIAR, a Computer-vision Assisted Vibrotactile Interface for Accessible Reaching, is a wearable system that aids people with vision impairment (PWVI) in locating, identifying, and acquiring objects within reach; a mobile phone worn on the chest processes video input and guides the user’s hand to objects via a wristband with vibrating actuators. TIKISI (Touch It, Key It, Speak It), running on a tablet, gives PWVI the ability to explore maps and other forms of graphical information. AccessGrade combines crowd-sourcing with machine learning techniques to predict the accessibility of Web pages.

To get access to this content you need the following product:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 69.000 Bücher
  • über 500 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt 90 Tage mit der neuen Mini-Lizenz testen!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 50.000 Bücher
  • über 380 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe



 


Jetzt 90 Tage mit der neuen Mini-Lizenz testen!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 58.000 Bücher
  • über 300 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko





Jetzt 90 Tage mit der neuen Mini-Lizenz testen!

Footnotes
7
The ellipses in the overview Lenora hears indicate prosodic cues. The prosody of speech output affords speech interface users a familiar way of indicating importance in a long stream of speech. The ellipses, which represent pauses, are also exactly the locations where a small audio tone or click can be inserted for further enforcement [23]. The silencing command is similar to that in Gravitas [17] to pause the focus at the given node, and then begin exploring from that point.
 
Literature
1.
go back to reference Abe, K., Azumatani, Y., Kukouda, M., & Suzuki, S. (1986). Discrimination of symbols, lines, and characters in flow chart recognition. In Proceedings of 8th ICPR, Paris, France (pp.1071–1074). Abe, K., Azumatani, Y., Kukouda, M., & Suzuki, S. (1986). Discrimination of symbols, lines, and characters in flow chart recognition. In Proceedings of 8th ICPR, Paris, France (pp.1071–1074).
3.
go back to reference Bahram, S., Chakraborty, A., & St. Amant, R. (2012). Caviar: A vibrotactile device for accessible reaching. In Proceedings of the international conference on Intelligent User Interfaces (IUI), Lisbon, Portugal (pp. 245–248). New York: ACM. Bahram, S., Chakraborty, A., & St. Amant, R. (2012). Caviar: A vibrotactile device for accessible reaching. In Proceedings of the international conference on Intelligent User Interfaces (IUI), Lisbon, Portugal (pp. 245–248). New York: ACM.
5.
go back to reference Bigham, J., Kaminsky, R., Ladner, R., Danielsson, O., & Hempton, G. (2006). WebInSight: Making web images accessible. In Proceedings of the 8th international ACM SIGACCESS conference on computers and accessibility, Portland, USA (pp. 181–188). New York: ACM. Bigham, J., Kaminsky, R., Ladner, R., Danielsson, O., & Hempton, G. (2006). WebInSight: Making web images accessible. In Proceedings of the 8th international ACM SIGACCESS conference on computers and accessibility, Portland, USA (pp. 181–188). New York: ACM.
6.
go back to reference Bigham, J., Lau, T., & Nichols, J. (2009). Trailblazer: Enabling blind users to blaze trails through the web. In Proceedings of the 13th international conference on intelligent user interfaces (pp. 177–186). New York: ACM. Bigham, J., Lau, T., & Nichols, J. (2009). Trailblazer: Enabling blind users to blaze trails through the web. In Proceedings of the 13th international conference on intelligent user interfaces (pp. 177–186). New York: ACM.
8.
go back to reference Bosman, S., Groenendaal, B., Findlater, J., Visser, T., Graaf, M., & Markopoulos, P. (2003). Gentleguide: An exploration of haptic output for indoors pedestrian guidance. In Human-computer interaction with mobile devices and services (pp. 358–362). Berlin/Heidelberg: Springer. Bosman, S., Groenendaal, B., Findlater, J., Visser, T., Graaf, M., & Markopoulos, P. (2003). Gentleguide: An exploration of haptic output for indoors pedestrian guidance. In Human-computer interaction with mobile devices and services (pp. 358–362). Berlin/Heidelberg: Springer.
10.
go back to reference Brock, A., Truillet, P., Oriola, B., & Jouffrais, C. (2010). Usage of multimodal maps for blind people: Why and how. In ACM international conference on interactive tabletops and surfaces Saarbrücken, Germany (pp. 247–248). New York: ACM. Brock, A., Truillet, P., Oriola, B., & Jouffrais, C. (2010). Usage of multimodal maps for blind people: Why and how. In ACM international conference on interactive tabletops and surfaces Saarbrücken, Germany (pp. 247–248). New York: ACM.
11.
go back to reference Brudvik, J., Bigham, J., Cavender, A., & Ladner, R. (2008). Hunting for headings: Sighted labeling vs. automatic classification of headings. In Proceedings of the 10th international ACM conference on computers and accessibility (pp. 201–208). New York: ACM. Brudvik, J., Bigham, J., Cavender, A., & Ladner, R. (2008). Hunting for headings: Sighted labeling vs. automatic classification of headings. In Proceedings of the 10th international ACM conference on computers and accessibility (pp. 201–208). New York: ACM.
12.
go back to reference Bühler, C., Heck, H., Perlick, O., Nietzio, A., & Ulltveit-Moe, N. (2006). Interpreting results from large scale automatic evaluation of web accessibility. In ICCHP’06 (pp. 184–191). Berlin/Heidelberg: Springer-Verlag. Bühler, C., Heck, H., Perlick, O., Nietzio, A., & Ulltveit-Moe, N. (2006). Interpreting results from large scale automatic evaluation of web accessibility. In ICCHP’06 (pp. 184–191). Berlin/Heidelberg: Springer-Verlag.
13.
go back to reference Davalcu, H., Vadrevu, S., Nagarajan, S., & Ramakrishnan, I. (2005). Ontominer: Bootstrapping and populating ontologies from domain-specific web sites. IEEE Intelligent Systems, 18(5), 24–33. Davalcu, H., Vadrevu, S., Nagarajan, S., & Ramakrishnan, I. (2005). Ontominer: Bootstrapping and populating ontologies from domain-specific web sites. IEEE Intelligent Systems, 18(5), 24–33.
14.
go back to reference Ferres, L., Lindgaard, G., & Sumegi, L. (2010). Evaluating a tool for improving accessibility to charts and graphs. In Proceedings of the 12th international ACM SIGACCESS conference on computers and accessibility (pp. 83–90). New York: ACM. Ferres, L., Lindgaard, G., & Sumegi, L. (2010). Evaluating a tool for improving accessibility to charts and graphs. In Proceedings of the 12th international ACM SIGACCESS conference on computers and accessibility (pp. 83–90). New York: ACM.
15.
17.
go back to reference Goncu, C., & Marriott, K. (2011). Gravvitas: Generic multi-touch presentation of accessible graphics. In Human-computer interaction–INTERACT 2011 (pp. 30–48). Berlin/Heidelberg: Springer. Goncu, C., & Marriott, K. (2011). Gravvitas: Generic multi-touch presentation of accessible graphics. In Human-computer interaction–INTERACT 2011 (pp. 30–48). Berlin/Heidelberg: Springer.
18.
go back to reference Hill, D. R., & Grieb, C. (1988). Substitution for a restricted visual channel in multimodal computer-human dialogue. IEEE Transactions on Systems, Man, and Cybernetics, 18(3), 285–304. CrossRef Hill, D. R., & Grieb, C. (1988). Substitution for a restricted visual channel in multimodal computer-human dialogue. IEEE Transactions on Systems, Man, and Cybernetics, 18(3), 285–304. CrossRef
20.
go back to reference Jacobson, R. (1998). Navigating maps with little or no sight: An audio-tactile approach. In Proceedings of the workshop on Content Visualization and Intermedia Representations (CVIR). New Brunswick: ACL (ACL = Association for Computational Linguistics). Jacobson, R. (1998). Navigating maps with little or no sight: An audio-tactile approach. In Proceedings of the workshop on Content Visualization and Intermedia Representations (CVIR). New Brunswick: ACL (ACL = Association for Computational Linguistics).
21.
go back to reference Kane, S., Morris, M., Perkins, A., Wigdor, D., Ladner, R., & Wobbrock, J. (2011). Access overlays: Improving non-visual access to large touch screens for blind users. In Proceedings of the 24th annual ACM symposium on user interface software and technology (pp. 273–282). New York: ACM. Kane, S., Morris, M., Perkins, A., Wigdor, D., Ladner, R., & Wobbrock, J. (2011). Access overlays: Improving non-visual access to large touch screens for blind users. In Proceedings of the 24th annual ACM symposium on user interface software and technology (pp. 273–282). New York: ACM.
22.
go back to reference Kane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008). Slide rule: Making mobile touch screens accessible to blind people using multi-touch interaction techniques. In Proceedings of the 10th international ACM SIGACCESS conference on computers and accessibility, Assets’08 (pp.73–80). New York: ACM. URL: http://​doi.​acm.​org/​10.​1145/​1414471.​1414487 Kane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008). Slide rule: Making mobile touch screens accessible to blind people using multi-touch interaction techniques. In Proceedings of the 10th international ACM SIGACCESS conference on computers and accessibility, Assets’08 (pp.73–80). New York: ACM. URL: http://​doi.​acm.​org/​10.​1145/​1414471.​1414487
23.
go back to reference Kane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008). Slide rule: Making mobile touch screens accessible to blind people using multi-touch interaction techniques. In Proceedings of the 10th international ACM SIGACCESS conference on computers and accessibility, Assets’08 (pp.73–80). New York: ACM. URL: http://​doi.​acm.​org/​10.​1145/​1414471.​1414487 Kane, S. K., Bigham, J. P., & Wobbrock, J. O. (2008). Slide rule: Making mobile touch screens accessible to blind people using multi-touch interaction techniques. In Proceedings of the 10th international ACM SIGACCESS conference on computers and accessibility, Assets’08 (pp.73–80). New York: ACM. URL: http://​doi.​acm.​org/​10.​1145/​1414471.​1414487
24.
go back to reference King, A. R. (2006). Re-presenting visual content for blind people. Ph.D. thesis, University of Manchester, Manchester. King, A. R. (2006). Re-presenting visual content for blind people. Ph.D. thesis, University of Manchester, Manchester.
25.
go back to reference Kottapally, K., Ngo, C., Reddy, R., Pontelli, E., Son, T., & Gillan, D. (2003). Towards the creation of accessibility agents for non-visual navigation of the web. In Proceedings of the 2003 conference on universal usability (pp. 134–141). New York: ACM. Kottapally, K., Ngo, C., Reddy, R., Pontelli, E., Son, T., & Gillan, D. (2003). Towards the creation of accessibility agents for non-visual navigation of the web. In Proceedings of the 2003 conference on universal usability (pp. 134–141). New York: ACM.
26.
go back to reference Landau, S., & Wells, L. (2003). Merging tactile sensory input and audio data by means of the talking tactile tablet. In EuroHaptics’03 (pp. 414–418). Ireland: Dublin. Landau, S., & Wells, L. (2003). Merging tactile sensory input and audio data by means of the talking tactile tablet. In EuroHaptics’03 (pp. 414–418). Ireland: Dublin.
27.
go back to reference Leshed, G., Haber, E., Matthews, T., & Lau, T. (2008). CoScripter: Automating & sharing how-to knowledge in the enterprise. In Proceeding of the twenty-sixth annual ACM conference on human factors in computing systems (pp. 1719–1728). New York: ACM. Leshed, G., Haber, E., Matthews, T., & Lau, T. (2008). CoScripter: Automating & sharing how-to knowledge in the enterprise. In Proceeding of the twenty-sixth annual ACM conference on human factors in computing systems (pp. 1719–1728). New York: ACM.
28.
go back to reference Lieberman, J., & Breazeal, C. (2007). Tikl: Development of a wearable vibrotactile feedback suit for improved human motor learning. IEEE Transactions on Robotics, 23(5), 919–926. CrossRef Lieberman, J., & Breazeal, C. (2007). Tikl: Development of a wearable vibrotactile feedback suit for improved human motor learning. IEEE Transactions on Robotics, 23(5), 919–926. CrossRef
29.
go back to reference Mahmud, J., Borodin, Y., Das, D., & Ramakrishnan, I. (2007). Combating information overload in non-visual web access using context. In Proceedings of the 12th international conference on intelligent user interfaces (pp. 341–344). New York: ACM. Mahmud, J., Borodin, Y., Das, D., & Ramakrishnan, I. (2007). Combating information overload in non-visual web access using context. In Proceedings of the 12th international conference on intelligent user interfaces (pp. 341–344). New York: ACM.
30.
go back to reference Mitchell, T. M. (1997). Machine learning. New York: McGraw-Hill. MATH Mitchell, T. M. (1997). Machine learning. New York: McGraw-Hill. MATH
32.
go back to reference Perkins, C., & Gardiner, A. (2003). Real world map reading strategies. The Cartographic Journal, 40(3), 265–268. CrossRef Perkins, C., & Gardiner, A. (2003). Real world map reading strategies. The Cartographic Journal, 40(3), 265–268. CrossRef
33.
go back to reference Petrie, H., Schlieder, C., Blenkhorn, P., Evans, G., King, A., O’Neill, A., Ioannidis, G., Gallagher, B., Crombie, D., & Mager, R., et al. (2002) Tedub: A system for presenting and exploring technical drawings for blind people. In Computers helping people with special needs (pp. 47–67). Petrie, H., Schlieder, C., Blenkhorn, P., Evans, G., King, A., O’Neill, A., Ioannidis, G., Gallagher, B., Crombie, D., & Mager, R., et al. (2002) Tedub: A system for presenting and exploring technical drawings for blind people. In Computers helping people with special needs (pp. 47–67).
34.
go back to reference Ramakrishnan, I., Mahmud, J., Borodin, Y., Islam, M., & Ahmed, F. (2009). Bridging the web accessibility divide. Electronic Notes in Theoretical Computer Science, 235, 107–124. CrossRef Ramakrishnan, I., Mahmud, J., Borodin, Y., Islam, M., & Ahmed, F. (2009). Bridging the web accessibility divide. Electronic Notes in Theoretical Computer Science, 235, 107–124. CrossRef
35.
go back to reference Siekierska, E., Labelle, R., Brunet, L., Mccurdy, B., Pulsifer, P., Rieger, M., et al. (2003). Enhancing spatial learning and mobility training of visually impaired people-a technical paper on the internet-based tactile and audio-tactile mapping. The Canadian Geographer/Le G? ographe canadien, 47(4), 480–493. CrossRef Siekierska, E., Labelle, R., Brunet, L., Mccurdy, B., Pulsifer, P., Rieger, M., et al. (2003). Enhancing spatial learning and mobility training of visually impaired people-a technical paper on the internet-based tactile and audio-tactile mapping. The Canadian Geographer/Le G? ographe canadien, 47(4), 480–493. CrossRef
37.
go back to reference Takagi, H., Asakawa, C., Fukuda, K., & Maeda, J. (2004). Accessibility designer: Visualizing usability for the blind. In Proceedings of the 6th international ACM SIGACCESS conference on computers and accessibility (pp. 177–184). New York: ACM. Takagi, H., Asakawa, C., Fukuda, K., & Maeda, J. (2004). Accessibility designer: Visualizing usability for the blind. In Proceedings of the 6th international ACM SIGACCESS conference on computers and accessibility (pp. 177–184). New York: ACM.
38.
go back to reference Van Der Linden, J., Schoonderwaldt, E., & Bird, J. (2009). Good vibrations: Guiding body movements with vibrotactile feedback. In Proceedings of 3rd international workshop physicality (pp. 13–18). UK: Cambridge. Van Der Linden, J., Schoonderwaldt, E., & Bird, J. (2009). Good vibrations: Guiding body movements with vibrotactile feedback. In Proceedings of 3rd international workshop physicality (pp. 13–18). UK: Cambridge.
39.
go back to reference Vanderheiden, G. C. (1996). Use of audio-haptic interface techniques to allow nonvisual access to touchscreen appliances. In Proceedings of the human factors and ergonomics society annual meeting (pp. 1266–1266). Thousand Oaks: SAGE Publications. Vanderheiden, G. C. (1996). Use of audio-haptic interface techniques to allow nonvisual access to touchscreen appliances. In Proceedings of the human factors and ergonomics society annual meeting (pp. 1266–1266). Thousand Oaks: SAGE Publications.
40.
go back to reference Yi, L., Liu, B., & Li, X. (2003). Eliminating noisy information in web pages for data mining. In Proceedings of the ninth ACM SIGKDD international conference on knowledge discovery and data mining (pp. 296–305). New York: ACM. Yi, L., Liu, B., & Li, X. (2003). Eliminating noisy information in web pages for data mining. In Proceedings of the ninth ACM SIGKDD international conference on knowledge discovery and data mining (pp. 296–305). New York: ACM.
41.
go back to reference Yoshioka, M. (2008). IR interface for contrasting multiple news sites. Information Retrieval Technology (pp. 508–513). Yoshioka, M. (2008). IR interface for contrasting multiple news sites. Information Retrieval Technology (pp. 508–513).
43.
go back to reference Yu, Y., Samal, A., & Seth, S. (1997). A system for recognizing a large class of engineering drawings. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(8), 868–890. CrossRef Yu, Y., Samal, A., & Seth, S. (1997). A system for recognizing a large class of engineering drawings. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(8), 868–890. CrossRef
44.
go back to reference Zapirain, B., Zorrilla, A., Oleagordia, I., & Muro, A. (2010). Accessible schematics content descriptors using image processing techniques for blind students learning. In 5th international symposium on I/V Communications and Mobile Network (ISVC) (pp. 1–4). New York: IEEE. doi: 10.​1109/​ISVC.​2010.​5656270 Zapirain, B., Zorrilla, A., Oleagordia, I., & Muro, A. (2010). Accessible schematics content descriptors using image processing techniques for blind students learning. In 5th international symposium on I/V Communications and Mobile Network (ISVC) (pp. 1–4). New York: IEEE. doi: 10.​1109/​ISVC.​2010.​5656270
Metadata
Title
Intelligent Interaction in Accessible Applications
Authors
Sina Bahram
Arpan Chakraborty
Srinath Ravindran
Robert St. Amant
Copyright Year
2013
Publisher
Springer London
DOI
https://doi.org/10.1007/978-1-4471-5082-4_5