Skip to main content
Erschienen in: Mobile Networks and Applications 3/2013

01.06.2013

Spatialized Audio Environmental Awareness for Blind Users with a Smartphone

verfasst von: Jeffrey R. Blum, Mathieu Bouchard, Jeremy R. Cooperstock

Erschienen in: Mobile Networks and Applications | Ausgabe 3/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Numerous projects have investigated assistive navigation technologies for the blind community, tackling challenges ranging from interface design to sensory substitution. However, none of these have successfully integrated what we consider to be the three factors necessary for a widely deployable system that delivers a rich experience of one’s environment: implementation on a commodity device, use of a pre-existing worldwide point of interest (POI) database, and a means of rendering the environment that is superior to a naive playback of spoken text. Our “In Situ Audio Services” (ISAS) application responds to these needs, allowing users to explore an urban area without necessarily having a particular destination in mind. We describe the technical aspects of its implementation, user requirements, interface design, safety concerns, POI data source issues, and further requirements to make the system practical on a wider basis. Initial qualitative feedback from blind users is also discussed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Blattner M, Sumikawa D, Greenberg R (1989) Earcons and icons: their structure and common design principles. Hum-Comput Interact 4(1):11–44CrossRef Blattner M, Sumikawa D, Greenberg R (1989) Earcons and icons: their structure and common design principles. Hum-Comput Interact 4(1):11–44CrossRef
2.
Zurück zum Zitat Blum J, Bouchard M, Cooperstock JR (2011) What’s around me? Spatialized audio augmented reality for blind users with a smartphone. In: Mobile and ubiquitous systems (Mobiquitous). Springer, New York Blum J, Bouchard M, Cooperstock JR (2011) What’s around me? Spatialized audio augmented reality for blind users with a smartphone. In: Mobile and ubiquitous systems (Mobiquitous). Springer, New York
3.
Zurück zum Zitat Cheverst K,Mitchell K, Davies N (2002) Exploring context-aware information push. PUC 6(4):276–281 Cheverst K,Mitchell K, Davies N (2002) Exploring context-aware information push. PUC 6(4):276–281
5.
Zurück zum Zitat El-Shimy D, Grond F, Olmos A, Cooperstock JR (2011) Eyesfree environmental awareness for navigation. J Multimodal User Interfaces, Special Issue on Interactive Sonification 5(3–4):131–141 El-Shimy D, Grond F, Olmos A, Cooperstock JR (2011) Eyesfree environmental awareness for navigation. J Multimodal User Interfaces, Special Issue on Interactive Sonification 5(3–4):131–141
6.
Zurück zum Zitat Gaver W (1986) Auditory icons: using sound in computer interfaces. Hum-Comput Interact 2(2):167–177CrossRef Gaver W (1986) Auditory icons: using sound in computer interfaces. Hum-Comput Interact 2(2):167–177CrossRef
7.
Zurück zum Zitat Golledge RG, Klatzky RL, Loomis JM, Speigle J, Tietz J (1998) A geographical information system for a GPS based personal guidance system. Int J Geogr Inf Sci 12(7):727–749CrossRef Golledge RG, Klatzky RL, Loomis JM, Speigle J, Tietz J (1998) A geographical information system for a GPS based personal guidance system. Int J Geogr Inf Sci 12(7):727–749CrossRef
8.
Zurück zum Zitat Golledge RG, Loomis JM, Klatzky RL, Flury A, Yang XL (1991) Designing a personal guidance system to aid navigation with out sight: progress on the GIS component. Int J Geogr Inf Sci 5(4):373–395CrossRef Golledge RG, Loomis JM, Klatzky RL, Flury A, Yang XL (1991) Designing a personal guidance system to aid navigation with out sight: progress on the GIS component. Int J Geogr Inf Sci 5(4):373–395CrossRef
9.
Zurück zum Zitat Helal AS, Moore SE, Ramachandran B (2001) Drishti: an integrated navigation system for visually impaired and disabled. In: Proceedings fifth international symposium on wearable computers. IEEE Computer Society, Los Alamitos, pp 149–156CrossRef Helal AS, Moore SE, Ramachandran B (2001) Drishti: an integrated navigation system for visually impaired and disabled. In: Proceedings fifth international symposium on wearable computers. IEEE Computer Society, Los Alamitos, pp 149–156CrossRef
10.
Zurück zum Zitat Kammoun S, Mace´ M, Oriola B, Jouffrais C (2012) Towards a geographic information system facilitating navigation of visually impaired users. In: Computers helping people with special needs, vol 7383, pp 521–528 Kammoun S, Mace´ M, Oriola B, Jouffrais C (2012) Towards a geographic information system facilitating navigation of visually impaired users. In: Computers helping people with special needs, vol 7383, pp 521–528
11.
Zurück zum Zitat Katz BFG, Kammoun S, Parseihian G, Gutierrez O, Brilhault A, Auvray M, Truillet P, Denis M, Thorpe S, Jouffrais C (2006) NAVIG: augmented reality guidance system for the visually impaired. Virtual Real 16(3):1–17 Katz BFG, Kammoun S, Parseihian G, Gutierrez O, Brilhault A, Auvray M, Truillet P, Denis M, Thorpe S, Jouffrais C (2006) NAVIG: augmented reality guidance system for the visually impaired. Virtual Real 16(3):1–17
12.
Zurück zum Zitat Klatzky RL, Marston JR, Giudice NA, Golledge RG, Loomis JM (2006) Cognitive load of navigating without vision when guided by virtual sound versus spatial language. J Exp Psychol Appl 12(4):223–32CrossRef Klatzky RL, Marston JR, Giudice NA, Golledge RG, Loomis JM (2006) Cognitive load of navigating without vision when guided by virtual sound versus spatial language. J Exp Psychol Appl 12(4):223–32CrossRef
13.
Zurück zum Zitat Linell M(2011) Comparison between two 3d-sound engines of the accuracy in determining the position of a source. Master’s thesis, Luleå U. of Technology Linell M(2011) Comparison between two 3d-sound engines of the accuracy in determining the position of a source. Master’s thesis, Luleå U. of Technology
15.
Zurück zum Zitat McGookin D, Gibbs M, Nivala AM, Brewster S (2007) Initial development of a PDA mobility aid for visually impaired people. In: Human-computer interaction INTERACT 2007, pp 665–668 McGookin D, Gibbs M, Nivala AM, Brewster S (2007) Initial development of a PDA mobility aid for visually impaired people. In: Human-computer interaction INTERACT 2007, pp 665–668
16.
Zurück zum Zitat Petrie H, Johnson V, Strothotte T, Raab A, Fritz S, Michel R (1996) MOBIC: designing a travel aid for blind and elderly people. J Navig 49(1):45–52CrossRef Petrie H, Johnson V, Strothotte T, Raab A, Fritz S, Michel R (1996) MOBIC: designing a travel aid for blind and elderly people. J Navig 49(1):45–52CrossRef
17.
Zurück zum Zitat Petrie H, Johnson V, Strothotte T, Raab A, Michel R, Reichert L, Schalt A (1997) MoBIC: an aid to increase the independent mobility of blind travellers. Br J Vis Impair 15(2):63–66CrossRef Petrie H, Johnson V, Strothotte T, Raab A, Michel R, Reichert L, Schalt A (1997) MoBIC: an aid to increase the independent mobility of blind travellers. Br J Vis Impair 15(2):63–66CrossRef
18.
Zurück zum Zitat Ran L, Helal S, Moore S (2004) Drishti: an integrated indoor/outdoor blind navigation system and service. In: Proceedings of the second IEEE annual conference on pervasive computing and communications, 2004, pp 23–30 Ran L, Helal S, Moore S (2004) Drishti: an integrated indoor/outdoor blind navigation system and service. In: Proceedings of the second IEEE annual conference on pervasive computing and communications, 2004, pp 23–30
19.
Zurück zum Zitat Roentgen UR, Jan Gelderblom G, Soede M, de Witte LP (2008) Inventory of electronic mobility aids for persons with visual impairments: a literature review. JVIB 102(11):702–724 Roentgen UR, Jan Gelderblom G, Soede M, de Witte LP (2008) Inventory of electronic mobility aids for persons with visual impairments: a literature review. JVIB 102(11):702–724
20.
Zurück zum Zitat Stewart J, Bauman S, Escobar M, Hilden J, Bihani K, Newman MW (2008) Accessible contextual information for urban orientation. In: Proceedings of the 10th international conference on ubiquitous computing—UbiComp ’08. ACM, New York, p 332CrossRef Stewart J, Bauman S, Escobar M, Hilden J, Bihani K, Newman MW (2008) Accessible contextual information for urban orientation. In: Proceedings of the 10th international conference on ubiquitous computing—UbiComp ’08. ACM, New York, p 332CrossRef
21.
Zurück zum Zitat Su J, Rosenzweig A, Goel A, de Lara E, Truong KN (2010) Timbremap: enabling the visually-impaired to use maps on touch-enabled devices. In: Proceedings of the 12th international conference on human computer interaction with mobile devices and services. ACM, New York, pp 17–26CrossRef Su J, Rosenzweig A, Goel A, de Lara E, Truong KN (2010) Timbremap: enabling the visually-impaired to use maps on touch-enabled devices. In: Proceedings of the 12th international conference on human computer interaction with mobile devices and services. ACM, New York, pp 17–26CrossRef
22.
Zurück zum Zitat Sundareswaran V, Wang K, Chen S, Behringer R, McGee J, Tam C, Zahorik P (2003) 3D audio augmented reality, implementation and experiments. In: Proceedings of the the second IEEE and ACM international symposium on mixed and augmented reality, pp 296–297 Sundareswaran V, Wang K, Chen S, Behringer R, McGee J, Tam C, Zahorik P (2003) 3D audio augmented reality, implementation and experiments. In: Proceedings of the the second IEEE and ACM international symposium on mixed and augmented reality, pp 296–297
23.
Zurück zum Zitat Sutherland EE, Sproull RF, Schumacker RA (1974) A characterization of ten hidden-surface algorithms. ACM Comput Surv 6(1):1–55MATHCrossRef Sutherland EE, Sproull RF, Schumacker RA (1974) A characterization of ten hidden-surface algorithms. ACM Comput Surv 6(1):1–55MATHCrossRef
24.
Zurück zum Zitat Vazquez-Alvarez Y, Brewster S (2009) Investigating background & foreground interactions using spatial audio cues. In: Proceedings of the 27th international conference extended abstracts on human factors in computing systems—CHI EA ’09, p 3823 Vazquez-Alvarez Y, Brewster S (2009) Investigating background & foreground interactions using spatial audio cues. In: Proceedings of the 27th international conference extended abstracts on human factors in computing systems—CHI EA ’09, p 3823
25.
Zurück zum Zitat Völkel T, Kühn R, Weber G (2008) Mobility impaired pedestrians are not cars: requirements for the annotation of geographical data. In: Computers helping people with special needs, pp 1085–1092 Völkel T, Kühn R, Weber G (2008) Mobility impaired pedestrians are not cars: requirements for the annotation of geographical data. In: Computers helping people with special needs, pp 1085–1092
26.
Zurück zum Zitat Walker BN, Lindsay J et al (2005) Navigation performance in a virtual environment with bonephones. In: Proc. of the int’l conf. on auditory display (ICAD2005). Citeseer, pp 260–263 Walker BN, Lindsay J et al (2005) Navigation performance in a virtual environment with bonephones. In: Proc. of the int’l conf. on auditory display (ICAD2005). Citeseer, pp 260–263
27.
Zurück zum Zitat Walker BN, Nance A, Lindsay J (2006) Spearcons: speech-based earcons improve navigation performance in auditory menus. In: Proceedings of the international conference on auditory display. Citeseer, London, UK, pp 63–68 Walker BN, Nance A, Lindsay J (2006) Spearcons: speech-based earcons improve navigation performance in auditory menus. In: Proceedings of the international conference on auditory display. Citeseer, London, UK, pp 63–68
28.
Zurück zum Zitat Walker BN, Stanley R (2005) Thresholds of audibility for bone-conduction headsets. In: International conference on auditory display, Limerick, Ireland, pp 218–222 Walker BN, Stanley R (2005) Thresholds of audibility for bone-conduction headsets. In: International conference on auditory display, Limerick, Ireland, pp 218–222
29.
Zurück zum Zitat Wilson J, Walker BN, Lindsay J, Cambias C, Dellaert F (2007) SWAN: system for wearable audio navigation. In: 2007 11th IEEE international symposium on wearable computers, pp 1–8 Wilson J, Walker BN, Lindsay J, Cambias C, Dellaert F (2007) SWAN: system for wearable audio navigation. In: 2007 11th IEEE international symposium on wearable computers, pp 1–8
30.
Zurück zum Zitat Yang R, Park S, Mishra SR, Hong Z, Newsom C, Joo H, Hofer E, Newman MW (2011) Supporting spatial awareness and independent wayfinding for pedestrians with visual impairments. In: The proceedings of the 13th international ACM SIGACCESS conference on computers and accessibility—ASSETS ’11. ACM Press, New York, p 27CrossRef Yang R, Park S, Mishra SR, Hong Z, Newsom C, Joo H, Hofer E, Newman MW (2011) Supporting spatial awareness and independent wayfinding for pedestrians with visual impairments. In: The proceedings of the 13th international ACM SIGACCESS conference on computers and accessibility—ASSETS ’11. ACM Press, New York, p 27CrossRef
31.
Zurück zum Zitat Zandbergen PA, Barbeau SJ (2011) Positional accuracy of assisted GPS data from high-sensitivity GPS-enabled mobile phones. J Navig 64(3):381–399CrossRef Zandbergen PA, Barbeau SJ (2011) Positional accuracy of assisted GPS data from high-sensitivity GPS-enabled mobile phones. J Navig 64(3):381–399CrossRef
32.
Zurück zum Zitat Zhao H, Plaisant C, Shneiderman B, Duraiswami R (2003) Sonification of geo-referenced data for auditory information seeking: design principle and pilot study. In: University of Maryland Tech. Report HCIL 2004, vol 3, pp 1–8 Zhao H, Plaisant C, Shneiderman B, Duraiswami R (2003) Sonification of geo-referenced data for auditory information seeking: design principle and pilot study. In: University of Maryland Tech. Report HCIL 2004, vol 3, pp 1–8
Metadaten
Titel
Spatialized Audio Environmental Awareness for Blind Users with a Smartphone
verfasst von
Jeffrey R. Blum
Mathieu Bouchard
Jeremy R. Cooperstock
Publikationsdatum
01.06.2013
Verlag
Springer US
Erschienen in
Mobile Networks and Applications / Ausgabe 3/2013
Print ISSN: 1383-469X
Elektronische ISSN: 1572-8153
DOI
https://doi.org/10.1007/s11036-012-0425-8

Weitere Artikel der Ausgabe 3/2013

Mobile Networks and Applications 3/2013 Zur Ausgabe

Neuer Inhalt