Skip to main content

Advertisement

Log in

Comparing picture and video prompting in autonomous indoor wayfinding for individuals with cognitive impairments

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

A challenge to individuals with cognitive impairments in wayfinding is how to remain oriented, recall routines, and travel in unfamiliar areas in a way relying on limited cognitive capacity. According to psychological model of spatial navigation and the requirements of rehabilitation professionals, a novel wayfinding system is presented with an aim to increase workplace and life independence for people with traumatic brain injury, cerebral palsy, intellectual and developmental disabilities, schizophrenia, Down syndromes, and Alzheimer’s disease. An architecture is proposed based on Bluetooth tags and scanning PDAs. A prototype is built and tested in field experiments with real patients. Two modalities, video and picture prompts, were compared by 20 subjects with cognitive impairments. The experimental results show the computer–human interface is friendly and the capabilities of wayfinding are reliable. Video prompts performed better by 25–28% than picture prompts at the price of users feeling slightly more rushed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Bond GR, Liberman RP (1992) Vocational rehabilitation. Handbook of psychiatric rehabilitation. Macmillan, New York

    Google Scholar 

  2. Bond GR, Drake RE (1996) Supported employment for people with severe mental illness: a review. Psychiatric Services

  3. Goodwin S (1997) Comparative mental health policy: from institutional to community care. Sage, Thousand Oaks

    Google Scholar 

  4. Wu M, Baecker R, Richards B (2005) Participatory design of an orientation aid for amnesics. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 511–520

  5. Sohlberg MM, Fickas S, Hung PF, Fortier A (2007) A Comparison of four prompt modes for route finding for community travelers with severe cognitive impairments. Brain Injury, January, pp 531–538

    Google Scholar 

  6. Dutton GN (2003) Cognitive vision, its disorders and differential diagnosis in adults and children: knowing where and what things are. Eye 17:289–304

    Article  Google Scholar 

  7. Carmien S, Dawe M, Fischer G, Gorman A, Kintsch A, Sullivan JF (2005) Socio-technical environments supporting people with cognitive disabilities using public transportation. ACM Trans Comput Hum Interact 12(2):233–262

    Article  Google Scholar 

  8. Chang YJ, Tsai SK, Wang TY (2008) A context aware handheld wayfinding system for individuals with cognitive impairments. In: Proceedings of the ACM ASSETS 2008, Halifax, Canada. Oct. 13–15, pp 27–34

  9. Chang YJ, Chu YY, Chen CN, Wang TY (2008) Mobile computing for indoor wayfinding based on Bluetooth sensors for individuals with cognitive impairments, In: Proceedings of the international symposium of wireless and pervasive computing (ISWPC 2008), Greece, May 7–9. pp 623–627

  10. Chang YJ, Chen CN, Chou LD, Wang TY (2008) A novel wayfinding systems based on passive RFID for individuals with cognitive impairment. In: Proceedings of the pervasive health 2008, Tempere, Jan. 31–Feb. 2, pp 108–111

  11. Chang YJ, Tsai SK, Chang YS, Wang TY (2007) A novel wayfinding system based on geo-coded QR codes for individuals with cognitive impairments. In: Proceedings of 9th international ACM SIGACCESS conference on computers and accessibility, Tempe, Arizona, Oct 15–17, pp 231–232

  12. Bohonos S, Lee A, Malik A, Thai C, Manduchi R (2007) Universal real-time navigational assistance (URNA): An urban Bluetooth beacon for the blind, In: Proceedings of the 1st ACM SIGMOBILE international workshop on Systems and networking support for healthcare and assisted living environments, pp 83–88

  13. Chang YJ, Liu HH, Wang TY (2009) Mobile social networks as quality of life technology for people with severe mental illness. IEEE Wirel Commun 16(3):34–41

    Article  Google Scholar 

  14. [Online]. Available: http://humansystems.arc.nasa.gov/groups/TLX/downloads/TLXScale.pdf

  15. Allen G (1999) Spatial abilities, cognitive maps, and wayfinding: bases for individual differences in spatial cognition and behavior. In: Golledge R (ed) Wayfinding behavior: cognitive mapping and other spatial processes. Johns Hopkins University Press, Baltimore, pp 46–80

    Google Scholar 

  16. Passini R (1996) Wayfinding design: logic, application and some thoughts on universality. Des Stud 17(3):319–331

    Google Scholar 

  17. Giroux S, Pigot H (2005) From smart homes to smart care, assistive technology research series. Proceeding of the 3rd International Conference on Smart homes and health Telematics. In: Proceedings of ICOST’05, Sherbrooke, Canada

  18. Bauchet J, Mayers A (2005) Modelisation of ADL in its environment for cognitive assistance. In: Proceedings of the 3rd international conference on smart homes and health telematic, ICOST’05, Sherbrooke, Canada, pp 3–10

  19. Boger J, Poupart P, Hoey J, Boutilier C, Fernie G, Mihailidis A (2005) A decision-theoretic approach to task assistance for persons with dementia. In: Proceedings of the international joint conference on artificial intelligence (IJCAI’05), Edinburgh, Scotland, pp 1293–1299

  20. Fatiha L, Lefebvre B (2005) A cognitive system for a smart home dedicated to people in loss of autonomy. In: Proceedings of the 3rd international conference on smart homes and health telematic, ICOST’05, Sherbrooke, Canada, pp 245–254

  21. Pigot H, Mayers A, Giroux S (2003) The intelligent habitat and everyday life activity support. In: Proceedings of the 5th international conference on simulations in biomedicine, April 2–4, Slovenia, pp 507–516

  22. Wahlster W, Baus J, Kray C, Krüger A (2001) A resource-adaptive mobile navigation system. In: Proceedings of the international workshop on information presentation and natural multimodal dialogue (IPNMD-2001). Verona, Italy, pp 5–9

    Google Scholar 

  23. Baus J, Kray C, Krüger A (2001) Visualization of route descriptions in a resource-adaptive navigation aid. Cogn Process 2(2/3):323–345

    Google Scholar 

  24. Raubal M (2001) Human wayfinding in unfamiliar buildings: a simulation with a cognizing agent. Cogn Process 2(2/3):363–388

    Google Scholar 

  25. Nothegger C, Winter S, Raubal M (2004) Selection of salient features for route directions. Spat Cogn Comput 4(2):113–136

    Article  Google Scholar 

  26. Kray C (2002) Situational context and navigational assistance. In: Proceedings spatial cognition 2002, Tutzing, Starnberger, Germany

  27. Baus J et al (2007) Auditory perceptible landmarks in mobile navigation. In: Proceedings of the 12th international conference on intelligent user interfaces. Honolulu, Hawaii, USA, pp 302–304

    Google Scholar 

  28. Goodman J, Brewster SA, Gray P (2005) How can we best use landmarks to support older people in navigation? Behav Inf Technol 24(1):3–20

    Article  Google Scholar 

  29. Liao L, Fox D, Kautz H (2007) Learning and inferring transportation routines. Artif Intell 171(5–6):311–331

    Article  MATH  MathSciNet  Google Scholar 

  30. Liu L, Hile H, Kautz H, Borriello G, Brown PA, Harniss M, Johnson K (2006) Indoor wayfinding: developing a functional interface for individuals with cognitive impairments, In: Proceedings of computers & accessibility, ASSETS 2006, October, pp 95–102

  31. Van Laarhoven T, Van Laarhoven-Myers T (2006) Comparison of three video-based instructional procedures for teaching daily living skills to persons with developmental disabilities. Educ Train Dev Disabil 41(4):365–381

    Google Scholar 

  32. Cannella-Malone H, Sigafoos J, O’Reilly M, de la Cruz B, Lancioni GE (2006) Comparing video prompting to video modeling for teaching daily living skills to six adults with developmental disabilities. Educ Train Dev Disabil 41(4):344–356

    Google Scholar 

  33. Cihaka DF, Kesslerb KB, Alberto PA (2007) Generalized use of a handheld prompting system. Res Dev Disabil 28(4):397–408

    Article  Google Scholar 

  34. Cihak DF, Kelby K, Alberto PA (2008) Use of a handheld prompting system to transition independently through vocational tasks for student with moderate and severe intellectual disabilities. Educ Train Dev Disabil 43(1):102–110

    Google Scholar 

  35. Liu A, Hile H, Kautz H, Borriello G, Brown PA, Harniss M, Johnson K (2007) Indoor wayfinding: developing a functional interface for individuals with cognitive impairments. Disability and Rehabilitation: Assistive Technology 3(1):69–81

    Article  Google Scholar 

  36. Gentry T, Wallace J, Kvarfordt C, Lynch KB (2007) Personal digital assistants as cognitive aids for individuals with severe traumatic brain injury: a community-based trial. Brain Injury, December, pp 19–24

    Google Scholar 

  37. Ross DA, Henderson VL (2005) Cyber crumbs: an indoor orientation and wayfinding infrastructure. In: Proceedings of the 28th RESNA conference, June

  38. Cook AM, Polgar JM, Hussey SM (2008) Assistive technology principles and practice, 3rd edn. Mosby, Elsevier

    Google Scholar 

  39. Liu H, Darabi H, Banerjee P, Liu J (2007) Survey of wireless indoor positioning techniques and systems. IEEE Trans Syst Man Cybern C 37(6):1067–1080

    Article  Google Scholar 

  40. Gu Y, Lo A, Niemegeers I (2009) A survey of indoor positioning systems for wireless personal networks. IEEE Commun Surv Tutor 11(1):13–32

    Article  Google Scholar 

  41. Hazas M, Hopper A (2006) Broadband ultrasonic location systems for improved indoor positioning. IEEE Trans Mobile Comput 5(5):536–547

    Article  Google Scholar 

  42. Ni LM, Liu Y, Lau YC, Patil AP (2004) LANDMARC: indoor location sensing using active RFID. Wirel Netw 10(6):701–710

    Article  Google Scholar 

  43. Golledge R (1999) Wayfinding behavior: cognitive mapping and other spatial processes. John Hopkins University Press, Cambridge, MA

    Google Scholar 

  44. Sutcliffe A, Fickas S, Sohlberg M, Ehlhardt L (2003) Investigating the usability of assistive user interfaces. Interact Comput 15(4):577–602

    Article  Google Scholar 

  45. LoPresti EF, Mihailidis A, Kirsch N (2004) Assistive technology for cognitive rehabilitation: state of the art. Neuropsychol Rehabil 14(1/2):5–39

    Article  Google Scholar 

  46. O’Connell MI, Mateer CA, Kerns KA (2003) Prosthetic systems for addressing problems with initiation: guidelines for selection, training & measuring efficacy. NeuroRehabilitation 18(1):9–20

    Google Scholar 

  47. Sohlberg MM, Ehlhardt LA, Fickas S, Sutcliffe A (2003) A pilot study exploring electronic mail in users with acquired cognitive-linguistic impairments. Brain Inj 17(7):609–629

    Article  Google Scholar 

  48. Dijkstra E (1959) A note on two problems in connexion with graphs. Numer Math 1:269–271

    Article  MATH  MathSciNet  Google Scholar 

  49. Cannella H, O’Reilly M, Lancioni G (2005) Choice and preference assessment research with people with severe to profound developmental disabilities: a review of the literature. Res Dev Disabil 26(1):1–15

    Article  Google Scholar 

  50. Bluetooth SIG. Bluetooth specification v2.0, 2004

Download references

Acknowledgments

The work presented in this paper has been funded by the National Science Council under grant numbers NSC 95-2627-E-008-002-, NSC 96-2627-E-008-001-, and NSC 97-2627-E-008-001-. Thanks for all the participating job coaches who have served the mentally impaired heartily and truthfully. Thanks for all the participating individuals with cognitive impairments, who have shown us deeper values of life. We thank the anonymous reviewers for their comments and suggestions which greatly improve the presentation of the paper. We also would like to extend our special thanks to a reviewer who suggests the idea of adaptive video framerate in the future work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yao-Jen Chang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chang, YJ., Wang, TY. Comparing picture and video prompting in autonomous indoor wayfinding for individuals with cognitive impairments. Pers Ubiquit Comput 14, 737–747 (2010). https://doi.org/10.1007/s00779-010-0285-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-010-0285-9

Keywords

Navigation