Skip to main content
Top

Hint

Swipe to navigate through the chapters of this book

2021 | OriginalPaper | Chapter

Playful Screening of Executive Functions Using Augmented Reality and Gaze Based Assessment

Authors : Martin Pszeida, Amir Dini, Sandra Schüssler, Claudia Voithofer, Jean-Philippe Andreu, Philipp Hafner, Lucas Paletta

Published in: Advances in Neuroergonomics and Cognitive Engineering

Publisher: Springer International Publishing

share
SHARE

Abstract

Augmented Reality (AR) technologies have recently been explored for application in dementia care, including cognitive training and screening, navigational assistance to find their way around, assistance to identify friends and family members, and assistance with activities of daily living. The presented work proposes the use of mobile and playful assessment of executive functions in the home environment by AR technology. We implemented a gamified version of the neuropsychological test ‘Tower of London’ (Shallice, 1982 [1]). It is played with poles of various size and colored balls, starting each exercise with a certain start and desired goal configuration of balls on poles. The novel AR-based technology enables hand-based interaction with artificial objects in the field of view and monitoring of the user’s gaze behavior via eye tracking towards the artificial objects of interest. A pilot study was performed with 12 healthy people that played the game with various degrees of difficulty concerning its planning depth. The results of the study demonstrate statistically significant correlation between the eye tracking features and the planning ability as well as cognitive flexibility measured by standardized psychological tests. This study provides first indication that executive functions can be estimated from playful AR-based interaction. Future work will focus on adjusting the game for persons with dementia, such as, by decreasing the difficulty level appropriately.
Literature
1.
go back to reference Shallice, T.: Specific impairments of planning. Philos. Trans. R. Soc. B 298, 199–209 (1982) Shallice, T.: Specific impairments of planning. Philos. Trans. R. Soc. B 298, 199–209 (1982)
2.
go back to reference Ngandu, T., Lehtisalo, J., Solomon, A., et al.: A 2 year multidomain intervention of diet, exercise, cognitive training, and vascular risk monitoring versus control to prevent cognitive decline in at-risk elderly people (FINGER): a randomised controlled trial. Lancet 385(9984), 2255–2263 (2015) CrossRef Ngandu, T., Lehtisalo, J., Solomon, A., et al.: A 2 year multidomain intervention of diet, exercise, cognitive training, and vascular risk monitoring versus control to prevent cognitive decline in at-risk elderly people (FINGER): a randomised controlled trial. Lancet 385(9984), 2255–2263 (2015) CrossRef
3.
go back to reference Diamond, A.: Executive functions. Annu. Rev. Psychol. 64, 135–168 (2013) CrossRef Diamond, A.: Executive functions. Annu. Rev. Psychol. 64, 135–168 (2013) CrossRef
4.
go back to reference Boyle, P.A., Cahn-Weiner, D.: Assessment and prediction of functional impairment in vascular dementia. Expert Rev. Neurother. 4, 109–114 (2005) CrossRef Boyle, P.A., Cahn-Weiner, D.: Assessment and prediction of functional impairment in vascular dementia. Expert Rev. Neurother. 4, 109–114 (2005) CrossRef
5.
go back to reference McKhann, G.M., et al.: The diagnosis of dementia due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dementia 7, 263–269 (2011) CrossRef McKhann, G.M., et al.: The diagnosis of dementia due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dementia 7, 263–269 (2011) CrossRef
6.
go back to reference Zanwar, P., Heyn, P., McGrew, G., Raji, M.: Assistive technology megatrends to support persons with Alzheimer’s disease and related dementias age in habitat: challenges for usability, engineering and public policy. In: H3 2018 (2018) Zanwar, P., Heyn, P., McGrew, G., Raji, M.: Assistive technology megatrends to support persons with Alzheimer’s disease and related dementias age in habitat: challenges for usability, engineering and public policy. In: H3 2018 (2018)
7.
go back to reference Bolestsis, C., McCallum, S.: Augmented reality cubes for cognitive gaming: preliminary usability and game experience testing. Int. J. Serious Games 3(1), 3–18 (2016) Bolestsis, C., McCallum, S.: Augmented reality cubes for cognitive gaming: preliminary usability and game experience testing. Int. J. Serious Games 3(1), 3–18 (2016)
9.
go back to reference Rainville, C., Amieva, H., Lafont, S., Dartigues, J.-F., Orgogozo, J.-M., Fabrigoule, C.: Executive function deficits in patients with dementia of the Alzheimer’s type a study with a Tower of London task. Arch. Clin. Neuropsychol. 17(2002), 513–530 (2002) CrossRef Rainville, C., Amieva, H., Lafont, S., Dartigues, J.-F., Orgogozo, J.-M., Fabrigoule, C.: Executive function deficits in patients with dementia of the Alzheimer’s type a study with a Tower of London task. Arch. Clin. Neuropsychol. 17(2002), 513–530 (2002) CrossRef
10.
go back to reference Oyama, A., et al.: Novel methods for rapid assessment of cognitive impairment using high-performance eye-tracking technology. Nat. Sci. Rep. 9, 12932 (2019) CrossRef Oyama, A., et al.: Novel methods for rapid assessment of cognitive impairment using high-performance eye-tracking technology. Nat. Sci. Rep. 9, 12932 (2019) CrossRef
11.
go back to reference Paletta, L., et al.: MIRA – a gaze-based serious game for continuous estimation of Alzheimer’s mental state. In: Proceedings of Eye Tracking Research & Applications. ACM Press (2020) Paletta, L., et al.: MIRA – a gaze-based serious game for continuous estimation of Alzheimer’s mental state. In: Proceedings of Eye Tracking Research & Applications. ACM Press (2020)
12.
go back to reference WHO Guidelines. Risk reduction of cognitive decline and dementia (2019) WHO Guidelines. Risk reduction of cognitive decline and dementia (2019)
13.
go back to reference Schaber, P., Lieberman, D.: Occupational Therapy Practice Guidelines for Adults with Alzheimer’s Disease and Related Disorders. AOTA Press, Bethesda (2010) Schaber, P., Lieberman, D.: Occupational Therapy Practice Guidelines for Adults with Alzheimer’s Disease and Related Disorders. AOTA Press, Bethesda (2010)
14.
go back to reference Guarino, A., et al.: Executive functions in alzheimer disease: a systematic review. Front. Aging Neurosci. 10, 437 (2019) CrossRef Guarino, A., et al.: Executive functions in alzheimer disease: a systematic review. Front. Aging Neurosci. 10, 437 (2019) CrossRef
15.
go back to reference Tarnanas, I., et al.: Five-year biomarker progression variability for Alzheimer’s disease dementia prediction: can a complex instrumental activities of daily living marker fill in the gaps? Alzheimer’s Dement. Diagn. Assess. Dis. Monit. 1(4), 521–532 (2015) Tarnanas, I., et al.: Five-year biomarker progression variability for Alzheimer’s disease dementia prediction: can a complex instrumental activities of daily living marker fill in the gaps? Alzheimer’s Dement. Diagn. Assess. Dis. Monit. 1(4), 521–532 (2015)
16.
go back to reference Kennedy, R.S., Lane, N.E., Berbaum, K.S., Lilienthal, M.G.: Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. Int. J. Aviat. Psychol. 3(3), 203–220 (1993) CrossRef Kennedy, R.S., Lane, N.E., Berbaum, K.S., Lilienthal, M.G.: Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. Int. J. Aviat. Psychol. 3(3), 203–220 (1993) CrossRef
17.
go back to reference Betella, A., Verschure, P.F.: The affective slider: a digital self-assessment scale for the measurement of human emotions. PLoS ONE 11(2), e0148037 (2016) Betella, A., Verschure, P.F.: The affective slider: a digital self-assessment scale for the measurement of human emotions. PLoS ONE 11(2), e0148037 (2016)
18.
go back to reference Brooke, J.: SUS: a “quick and dirty” usability scale. In: Jordan, P.W., Thomas, B., Weerdmeester, B.A., McClelland, A.L. (Hrsg.) Usability Evaluation in Industry (1996) Brooke, J.: SUS: a “quick and dirty” usability scale. In: Jordan, P.W., Thomas, B., Weerdmeester, B.A., McClelland, A.L. (Hrsg.) Usability Evaluation in Industry (1996)
19.
go back to reference Reitan, R.M.: The relation of the trail making test to organic brain damage. J. Consulting Psychol. (1955) Reitan, R.M.: The relation of the trail making test to organic brain damage. J. Consulting Psychol. (1955)
20.
go back to reference Kaller, C.P., et al.: Manual Tower of London – Freiburger Version, Mödling (2011) Kaller, C.P., et al.: Manual Tower of London – Freiburger Version, Mödling (2011)
21.
go back to reference Schüssler, S.: Care dependency and nursing care problems in nursing home residents with and without dementia. Medical University of Graz, Institute of Nursing Science, Austria (2015) Schüssler, S.: Care dependency and nursing care problems in nursing home residents with and without dementia. Medical University of Graz, Institute of Nursing Science, Austria (2015)
Metadata
Title
Playful Screening of Executive Functions Using Augmented Reality and Gaze Based Assessment
Authors
Martin Pszeida
Amir Dini
Sandra Schüssler
Claudia Voithofer
Jean-Philippe Andreu
Philipp Hafner
Lucas Paletta
Copyright Year
2021
DOI
https://doi.org/10.1007/978-3-030-80285-1_49