Skip to main content
Erschienen in: Health and Technology 2/2019

10.09.2018 | Original Paper

The PERSON project: a serious brain-computer interface game for treatment in cognitive impairment

verfasst von: Alfonso Monaco, Gianluca Sforza, Nicola Amoroso, Marica Antonacci, Roberto Bellotti, Marina de Tommaso, Pierpaolo Di Bitonto, Eugenio Di Sciascio, Domenico Diacono, Eleonora Gentile, Anna Montemurno, Michele Ruta, Antonio Ulloa, Sabina Tangaro

Erschienen in: Health and Technology | Ausgabe 2/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The cognitive and computational neurosciences have developed neurorehabilitative tools able to treat suffering subjects from early symptoms, in order to give priority to a home environment. In this way, the curative treatment would not burden the hospital with excessive costs and the patient with psychological disorientation. Recent studies have shown the efficacy of video games on improving cognitive processes impaired by ageing’s physiological effect, neurodegenerative or other diseases, with potential beneficial effects. The PERvasive game for perSOnalized treatment of cognitive and functional deficits associated with chronic and Neurodegenerative diseases (PERSON) project proposed new tools for cognitive rehabilitation, aiming to improve the quality of life for patients with cognitive impairments, especially at early stages, by the use of sophisticated, non-invasive technology. This article is an overview of game solutions for training cognitive abilities and it presents the tools developed within the PERSON project. These tools are serious games based on virtual reality, connected to a brain-computer interface based on electroencephalography (EEG) and to haptic devices. The project was born thanks to a strategic synergy between research and public health, to implement a technology for personalized medicine that relies on the cloud infrastructure of the REte di CAlcolo per SuperB ed altre applicazioni (ReCaS)-Bari data centre. PERSON developed a completely open source and innovative framework to interface the game device with the computational resources in the cloud. We exploited the container technology and the Software as a Service (SaaS) paradigm to implement a genetic algorithm that analyses the neural responses in EEG recordings. The paper focuses on technical aspects of the designed tools. A test was conducted on a few volunteers for the purpose of tuning the overall system. The paper does not contain results of a clinical trial as this is planned in a second testing phase, when the user’s perception of the system will also be tested.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Rose FD, Brooks BM, Rizzo AA. Virtual reality in brain damage rehabilitation: review. CyberPsychology & Behavior 2005;8(3):241.CrossRef Rose FD, Brooks BM, Rizzo AA. Virtual reality in brain damage rehabilitation: review. CyberPsychology & Behavior 2005;8(3):241.CrossRef
2.
Zurück zum Zitat Brettschneider J, Tredici KD, Lee VM, Trojanowski JQ. Spreading of pathology in neurodegenerative diseases: a focus on human studies. Nat Rev Neurol 2015;16(2):109.CrossRef Brettschneider J, Tredici KD, Lee VM, Trojanowski JQ. Spreading of pathology in neurodegenerative diseases: a focus on human studies. Nat Rev Neurol 2015;16(2):109.CrossRef
3.
Zurück zum Zitat Prince M, Comas-Herrera A, Knapp M, Guerchet M, Karagiannidou M. 2016. World Alzheimer report 2016: improving healthcare for people living with dementia: coverage quality and costs now and in the future (Alzheimer’s Disease International). Prince M, Comas-Herrera A, Knapp M, Guerchet M, Karagiannidou M. 2016. World Alzheimer report 2016: improving healthcare for people living with dementia: coverage quality and costs now and in the future (Alzheimer’s Disease International).
4.
Zurück zum Zitat Amoroso N, Errico R, Bruno S, Chincarini A, Garuccio E, Sensi F, Tangaro S, Tateo A, Bellotti R. For the Alzheimer’s disease neuroimaging initiative. Phys Med Biol 2015;60(22):8851.CrossRef Amoroso N, Errico R, Bruno S, Chincarini A, Garuccio E, Sensi F, Tangaro S, Tateo A, Bellotti R. For the Alzheimer’s disease neuroimaging initiative. Phys Med Biol 2015;60(22):8851.CrossRef
6.
Zurück zum Zitat Serino S, Pedroli E. Technology and cognitive empowerment for healthy elderly: the link between cognitive skills acquisition and well-being. Integrating technology in positive psychology practice (IGI Global); 2016. p. 193–213. Serino S, Pedroli E. Technology and cognitive empowerment for healthy elderly: the link between cognitive skills acquisition and well-being. Integrating technology in positive psychology practice (IGI Global); 2016. p. 193–213.
7.
Zurück zum Zitat Wattanasoontorn V, Hernández RJG, Sbert M. Serious games for e-health care. Simulations serious games and their applications. Berlin: Springer; 2014. p. 127–146. Wattanasoontorn V, Hernández RJG, Sbert M. Serious games for e-health care. Simulations serious games and their applications. Berlin: Springer; 2014. p. 127–146.
8.
Zurück zum Zitat McCallum S. Gamification and serious games for personalized health. Proceedings of the international conference on wearable micro and nano technologies for personalized health; 2012. p. 85–96. McCallum S. Gamification and serious games for personalized health. Proceedings of the international conference on wearable micro and nano technologies for personalized health; 2012. p. 85–96.
9.
Zurück zum Zitat Bowes J, Brown A, Hamon J, Jarolimek W, Sridhar A, Waldron G, Whitebread S. Reducing safety-related drug attrition: the use of in vitro pharmacological profiling. Nat Rev Drug Discov 2012;11(12): 909.CrossRef Bowes J, Brown A, Hamon J, Jarolimek W, Sridhar A, Waldron G, Whitebread S. Reducing safety-related drug attrition: the use of in vitro pharmacological profiling. Nat Rev Drug Discov 2012;11(12): 909.CrossRef
10.
Zurück zum Zitat Luck SJ. An Introduction to the Event-Related Potential Technique. Cambridge: MIT Press; 2005. Luck SJ. An Introduction to the Event-Related Potential Technique. Cambridge: MIT Press; 2005.
11.
Zurück zum Zitat Polich J, Margala C. P300 and probability: comparison of oddball and single-stimulus paradigms. Int J Psychophysiol 1997;25(2):169.CrossRef Polich J, Margala C. P300 and probability: comparison of oddball and single-stimulus paradigms. Int J Psychophysiol 1997;25(2):169.CrossRef
12.
Zurück zum Zitat Howard MC. A meta-analysis and systematic literature review of virtual reality rehabilitation programs. Comput Hum Behav 2017;70:317.CrossRef Howard MC. A meta-analysis and systematic literature review of virtual reality rehabilitation programs. Comput Hum Behav 2017;70:317.CrossRef
13.
Zurück zum Zitat Burdea G. Virtual rehabilitation-benefits and challenges. Methods Inf Med 2003;42(5):519.CrossRef Burdea G. Virtual rehabilitation-benefits and challenges. Methods Inf Med 2003;42(5):519.CrossRef
14.
Zurück zum Zitat Romero LE, Chatterjee P, Armentano RL. An IoT approach for integration of computational intelligence and wearable sensors for Parkinson’s disease diagnosis and monitoring. Heal Technol 2016;6(3):167.CrossRef Romero LE, Chatterjee P, Armentano RL. An IoT approach for integration of computational intelligence and wearable sensors for Parkinson’s disease diagnosis and monitoring. Heal Technol 2016;6(3):167.CrossRef
15.
Zurück zum Zitat Lavalle SM. Virtual reality. Cambridge: Cambridge University Press; 2017. Lavalle SM. Virtual reality. Cambridge: Cambridge University Press; 2017.
16.
Zurück zum Zitat Lee TS, Goh SJA, Quek SY, Phillips R, Guan C, Cheung YB, Feng L, Teng SSW, Wang CC, Chin ZY, Zhang H, Ng TP, Lee J, Keefe R, Krishnan KRR. A brain-computer interface based cognitive training system for healthy elderly: a randomized control pilot study for usability and preliminary efficacy. PLoS One 2013;8:1. Lee TS, Goh SJA, Quek SY, Phillips R, Guan C, Cheung YB, Feng L, Teng SSW, Wang CC, Chin ZY, Zhang H, Ng TP, Lee J, Keefe R, Krishnan KRR. A brain-computer interface based cognitive training system for healthy elderly: a randomized control pilot study for usability and preliminary efficacy. PLoS One 2013;8:1.
17.
Zurück zum Zitat Guy V, Soriani MH, Bruno M, Papadopoulo T, Desnuelle C, Clerc M. Brain computer interface with the P300 speller: usability for disabled people with amyotrophic lateral sclerosis. Ann Phys Rehabil Med 2018; 61(1):5.CrossRef Guy V, Soriani MH, Bruno M, Papadopoulo T, Desnuelle C, Clerc M. Brain computer interface with the P300 speller: usability for disabled people with amyotrophic lateral sclerosis. Ann Phys Rehabil Med 2018; 61(1):5.CrossRef
18.
Zurück zum Zitat Garcia-Betances RI, Jimenez-Mixco V, Arredondo MT, Cabrera-Umpierrez MF. Using virtual reality for cognitive training of the elderly. Am J Alzheimers Dis Other Demen 2015;30 (1):49.CrossRef Garcia-Betances RI, Jimenez-Mixco V, Arredondo MT, Cabrera-Umpierrez MF. Using virtual reality for cognitive training of the elderly. Am J Alzheimers Dis Other Demen 2015;30 (1):49.CrossRef
19.
Zurück zum Zitat Lin CX, Lee C, Lally D, Coughlin JF. Impact of virtual reality (VR) experience on older adults’ well-being. Proceedings of the international conference on human aspects of IT for the aged population; 2018. p. 89–100. Lin CX, Lee C, Lally D, Coughlin JF. Impact of virtual reality (VR) experience on older adults’ well-being. Proceedings of the international conference on human aspects of IT for the aged population; 2018. p. 89–100.
20.
Zurück zum Zitat Yoon HU, Anil Kumar N, Hur P. Synergistic effects on the elderly people’s motor control by wearable skin-stretch device combined with haptic joystick. Frontiers in Neurorobotics 2017;11:31.CrossRef Yoon HU, Anil Kumar N, Hur P. Synergistic effects on the elderly people’s motor control by wearable skin-stretch device combined with haptic joystick. Frontiers in Neurorobotics 2017;11:31.CrossRef
21.
Zurück zum Zitat Che Me R, Biamonti A, Mohd Saad MR. Conceptual design of haptic-feedback navigation device for individuals with Alzheimer’s disease. Proceedings of the European Conference on the Advancement of Assistive Technology; 2015. p. 195–203. Che Me R, Biamonti A, Mohd Saad MR. Conceptual design of haptic-feedback navigation device for individuals with Alzheimer’s disease. Proceedings of the European Conference on the Advancement of Assistive Technology; 2015. p. 195–203.
22.
Zurück zum Zitat Pfurtscheller G, Müller-Putz GR, Scherer R, Neuper C. Rehabilitation with braincomputer interface systems. Computer 2008;41(10):58.CrossRef Pfurtscheller G, Müller-Putz GR, Scherer R, Neuper C. Rehabilitation with braincomputer interface systems. Computer 2008;41(10):58.CrossRef
23.
Zurück zum Zitat Lotte F, Larrue F, Mühl C. Flaws in current human training protocols for spontaneous brain-computer interfaces: lessons learned from instructional design. Front Hum Neurosci 2013;7:568.CrossRef Lotte F, Larrue F, Mühl C. Flaws in current human training protocols for spontaneous brain-computer interfaces: lessons learned from instructional design. Front Hum Neurosci 2013;7:568.CrossRef
24.
Zurück zum Zitat Lécuyer A., Lotte F, Reilly RB, Leeb R, Hirose M, Slater M. Brain-computer interfaces, virtual reality, and videogames. Computer 2008;41(10):66.CrossRef Lécuyer A., Lotte F, Reilly RB, Leeb R, Hirose M, Slater M. Brain-computer interfaces, virtual reality, and videogames. Computer 2008;41(10):66.CrossRef
25.
Zurück zum Zitat Burdea G, Polistico K, Krishnamoorthy A, House G, Rethage D, Hundal J, Damiani F, Pollack S. Feasibility study of the BrightBrainer integrative cognitive rehabilitation system for elderly with dementia. Disabil Rehabil Assist Technol 2015;10(5):421.CrossRef Burdea G, Polistico K, Krishnamoorthy A, House G, Rethage D, Hundal J, Damiani F, Pollack S. Feasibility study of the BrightBrainer integrative cognitive rehabilitation system for elderly with dementia. Disabil Rehabil Assist Technol 2015;10(5):421.CrossRef
26.
Zurück zum Zitat Zyda M. From visual simulation to virtual reality to games. Computer 2005;38(9):25.CrossRef Zyda M. From visual simulation to virtual reality to games. Computer 2005;38(9):25.CrossRef
27.
Zurück zum Zitat Burdea GC, Polistico K. A review of integrative virtual reality games for rehabilitation. Proceedings of the E-Health and Bioengineering Conference; 2017. p. 733–736. Burdea GC, Polistico K. A review of integrative virtual reality games for rehabilitation. Proceedings of the E-Health and Bioengineering Conference; 2017. p. 733–736.
28.
Zurück zum Zitat Burdea GC, Polistico K, House GP, Liu RR, Muniz R, Macaro NA, Slater LM. Novel integrative virtual rehabilitation reduces symptomatology of primary progressive aphasia - a case report. Int J Neurosci 2015;125(12):949.CrossRef Burdea GC, Polistico K, House GP, Liu RR, Muniz R, Macaro NA, Slater LM. Novel integrative virtual rehabilitation reduces symptomatology of primary progressive aphasia - a case report. Int J Neurosci 2015;125(12):949.CrossRef
29.
Zurück zum Zitat Sánchez J, Lumbreras M. Usability and cognitive impact of the interaction with 3D virtual interactive acoustic environments by blind children. Proceedings of the international conference on disability, virtual reality and associated technologies; 2000. p. 67–73. Sánchez J, Lumbreras M. Usability and cognitive impact of the interaction with 3D virtual interactive acoustic environments by blind children. Proceedings of the international conference on disability, virtual reality and associated technologies; 2000. p. 67–73.
30.
Zurück zum Zitat Jiang L, Guan C, Zhang H, Wang C, Jiang B. Brain computer interface based 3D game for attention training and rehabilitation. Proceedings of the IEEE conference on industrial electronics and applications; 2011. p. 124–127. Jiang L, Guan C, Zhang H, Wang C, Jiang B. Brain computer interface based 3D game for attention training and rehabilitation. Proceedings of the IEEE conference on industrial electronics and applications; 2011. p. 124–127.
31.
Zurück zum Zitat Strauss E, Sherman EM, Spreen O. 2006. A compendium of neuropsychological tests: administration, norms and commentary (American Chemical Society). Strauss E, Sherman EM, Spreen O. 2006. A compendium of neuropsychological tests: administration, norms and commentary (American Chemical Society).
32.
Zurück zum Zitat Unsworth N, Heitz RP, Schrock JC, Engle RW. An automated version of the operation span task. Behav Res Methods 2005;37(3):498.CrossRef Unsworth N, Heitz RP, Schrock JC, Engle RW. An automated version of the operation span task. Behav Res Methods 2005;37(3):498.CrossRef
33.
Zurück zum Zitat Robert P, Konig A, Amieva H, Andrieu S, Bremond F, Bullock R, Ceccaldi M, Dubois B, Gauthier S, Kenigsberg PA, Nave S, Orgogozo JM, Piano J, Benoit M, Touchon J, Vellas B, Yesavage J, Manera V. Recommendations for the use of serious games in people with Alzheimer’s disease, related disorders and frailty. Front Aging Neurosci 2014;6:54.CrossRef Robert P, Konig A, Amieva H, Andrieu S, Bremond F, Bullock R, Ceccaldi M, Dubois B, Gauthier S, Kenigsberg PA, Nave S, Orgogozo JM, Piano J, Benoit M, Touchon J, Vellas B, Yesavage J, Manera V. Recommendations for the use of serious games in people with Alzheimer’s disease, related disorders and frailty. Front Aging Neurosci 2014;6:54.CrossRef
34.
Zurück zum Zitat Ouellet E, Boller B, Corriveau-Lecavalier N, Cloutier S, Belleville S. The virtual shop: a new immersive virtual reality environment and scenario for the assessment of everyday memory. J Neurosci Methods 2018; 303:126.CrossRef Ouellet E, Boller B, Corriveau-Lecavalier N, Cloutier S, Belleville S. The virtual shop: a new immersive virtual reality environment and scenario for the assessment of everyday memory. J Neurosci Methods 2018; 303:126.CrossRef
35.
Zurück zum Zitat Invitto S, Faggiano C, Sammarco S, De Luca V, De Paolis LT. Haptic, virtual interaction and motor imagery: entertainment tools and psychophysiological testing. Sensors 2016;16(3):394.CrossRef Invitto S, Faggiano C, Sammarco S, De Luca V, De Paolis LT. Haptic, virtual interaction and motor imagery: entertainment tools and psychophysiological testing. Sensors 2016;16(3):394.CrossRef
36.
Zurück zum Zitat Ortner R, Allison BZ, Korisek G, Gaggl H, Pfurtscheller G. An SSVEP BCI to control a hand orthosis for persons with tetraplegia. IEEE Trans Neural Syst Rehabil Eng 2011;19(1):1.CrossRef Ortner R, Allison BZ, Korisek G, Gaggl H, Pfurtscheller G. An SSVEP BCI to control a hand orthosis for persons with tetraplegia. IEEE Trans Neural Syst Rehabil Eng 2011;19(1):1.CrossRef
37.
Zurück zum Zitat Wang Z, Ji Q, Miller K, Schalk G. Prior knowledge improves decoding of finger flexion from electrocorticographic signals. Front Neurosci 2011;5:127.CrossRef Wang Z, Ji Q, Miller K, Schalk G. Prior knowledge improves decoding of finger flexion from electrocorticographic signals. Front Neurosci 2011;5:127.CrossRef
38.
Zurück zum Zitat Jones HE. Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. Am J Psychol 1935;47(2):241.CrossRef Jones HE. Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. Am J Psychol 1935;47(2):241.CrossRef
39.
Zurück zum Zitat Kutas M, McCarthy G, Donchin E. Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. Science 1977;197(4305):792.CrossRef Kutas M, McCarthy G, Donchin E. Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. Science 1977;197(4305):792.CrossRef
40.
Zurück zum Zitat Da Pelo P, De Tommaso M, Monaco A, Stramaglia S, Bellotti R, Tangaro S. Trial latencies estimation of event-related potentials in EEG by means of genetic algorithms. J Neural Eng 2018;15:026016. 2.CrossRef Da Pelo P, De Tommaso M, Monaco A, Stramaglia S, Bellotti R, Tangaro S. Trial latencies estimation of event-related potentials in EEG by means of genetic algorithms. J Neural Eng 2018;15:026016. 2.CrossRef
41.
Zurück zum Zitat Beasley D, Bull DR, Martin RR. An overview of genetic algorithms: Part 2, research topics. University computing 1993;15(4):170. Beasley D, Bull DR, Martin RR. An overview of genetic algorithms: Part 2, research topics. University computing 1993;15(4):170.
42.
Zurück zum Zitat De Venuto D, Annese VF, Ruta M, Di Sciascio E. A. Sangiovanni Vincentelli. IEEE Design & Test 2015;33(3):66.CrossRef De Venuto D, Annese VF, Ruta M, Di Sciascio E. A. Sangiovanni Vincentelli. IEEE Design & Test 2015;33(3):66.CrossRef
43.
Zurück zum Zitat De Venuto D, Annese VF, Mezzina G, Ruta M, Di Sciascio E. Brain-computer interface using p300: a gaming approach for neurocognitive impairment diagnosis. Proceedings of the IEEE international high level design validation and test workshop; 2016. p. 93–99. De Venuto D, Annese VF, Mezzina G, Ruta M, Di Sciascio E. Brain-computer interface using p300: a gaming approach for neurocognitive impairment diagnosis. Proceedings of the IEEE international high level design validation and test workshop; 2016. p. 93–99.
44.
Zurück zum Zitat Buyya R, Broberg J, Goscinski AM. Cloud computing: principles and paradigms. New York: Wiley; 2010. Buyya R, Broberg J, Goscinski AM. Cloud computing: principles and paradigms. New York: Wiley; 2010.
45.
Zurück zum Zitat Salomoni D, Campos Plasencia I, Gaido L, Donvito G, Antonacci M, Fuhrmann P, Marco J, Lopez-Garcia A, Orviz Fernandez P, Blanquer I, Caballer M, Molto G, Plociennik M, Owsiak M, Urbaniak M, Hardt M, Ceccanti A, Wegh B, Gomes J, Rocha R. 2016. INDIGO-Datacloud: foundations and architectural description of a Platform as a Service oriented to scientific computing, arXiv:1603.09536. Salomoni D, Campos Plasencia I, Gaido L, Donvito G, Antonacci M, Fuhrmann P, Marco J, Lopez-Garcia A, Orviz Fernandez P, Blanquer I, Caballer M, Molto G, Plociennik M, Owsiak M, Urbaniak M, Hardt M, Ceccanti A, Wegh B, Gomes J, Rocha R. 2016. INDIGO-Datacloud: foundations and architectural description of a Platform as a Service oriented to scientific computing, arXiv:1603.​09536.
Metadaten
Titel
The PERSON project: a serious brain-computer interface game for treatment in cognitive impairment
verfasst von
Alfonso Monaco
Gianluca Sforza
Nicola Amoroso
Marica Antonacci
Roberto Bellotti
Marina de Tommaso
Pierpaolo Di Bitonto
Eugenio Di Sciascio
Domenico Diacono
Eleonora Gentile
Anna Montemurno
Michele Ruta
Antonio Ulloa
Sabina Tangaro
Publikationsdatum
10.09.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
Health and Technology / Ausgabe 2/2019
Print ISSN: 2190-7188
Elektronische ISSN: 2190-7196
DOI
https://doi.org/10.1007/s12553-018-0258-y

Weitere Artikel der Ausgabe 2/2019

Health and Technology 2/2019 Zur Ausgabe