Augmented Reality Integrated Brain Computer Interface for Smart Home Control

Brain computer interface (BCI) technology is an alternate communication option for individuals with neuromuscular impairments. There are several challenges to optimal BCI use including positioning of the screen, ease of use, independence in access, and calibration. Our study is directed at the development of a practical, accessible, at-home use BCI system that addresses these obstacles. Our design utilizes an augmented reality (AR) head-mounted display as a solution to provide BCI stimuli and output. We used a battery-operated Bluetooth-connected 8-channel portable EEG system and a custom P300 selection matrix displaying icons corresponding to various home control actions. Finally, the BCI system is integrated with a built-in smart assistant (Google Assistant) which allows the user to control their environment. In this paper, we describe the engineering of this home-use BCI system designed specifically for people with Amyotrophic Lateral Sclerosis, a neuromuscular disease causing severe motor deficits and loss of mobility.