TACTILE – A Novel Mixed Reality System for Training and Social Interaction

Elderly people are frequently affected by a decline of mental and physical abilities, which results in anxiety, frailty and reclusiveness. Often, they live alone, spatially separated from their families or friends, unable to meet them on a regular basis. The TACTILE project addresses these challenges and fosters an active lifestyle and well-being of older adults via an enjoyable, innovative, and user-friendly Mixed Reality (MR) solution. The system enables training both the cognitive and physical state using MR technology and maintaining social contacts by connecting seniors with family and friends. Cognitive trainings are provided by conventional and physically available board games - such as Ludo - that are completed with virtual game pieces of a remote partner. Since the system uses real physical game pieces, the user experiences a tactile feedback that enables a more familiar feeling and thus novel way of digital interaction. Physical trainings are provided by a virtual avatar that explains and shows dedicated exercises, adaptable to the individual needs and physical restrictions of the user. Thus, the avatar accompanies the user during the physical training in a more natural way.