Skip to main content
Top

2017 | OriginalPaper | Chapter

Agent-Based Assistance in Ambient Assisted Living Through Reinforcement Learning and Semantic Technologies

(Short Paper)

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

For impaired people, the conduction of certain daily life activities is problematic due to motoric and cognitive handicaps. For that reason, assistive agents in ambient assisted environments provide services that aim at supporting elderly and impaired people. However, these agents act in complex stochastic and indeterministic environments where the concrete effects of a performed action are usually unknown at design time. Furthermore, they have to perform varying tasks according to the user’s context and needs, wherefore an agent has to be flexible and able to recognize required capabilities in a certain situation in order to provide adequate, unobtrusive assistance. Hence, an expressive representation framework is required that relates user-specific impairments to required agent capabilities. This work presents an approach which (a) describes and links user impairments and capabilities using the formal, model-theoretic semantics expressed in OWL2 DL ontologies, (b) computes optimal policies through Reinforcement Learning and propagates these in an agent network. The presented approach improves the collaborative, personalized and adequate assistance of assistive agents and tailors the agent-based services to the user’s missing capabilities.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
A policy is a strategy for performing the best possible action in a certain state.
 
2
A content management platform for generating a light-weight RDF(S) representation of annotated wiki pages. See: https://​www.​semantic-mediawiki.​org/​wiki/​Semantic_​MediaWiki.
 
4
Internet of Things.
 
Literature
1.
go back to reference Zander, S., Merkle, N., Frank, M.: Enhancing the utilization of IoT devices using ontological semantics and reasoning. Proc. Comput. Sci. 98, 87–90 (2016). 7th EUSPN 2016 Conference, UKCrossRef Zander, S., Merkle, N., Frank, M.: Enhancing the utilization of IoT devices using ontological semantics and reasoning. Proc. Comput. Sci. 98, 87–90 (2016). 7th EUSPN 2016 Conference, UKCrossRef
2.
go back to reference Liming, C., Nugent, C., Okeyo, G.: An ontology-based hybrid approach to activity modeling for smart homes. IEEE Trans. Hum.-Mach. Syst. 44(1), 92–105 (2014)CrossRef Liming, C., Nugent, C., Okeyo, G.: An ontology-based hybrid approach to activity modeling for smart homes. IEEE Trans. Hum.-Mach. Syst. 44(1), 92–105 (2014)CrossRef
3.
go back to reference Merkle, N., Zander, S.: Improving the utilization of AAL devices through semantic web technologies and web of things concepts. Proc. Comput. Sci. 98, 290–297 (2016). 6th ICTHCrossRef Merkle, N., Zander, S.: Improving the utilization of AAL devices through semantic web technologies and web of things concepts. Proc. Comput. Sci. 98, 290–297 (2016). 6th ICTHCrossRef
4.
go back to reference Merkle, N., Kämpgen, B., Zander, S.: Self-service ambient intelligence using web of things technologies. In: Proceedings of the 1st SEMPER Workshop, Co-located with the 13th Extended Semantic Web Conference (ESWC) 2016, Greece, 29 May 2016, pp. 1–10 (2016) Merkle, N., Kämpgen, B., Zander, S.: Self-service ambient intelligence using web of things technologies. In: Proceedings of the 1st SEMPER Workshop, Co-located with the 13th Extended Semantic Web Conference (ESWC) 2016, Greece, 29 May 2016, pp. 1–10 (2016)
5.
go back to reference Stavropoulos, T., et al.: The DemaWare Service-Oriented Platform for AAL of Patients with Dementia, Czech Republic (2014) Stavropoulos, T., et al.: The DemaWare Service-Oriented Platform for AAL of Patients with Dementia, Czech Republic (2014)
6.
go back to reference Stelios, A., et al.: Dem@Home: Ambient Intelligence for Clinical Support of People Living with Dementia, Greece, May 2016 Stelios, A., et al.: Dem@Home: Ambient Intelligence for Clinical Support of People Living with Dementia, Greece, May 2016
7.
go back to reference Beetz, M., et al.: Towards automated models of activities of daily life. Technol. Disabil. 22(1–2), 27–40 (2010). IOS Press Beetz, M., et al.: Towards automated models of activities of daily life. Technol. Disabil. 22(1–2), 27–40 (2010). IOS Press
8.
go back to reference Hyoungnyoun, K., et al.: Adaptive modelling of a user’s daily life with a wearable sensor network. In: Tenth IEEE International Symposium on Multimedia (2008) Hyoungnyoun, K., et al.: Adaptive modelling of a user’s daily life with a wearable sensor network. In: Tenth IEEE International Symposium on Multimedia (2008)
9.
go back to reference Kurschl, W., et al.: Modeling situation-aware ambient assisted living systems for eldercare. In: Information Technology: New Generations (2009) Kurschl, W., et al.: Modeling situation-aware ambient assisted living systems for eldercare. In: Information Technology: New Generations (2009)
10.
go back to reference Sutton, R., Barto, A.: Introduction to Reinforcement Learning, 1st edn. MIT Press, Cambridge (1998) Sutton, R., Barto, A.: Introduction to Reinforcement Learning, 1st edn. MIT Press, Cambridge (1998)
11.
go back to reference Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach, 3rd edn. Prentice Hall Press, Upper Saddle River (2009)MATH Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach, 3rd edn. Prentice Hall Press, Upper Saddle River (2009)MATH
13.
go back to reference Denil, M., Colmenarejo, S.G., Cabi, S., Saxton, D., de Freitas, N.: Programmable agents. CoRR abs/1706.06383 (2017) Denil, M., Colmenarejo, S.G., Cabi, S., Saxton, D., de Freitas, N.: Programmable agents. CoRR abs/1706.06383 (2017)
14.
go back to reference Mnih, V., et al.: Playing ATARI with deep reinforcement learning. J. CoRR abs/1312.5602 (2013) Mnih, V., et al.: Playing ATARI with deep reinforcement learning. J. CoRR abs/1312.5602 (2013)
15.
go back to reference Dragoni, M., et al.: A semantic-enabled platform for supporting healthy lifestyles, pp. 315–322 (2017) Dragoni, M., et al.: A semantic-enabled platform for supporting healthy lifestyles, pp. 315–322 (2017)
16.
go back to reference Bailoni, T., et al.: PerKApp: a context aware motivational system for healthier lifestyles, pp. 1–4 (2016) Bailoni, T., et al.: PerKApp: a context aware motivational system for healthier lifestyles, pp. 1–4 (2016)
Metadata
Title
Agent-Based Assistance in Ambient Assisted Living Through Reinforcement Learning and Semantic Technologies
Authors
Nicole Merkle
Stefan Zander
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-69459-7_12

Premium Partner