Skip to main content
Erschienen in: Journal of Intelligent Information Systems 1/2017

14.12.2015

Skeleton clustering by multi-robot monitoring for fall risk discovery

verfasst von: Yutaka Deguchi, Daisuke Takayama, Shigeru Takano, Vasile-Marian Scuturici, Jean-Marc Petit, Einoshin Suzuki

Erschienen in: Journal of Intelligent Information Systems | Ausgabe 1/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper tackles the problem of discovering subtle fall risks using skeleton clustering by multi-robot monitoring. We aim to identify whether a gait has fall risks and obtain useful information in inspecting fall risks. We employ clustering of walking postures and propose a similarity of two datasets with respect to the clusters. When a gait has fall risks, the similarity between the gait which is being observed and a normal gait which was monitored in advance exhibits a low value. In subtle fall risk discovery, unsafe skeletons, postures in which fall risks appear slightly as instabilities, are similar to safe skeletons and this fact causes the difficulty in clustering. To circumvent this difficulty, we propose two instability features, the horizontal deviation of the upper and lower bodies and the curvature of the back, which are sensitive to instabilities and a data preprocessing method which increases the ability to discriminate safe and unsafe skeletons. To evaluate our method, we prepare seven kinds of gait datasets of four persons. To identify whether a gait has fall risks, the first and second experiments use normal gait datasets of the same person and another person, respectively. The third experiments consider that how many skeletons are necessary to identify whether a gait has fall risks and then we inspect the obtained clusters. In clustering more than 500 skeletons, the combination of the proposed features and our preprocessing method discriminates gaits with fall risks and without fall risks and gathers unsafe skeletons into a few clusters.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
3
It is surely better to conduct fall risk discovery at home. However, if fall risk discovery is conducted in another situation, it has an advantage over early fall detection in an aspect because prevention is better than cure. Fall risk discovery aims to find fall risks before the target human is likely to fall.
 
5
Kinect is a sensing device developed by Microsoft. Kinect consists of an RGB camera, an IR emitter and an IR depth sensor, a multi-array microphone and a 3-axis accelerometer. (http://​www.​microsoft.​com/​en-us/​kinectforwindows​/​)
 
6
A left/right turn precedes a forward/backward move so that the robot does not lose sight of the target human easily.
 
7
Because Kinect was initially developed as an input device for a video game console.
 
8
In line 7, the command c t =0 which has no effect to the behavior of R r(t) is necessary for the generating command service. This is because a service which is managed by a SoCQ engine needs to respond to the engine.
 
9
We assume that the hip center joint p 0,t is positioned on the center of the whole body.
 
10
We consider a normal distribution and an exponential distribution only because these distributions are not necessary to set parameters such as a value k for degrees of freedom in a chi-squared distribution. It is difficult to determine such parameters because instabilities of a posture is caused by plural fall risks.
 
12
Although it is the best way to prepare datasets taken from healthy elderly people, it is difficult for us to prepare such datasets. This is because we cannot guarantee their safety completely.
 
13
The tools are introduced to various domains, e.g., education, social welfare, home builder, airline company and vocational training. From 2011, the tools were used in several news programs. Therefore, we consider that the tools simulate the physical situation of the elderly adequately.
 
14
We employ the normalized threshold \(\theta ^{\prime }_{\text {leaf}}\) as the horizontal axis instead of the number of clusters because we confirm the difficulty to select an optimal value for \(\theta ^{\prime }_{\text {leaf}}\).
 
Literatur
Zurück zum Zitat Ardiyanto, I., & Miura, J. (2014). Cameraman robot: Dynamic trajectory tracking with final time constraint using state-time space stochastic approach. In Intelligent Robots and Systems (IROS 2014). IEEE/RSJ International Conference on IEEE (pp. 3108–3115). Ardiyanto, I., & Miura, J. (2014). Cameraman robot: Dynamic trajectory tracking with final time constraint using state-time space stochastic approach. In Intelligent Robots and Systems (IROS 2014). IEEE/RSJ International Conference on IEEE (pp. 3108–3115).
Zurück zum Zitat Bhattacharyya, A. (1946). On a measure of divergence between two multinomial populations. Sankhyā: The Indian Journal of Statistics, 401–406. Bhattacharyya, A. (1946). On a measure of divergence between two multinomial populations. Sankhyā: The Indian Journal of Statistics, 401–406.
Zurück zum Zitat Clauser, C.E., McConville, J.T., & Young, J.W. (1969). Weight, volume, and center of mass of segments of the human body. USA: Ohio. Clauser, C.E., McConville, J.T., & Young, J.W. (1969). Weight, volume, and center of mass of segments of the human body. USA: Ohio.
Zurück zum Zitat Coradeschi, S., Cesta, A., Cortellessa, G., Coraci, L., Gonzalez, J., Karlsson, L., Furfari, F., Loutfi, A., Orlandini, A., Palumbo, F., Pecora, F., von Rump, S., S̆timec, A., Ullberg, J., & Östlund, B. (2013). GiraffPlus: combining social interaction and long term monitoring for promoting independent living. In Human System Interaction (HSI). Coradeschi, S., Cesta, A., Cortellessa, G., Coraci, L., Gonzalez, J., Karlsson, L., Furfari, F., Loutfi, A., Orlandini, A., Palumbo, F., Pecora, F., von Rump, S., S̆timec, A., Ullberg, J., & Östlund, B. (2013). GiraffPlus: combining social interaction and long term monitoring for promoting independent living. In Human System Interaction (HSI).
Zurück zum Zitat Deguchi, Y. (2014). Construction of a human monitoring system based on incremental discovery by multiple mobile robots. Master thesis, Graduate School of ISEE, Kyushu University (in Japanese). Deguchi, Y. (2014). Construction of a human monitoring system based on incremental discovery by multiple mobile robots. Master thesis, Graduate School of ISEE, Kyushu University (in Japanese).
Zurück zum Zitat Deguchi, Y., & Suzuki, E. (2014). Skeleton clustering by autonomous mobile robots for subtle fall risk discovery. In ISMIS 2014. LNCS. doi:10.1007/978-3-319-08326-1_51, (Vol. 8502 pp. 500–505). Deguchi, Y., & Suzuki, E. (2014). Skeleton clustering by autonomous mobile robots for subtle fall risk discovery. In ISMIS 2014. LNCS. doi:10.​1007/​978-3-319-08326-1_​51, (Vol. 8502 pp. 500–505).
Zurück zum Zitat Deguchi, Y., Takayama, D., Takano, S., Scuturici, V.M., Petit, J.M., & Suzuki, E (2014). Multiple-robot monitoring system based on a service-oriented DBMS. In Seventh ACM International Conference on Pervasive Technologies Related to Assistive Environments (PETRA). Deguchi, Y., Takayama, D., Takano, S., Scuturici, V.M., Petit, J.M., & Suzuki, E (2014). Multiple-robot monitoring system based on a service-oriented DBMS. In Seventh ACM International Conference on Pervasive Technologies Related to Assistive Environments (PETRA).
Zurück zum Zitat Diraco, G., Leone, A., & Siciliano, P. (2010). An active vision system for fall detection and posture recognition in elderly healthcare. In Design, Automation and Test in Europe (pp. 1536–1541). Diraco, G., Leone, A., & Siciliano, P. (2010). An active vision system for fall detection and posture recognition in elderly healthcare. In Design, Automation and Test in Europe (pp. 1536–1541).
Zurück zum Zitat Fischinger, D., Einramhof, P., Wohlkinger, W., Papoutsakis, K., Mayer, P., Panek, P., Koertner, T., Hofmann, S., Argyros, A., Vincze, M., Weiss, A., & Gisinger C. (2013). Hobbit - the mutual care robot. In ASROB-2013 in conjunction with IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), in conjunction with IROS. Fischinger, D., Einramhof, P., Wohlkinger, W., Papoutsakis, K., Mayer, P., Panek, P., Koertner, T., Hofmann, S., Argyros, A., Vincze, M., Weiss, A., & Gisinger C. (2013). Hobbit - the mutual care robot. In ASROB-2013 in conjunction with IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), in conjunction with IROS.
Zurück zum Zitat Gjoreski, H., Lustrek, M., & Gams, M. (2012). Context-based fall detection using inertial and location sensors. In Ambient Intelligence - Third International Joint Conference, AmI 2012, pp.1–16. doi:10.1007/978-3-642-34898-3_1. Gjoreski, H., Lustrek, M., & Gams, M. (2012). Context-based fall detection using inertial and location sensors. In Ambient Intelligence - Third International Joint Conference, AmI 2012, pp.1–16. doi:10.​1007/​978-3-642-34898-3_​1.
Zurück zum Zitat Gripay, Y., Laforest, F., & Petit, J.M. (2010). A simple (yet powerful) algebra for pervasive environments. In EDBT 2010, 13th International Conference on Extending Database Technology. doi:10.1145/1739041.1739086 (pp. 359–370). Gripay, Y., Laforest, F., & Petit, J.M. (2010). A simple (yet powerful) algebra for pervasive environments. In EDBT 2010, 13th International Conference on Extending Database Technology. doi:10.​1145/​1739041.​1739086 (pp. 359–370).
Zurück zum Zitat Kondo, R., Deguchi, Y., & Suzuki, E. (2014). Developing a face monitoring robot for a desk worker. In AmI 2014. LNCS, vol. 8850 (pp. 226–241): Springer. Kondo, R., Deguchi, Y., & Suzuki, E. (2014). Developing a face monitoring robot for a desk worker. In AmI 2014. LNCS, vol. 8850 (pp. 226–241): Springer.
Zurück zum Zitat Koshmak, G.A., Linden, M., & Loutfi, A. (2013). Evaluation of the android-based fall detection system with physiological data monitoring. In The 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC’13), IEEE (pp. 1164–1168). Koshmak, G.A., Linden, M., & Loutfi, A. (2013). Evaluation of the android-based fall detection system with physiological data monitoring. In The 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC’13), IEEE (pp. 1164–1168).
Zurück zum Zitat Leibrandt, K., Marcus, H.J., Kwok, K.W., & Yang, G.Z. (2014). Implicit active constraints for a compliant surgical manipulator. In 2014 IEEE International Conference on Robotics and Automation, ICRA 2014, Hong Kong, China, May 31 - June 7. doi:10.1109/ICRA.2014.6906622 (pp. 276–283). Leibrandt, K., Marcus, H.J., Kwok, K.W., & Yang, G.Z. (2014). Implicit active constraints for a compliant surgical manipulator. In 2014 IEEE International Conference on Robotics and Automation, ICRA 2014, Hong Kong, China, May 31 - June 7. doi:10.​1109/​ICRA.​2014.​6906622 (pp. 276–283).
Zurück zum Zitat Martinson, E., & Yalla, V. (2014). Guiding computational perception through a shared auditory space. In Intelligent Robots and Systems (IROS 2014). IEEE/RSJ International Conference on IEEE (pp. 3156–3161). Martinson, E., & Yalla, V. (2014). Guiding computational perception through a shared auditory space. In Intelligent Robots and Systems (IROS 2014). IEEE/RSJ International Conference on IEEE (pp. 3156–3161).
Zurück zum Zitat Neumann, P.P., Asadi, S., Lilienthal, A.J., Bartholmai, M., & Schiller, J.H. (2012). Autonomous gas-sensitive microdrone: wind vector estimation and gas distribution mapping. IEEE Robotics & Automation Magazine, 19(1), 50–61. doi:10.1109/MRA.2012.2184671.CrossRef Neumann, P.P., Asadi, S., Lilienthal, A.J., Bartholmai, M., & Schiller, J.H. (2012). Autonomous gas-sensitive microdrone: wind vector estimation and gas distribution mapping. IEEE Robotics & Automation Magazine, 19(1), 50–61. doi:10.​1109/​MRA.​2012.​2184671.CrossRef
Zurück zum Zitat Pal, M., Saha, S., & Konar, A. (2014). A fuzzy c means clustering approach for gesture recognition in healthcare. Enhanced Research in Science Technology & Engineering, 3, 87–94. Pal, M., Saha, S., & Konar, A. (2014). A fuzzy c means clustering approach for gesture recognition in healthcare. Enhanced Research in Science Technology & Engineering, 3, 87–94.
Zurück zum Zitat Pippin, C., & Christensen, H.I. (2014). Trust modeling in multi-robot patrolling. In 2014 IEEE International Conference on Robotics and Automation, ICRA. doi:10.1109/ICRA.2014.6906590 (pp. 59–66). Pippin, C., & Christensen, H.I. (2014). Trust modeling in multi-robot patrolling. In 2014 IEEE International Conference on Robotics and Automation, ICRA. doi:10.​1109/​ICRA.​2014.​6906590 (pp. 59–66).
Zurück zum Zitat Rougier, C., Auvinet, E., Rousseau, J., Mignotte, M., & Meunier, J. (2011). Fall detection from depth map video sequences. In Toward Useful Services for Elderly and People with Disabilities - 9th International Conference on Smart Homes and Health Telematics, ICOST, 2011, pp. 121–128. doi:10.1007/978-3-642-21535-3_16. Rougier, C., Auvinet, E., Rousseau, J., Mignotte, M., & Meunier, J. (2011). Fall detection from depth map video sequences. In Toward Useful Services for Elderly and People with Disabilities - 9th International Conference on Smart Homes and Health Telematics, ICOST, 2011, pp. 121–128. doi:10.​1007/​978-3-642-21535-3_​16.
Zurück zum Zitat Rubenstein, L.Z. (2006). Falls in older people: epidemiology, risk factors and strategies for prevention. Age and Ageing, 35((Suppl 2)), ii37–ii41. Rubenstein, L.Z. (2006). Falls in older people: epidemiology, risk factors and strategies for prevention. Age and Ageing, 35((Suppl 2)), ii37–ii41.
Zurück zum Zitat Scuturici, V.M., Surdu, S., Gripay, Y., & Petit, J.M. (2012). In ACM (Ed.) 13th International Middleware Conference (Middleware’12), ACM. doi:10.1145/2405153.2405164 (pp. 11:1–11:2). Scuturici, V.M., Surdu, S., Gripay, Y., & Petit, J.M. (2012). In ACM (Ed.) 13th International Middleware Conference (Middleware’12), ACM. doi:10.​1145/​2405153.​2405164 (pp. 11:1–11:2).
Zurück zum Zitat Suzuki, E., Matsumoto, E., & Kouno, A. (2012). Data squashing for HSV subimages by an autonomous mobile robot. In Discovery Science (DS 2012), LNAI 7569 (pp. 95–109): Springer. Suzuki, E., Matsumoto, E., & Kouno, A. (2012). Data squashing for HSV subimages by an autonomous mobile robot. In Discovery Science (DS 2012), LNAI 7569 (pp. 95–109): Springer.
Zurück zum Zitat Suzuki, E., Deguchi, Y., Takayama, D., Takano, S., Scuturici, V.M., & Petit J.M. (2014). Towards facilitating the development of a monitoring system with autonomous mobile robots. In Information Search Integration and Personalization (pp. 57–70): Springer. Suzuki, E., Deguchi, Y., Takayama, D., Takano, S., Scuturici, V.M., & Petit J.M. (2014). Towards facilitating the development of a monitoring system with autonomous mobile robots. In Information Search Integration and Personalization (pp. 57–70): Springer.
Zurück zum Zitat Takayama, D., Deguchi, Y., Takano, S., Scuturici, V.M., Petit, J.M., & Suzuki, E. (2014). Multi-view onboard clustering of skeleton data for fall risk discovery. In AmI 2014. LNCS, vol. 8850 (pp. 258–273): Springer. Takayama, D., Deguchi, Y., Takano, S., Scuturici, V.M., Petit, J.M., & Suzuki, E. (2014). Multi-view onboard clustering of skeleton data for fall risk discovery. In AmI 2014. LNCS, vol. 8850 (pp. 258–273): Springer.
Zurück zum Zitat Tinetti, M.E., Williams, T.F., & Mayewski, R. (1986). Fall risk index for elderly patients based on number of chronic disabilities. The American Journal of Medicine, 80(3), 429–434.CrossRef Tinetti, M.E., Williams, T.F., & Mayewski, R. (1986). Fall risk index for elderly patients based on number of chronic disabilities. The American Journal of Medicine, 80(3), 429–434.CrossRef
Zurück zum Zitat United Nations (2013). Department of Economic and Social Affairs, Population Devision World population ageing 2013. Tech. rep., ST/ESA/SER.A/348. United Nations (2013). Department of Economic and Social Affairs, Population Devision World population ageing 2013. Tech. rep., ST/ESA/SER.A/348.
Zurück zum Zitat Wang, Z. (2010). Comparison of four kinds of fuzzy c-means clustering methods. In Information Processing (ISIP) 2010. Third International Symposium on IEEE, pp. 563–566. Wang, Z. (2010). Comparison of four kinds of fuzzy c-means clustering methods. In Information Processing (ISIP) 2010. Third International Symposium on IEEE, pp. 563–566.
Metadaten
Titel
Skeleton clustering by multi-robot monitoring for fall risk discovery
verfasst von
Yutaka Deguchi
Daisuke Takayama
Shigeru Takano
Vasile-Marian Scuturici
Jean-Marc Petit
Einoshin Suzuki
Publikationsdatum
14.12.2015
Verlag
Springer US
Erschienen in
Journal of Intelligent Information Systems / Ausgabe 1/2017
Print ISSN: 0925-9902
Elektronische ISSN: 1573-7675
DOI
https://doi.org/10.1007/s10844-015-0392-1

Weitere Artikel der Ausgabe 1/2017

Journal of Intelligent Information Systems 1/2017 Zur Ausgabe

Premium Partner