Skip to main content
Top
Published in: Universal Access in the Information Society 2/2011

01-06-2011 | Long Paper

Behavior monitoring for assistive environments using multiple views

Author: Dimitrios I. Kosmopoulos

Published in: Universal Access in the Information Society | Issue 2/2011

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This work presents an approach to behavior understanding using multiple cameras. This approach is appropriate for monitoring people in an assistive environment for the purpose of issuing alerts in cases of abnormal behavior. The output of multiple classifiers is used to model and extract abnormal behavior from both the target trajectory and the target short-term activity (i.e., walking, running, abrupt motion, etc.). Spatial information is obtained after an offline camera registration using homography information. The proposed approach is verified experimentally in an indoor environment. The experiments are performed with a single moving target; however, the method can be generalized to multiple moving targets, which may occlude each other, due to the use of multiple cameras.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
An early version of this work has been presented in [4].
 
Literature
3.
go back to reference Hayes, T.L., Pavel, M., Larimer, N., Tsay, I.A., Nutt, J., Adami, A.G.: Distributed healthcare: Simultaneous assessment of multiple individuals. IEEE Pervasive Comput. 6(1), 36–43 (2007). doi:10.1109/MPRV.2007.9 CrossRef Hayes, T.L., Pavel, M., Larimer, N., Tsay, I.A., Nutt, J., Adami, A.G.: Distributed healthcare: Simultaneous assessment of multiple individuals. IEEE Pervasive Comput. 6(1), 36–43 (2007). doi:10.​1109/​MPRV.​2007.​9 CrossRef
4.
go back to reference Kosmopoulos, D., Antonakaki, P., Valasoulis, K., Katsoulas, D.: Monitoring human behavior in an assistive environment using multiple views. In: PETRA ’08: Proceedings of the 1st International Conference on Pervasive Technologies Related to Assistive Environments, pp. 1–6. ACM, New York, NY (2008). doi:10.1145/1389586.1389624 Kosmopoulos, D., Antonakaki, P., Valasoulis, K., Katsoulas, D.: Monitoring human behavior in an assistive environment using multiple views. In: PETRA ’08: Proceedings of the 1st International Conference on Pervasive Technologies Related to Assistive Environments, pp. 1–6. ACM, New York, NY (2008). doi:10.​1145/​1389586.​1389624
5.
7.
go back to reference Efros, A.A., Berg, A.C., Mori, G., Malik, J.: Recognizing action at a distance. In: IEEE International Conference on Computer Vision, pp. 726–733. Nice, France (2003) Efros, A.A., Berg, A.C., Mori, G., Malik, J.: Recognizing action at a distance. In: IEEE International Conference on Computer Vision, pp. 726–733. Nice, France (2003)
9.
go back to reference Chan, M., Campo, E., Esteve, D.: Monitoring elderly people using a multisensor system. In: Zhang, M., Mokhtari, D. (eds.) Toward a Human-Friendly Assistive Environment: ICOST ’2004, 2nd International Conference on Smart Homes and Health Telematics, pp. 162–169. IOS Press, Amsterdam (2004) Chan, M., Campo, E., Esteve, D.: Monitoring elderly people using a multisensor system. In: Zhang, M., Mokhtari, D. (eds.) Toward a Human-Friendly Assistive Environment: ICOST ’2004, 2nd International Conference on Smart Homes and Health Telematics, pp. 162–169. IOS Press, Amsterdam (2004)
11.
go back to reference Ivanov, Y.A., Bobick, A.F.: Recognition of visual activities and interactions by stochastic parsing. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 852–872 (2000). doi:10.1109/34.868686 CrossRef Ivanov, Y.A., Bobick, A.F.: Recognition of visual activities and interactions by stochastic parsing. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 852–872 (2000). doi:10.​1109/​34.​868686 CrossRef
12.
go back to reference Bashir, F.I., Qu, W., Khokhar, A.A., Schonfeld, D.: Hmm-based motion recognition system using segmented pca. In: ICIP (3), pp. 1288–1291 (2005) Bashir, F.I., Qu, W., Khokhar, A.A., Schonfeld, D.: Hmm-based motion recognition system using segmented pca. In: ICIP (3), pp. 1288–1291 (2005)
13.
go back to reference Sukthankar, G., Sycara, K.: Robust recognition of physical team behaviors using spatio-temporal models. In: Proceedings of Workshop on Modeling Others from Observations (MOO 2005) (2006) Sukthankar, G., Sycara, K.: Robust recognition of physical team behaviors using spatio-temporal models. In: Proceedings of Workshop on Modeling Others from Observations (MOO 2005) (2006)
14.
15.
go back to reference Brand, M., Oliver, N., Pentland, A.: Coupled Hidden Markov models for complex action recognition. In: CVPR ’97: Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR ’97), p. 994. IEEE Computer Society, Washington, DC (1997) Brand, M., Oliver, N., Pentland, A.: Coupled Hidden Markov models for complex action recognition. In: CVPR ’97: Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR ’97), p. 994. IEEE Computer Society, Washington, DC (1997)
16.
go back to reference Xiang, T., Gong, S.: Beyond tracking: Modelling activity and understanding behaviour. Int. J. Comput. Vis. 67(1), 21–51 (2006)CrossRef Xiang, T., Gong, S.: Beyond tracking: Modelling activity and understanding behaviour. Int. J. Comput. Vis. 67(1), 21–51 (2006)CrossRef
17.
go back to reference Nguyen, N., Bui, H., Venkatesh, S., West, G.: Recognising and monitoring highlevel behaviours in complex spatial environments. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR-03) (2003) Nguyen, N., Bui, H., Venkatesh, S., West, G.: Recognising and monitoring highlevel behaviours in complex spatial environments. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR-03) (2003)
18.
go back to reference Wang, T., Li, J., Diao, Q., Hu, W., Zhang, Y., Dulong, C.: Semantic event detection using conditional random fields. In: CVPRW ’06: Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop, p. 109. IEEE Computer Society, Washington, DC (2006). doi:10.1109/CVPRW.2006.190 Wang, T., Li, J., Diao, Q., Hu, W., Zhang, Y., Dulong, C.: Semantic event detection using conditional random fields. In: CVPRW ’06: Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop, p. 109. IEEE Computer Society, Washington, DC (2006). doi:10.​1109/​CVPRW.​2006.​190
19.
go back to reference Xiang, T., Gong, S.: Unsupervised video behaviour profiling for on-the-fly anomaly detection. IEEE Trans. Pattern Anal. Mach. Intell. 30(5), 893–908 (2008) Xiang, T., Gong, S.: Unsupervised video behaviour profiling for on-the-fly anomaly detection. IEEE Trans. Pattern Anal. Mach. Intell. 30(5), 893–908 (2008)
20.
go back to reference Park, S., Trivedi, M.M.: Analysis and query of person-vehicle interactions in homography domain. In: VSSN ’06: Proceedings of the 4th ACM International Workshop on Video Surveillance and Sensor Networks, pp. 101–110. ACM, New York, NY (2006). doi:10.1145/1178782.1178798 Park, S., Trivedi, M.M.: Analysis and query of person-vehicle interactions in homography domain. In: VSSN ’06: Proceedings of the 4th ACM International Workshop on Video Surveillance and Sensor Networks, pp. 101–110. ACM, New York, NY (2006). doi:10.​1145/​1178782.​1178798
21.
go back to reference Ribeiro, P., Santos-Victor, J.: Human activities recognition from video: modelling, feature selection and classification architecture. In: Proceedings of International Workshop on Human Activity Recognition and Modelling (HAREM 2005), pp. 61–70 (2005) Ribeiro, P., Santos-Victor, J.: Human activities recognition from video: modelling, feature selection and classification architecture. In: Proceedings of International Workshop on Human Activity Recognition and Modelling (HAREM 2005), pp. 61–70 (2005)
22.
go back to reference Zivkovic, Z., van der Heijden, F.: Efficient adaptive density estimation per image pixel for the task of background subtraction. Pattern Recognit. Lett. 27(7), 773–780 (2006)CrossRef Zivkovic, Z., van der Heijden, F.: Efficient adaptive density estimation per image pixel for the task of background subtraction. Pattern Recognit. Lett. 27(7), 773–780 (2006)CrossRef
23.
go back to reference Khan, S.M., Shah, M.: A multiview approach to tracking people in crowded scenes using a planar homography constraint. In: ECCV (4), pp. 133–146 (2006) Khan, S.M., Shah, M.: A multiview approach to tracking people in crowded scenes using a planar homography constraint. In: ECCV (4), pp. 133–146 (2006)
24.
go back to reference Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: 7th International Joint Conference on Artificial Intelligence (IJCAI), pp. 674–679 (1981) Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: 7th International Joint Conference on Artificial Intelligence (IJCAI), pp. 674–679 (1981)
29.
go back to reference Kesidis, A.L., Kosmopoulos, D.I.: Robust occlusion handling with multiple cameras using a homography constraint. Int. Conf. Comput. Vis. Theory Appl. 2, 560–565 (2009) Kesidis, A.L., Kosmopoulos, D.I.: Robust occlusion handling with multiple cameras using a homography constraint. Int. Conf. Comput. Vis. Theory Appl. 2, 560–565 (2009)
Metadata
Title
Behavior monitoring for assistive environments using multiple views
Author
Dimitrios I. Kosmopoulos
Publication date
01-06-2011
Publisher
Springer-Verlag
Published in
Universal Access in the Information Society / Issue 2/2011
Print ISSN: 1615-5289
Electronic ISSN: 1615-5297
DOI
https://doi.org/10.1007/s10209-010-0193-9

Other articles of this Issue 2/2011

Universal Access in the Information Society 2/2011 Go to the issue

Premium Partner