nach oben

Erschienen in:

2017 | OriginalPaper | Buchkapitel

Machine Learning Methods from Group to Crowd Behaviour Analysis

verfasst von : Luis Felipe Borja-Borja, Marcelo Saval-Calvo, Jorge Azorin-Lopez

Erschienen in: Advances in Computational Intelligence

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

The human behaviour analysis has been a subject of study in various fields of science (e.g. sociology, psychology, computer science). Specifically, the automated understanding of the behaviour of both individuals and groups remains a very challenging problem from the sensor systems to artificial intelligence techniques. Being aware of the extent of the topic, the objective of this paper is to review the state of the art focusing on machine learning techniques and computer vision as sensor system to the artificial intelligence techniques. Moreover, a lack of review comparing the level of abstraction in terms of activities duration is found in the literature. In this paper, a review of the methods and techniques based on machine learning to classify group behaviour in sequence of images is presented. The review take into account the different levels of understanding and the number of people in the group.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel Machine Learning Improves Human-Robot Interaction in Productive Environments: A Review

Nächstes Kapitel Unsupervised Color Quantization with the Growing Neural Forest

Azorin-Lopez, J., Saval-Calvo, M., Fuster-Guillo, A., Garcia-Rodriguez, J., Orts-Escolano, S.: Self-organizing activity description map to represent and classify human behaviour. In: IJCNN 2015 (2015)

Chaaraoui, A.A., Climent-Pérez, P., Flórez-Revuelta, F.: A review on vision techniques applied to human behaviour analysis for ambient-assisted living. Expert Syst. Appl. 39(12), 10873–10888 (2012)CrossRef

Cardinaux, F., Deepayan, B., Charith, A., Hawley, M.S., Mark, S., Bhowmik, D., Abhayaratne, C.: Video based technology for ambient assisted living: a review of the literature. J. Ambient Intell. Smart Environ. (JAISE) 1364(3), 253–269 (2011)

Turaga, P., Chellappa, R., Subrahmanian, V., Udrea, O.: Machine recognition of human activities: a survey. IEEE Trans. Circ. Syst. Video Technol. 18, 1473–1488 (2008)CrossRef

Ryoo, M.S., Aggarwal, J.K.: Recognition of high-level group activities based on activities of individual members. In: 2008 IEEE Workshop on Motion and Video Computing, WMVC 2008, January 2008

Mihaylova, L., Carmi, A.Y., Septier, F., Gning, A., Pang, S.K., Godsill, S.: Overview of Bayesian sequential Monte Carlo methods for group and extended object tracking. Digit. Sig. Process.: Rev. J. 25(1), 1–16 (2014)

Climent-Pérez, P., Mauduit, A., Monekosso, D.N., Remagnino, P.: Detecting events in crowded scenes using tracklet plots. In: Proceedings of the International Conference on Computer Vision Theory and Applications (2014)

Vishwakarma, S., Agrawal, A.: A survey on activity recognition and behavior understanding in video surveillance. Vis. Comput. 29(10), 983–1009 (2013)CrossRef

Blunsden, S., Fisher, R.B.: The BEHAVE video dataset: ground truthed video for multi-person behavior classification. Ann. BMVA 2010(4), 1–11 (2010)

10.

Chaquet, J.M., Carmona, E.J., Fernández-Caballero, A.: A survey of video datasets for human action and activity recognition. Comput. Vis. Image Underst. 117(6), 633–659 (2013)CrossRef

11.

Banos, O., Damas, M., Pomares, H., Rojas, F., Delgado-Marquez, B., Valenzuela, O.: Human activity recognition based on a sensor weighting hierarchical classifier. Soft Comput. 17(2), 333–343 (2013)CrossRef

12.

Bruckner, D., Yin, G.Q., Faltinger, A.: Relieved commissioning and human behavior detection in ambient assisted living systems. Elektrotechnik und Informationstechnik 129(4), 293–298 (2012)CrossRef

13.

Wu, Y., Jia, Z., Ming, Y., Sun, J., Cao, L.: Human behavior recognition based on 3D features and hidden markov models. Sign. Image Video Process. 10(3), 495–502 (2015)CrossRef

14.

Azorin-Lopez, J., Saval-Calvo, M., Fuster-Guillo, A., Garcia-Rodriguez, J., Cazorla, M., Signes-Pont, M.T.: Group activity description and recognition based on trajectory analysis and neural networks, pp. 1585–1592 (2016)

15.

Azorin-Lopez, J., Saval-Calvo, M., Fuster-Guillo, A., Oliver-Albert, A.: A predictive model for recognizing human behaviour based on trajectory representation. In: International Joint Conference on Neural Networks (IJCNN), pp. 1494–1501 (2014)

16.

Andrade, E., Blunsden, S., Fisher, R.: Hidden markov models for optical flow analysis in crowds. In: 18th International Conference on Pattern Recognition, pp. 460–463, January 2006

17.

Hu, Y., Zhang, Y., Davis, L.S.: Unsupervised abnormal crowd activity detection using semiparametric scan statistic. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, vol. 1, pp. 767–774 (2013)

18.

Ge, W., Collins, R.T., Ruback, B.: Automatically detecting the small group structure of a crowd. In: 2009 Workshop on Applications of Computer Vision, WACV 2009 (2009)

19.

Goel, K., Robicquet, A.: Learning causalities behind human trajectories (2015)

20.

Maksai, A., Wang, X., Fua, P.: Globally consistent multi-people tracking using motion patterns, vol. 1 (2016). arXiv preprint arXiv:1612.00604

21.

Shao, J., Loy, C.C., Wang, X.: Scene-independent group profiling in crowd, pp. 2219–2226 (2014)

22.

Yi, S., Li, H., Wang, X.: Pedestrian travel time estimation in crowded scenes. Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, pp. 3137–3145 (2015)

23.

Yi, S., Li, H., Wang, X.: Understanding pedestrian behaviors from stationary crowd groups. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 07–12 June 2015, pp. 3488–3496 (2015)

24.

Al-Raziqi, A., Denzler, J.: Unsupervised framework for interactions modeling between multiple objects. In: Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP, vol. 4, pp. 509–516 (2016)

25.

Shen, C., Xie, R., Zhang, L., Song, L.: Small group people behavior analysis based on temporal recursive trajectory identification. Institute of Image Communication and Network Engineering, Shanghai Jiao Tong University, Cooperative Medianet Innovation Center (2015)

26.

Vascon, S., Mequanint, E.Z., Cristani, M., Hung, H., Pelillo, M., Murino, V.: Detecting conversational groups in images, sequences: a robust game-theoretic approach. Comput. Vis. Image Underst. 143, 11–24 (2016)CrossRef

27.

Li, W., Mahadevan, V., Vasconcelos, N.: Anomaly detection and localization in crowded scenes. IEEE Trans. Pattern Anal. Mach. Intell. 36(1), 18–32 (2014)CrossRef

28.

Liu, J., Tong, X., Li, W., Wang, T., Zhang, Y., Wang, H., Yang, B., Sun, L., Yang, S.: Automatic player detection, labeling and tracking in broadcast soccer video. In: Proceedings of the British Machine Vision Conference 2007, pp. 3.1–3.10 (2007)

29.

Lin, W., Sun, M.-T., Poovandran, R., Zhang, Z.: Human activity recognition for video surveillance. In: IEEE International Symposium on Circuits and Systems, pp. 2737–2740, June 2008

30.

Harmon, M., Lucey, P., Klabjan, D.: Predicting shot making in basketball using convolutional neural networks learnt from adversarial multiagent trajectories (2016). arXiv preprint arXiv:1609.04849

31.

Camplani, M., Paiement, A., Mirmehdi, M., Damen, D., Hannuna, S., Burghardt, T., Tao, L.: Multiple human tracking in RGB-D data: a survey, June 2016

32.

Wickramaratna, K., Chen, M., Chen, S.C., Shyu, M.L.: Neural network based framework for goal event detection in soccer videos. In: Proceedings - Seventh IEEE International Symposium on Multimedia, ISM 2005, vol. 2005, pp. 21–28 (2005)

33.

Hamidreza Rabiee, H.M., Haddadnia, J.: Emotion-based crowd representation for abnormality detection hamidreza. Int. J. Artif. Intell. Tools (2016)

34.

Fradi, H., Dugelay, J.L.: Spatial and temporal variations of feature tracks for crowd behavior analysis. J. Multimodal User Interfaces 10(4), 307–317 (2016)CrossRef

35.

Gong, S., Cristani, M., Yan, S., Loy, C.C.: Person re-identification. In: Gong, S., Cristani, M., Yan, S., Loy, C.C. (eds.) ACVPR. Springer, London (2014)

36.

Cao, L., Huang, K.: Video-based crowd density estimation and prediction system for wide-area surveillance. China Commun. 10(5), 79–88 (2013)CrossRef

37.

Liao, H., Xiang, J., Sun, W., Feng, Q., Dai, J.: An abnormal event recognition in crowd scene. In: Proceedings - 6th International Conference on Image and Graphics, ICIG 2011, pp. 731–736, September 2011

38.

Chang, M.C., Krahnstoever, N., Lim, S., Yu, T.: Group level activity recognition in crowded environments across multiple cameras. In: Proceedings - IEEE International Conference on Advanced Video and Signal Based Surveillance, AVSS 2010, pp. 56–63, February 2010

39.

Gning, A., Mihaylova, L., Maskell, S., Pang, S.K., Godsill, S.: Group object structure and state estimation with evolving networks and Monte Carlo methods. IEEE Trans. Sig. Process. 59(4), 1383–1396 (2011)CrossRef

40.

Pellegrini, S., Ess, A., Tanaskovic, M.: Wrong turn-no dead end: a stochastic pedestrian motion model. In: 2010 IEEE Computer Society Conference on CVPRW (2010)

41.

Perše, M., Kristan, M., Kovačič, S., Vučkovič, G., Perš, J.: A trajectory-based analysis of coordinated team activity in a basketball game. Comput. Vis. Image Underst. 113(5), 612–621 (2009)CrossRef

42.

Yin, Y., Yang, G., Man, H.: Small human group detection and event representation based on cognitive semantics. In: Proceedings - 2013 IEEE 7th International Conference on Semantic Computing, ICSC 2013, pp. 64–69, September 2013

43.

Ge, W., Collins, R.T., Ruback, R.B.: Vision-based analysis of small groups in pedestrian crowds. IEEE Trans. Pattern Anal. Mach. Intell. 34(5), 1003–1016 (2012)CrossRef

44.

Lau, B., Arras, K.O., Burgard, W.: Multi-model hypothesis group tracking and group size estimation. Int. J. Soc. Robot. 2(1), 19–30 (2010)CrossRef

45.

Jacques, J.C.S., Braun, A., Soldera, J., Musse, S.R., Jung, C.R.: Understanding people motion in video sequences using Voronoi diagrams. Pattern Anal. Appl. 10(4), 321–332 (2007)MathSciNetCrossRef

46.

Schuldt, C., Barbara, L., Stockholm, S.: Rcognizing human actions: a local SVM approach. Department of Numerical Analysis and Computer Science. In: Pattern Recognition, Proceedings of the 17th International Conference on ICPPR 2004, vol. 3, pp. 32–36 (2004)

47.

Andrade, E.L., Blunsden, S., Fisher, R.B.: Modelling crowd scenes for event detection (2006)

48.

Kilambi, P., Ribnick, E., Joshi, A.J., Masoud, O., Papanikolopoulos, N.: Estimating pedestrian counts in groups. Comput. Vis. Image Underst. 110(1), 43–59 (2008)CrossRef

49.

Zhang, C., Yang, X., Lin, W., Zhu, J.: Recognizing human group behaviors with multi-group causalities. In: Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology Workshops, WIIAT 2012, pp. 44–48 (2012)

50.

Brostow, G.J., Cipolla, R.: Brostow: unsupervised bayesian detection of independent motion in crowds (2006)

51.

Ge, W., Collins, R.T.: Marked point processes for crowd counting. In: IEEE Computer Vision and Pattern Recognition 2009, pp. 2913–2920 (2009)

52.

Mehran, R., Oyama, A., Shah, M.: Abnormal crowd behaviour detection using social force model. In: IEEE Conference on Computer Vision and Pattern Recognition, no. 2, pp. 935–942 (2009)

53.

Cupillard, F., Brémond, F., Thonnat, M.: Tracking groups of people for video surveillance. In: Remagnino, P., Jones, G.A., Paragios, N., Regazzoni, C.S. (eds.) Video-Based Surveillance Systems, pp. 89–100. Springer, USA (2002)CrossRef

54.

Kong, D., Gray, D., Tao, H.: A viewpoint invariant approach for crowd counting. In: Proceedings - International Conference on Pattern Recognition, vol. 3, pp. 1187–1190 (2006)

Titel: Machine Learning Methods from Group to Crowd Behaviour Analysis
verfasst von: Luis Felipe Borja-Borja
Marcelo Saval-Calvo
Jorge Azorin-Lopez
Verlag: Springer International Publishing
Buch: Advances in Computational Intelligence
Print ISBN: 978-3-319-59146-9

Electronic ISBN: 978-3-319-59147-6

Copyright-Jahr: 2017
DOI: https://doi.org/10.1007/978-3-319-59147-6_26

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"