Skip to main content
Top
Published in: Multimedia Systems 3/2016

01-06-2016 | Regular Paper

A fast recognition algorithm for suspicious behavior in high definition videos

Authors: Chundi Mu, Jianbin Xie, Wei Yan, Tong Liu, Peiqin Li

Published in: Multimedia Systems | Issue 3/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Detecting suspicious behavior from high definition (HD) videos is always a complex and time-consuming process. To solve that problem, a fast suspicious behavior recognition method is proposed based on motion vectors. In this paper, the data format and decoding features of HD videos are analyzed. Then, the characteristics of suspicious activities and the ways of obtaining motion vectors directly from the video stream are concluded. Besides, the motion vectors are normalized by taking the reference frames into account. The feature vectors that display the inter-frame and intra-frame information of the region of interest are extracted. Gaussian radial basis function is employed as the kernel function of the support vector machines (SVM). It also realizes the detection and classification of suspicious behavior in HD videos. Finally, an extensive set of experiments are performed and this method is compared with some of the most recent approaches in the field using publicly available datasets as well as a new annotated human action dataset including actions performed in complex scenarios.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Aggarwal, J.K., Ryoo, M.S.: Human activity analysis: a review. In: ACM (2011) Aggarwal, J.K., Ryoo, M.S.: Human activity analysis: a review. In: ACM (2011)
2.
go back to reference Rao C., Shah, M.: View-invariance in action recognition. In: CVPR (2001) Rao C., Shah, M.: View-invariance in action recognition. In: CVPR (2001)
3.
go back to reference Savarese, S., Delpozo, A., Niebles, J., Fei-Fei, L.: Spatial-temporal correlations for unsupervised action classification. In: WMVC (2008) Savarese, S., Delpozo, A., Niebles, J., Fei-Fei, L.: Spatial-temporal correlations for unsupervised action classification. In: WMVC (2008)
4.
go back to reference Rodriguez, M.D., Ahmed, J., Shah, M.: Action MACH: a spatio-temporal maximum average correlation height filter for action recognition. In: CVPR (2008) Rodriguez, M.D., Ahmed, J., Shah, M.: Action MACH: a spatio-temporal maximum average correlation height filter for action recognition. In: CVPR (2008)
5.
go back to reference Ryoo, M.S., Aggarwal, J.K.: Spatio-temporal relationship match: video structure comparison for recognition of complex human activities. In: ICCV (2009) Ryoo, M.S., Aggarwal, J.K.: Spatio-temporal relationship match: video structure comparison for recognition of complex human activities. In: ICCV (2009)
6.
go back to reference Jiang, H., Drew, M., Li, Z.: Successive convex matching for action detection. In: CVPR (2006) Jiang, H., Drew, M., Li, Z.: Successive convex matching for action detection. In: CVPR (2006)
7.
go back to reference Veeraraghavan, A., Chellappa, R., Roy-Chowdhury, A.: The function space of an activity. In: CVPR (2006) Veeraraghavan, A., Chellappa, R., Roy-Chowdhury, A.: The function space of an activity. In: CVPR (2006)
8.
go back to reference Natarajan, P., Nevatia, R.: Coupled hidden semi-markov models for activity recognition. In: WMVC (2007) Natarajan, P., Nevatia, R.: Coupled hidden semi-markov models for activity recognition. In: WMVC (2007)
9.
go back to reference Damen, D., Hogg, D.: Recognizing linked events: searching the space of feasible explanations. In: CVPR (2009) Damen, D., Hogg, D.: Recognizing linked events: searching the space of feasible explanations. In: CVPR (2009)
10.
go back to reference Joo, S.W., Chellappa, R.: Attribute grammar-based event recognition and anomaly detection. In: CVPR (2006) Joo, S.W., Chellappa, R.: Attribute grammar-based event recognition and anomaly detection. In: CVPR (2006)
11.
go back to reference Ryoo, M.S., Aggarwal, J.K.: Semantic representation and recognition of continued and recursive human activities. In: IJCV (2009) Ryoo, M.S., Aggarwal, J.K.: Semantic representation and recognition of continued and recursive human activities. In: IJCV (2009)
12.
go back to reference Ryoo, M.S., Aggarwal, J.K.: Recognition of composite human activities through context-free grammar based representation. In: CVPR (2006) Ryoo, M.S., Aggarwal, J.K.: Recognition of composite human activities through context-free grammar based representation. In: CVPR (2006)
13.
go back to reference Schüldt, C., Laptev, I., Caputo, B.: Recognizing human actions: a local SVM approach. In: ICPR (2004) Schüldt, C., Laptev, I., Caputo, B.: Recognizing human actions: a local SVM approach. In: ICPR (2004)
14.
go back to reference Marszałek, M., Laptev, I., Schmid, C.: Actions in context. In: CVPR (2009) Marszałek, M., Laptev, I., Schmid, C.: Actions in context. In: CVPR (2009)
15.
go back to reference Blank, M., Gorelick, L., Shechtman, E., Irani, M., Basri, R.: Actions as space-time shapes. In: ICCV (2005) Blank, M., Gorelick, L., Shechtman, E., Irani, M., Basri, R.: Actions as space-time shapes. In: ICCV (2005)
16.
go back to reference Laptev, I., Marszałek, M., Schmid, C., Rozenfeld, B.: Learning realistic human actions from movies. In: CVPR (2008) Laptev, I., Marszałek, M., Schmid, C., Rozenfeld, B.: Learning realistic human actions from movies. In: CVPR (2008)
17.
go back to reference Liu, J., Luo, J., Shah, M.: Recognizing realistic actions from videos’in the wild’. In: CVPR (2009) Liu, J., Luo, J., Shah, M.: Recognizing realistic actions from videos’in the wild’. In: CVPR (2009)
18.
go back to reference Porikli, F., Bashir, F., Sun, H.: Compressed domain video object segmentation, IEEE Trans. Circuits Syst. Video Technol. 20(1), 2–14 (2010)CrossRef Porikli, F., Bashir, F., Sun, H.: Compressed domain video object segmentation, IEEE Trans. Circuits Syst. Video Technol. 20(1), 2–14 (2010)CrossRef
19.
go back to reference Messing, R., Pal, C., Kautz, H.: Activity recognition using the velocity histories of tracked keypoints. In: ICCV (2009) Messing, R., Pal, C., Kautz, H.: Activity recognition using the velocity histories of tracked keypoints. In: ICCV (2009)
20.
go back to reference Wang, H., Klaser, A., Schmid, C., Liu, C.L.: Action recognition by dense trajectories. In: CVPR (2011) Wang, H., Klaser, A., Schmid, C., Liu, C.L.: Action recognition by dense trajectories. In: CVPR (2011)
21.
go back to reference Sadanand, S., Corso, J.J.: Action Bank: a high-level representation of activity in video. In: CVPR (2012) Sadanand, S., Corso, J.J.: Action Bank: a high-level representation of activity in video. In: CVPR (2012)
22.
go back to reference Lavee, G., Khan, L., Thuraisingham, B.: A framework for a video analysis tool for suspicious event detection. In: MDM (2005) Lavee, G., Khan, L., Thuraisingham, B.: A framework for a video analysis tool for suspicious event detection. In: MDM (2005)
23.
go back to reference Mecocci, A., Pannozzo, M., Fumarola, A.: Automatic Detection of Anomalous Behavioural Events for Advanced Real-Time Video Surveilance, International Symposium on Computational Intelligence for Measurement Systems and Applications, pp. 187–192. Lugano (2003) Mecocci, A., Pannozzo, M., Fumarola, A.: Automatic Detection of Anomalous Behavioural Events for Advanced Real-Time Video Surveilance, International Symposium on Computational Intelligence for Measurement Systems and Applications, pp. 187–192. Lugano (2003)
24.
go back to reference Barbará, D., Filippone, M.: Detecting suspicious behavior in surveillance images. In: ICDMW (2008) Barbará, D., Filippone, M.: Detecting suspicious behavior in surveillance images. In: ICDMW (2008)
25.
go back to reference Wiliem, A., Madasu, V., Boles, W., Yarlagadda, P.: A context-based approach for detecting suspicious behaviours. In: DICTA (2009) Wiliem, A., Madasu, V., Boles, W., Yarlagadda, P.: A context-based approach for detecting suspicious behaviours. In: DICTA (2009)
26.
go back to reference Qamar, S.A., Jaffar, M.A., Habib, H.A.: A supervisory system to detect suspicious behavior in online testing system. In: ICMLC (2009) Qamar, S.A., Jaffar, M.A., Habib, H.A.: A supervisory system to detect suspicious behavior in online testing system. In: ICMLC (2009)
27.
go back to reference Kaluža, B., Kaminka, G.A., Tambe, M.: Detection of suspicious behavior from a sparse set of multiagent interactions. In: AAMAS (2012) Kaluža, B., Kaminka, G.A., Tambe, M.: Detection of suspicious behavior from a sparse set of multiagent interactions. In: AAMAS (2012)
28.
go back to reference Schindler, K., Gool, L.J.V.: Action snippets: how many frames does human action recognition require?. In: CVPR (2008) Schindler, K., Gool, L.J.V.: Action snippets: how many frames does human action recognition require?. In: CVPR (2008)
29.
go back to reference Gilbert, A., Illingworth, J., Bowden, R.: Fast realistic multi-action recognition using mined dense spatio-temporal features. In: ICCV (2009) Gilbert, A., Illingworth, J., Bowden, R.: Fast realistic multi-action recognition using mined dense spatio-temporal features. In: ICCV (2009)
30.
go back to reference Yao, A., Gall, J., Van Gool, L.: A hough transform-based voting framework for action recognition. In: CVPR (2010) Yao, A., Gall, J., Van Gool, L.: A hough transform-based voting framework for action recognition. In: CVPR (2010)
31.
go back to reference Barnich, Olivier, Van Droogenbroeck, Marc: ViBe: a universal background subtraction algorithm for video sequences. IEEE Trans. Image Process 20(6), 1709–1724 (2011)MathSciNetCrossRef Barnich, Olivier, Van Droogenbroeck, Marc: ViBe: a universal background subtraction algorithm for video sequences. IEEE Trans. Image Process 20(6), 1709–1724 (2011)MathSciNetCrossRef
32.
go back to reference Jiangbin, Zheng, Xiuxiu, Li, Yanning, Zhang: Novel tacking algorithm for video surveillance. Syst. Eng. Electron. 29(11), 191–193 (2007) Jiangbin, Zheng, Xiuxiu, Li, Yanning, Zhang: Novel tacking algorithm for video surveillance. Syst. Eng. Electron. 29(11), 191–193 (2007)
33.
go back to reference Nagasaka, A., Tanaka, Y.: Automatic video indexing and full video search for object appearances. Visual Database Systems II, pp. 113–127 (1992) Nagasaka, A., Tanaka, Y.: Automatic video indexing and full video search for object appearances. Visual Database Systems II, pp. 113–127 (1992)
Metadata
Title
A fast recognition algorithm for suspicious behavior in high definition videos
Authors
Chundi Mu
Jianbin Xie
Wei Yan
Tong Liu
Peiqin Li
Publication date
01-06-2016
Publisher
Springer Berlin Heidelberg
Published in
Multimedia Systems / Issue 3/2016
Print ISSN: 0942-4962
Electronic ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-015-0456-7

Other articles of this Issue 3/2016

Multimedia Systems 3/2016 Go to the issue