Skip to main content
Top
Published in: International Journal of Computer Vision 8/2019

01-12-2018

Fast Abnormal Event Detection

Authors: Cewu Lu, Jianping Shi, Weiming Wang, Jiaya Jia

Published in: International Journal of Computer Vision | Issue 8/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Fast abnormal event detection meets the growing demand to process an enormous number of surveillance videos. Based on the inherent redundancy of video structures, we propose an efficient sparse combination learning framework with both batch and online solvers. It achieves decent performance in the detection phase without compromising result quality. The extremely fast execution speed is guaranteed owing to the fact that our method effectively turns the original complicated problem into a few small-scale least square optimizations. Our method reaches high detection rates on benchmark datasets at a speed of 1000–1200 frames per second on average when computing on an ordinary single core desktop PC using MATLAB.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Adam, A., Rivlin, E., Shimshoni, I., & Reinitz, D. (2008). Robust real-time unusual event detection using multiple fixed-location monitors. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(3), 555–560.CrossRef Adam, A., Rivlin, E., Shimshoni, I., & Reinitz, D. (2008). Robust real-time unusual event detection using multiple fixed-location monitors. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(3), 555–560.CrossRef
go back to reference Antic, B., & Ommer, B. (2011). Video parsing for abnormality detection. In International conference on computer vision (ICCV) (pp. 2415–2422). Antic, B., & Ommer, B. (2011). Video parsing for abnormality detection. In International conference on computer vision (ICCV) (pp. 2415–2422).
go back to reference Basharat, A., Gritai, A., & Shah, M. (2008). Learning object motion patterns for anomaly detection and improved object detection. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1–8). Basharat, A., Gritai, A., & Shah, M. (2008). Learning object motion patterns for anomaly detection and improved object detection. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1–8).
go back to reference Beck, A., & Teboulle, M. (2009). A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM Journal on Imaging Sciences, 2(1), 183–202.MathSciNetCrossRefMATH Beck, A., & Teboulle, M. (2009). A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM Journal on Imaging Sciences, 2(1), 183–202.MathSciNetCrossRefMATH
go back to reference Benezeth, Y., Jodoin, P.-M., Saligrama, V., & Rosenberger, C. (2009). Abnormal events detection based on spatio-temporal co-occurences. In IEEE conference on computer vision and pattern recognition (CVPR). Benezeth, Y., Jodoin, P.-M., Saligrama, V., & Rosenberger, C. (2009). Abnormal events detection based on spatio-temporal co-occurences. In IEEE conference on computer vision and pattern recognition (CVPR).
go back to reference Bertsekas, D. P. (1999). Nonlinear programming. Belmont, MA: Athena Scientific.MATH Bertsekas, D. P. (1999). Nonlinear programming. Belmont, MA: Athena Scientific.MATH
go back to reference Chandola, V., Banerjee, A., & Kumar, V. (2009). Anomaly detection: A survey. ACM Computing Surveys (CSUR), 41(3), 15.CrossRef Chandola, V., Banerjee, A., & Kumar, V. (2009). Anomaly detection: A survey. ACM Computing Surveys (CSUR), 41(3), 15.CrossRef
go back to reference Cheng, K.-W., Chen, Y.-T., & Fang, W.-H. (2015). Video anomaly detection and localization using hierarchical feature representation and Gaussian process regression. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 2909–2917). Cheng, K.-W., Chen, Y.-T., & Fang, W.-H. (2015). Video anomaly detection and localization using hierarchical feature representation and Gaussian process regression. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 2909–2917).
go back to reference Combettes, P. L., & Wajs, V. R. (2005). Signal recovery by proximal forward-backward splitting. Multiscale Modeling & Simulation, 4(4), 1168–1200.MathSciNetCrossRefMATH Combettes, P. L., & Wajs, V. R. (2005). Signal recovery by proximal forward-backward splitting. Multiscale Modeling & Simulation, 4(4), 1168–1200.MathSciNetCrossRefMATH
go back to reference Cong, Y., Yuan, J., & Liu, J. (2011). Sparse reconstruction costs for abnormal event detection. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 3449–3456). Cong, Y., Yuan, J., & Liu, J. (2011). Sparse reconstruction costs for abnormal event detection. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 3449–3456).
go back to reference Cui, X., Liu, Q., Gao, M., & Metaxas, D. N. (2011). Abnormal detection using interaction energy potentials. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 3161–3167). Cui, X., Liu, Q., Gao, M., & Metaxas, D. N. (2011). Abnormal detection using interaction energy potentials. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 3161–3167).
go back to reference Elhamifar, E., & Vidal, R. (2009). Sparse subspace clustering. In IEEE conference on computer vision and pattern recognition (CVPR). Elhamifar, E., & Vidal, R. (2009). Sparse subspace clustering. In IEEE conference on computer vision and pattern recognition (CVPR).
go back to reference Elhamifar, E., & Vidal, R. (2013). Sparse subspace clustering: Algorithm, theory, and applications. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(11), 2765–2781.CrossRef Elhamifar, E., & Vidal, R. (2013). Sparse subspace clustering: Algorithm, theory, and applications. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(11), 2765–2781.CrossRef
go back to reference Fischler, M. A., & Bolles, R. C. (1981). Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6), 381–395.MathSciNetCrossRef Fischler, M. A., & Bolles, R. C. (1981). Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6), 381–395.MathSciNetCrossRef
go back to reference Jager, M., Knoll, C., & Hamprecht, F. A. (2008). Weakly supervised learning of a classifier for unusual event detection. IEEE Transactions on Image Processing, 17(9), 1700–1708.MathSciNetCrossRef Jager, M., Knoll, C., & Hamprecht, F. A. (2008). Weakly supervised learning of a classifier for unusual event detection. IEEE Transactions on Image Processing, 17(9), 1700–1708.MathSciNetCrossRef
go back to reference Jiang, F., Wu, Y., & Katsaggelos, A. K. (2007). Abnormal event detection from surveillance video by dynamic hierarchical clustering. In ICIP (pp. 145–148). Jiang, F., Wu, Y., & Katsaggelos, A. K. (2007). Abnormal event detection from surveillance video by dynamic hierarchical clustering. In ICIP (pp. 145–148).
go back to reference Jiang, F., Wu, Y., & Katsaggelos, A. K. (2008). Abnormal event detection based on trajectory clustering by 2-depth greedy search. In IEEE international conference on acoustics, speech and signal processing (pp. 2129–2132). Jiang, F., Wu, Y., & Katsaggelos, A. K. (2008). Abnormal event detection based on trajectory clustering by 2-depth greedy search. In IEEE international conference on acoustics, speech and signal processing (pp. 2129–2132).
go back to reference Jianga, F., Yuan, J., Tsaftarisa, S. A., & Katsaggelosa, A. K. (2011). Anomalous video event detection using spatiotemporal context. Computer Vision and Image Understanding, 115(3), 323–333.CrossRef Jianga, F., Yuan, J., Tsaftarisa, S. A., & Katsaggelosa, A. K. (2011). Anomalous video event detection using spatiotemporal context. Computer Vision and Image Understanding, 115(3), 323–333.CrossRef
go back to reference Jouseok, K., & Kyoungmu, L. (2012). A unified framework for event summarization and rare event detection. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1266–1273). Jouseok, K., & Kyoungmu, L. (2012). A unified framework for event summarization and rare event detection. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1266–1273).
go back to reference Kaltsa, V., Briassouli, A., Kompatsiaris, I., Hadjileontiadis, L. J., & Strintzis, M. G. (2015). Swarm intelligence for detecting interesting events in crowded environments. IEEE Transactions on Image Processing, 24(7), 2153–2166.MathSciNetCrossRefMATH Kaltsa, V., Briassouli, A., Kompatsiaris, I., Hadjileontiadis, L. J., & Strintzis, M. G. (2015). Swarm intelligence for detecting interesting events in crowded environments. IEEE Transactions on Image Processing, 24(7), 2153–2166.MathSciNetCrossRefMATH
go back to reference Kim, J., & Grauman, K. (2009). Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 2921–2928). Kim, J., & Grauman, K. (2009). Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 2921–2928).
go back to reference Kratz, L., & Nishino, K. (2009). Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1446–1453). Kratz, L., & Nishino, K. (2009). Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1446–1453).
go back to reference Li, W., Mahadevan, V., & Vasconcelos, N. (2014). Anomaly detection and localization in crowded scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(1), 18–22.CrossRef Li, W., Mahadevan, V., & Vasconcelos, N. (2014). Anomaly detection and localization in crowded scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(1), 18–22.CrossRef
go back to reference Lu, C., Shi, J., & Jia, J. (2013a). Abnormal event detection at 150 fps in matlab. In International conference on computer vision (ICCV). Lu, C., Shi, J., & Jia, J. (2013a). Abnormal event detection at 150 fps in matlab. In International conference on computer vision (ICCV).
go back to reference Lu, C., Shi, J., & Jia, J. (2013b). Online robust dictionary learning. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 415–422). Lu, C., Shi, J., & Jia, J. (2013b). Online robust dictionary learning. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 415–422).
go back to reference Mahadevan, V., Li, W., Bhalodia, V., & Vasconcelos, N. (2010). Anomaly detection in crowded scenes. In IEEE conference on computer vision and pattern recognition (CVPR). Mahadevan, V., Li, W., Bhalodia, V., & Vasconcelos, N. (2010). Anomaly detection in crowded scenes. In IEEE conference on computer vision and pattern recognition (CVPR).
go back to reference Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2010). Online learning for matrix factorization and sparse coding. The Journal of Machine Learning Research, 11, 19–60.MathSciNetMATH Mairal, J., Bach, F., Ponce, J., & Sapiro, G. (2010). Online learning for matrix factorization and sparse coding. The Journal of Machine Learning Research, 11, 19–60.MathSciNetMATH
go back to reference Ma, Y., Yang, A. Y., Derksen, H., & Fossum, R. (2008). Estimation of subspace arrangements with applications in modeling and segmenting mixed data. SIAM Review, 50(3), 413–458.MathSciNetCrossRefMATH Ma, Y., Yang, A. Y., Derksen, H., & Fossum, R. (2008). Estimation of subspace arrangements with applications in modeling and segmenting mixed data. SIAM Review, 50(3), 413–458.MathSciNetCrossRefMATH
go back to reference Mehran, R., Oyama, A., & Shah, M. (2009). Abnormal crowd behavior detection using social force model. In IEEE conference on computer vision and pattern recognition (CVPR). Mehran, R., Oyama, A., & Shah, M. (2009). Abnormal crowd behavior detection using social force model. In IEEE conference on computer vision and pattern recognition (CVPR).
go back to reference Nowak, R. D, & Wright, S. J., et al. (2007). Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems. IEEE Journal of Selected Topics in Signal Processing. Nowak, R. D, & Wright, S. J., et al. (2007). Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems. IEEE Journal of Selected Topics in Signal Processing.
go back to reference Osborne, M. R., Presnell, B., & Turlach, B. A. (2000). A new approach to variable selection in least squares problems. IMA Journal of Numerical Analysis, 20(3). Osborne, M. R., Presnell, B., & Turlach, B. A. (2000). A new approach to variable selection in least squares problems. IMA Journal of Numerical Analysis, 20(3).
go back to reference Peng, X, Zhang, L., & Yi, Z. (2013). Scalable sparse subspace clustering. In IEEE conference on computer vision and pattern recognition (CVPR). Peng, X, Zhang, L., & Yi, Z. (2013). Scalable sparse subspace clustering. In IEEE conference on computer vision and pattern recognition (CVPR).
go back to reference Pruteanu-Malinici, I., & Carin, L. (2008). Infinite hidden Markov models for unusual-event detection in video. IEEE Transactions on Image Processing, 17(5), 811–822.MathSciNetCrossRef Pruteanu-Malinici, I., & Carin, L. (2008). Infinite hidden Markov models for unusual-event detection in video. IEEE Transactions on Image Processing, 17(5), 811–822.MathSciNetCrossRef
go back to reference Saligrama, V., & Chen, Z. (2012a). Video anomaly detection based on local statistical aggregates. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 2112–2119). Saligrama, V., & Chen, Z. (2012a). Video anomaly detection based on local statistical aggregates. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 2112–2119).
go back to reference Saligrama, V., & Chen, Z. (2012b). Video anomaly detection based on local statistical aggregates. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 2112–2119). Saligrama, V., & Chen, Z. (2012b). Video anomaly detection based on local statistical aggregates. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 2112–2119).
go back to reference Shet, V. D., Harwood, D., & Davis, L. S. (2006). Multivalued default logic for identity maintenance in visual surveillance. In European conference on computer vision (ECCV). Shet, V. D., Harwood, D., & Davis, L. S. (2006). Multivalued default logic for identity maintenance in visual surveillance. In European conference on computer vision (ECCV).
go back to reference Shi, Y., Gao, Y., & Wang, R. (2010). Real-time abnormal event detection in complicated scenes. In International conference on pattern recognition (ICPR) (pp. 3653–3656). Shi, Y., Gao, Y., & Wang, R. (2010). Real-time abnormal event detection in complicated scenes. In International conference on pattern recognition (ICPR) (pp. 3653–3656).
go back to reference Shi, J., Ren, X., Dai, G., Wang, J., & Zhang, Z. (2011). A non-convex relaxation approach to sparse dictionary learning. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1809–1816). Shi, J., Ren, X., Dai, G., Wang, J., & Zhang, Z. (2011). A non-convex relaxation approach to sparse dictionary learning. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1809–1816).
go back to reference Szabo, Z., Poczos, B., & Lorincz, A. (2011). Online group-structured dictionary learning. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 2865–2872). Szabo, Z., Poczos, B., & Lorincz, A. (2011). Online group-structured dictionary learning. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 2865–2872).
go back to reference Trevor, H., Robert, T., & Friedman, J. H. (2001). The elements of statistical learning. New York: Springer. Trevor, H., Robert, T., & Friedman, J. H. (2001). The elements of statistical learning. New York: Springer.
go back to reference Vidal, R., Ma, Y., & Sastry, S. (2005). Generalized principal component analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(12), 1945–1959.CrossRef Vidal, R., Ma, Y., & Sastry, S. (2005). Generalized principal component analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(12), 1945–1959.CrossRef
go back to reference Wang, X., Ma, X., & Grimson, E. (2007). Unsupervised activity perception by hierarchical bayesian models. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1–8). Wang, X., Ma, X., & Grimson, E. (2007). Unsupervised activity perception by hierarchical bayesian models. In IEEE conference on computer vision and pattern recognition (CVPR) (pp. 1–8).
go back to reference Wu, S., Moore, B. E., & Shah, M. (2010). Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes. In IEEE conference on computer vision and pattern recognition (CVPR). Wu, S., Moore, B. E., & Shah, M. (2010). Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes. In IEEE conference on computer vision and pattern recognition (CVPR).
go back to reference Xu, D., Ricci, E., Yan, Y., Song, J., & Sebe, N. (2015). Learning deep representations of appearance and motion for anomalous event detection. arXiv preprint arXiv:1510.01553. Xu, D., Ricci, E., Yan, Y., Song, J., & Sebe, N. (2015). Learning deep representations of appearance and motion for anomalous event detection. arXiv preprint arXiv:​1510.​01553.
go back to reference Yang, J., & Zhang, Y. (2011). Alternating direction algorithms for \(\backslash \)ell\_1-problems in compressive sensing. SIAM Journal on Scientific Computing, 33(1), 250–278.MathSciNetCrossRefMATH Yang, J., & Zhang, Y. (2011). Alternating direction algorithms for \(\backslash \)ell\_1-problems in compressive sensing. SIAM Journal on Scientific Computing, 33(1), 250–278.MathSciNetCrossRefMATH
go back to reference Zhang, D., Gatica-Perez, D., Bengio, S., & McCowan, I. (2005). Semi-supervised adapted hmms for unusual event detection. In IEEE conference on computer vision and pattern recognition (CVPR). Zhang, D., Gatica-Perez, D., Bengio, S., & McCowan, I. (2005). Semi-supervised adapted hmms for unusual event detection. In IEEE conference on computer vision and pattern recognition (CVPR).
go back to reference Zhao, B., Fei-Fei, L., & Xing, E. P. (2011). Online detection of unusual events in videos via dynamic sparse coding. In IEEE conference on computer vision and pattern recognition (CVPR). Zhao, B., Fei-Fei, L., & Xing, E. P. (2011). Online detection of unusual events in videos via dynamic sparse coding. In IEEE conference on computer vision and pattern recognition (CVPR).
go back to reference Zhong, H., Shi, J., & Visontai, M. (2004). Detecting unusual activity in video. In IEEE conference on computer vision and pattern recognition (CVPR). Zhong, H., Shi, J., & Visontai, M. (2004). Detecting unusual activity in video. In IEEE conference on computer vision and pattern recognition (CVPR).
Metadata
Title
Fast Abnormal Event Detection
Authors
Cewu Lu
Jianping Shi
Weiming Wang
Jiaya Jia
Publication date
01-12-2018
Publisher
Springer US
Published in
International Journal of Computer Vision / Issue 8/2019
Print ISSN: 0920-5691
Electronic ISSN: 1573-1405
DOI
https://doi.org/10.1007/s11263-018-1129-8

Other articles of this Issue 8/2019

International Journal of Computer Vision 8/2019 Go to the issue

Premium Partner