Skip to main content

2020 | OriginalPaper | Buchkapitel

Abnormal Event Detection and Localization in Visual Surveillance

verfasst von : Yonglin Mu, Bo Zhang

Erschienen in: Communications, Signal Processing, and Systems

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we propose a framework for abnormal event detection and analysis in the field of visual surveillance based on the state-of-the-art deep learning techniques. We train a pair of conditional generative adversarial networks (cGANs) using the normal behavior samples, where one cGAN takes video frames as inputs and generates the corresponding optical flow features. While on the other hand, the other cGANs take optical flow features as inputs and generate the corresponding video frames. By analyzing the differences between the generated frames/optical flow features and the realistic samples, abnormal events can be detected and localized effectively. Moreover, for suspected regions, we adopt the faster RCNN to analyze the abnormal events. Experimental results demonstrate that the proposed framework can detect the abnormal events accurately and efficiently.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Mehran R, Oyama A, Shah M. Abnormal crowd behavior detection using social force model. In: IEEE conference on computer vision and pattern recognition; 2009. p. 935–42. Mehran R, Oyama A, Shah M. Abnormal crowd behavior detection using social force model. In: IEEE conference on computer vision and pattern recognition; 2009. p. 935–42.
2.
Zurück zum Zitat Cong Y, Yuan J, Liu J. Sparse reconstruction cost for abnormal event detection. In: IEEE conference on computer vision and pattern recognition; 2011. p. 3449–3456. Cong Y, Yuan J, Liu J. Sparse reconstruction cost for abnormal event detection. In: IEEE conference on computer vision and pattern recognition; 2011. p. 3449–3456.
3.
Zurück zum Zitat Hinami R, Mei T, Shin. Joint detection and recounting of abnormal events by learning deep generic knowledge. In: IEEE international conference on computer vision; 2017. p. 3639–47. Hinami R, Mei T, Shin. Joint detection and recounting of abnormal events by learning deep generic knowledge. In: IEEE international conference on computer vision; 2017. p. 3639–47.
4.
Zurück zum Zitat Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville AC, Bengio Y. Generative adversarial nets. In: International conference on neural information processing systems; 2014. p. 2672–80. Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville AC, Bengio Y. Generative adversarial nets. In: International conference on neural information processing systems; 2014. p. 2672–80.
5.
Zurück zum Zitat Isola P, Zhu J, Zhou T, Efros AA. Image-to-image translation with conditional adversarial networks. In: IEEE conference on computer vision and pattern recognition; 2016. p. 5967–76. Isola P, Zhu J, Zhou T, Efros AA. Image-to-image translation with conditional adversarial networks. In: IEEE conference on computer vision and pattern recognition; 2016. p. 5967–76.
6.
Zurück zum Zitat Ren S, Girshick R, Girshick R, Sun J. Faster RCNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell. 2017;39(6):1137–49.CrossRef Ren S, Girshick R, Girshick R, Sun J. Faster RCNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell. 2017;39(6):1137–49.CrossRef
8.
Zurück zum Zitat Kim J, Grauman K. Observe locally, infer globally: A space-time MRF for detecting abnormal activities with incremental updates. In: IEEE Conference on Computer Vision and Pattern Recognition; 2015. 2921–7. Kim J, Grauman K. Observe locally, infer globally: A space-time MRF for detecting abnormal activities with incremental updates. In: IEEE Conference on Computer Vision and Pattern Recognition; 2015. 2921–7.
9.
Zurück zum Zitat Choi W, Shahid K, Savarese S. Learning context for collective activity recognition. In: IEEE conference on computer vision and pattern recognition; 2011. p. 3273–80. Choi W, Shahid K, Savarese S. Learning context for collective activity recognition. In: IEEE conference on computer vision and pattern recognition; 2011. p. 3273–80.
10.
Zurück zum Zitat Mousavi H, Nabi M, Galoogahi HK, Perina A, Murino V. Abnormality detection with improved histogram of oriented tracklets. In: International conference on image analysis and processing; 2015. p. 722–32.CrossRef Mousavi H, Nabi M, Galoogahi HK, Perina A, Murino V. Abnormality detection with improved histogram of oriented tracklets. In: International conference on image analysis and processing; 2015. p. 722–32.CrossRef
11.
Zurück zum Zitat Ravanbakhsh M, Nabi M, Mousavi H, Sangineto E, Sebe N. Plug-and-play CNN for crowd motion analysis: an application in abnormal event detection. In: IEEE winter conference on applications of computer vision; 2018. Ravanbakhsh M, Nabi M, Mousavi H, Sangineto E, Sebe N. Plug-and-play CNN for crowd motion analysis: an application in abnormal event detection. In: IEEE winter conference on applications of computer vision; 2018.
13.
Zurück zum Zitat Radford A, Metz L, Chintala S. Unsupervised representation learning with deep convolutional generative adversarial networks. In: International Conference on Learning Representations; 2016. Radford A, Metz L, Chintala S. Unsupervised representation learning with deep convolutional generative adversarial networks. In: International Conference on Learning Representations; 2016.
14.
Zurück zum Zitat Ravanbakhsh M, Nabi M, Sangineto E, Marcenaro L, Regazzoni C, Sebe N. Abnormal event detection in videos using generative adversarial nets. In: IEEE international conference on image processing; 2017. Ravanbakhsh M, Nabi M, Sangineto E, Marcenaro L, Regazzoni C, Sebe N. Abnormal event detection in videos using generative adversarial nets. In: IEEE international conference on image processing; 2017.
15.
Zurück zum Zitat Brox T, Malik J. Large displacement optical flow: descriptor matching in variational motion estimation. IEEE Trans Pattern Anal Mach Intell. 2011;33(3):500–13.CrossRef Brox T, Malik J. Large displacement optical flow: descriptor matching in variational motion estimation. IEEE Trans Pattern Anal Mach Intell. 2011;33(3):500–13.CrossRef
16.
Zurück zum Zitat Mahadevan V, Li W, Vasconcelos N. Anomaly detection in crowded scenes. In: IEEE conference on computer vision and pattern recognition; 2010. p. 1975–81. Mahadevan V, Li W, Vasconcelos N. Anomaly detection in crowded scenes. In: IEEE conference on computer vision and pattern recognition; 2010. p. 1975–81.
17.
Zurück zum Zitat Lu C, Shi J, Jia J. Abnormal event detection at 150 FPS in MATLAB. In: IEEE international conference on computer vision; 2014. p. 2720–7. Lu C, Shi J, Jia J. Abnormal event detection at 150 FPS in MATLAB. In: IEEE international conference on computer vision; 2014. p. 2720–7.
18.
Zurück zum Zitat Xu D, Yan Y, Ricci E, Sebe N. Detecting anomalous events in videos by learning deep representations of appearance and motion. Comput Vis Image Underst. 2016;156:117–27.CrossRef Xu D, Yan Y, Ricci E, Sebe N. Detecting anomalous events in videos by learning deep representations of appearance and motion. Comput Vis Image Underst. 2016;156:117–27.CrossRef
Metadaten
Titel
Abnormal Event Detection and Localization in Visual Surveillance
verfasst von
Yonglin Mu
Bo Zhang
Copyright-Jahr
2020
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-13-6504-1_145