Skip to main content
Top
Published in: Neural Computing and Applications 5/2019

09-03-2018 | S.I. : Emerging Intelligent Algorithms for Edge-of-Things Computing

Abnormal event detection with semi-supervised sparse topic model

Authors: Jun Wang, Limin Xia, Xiangjie Hu, Yongliang Xiao

Published in: Neural Computing and Applications | Issue 5/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Most research on anomaly detection has focused on event that is different from its spatial–temporal neighboring events. However, it is still a significant challenge to detect anomalies that involve multiple normal events interacting in an unusual pattern. To address this problem, a novel semi-supervised method based on sparse topic model is proposed to detect anomalies in video surveillance. Short local trajectory method is used to extract motion information in order to improve the robustness of trajectories. For the purpose of strengthening the relationship of interest points on the same trajectory, the Fisher kernel method is applied to obtain the representation of trajectory which is quantized into visual word. Then, the sparse topic model is proposed to explore the latent motion patterns and achieve a sparse representation for the video scene. Finally, a semi-supervised learning method is applied to enhance the discrimination of model and improve the performance of anomaly detection. Experiments are conducted on QMUL dataset and AVSS dataset. The results demonstrated the superior efficiency of the proposed method.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Leyva R, Sanchez V, Li C (2015) Video anomaly detection based on wake motion descriptors and perspective grids. In: IEEE international workshop on information forensics and security. IEEE, pp 209–214 Leyva R, Sanchez V, Li C (2015) Video anomaly detection based on wake motion descriptors and perspective grids. In: IEEE international workshop on information forensics and security. IEEE, pp 209–214
2.
go back to reference Piciarelli C, Foresti GL (2010) Surveillance-oriented event detection in video streams. IEEE Intell Syst 26(3):32–41CrossRef Piciarelli C, Foresti GL (2010) Surveillance-oriented event detection in video streams. IEEE Intell Syst 26(3):32–41CrossRef
3.
go back to reference Cong Y, Yuan J, Liu J (2011) Sparse reconstruction cost for abnormal event detection. In: IEEE conference on computer vision and pattern recognition. IEEE Computer Society, pp 3449–3456 Cong Y, Yuan J, Liu J (2011) Sparse reconstruction cost for abnormal event detection. In: IEEE conference on computer vision and pattern recognition. IEEE Computer Society, pp 3449–3456
4.
go back to reference Ren H, Moeslund TB (2014) Abnormal event detection using local sparse representation. In: IEEE international conference on advanced video and signal based surveillance. IEEE, pp 125–130 Ren H, Moeslund TB (2014) Abnormal event detection using local sparse representation. In: IEEE international conference on advanced video and signal based surveillance. IEEE, pp 125–130
5.
go back to reference Xia LM, Yang BJ, Tu HB (2015) Recognition of suspicious behavior using case-based reasoning. J Cent South Univ 22(1):241–250CrossRef Xia LM, Yang BJ, Tu HB (2015) Recognition of suspicious behavior using case-based reasoning. J Cent South Univ 22(1):241–250CrossRef
6.
go back to reference Roshtkhari MJ, Levine MD (2013) Online dominant and anomalous behavior detection in videos. In: Computer vision and pattern recognition. IEEE, pp 2611–2618 Roshtkhari MJ, Levine MD (2013) Online dominant and anomalous behavior detection in videos. In: Computer vision and pattern recognition. IEEE, pp 2611–2618
7.
go back to reference Biswas S, Barur V (2015) Sparse representation based anomaly detection with enhanced local dictionaries. In: IEEE international conference on image processing. IEEE, pp 5532–5536 Biswas S, Barur V (2015) Sparse representation based anomaly detection with enhanced local dictionaries. In: IEEE international conference on image processing. IEEE, pp 5532–5536
8.
go back to reference Cui X, Liu Q, Gao M et al (2011) Abnormal detection using interaction energy potentials. In: Computer vision and pattern recognition. IEEE, pp 3161–3167 Cui X, Liu Q, Gao M et al (2011) Abnormal detection using interaction energy potentials. In: Computer vision and pattern recognition. IEEE, pp 3161–3167
9.
go back to reference Bera A, Kim S, Manocha D (2016) Realtime anomaly detection using trajectory-level crowd behavior learning. In: IEEE conference on computer vision and pattern recognition workshops. IEEE Computer Society, pp 1289–1296 Bera A, Kim S, Manocha D (2016) Realtime anomaly detection using trajectory-level crowd behavior learning. In: IEEE conference on computer vision and pattern recognition workshops. IEEE Computer Society, pp 1289–1296
10.
go back to reference Cheng KW, Chen YT, Fang WH (2015) Gaussian process regression-based video anomaly detection and localization with hierarchical feature representation. IEEE Trans Image Process 24(12):5288–5301MathSciNetCrossRefMATH Cheng KW, Chen YT, Fang WH (2015) Gaussian process regression-based video anomaly detection and localization with hierarchical feature representation. IEEE Trans Image Process 24(12):5288–5301MathSciNetCrossRefMATH
11.
go back to reference Yang C, Yuan J, Ji L (2011) Sparse reconstruction cost for abnormal event detection. In: IEEE conference on computer vision & pattern recognition, pp 3449–3456 Yang C, Yuan J, Ji L (2011) Sparse reconstruction cost for abnormal event detection. In: IEEE conference on computer vision & pattern recognition, pp 3449–3456
12.
go back to reference Guo K, Ishwar P, Konrad J (2010) Action recognition using sparse representation on covariance manifolds of optical flow. In: IEEE international conference on advanced video & signal based surveillance. IEEE Computer Society, pp 188–195 Guo K, Ishwar P, Konrad J (2010) Action recognition using sparse representation on covariance manifolds of optical flow. In: IEEE international conference on advanced video & signal based surveillance. IEEE Computer Society, pp 188–195
13.
go back to reference Mo X, Monga V, Bala R et al (2014) Adaptive sparse representations for video anomaly detection. IEEE Trans Circuits Syst Video Technol 24(4):631–645CrossRef Mo X, Monga V, Bala R et al (2014) Adaptive sparse representations for video anomaly detection. IEEE Trans Circuits Syst Video Technol 24(4):631–645CrossRef
14.
go back to reference Kaviani R, Ahmadi P, Gholampour I (2014) Incorporating fully sparse topic models for abnormality detection in traffic videos. In: International conference on computer and knowledge engineering. IEEE, pp 586–591 Kaviani R, Ahmadi P, Gholampour I (2014) Incorporating fully sparse topic models for abnormality detection in traffic videos. In: International conference on computer and knowledge engineering. IEEE, pp 586–591
15.
go back to reference Emonet R, Varadarajan J, Odobez JM (2011) Extracting and locating temporal motifs in video scenes using a hierarchical non parametric bayesian model. In: Computer vision and pattern recognition. IEEE, pp 3233–3240 Emonet R, Varadarajan J, Odobez JM (2011) Extracting and locating temporal motifs in video scenes using a hierarchical non parametric bayesian model. In: Computer vision and pattern recognition. IEEE, pp 3233–3240
16.
go back to reference Yoo Y, Yun K, Yun S et al (2016) Visual path prediction in complex scenes with crowded moving objects. In: Computer vision and pattern recognition. IEEE, pp 2668–2677 Yoo Y, Yun K, Yun S et al (2016) Visual path prediction in complex scenes with crowded moving objects. In: Computer vision and pattern recognition. IEEE, pp 2668–2677
17.
go back to reference Fu W, Wang J, Lu H et al (2013) Dynamic scene understanding by improved sparse topical coding. Pattern Recogn 46(7):1841–1850CrossRef Fu W, Wang J, Lu H et al (2013) Dynamic scene understanding by improved sparse topical coding. Pattern Recogn 46(7):1841–1850CrossRef
18.
go back to reference Wang J, Fu W, Lu H et al (2014) Bilayer sparse topic model for scene analysis in imbalanced surveillance videos. IEEE Trans Image Process 23(12):5198–5208MathSciNetCrossRefMATH Wang J, Fu W, Lu H et al (2014) Bilayer sparse topic model for scene analysis in imbalanced surveillance videos. IEEE Trans Image Process 23(12):5198–5208MathSciNetCrossRefMATH
19.
go back to reference Jeong H, Yoo Y, Yi KM et al (2014) Two-stage online inference model for traffic pattern analysis and anomaly detection. Mach Vis Appl 25(6):1501–1517CrossRef Jeong H, Yoo Y, Yi KM et al (2014) Two-stage online inference model for traffic pattern analysis and anomaly detection. Mach Vis Appl 25(6):1501–1517CrossRef
20.
go back to reference Pathak D, Sharang A, Mukerjee A (2015) Anomaly localization in topic-based analysis of surveillance videos. In: IEEE winter conference on applications of computer vision. IEEE Computer Society, pp 389–395 Pathak D, Sharang A, Mukerjee A (2015) Anomaly localization in topic-based analysis of surveillance videos. In: IEEE winter conference on applications of computer vision. IEEE Computer Society, pp 389–395
21.
go back to reference Wang H, Klaser A, Schmid C et al (2013) Dense trajectories and motion boundary descriptors for action recognition. Int J Comput Vis 103(1):60–79MathSciNetCrossRef Wang H, Klaser A, Schmid C et al (2013) Dense trajectories and motion boundary descriptors for action recognition. Int J Comput Vis 103(1):60–79MathSciNetCrossRef
22.
go back to reference Perronnin F, Nchez J, Mensink T (2010) Improving the fisher kernel for large-scale image classification. In: European conference on computer vision. Springer, pp 143–156 Perronnin F, Nchez J, Mensink T (2010) Improving the fisher kernel for large-scale image classification. In: European conference on computer vision. Springer, pp 143–156
23.
go back to reference Perronnin F, Dance C, Csurka G et al (2006) Adapted vocabularies for generic visual categorization. In: European conference on computer vision. Springer, pp 464–475 Perronnin F, Dance C, Csurka G et al (2006) Adapted vocabularies for generic visual categorization. In: European conference on computer vision. Springer, pp 464–475
24.
go back to reference Eltoft T, Kim T, Lee TW (2006) On the multivariate Laplace distribution. IEEE Signal Process Lett 13(5):300–330CrossRef Eltoft T, Kim T, Lee TW (2006) On the multivariate Laplace distribution. IEEE Signal Process Lett 13(5):300–330CrossRef
Metadata
Title
Abnormal event detection with semi-supervised sparse topic model
Authors
Jun Wang
Limin Xia
Xiangjie Hu
Yongliang Xiao
Publication date
09-03-2018
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 5/2019
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-018-3417-1

Other articles of this Issue 5/2019

Neural Computing and Applications 5/2019 Go to the issue

S.I. : Emerging Intelligent Algorithms for Edge-of-Things Computing

EoT-driven hybrid ambient assisted living framework with naïve Bayes–firefly algorithm

S.I. : Emerging Intelligent Algorithms for Edge-of-Things Computing

A new and efficient firefly algorithm for numerical optimization problems

S.I. : Emerging Intelligent Algorithms for Edge-of-Things Computing

Tuberculosis (TB) detection system using deep neural networks

S.I. : Emerging Intelligent Algorithms for Edge-of-Things Computing

Classifying streaming of Twitter data based on sentiment analysis using hybridization

Premium Partner