Skip to main content

2016 | OriginalPaper | Buchkapitel

A Discriminative Framework for Anomaly Detection in Large Videos

verfasst von : Allison Del Giorno, J. Andrew Bagnell, Martial Hebert

Erschienen in: Computer Vision – ECCV 2016

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We address an anomaly detection setting in which training sequences are unavailable and anomalies are scored independently of temporal ordering. Current algorithms in anomaly detection are based on the classical density estimation approach of learning high-dimensional models and finding low-probability events. These algorithms are sensitive to the order in which anomalies appear and require either training data or early context assumptions that do not hold for longer, more complex videos. By defining anomalies as examples that can be distinguished from other examples in the same video, our definition inspires a shift in approaches from classical density estimation to simple discriminative learning. Our contributions include a novel framework for anomaly detection that is (1) independent of temporal ordering of anomalies, and (2) unsupervised, requiring no separate training sequences. We show that our algorithm can achieve state-of-the-art results even when we adjust the setting by removing training sequences from standard datasets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
For simplicity, we describe the algorithm when the sliding window size and stride equal each other, \(t_w = \varDelta t_w\). It is just as valid to shorten the stride to increase accuracy. See Algorithm 1.
 
2
Ignoring the rare case when it occurs in the very first negative window.
 
3
Kakade provides a quick summary for those unfamiliar with these bounds [16]: http://​stat.​wharton.​upenn.​edu/​~skakade/​courses/​stat928/​lectures/​lecture06.​pdf.
 
4
The insights that follow generalize to VC dimension and other complexity measures.
 
5
For a useful introduction, see [19].
 
7
See supplementary material for more results, including results on individual videos in the UMN and Avenue datasets.
 
8
Other videos are unusable for a similar reason; for instance, 2 of the 8 videos available from [23] contain more than 50 % frames with at least one anomaly, and only 2 contain fewer than 20 % anomalous frames (one of which is the Subway exit sequence).
 
10
Consider the case when only 1 % of the video is anomalous: the EER on an algorithm that markes all frames normal would be 1 %, outperforming most modern algorithms. This extreme class imbalance is less prevalent in current standard datasets, but will become an apparent problem as more realistic datasets become prevalent.
 
Literatur
1.
Zurück zum Zitat Zhao, B., Fei-Fei, L., Xing, E.: Online detection of unusual events in videos via dynamic sparse coding. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3313–3320, June 2011 Zhao, B., Fei-Fei, L., Xing, E.: Online detection of unusual events in videos via dynamic sparse coding. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3313–3320, June 2011
2.
Zurück zum Zitat Lu, C., Shi, J., Jia, J.: Abnormal event detection at 150 fps in matlab. In: 2013 IEEE International Conference on Computer Vision (ICCV), pp. 2720–2727. IEEE (2013) Lu, C., Shi, J., Jia, J.: Abnormal event detection at 150 fps in matlab. In: 2013 IEEE International Conference on Computer Vision (ICCV), pp. 2720–2727. IEEE (2013)
3.
Zurück zum Zitat Mahadevan, V., Li, W., Bhalodia, V., Vasconcelos, N.: Anomaly detection in crowded scenes. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1975–1981. IEEE (2010) Mahadevan, V., Li, W., Bhalodia, V., Vasconcelos, N.: Anomaly detection in crowded scenes. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1975–1981. IEEE (2010)
4.
Zurück zum Zitat Kim, J., Grauman, K.: Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates. In: IEEE Conference on Computer Vision and Pattern Recognition, 2009, CVPR 2009, pp. 2921–2928. IEEE (2009) Kim, J., Grauman, K.: Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates. In: IEEE Conference on Computer Vision and Pattern Recognition, 2009, CVPR 2009, pp. 2921–2928. IEEE (2009)
5.
Zurück zum Zitat Li, W., Mahadevan, V., Vasconcelos, N.: Anomaly detection and localization in crowded scenes. IEEE Trans. Pattern Anal. Mach. Intell. 36(1), 18–32 (2014)CrossRef Li, W., Mahadevan, V., Vasconcelos, N.: Anomaly detection and localization in crowded scenes. IEEE Trans. Pattern Anal. Mach. Intell. 36(1), 18–32 (2014)CrossRef
6.
Zurück zum Zitat Mehran, R., Oyama, A., Shah, M.: Abnormal crowd behavior detection using social force model. In: IEEE Conference on Computer Vision and Pattern Recognition, 2009, CVPR 2009, pp. 935–942. IEEE (2009) Mehran, R., Oyama, A., Shah, M.: Abnormal crowd behavior detection using social force model. In: IEEE Conference on Computer Vision and Pattern Recognition, 2009, CVPR 2009, pp. 935–942. IEEE (2009)
7.
Zurück zum Zitat Antić, B., Ommer, B.: Video parsing for abnormality detection. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 2415–2422. IEEE (2011) Antić, B., Ommer, B.: Video parsing for abnormality detection. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 2415–2422. IEEE (2011)
8.
Zurück zum Zitat Roshtkhari, M., Levine, M.: Online dominant and anomalous behavior detection in videos. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2611–2618 (2013) Roshtkhari, M., Levine, M.: Online dominant and anomalous behavior detection in videos. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2611–2618 (2013)
9.
Zurück zum Zitat Calderara, S., Heinemann, U., Prati, A., Cucchiara, R., Tishby, N.: Detecting anomalies in peoples trajectories using spectral graph analysis. Comput. Vis. Image Underst. 115(8), 1099–1111 (2011)CrossRef Calderara, S., Heinemann, U., Prati, A., Cucchiara, R., Tishby, N.: Detecting anomalies in peoples trajectories using spectral graph analysis. Comput. Vis. Image Underst. 115(8), 1099–1111 (2011)CrossRef
10.
Zurück zum Zitat Liu, S., Yamada, M., Collier, N., Sugiyama, M.: Change-point detection in time-series data by relative density-ratio estimation. Neural Netw. 43, 72–83 (2013)CrossRefMATH Liu, S., Yamada, M., Collier, N., Sugiyama, M.: Change-point detection in time-series data by relative density-ratio estimation. Neural Netw. 43, 72–83 (2013)CrossRefMATH
11.
Zurück zum Zitat Ito, Y., Kitani, K.M., Bagnell, J.A., Hebert, M.: Detecting interesting events using unsupervised density ratio estimation. In: Fusiello, A., Murino, V., Cucchiara, R. (eds.) ECCV 2012. LNCS, vol. 7585, pp. 151–161. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33885-4_16 Ito, Y., Kitani, K.M., Bagnell, J.A., Hebert, M.: Detecting interesting events using unsupervised density ratio estimation. In: Fusiello, A., Murino, V., Cucchiara, R. (eds.) ECCV 2012. LNCS, vol. 7585, pp. 151–161. Springer, Heidelberg (2012). doi:10.​1007/​978-3-642-33885-4_​16
12.
Zurück zum Zitat Kawahara, Y., Sugiyama, M.: Change-point detection in time-series data by direct density-ratio estimation. In: SDM, vol. 9, pp. 389–400. SIAM (2009) Kawahara, Y., Sugiyama, M.: Change-point detection in time-series data by direct density-ratio estimation. In: SDM, vol. 9, pp. 389–400. SIAM (2009)
13.
Zurück zum Zitat Sugiyama, M., Suzuki, T., Kanamori, T.: Density ratio estimation: a comprehensive review. RIMS Kokyuroku, pp. 10–31 (2010) Sugiyama, M., Suzuki, T., Kanamori, T.: Density ratio estimation: a comprehensive review. RIMS Kokyuroku, pp. 10–31 (2010)
14.
Zurück zum Zitat Wang, H., Kläser, A., Schmid, C., Liu, C.L.: Action recognition by dense trajectories. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3169–3176. IEEE (2011) Wang, H., Kläser, A., Schmid, C., Liu, C.L.: Action recognition by dense trajectories. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3169–3176. IEEE (2011)
15.
Zurück zum Zitat Motwani, R., Raghavan, P.: Randomized algorithms. Chapman & Hall/CRC (2010) Motwani, R., Raghavan, P.: Randomized algorithms. Chapman & Hall/CRC (2010)
17.
Zurück zum Zitat Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., Vaughan, J.W.: A theory of learning from different domains. Mach. Learn. 79(1–2), 151–175 (2010)MathSciNetCrossRef Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., Vaughan, J.W.: A theory of learning from different domains. Mach. Learn. 79(1–2), 151–175 (2010)MathSciNetCrossRef
18.
Zurück zum Zitat Bartlett, P.L., Mendelson, S.: Rademacher and gaussian complexities: risk bounds and structural results. J. Mach. Learn. Res. 3, 463–482 (2003)MathSciNetMATH Bartlett, P.L., Mendelson, S.: Rademacher and gaussian complexities: risk bounds and structural results. J. Mach. Learn. Res. 3, 463–482 (2003)MathSciNetMATH
20.
Zurück zum Zitat Borenstein, M., Hedges, L.V., Higgins, J., Rothstein, H.R.: A basic introduction to fixed-effect and random-effects models for meta-analysis. Res. Synth. Methods 1(2), 97–111 (2010)CrossRef Borenstein, M., Hedges, L.V., Higgins, J., Rothstein, H.R.: A basic introduction to fixed-effect and random-effects models for meta-analysis. Res. Synth. Methods 1(2), 97–111 (2010)CrossRef
21.
Zurück zum Zitat Adam, A., Rivlin, E., Shimshoni, I., Reinitz, D.: Robust real-time unusual event detection using multiple fixed-location monitors. IEEE Trans. Pattern Anal. Mach. Intell. 30(3), 555–560 (2008)CrossRef Adam, A., Rivlin, E., Shimshoni, I., Reinitz, D.: Robust real-time unusual event detection using multiple fixed-location monitors. IEEE Trans. Pattern Anal. Mach. Intell. 30(3), 555–560 (2008)CrossRef
Metadaten
Titel
A Discriminative Framework for Anomaly Detection in Large Videos
verfasst von
Allison Del Giorno
J. Andrew Bagnell
Martial Hebert
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46454-1_21