Skip to main content
Erschienen in: Machine Vision and Applications 1-2/2017

11.11.2016 | Original Paper

Motion interaction field for detection of abnormal interactions

verfasst von: Kimin Yun, Youngjoon Yoo, Jin Young Choi

Erschienen in: Machine Vision and Applications | Ausgabe 1-2/2017

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes a new method for the modeling of interactions among objects and for the detection of abnormal interactions in a video. To model interactions among multiple moving objects, we design a motion interaction field (MIF) that is similar to a water waveform generated by multiple objects moving on the surface of water and that describes the intensity of motion interaction in a video. Using the MIF, we establish a framework to detect abnormal interactions, which consists of rule-based decision about regions of interest and dictionary learning-based anomaly decision for these regions. The regions of interest are determined as the regions remaining after filtering out collision-free regions that are recognized clearly to be normal by a rule-based decision based on the shape of MIF. The MIF values in these regions are then used to construct spatiotemporal features for the detection of abnormal interactions by a dictionary learning algorithm with sparse representation. In the experiments, the effectiveness of the proposed method is validated through quantitative and qualitative evaluations with three datasets containing typical abnormal interactions such as car accidents, crowd riots, and uncontrolled fighting.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Basharat, A., Gritai, A., Shah, M.: Learning object motion patterns for anomaly detection and improved object detection. In: Computer Vision and Pattern Recognition (CVPR), pp. 1–8 (2008) Basharat, A., Gritai, A., Shah, M.: Learning object motion patterns for anomaly detection and improved object detection. In: Computer Vision and Pattern Recognition (CVPR), pp. 1–8 (2008)
2.
Zurück zum Zitat Blunsden, S., Fisher, R.B.: The BEHAVE video dataset: ground truthed video for multi-person behavior classificationt. Ann. BMVA 4, 1–12 (2010) Blunsden, S., Fisher, R.B.: The BEHAVE video dataset: ground truthed video for multi-person behavior classificationt. Ann. BMVA 4, 1–12 (2010)
3.
Zurück zum Zitat Breitenstein, M.D., Grabner, H., Van Gool, L.: Hunting nessie-real-time abnormality detection from webcams. In: International Conference on Computer Vision Workshops (ICCV Workshops), pp. 1243–1250. IEEE (2009) Breitenstein, M.D., Grabner, H., Van Gool, L.: Hunting nessie-real-time abnormality detection from webcams. In: International Conference on Computer Vision Workshops (ICCV Workshops), pp. 1243–1250. IEEE (2009)
4.
Zurück zum Zitat Brendel, W., Todorovic, S.: Learning spatiotemporal graphs of human activities. In: International Conference on Computer Vision (ICCV), pp. 778–785 (2011) Brendel, W., Todorovic, S.: Learning spatiotemporal graphs of human activities. In: International Conference on Computer Vision (ICCV), pp. 778–785 (2011)
5.
Zurück zum Zitat Bruhn, A., Weickert, J., Feddern, C., Kohlberger, T., Schnörr, C.: Variational optical flow computation in real time. IEEE Trans. Image Process. 14(5), 608–615 (2005)MathSciNetCrossRefMATH Bruhn, A., Weickert, J., Feddern, C., Kohlberger, T., Schnörr, C.: Variational optical flow computation in real time. IEEE Trans. Image Process. 14(5), 608–615 (2005)MathSciNetCrossRefMATH
6.
Zurück zum Zitat Choi, W., Shahid, K., Savarese, S.: Learning context for collective activity recognition. In: Computer Vision and Pattern Recognition (CVPR), pp. 3273–3280. IEEE (2011) Choi, W., Shahid, K., Savarese, S.: Learning context for collective activity recognition. In: Computer Vision and Pattern Recognition (CVPR), pp. 3273–3280. IEEE (2011)
7.
Zurück zum Zitat Cong, Y., Yuan, J., Liu, J.: Sparse reconstruction cost for abnormal event detection. In: Computer Vision and Pattern Recognition (CVPR) (2011) Cong, Y., Yuan, J., Liu, J.: Sparse reconstruction cost for abnormal event detection. In: Computer Vision and Pattern Recognition (CVPR) (2011)
8.
Zurück zum Zitat Cords, H., Staadt, O.G.: Real-time open water environments with interacting objects. Eurographics Workshop on Natural Phenomena (2009) Cords, H., Staadt, O.G.: Real-time open water environments with interacting objects. Eurographics Workshop on Natural Phenomena (2009)
9.
Zurück zum Zitat Cui, X., Liu, Q., Gao, M., Metaxas, D.N.: Abnormal detection using interaction energy potentials. In: Computer Vision and Pattern Recognition (CVPR), pp. 3161–3167. IEEE (2011) Cui, X., Liu, Q., Gao, M., Metaxas, D.N.: Abnormal detection using interaction energy potentials. In: Computer Vision and Pattern Recognition (CVPR), pp. 3161–3167. IEEE (2011)
10.
Zurück zum Zitat Farnebäck, G.: Two-frame motion estimation based on polynomial expansion. In: SCIA’03: Proceedings of the 13th Scandinavian Conference on Image Analysis. Linkoping University, Springer (2003) Farnebäck, G.: Two-frame motion estimation based on polynomial expansion. In: SCIA’03: Proceedings of the 13th Scandinavian Conference on Image Analysis. Linkoping University, Springer (2003)
11.
Zurück zum Zitat Helbing, D., Tilch, B.: Generalized force model of traffic dynamics. Phys. Rev. E 58(1), 133–138 (1998)CrossRef Helbing, D., Tilch, B.: Generalized force model of traffic dynamics. Phys. Rev. E 58(1), 133–138 (1998)CrossRef
12.
Zurück zum Zitat Hospedales, T., Gong, S., Xiang, T.: A Markov clustering topic model for mining behaviour in video. In: International Conference on Computer Vision (ICCV) (2009) Hospedales, T., Gong, S., Xiang, T.: A Markov clustering topic model for mining behaviour in video. In: International Conference on Computer Vision (ICCV) (2009)
13.
Zurück zum Zitat Hu, M.K.: Visual pattern recognition by moment invariants. IRE Trans. Inf. Theory IT–8, 179–187 (1962)MATH Hu, M.K.: Visual pattern recognition by moment invariants. IRE Trans. Inf. Theory IT–8, 179–187 (1962)MATH
14.
Zurück zum Zitat Hu, W., Xiao, X., Fu, Z., Xie, D., Tan, T., Maybank, S.: A system for learning statistical motion patterns. IEEE Trans. Pattern Anal. Mach. Intell. 28(9), 1450–1464 (2006)CrossRef Hu, W., Xiao, X., Fu, Z., Xie, D., Tan, T., Maybank, S.: A system for learning statistical motion patterns. IEEE Trans. Pattern Anal. Mach. Intell. 28(9), 1450–1464 (2006)CrossRef
15.
Zurück zum Zitat Jeong, H., Yoo, Y., Yi, K.M., Choi, J.Y.: Two-stage online inference model for traffic pattern analysis and anomaly detection. Mach. Vis. Appl. 25(6), 1501–1517 (2014)CrossRef Jeong, H., Yoo, Y., Yi, K.M., Choi, J.Y.: Two-stage online inference model for traffic pattern analysis and anomaly detection. Mach. Vis. Appl. 25(6), 1501–1517 (2014)CrossRef
16.
Zurück zum Zitat Konrad, J.: Motion Detection and Estimation. Handbook of Image and Video Processing, 2nd edn. Academic Press, Cambridge (2005) Konrad, J.: Motion Detection and Estimation. Handbook of Image and Video Processing, 2nd edn. Academic Press, Cambridge (2005)
17.
Zurück zum Zitat Lan, T., Wang, Y., Yang, W., Mori, G.: Beyond actions: discriminative models for contextual group activities. In: Advances in Neural Information Processing Systems, pp. 1216–1224 (2010) Lan, T., Wang, Y., Yang, W., Mori, G.: Beyond actions: discriminative models for contextual group activities. In: Advances in Neural Information Processing Systems, pp. 1216–1224 (2010)
18.
Zurück zum Zitat Liu, C.: Beyond pixels: exploring new representations and applications for motion analysis. Doctoral thesis, Massachusetts Institute of Technology (2009) Liu, C.: Beyond pixels: exploring new representations and applications for motion analysis. Doctoral thesis, Massachusetts Institute of Technology (2009)
19.
Zurück zum Zitat Lu, C., Shi, J., Jia, J.: Abnormal event detection at 150 fps in matlab. In: International Conference on Computer Vision (ICCV) (2013) Lu, C., Shi, J., Jia, J.: Abnormal event detection at 150 fps in matlab. In: International Conference on Computer Vision (ICCV) (2013)
20.
Zurück zum Zitat Marsden, M., McGuinness, K., Little, S., O’Connor, N.E.: Holistic features for real-time crowd behaviour anomaly detection. In: International Conference on Image Processing (ICIP) (2016) Marsden, M., McGuinness, K., Little, S., O’Connor, N.E.: Holistic features for real-time crowd behaviour anomaly detection. In: International Conference on Image Processing (ICIP) (2016)
21.
Zurück zum Zitat Mehran, R., Oyama, A., Shah, M.: Abnormal crowd behavior detection using social force model. In: Computer Vision and Pattern Recognition (CVPR) (2009) Mehran, R., Oyama, A., Shah, M.: Abnormal crowd behavior detection using social force model. In: Computer Vision and Pattern Recognition (CVPR) (2009)
23.
Zurück zum Zitat Raghavendra, R., Bue, A.D., Cristani, M., Murino, V.: Optimizing interaction force for global anomaly detection in crowded scenes. In: International Conference on Computer Vision Workshops (ICCV Workshops) (2011) Raghavendra, R., Bue, A.D., Cristani, M., Murino, V.: Optimizing interaction force for global anomaly detection in crowded scenes. In: International Conference on Computer Vision Workshops (ICCV Workshops) (2011)
24.
Zurück zum Zitat Saleemi, I., Shafique, K., Shah, M.: Probabilistic modeling of scene dynamics for applications in visual surveillance. IEEE Trans. Pattern Anal. Mach. Intell. 31(8), 1472–1485 (2009)CrossRef Saleemi, I., Shafique, K., Shah, M.: Probabilistic modeling of scene dynamics for applications in visual surveillance. IEEE Trans. Pattern Anal. Mach. Intell. 31(8), 1472–1485 (2009)CrossRef
25.
Zurück zum Zitat Saligrama, V., Chen, Z.: Video anomaly detection based on local statistical aggregates. CVPR 12, 2112–2119 (2012) Saligrama, V., Chen, Z.: Video anomaly detection based on local statistical aggregates. CVPR 12, 2112–2119 (2012)
26.
Zurück zum Zitat Sandhan, T., Sethi, A., Srivastava, T., Choi, J.Y.: Unsupervised learning approach for abnormal event detection in surveillance video by revealing infrequent patterns. In: International Conference on Image and Vision Computing New Zealand, pp. 494–499. IEEE (2013) Sandhan, T., Sethi, A., Srivastava, T., Choi, J.Y.: Unsupervised learning approach for abnormal event detection in surveillance video by revealing infrequent patterns. In: International Conference on Image and Vision Computing New Zealand, pp. 494–499. IEEE (2013)
27.
Zurück zum Zitat Schuster, R., Mörzinger, R., Haas, W., Grabner, H., Van Gool, L.: Real-time detection of unusual regions in image streams. In: Proceedings of the International Conference on Multimedia, pp. 1307–1310 (2010) Schuster, R., Mörzinger, R., Haas, W., Grabner, H., Van Gool, L.: Real-time detection of unusual regions in image streams. In: Proceedings of the International Conference on Multimedia, pp. 1307–1310 (2010)
28.
Zurück zum Zitat Shao, J., Kang, K., Loy, C.C., Wang, X.: Deeply learned attributes for crowded scene understanding. In: Computer Vision and Pattern Recognition (CVPR), pp. 4657–4666. IEEE (2015) Shao, J., Kang, K., Loy, C.C., Wang, X.: Deeply learned attributes for crowded scene understanding. In: Computer Vision and Pattern Recognition (CVPR), pp. 4657–4666. IEEE (2015)
29.
Zurück zum Zitat Sultani, W., Choi, J.: Abnormal traffic detection using intelligent driver model. In: International Conference on Pattern Recognition (ICPR) (2010) Sultani, W., Choi, J.: Abnormal traffic detection using intelligent driver model. In: International Conference on Pattern Recognition (ICPR) (2010)
31.
Zurück zum Zitat Vahdat, A., Gao, B., Ranjbar, M., Mori, G.: A discriminative key pose sequence model for recognizing human interactions. In: International Conference on Computer Vision Workshops (ICCV Workshops), pp. 1729–1736. IEEE (2011) Vahdat, A., Gao, B., Ranjbar, M., Mori, G.: A discriminative key pose sequence model for recognizing human interactions. In: International Conference on Computer Vision Workshops (ICCV Workshops), pp. 1729–1736. IEEE (2011)
32.
Zurück zum Zitat Wang, X., Ma, X., Grimson, W.E.L.: Unsupervised activity perception in crowded and complicated scenes using hierarchical Bayesian models. IEEE Trans. Pattern Anal. Mach. Intell. 31(3), 539–555 (2009)CrossRef Wang, X., Ma, X., Grimson, W.E.L.: Unsupervised activity perception in crowded and complicated scenes using hierarchical Bayesian models. IEEE Trans. Pattern Anal. Mach. Intell. 31(3), 539–555 (2009)CrossRef
33.
Zurück zum Zitat Wang, X., Tieu, K., Grimson, E.: Learning semantic scene models by trajectory analysis. In: European Conference on Computer Vision (ECCV), pp. 110–123. 9th European Conference on Computer Vision, Berlin, Heidelberg (2006) Wang, X., Tieu, K., Grimson, E.: Learning semantic scene models by trajectory analysis. In: European Conference on Computer Vision (ECCV), pp. 110–123. 9th European Conference on Computer Vision, Berlin, Heidelberg (2006)
34.
Zurück zum Zitat Yun, K., Jeong, H., Yi, K.M., Kim, S.W., Choi, J.Y.: Motion interaction field for accident detection in traffic surveillance video. In: International Conference on Pattern Recognition (ICPR) (2014) Yun, K., Jeong, H., Yi, K.M., Kim, S.W., Choi, J.Y.: Motion interaction field for accident detection in traffic surveillance video. In: International Conference on Pattern Recognition (ICPR) (2014)
35.
Zurück zum Zitat Yun, K., Kim, J., Kim, S.W., Jeong, H., Choi, J.Y.: Learning with adaptive rate for online detection of unusual appearance. In: International Symposium on Visual Computing, pp. 1–10 (2014) Yun, K., Kim, J., Kim, S.W., Jeong, H., Choi, J.Y.: Learning with adaptive rate for online detection of unusual appearance. In: International Symposium on Visual Computing, pp. 1–10 (2014)
36.
Zurück zum Zitat Zhang, Y., Qin, L., Yao, H., Huang, Q.: Abnormal crowd behavior detection based on social attribute-aware force model. In: International Conference on Image Processing (ICIP) (2012) Zhang, Y., Qin, L., Yao, H., Huang, Q.: Abnormal crowd behavior detection based on social attribute-aware force model. In: International Conference on Image Processing (ICIP) (2012)
37.
Zurück zum Zitat Zhao, B., Fei-Fei, L., Xing, E.P.: Online detection of unusual events in videos via dynamic sparse coding. In: Computer Vision and Pattern Recognition (CVPR) (2011) Zhao, B., Fei-Fei, L., Xing, E.P.: Online detection of unusual events in videos via dynamic sparse coding. In: Computer Vision and Pattern Recognition (CVPR) (2011)
38.
Zurück zum Zitat Zhou, B., Tang, X., Zhang, H., Wang, X.: Measuring crowd collectiveness. IEEE Trans. Pattern Anal. Mach. Intell. 36(8), 1586–1599 (2014)CrossRef Zhou, B., Tang, X., Zhang, H., Wang, X.: Measuring crowd collectiveness. IEEE Trans. Pattern Anal. Mach. Intell. 36(8), 1586–1599 (2014)CrossRef
Metadaten
Titel
Motion interaction field for detection of abnormal interactions
verfasst von
Kimin Yun
Youngjoon Yoo
Jin Young Choi
Publikationsdatum
11.11.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
Machine Vision and Applications / Ausgabe 1-2/2017
Print ISSN: 0932-8092
Elektronische ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-016-0816-0

Weitere Artikel der Ausgabe 1-2/2017

Machine Vision and Applications 1-2/2017 Zur Ausgabe