Skip to main content

2011 | OriginalPaper | Buchkapitel

Learning Behavioral Patterns of Time Series for Video-Surveillance

verfasst von : Nicoletta Noceti, Matteo Santoro, Francesca Odone

Erschienen in: Machine Learning for Vision-Based Motion Analysis

Verlag: Springer London

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter deals with the problem of learning behaviors of people activities from (possibly big) sets of visual dynamic data, with a specific reference to video-surveillance applications. The study focuses mainly on devising meaningful data abstractions able to capture the intrinsic nature of the available data, and applying similarity measures appropriate to the specific representations. The methods are selected among the most promising techniques available in the literature and include classical curve fitting, string-based approaches, and hidden Markov models. The analysis considers both supervised and unsupervised settings and is based on a set of loosely labeled data acquired by a real video-surveillance system. The experiments highlight different peculiarities of the methods taken into consideration, and the final discussion guides the reader towards the most appropriate choice for a given scenario.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Note that in the unsupervised setting, the similarity function plays the role of the kernel function of the RLS case—as they both model the similarity among available data.
 
4
The Imanalysis suite, we obtained within a technology transfer program with the company Imavis srl, http://​www.​imavis.​com/​.
 
Literatur
1.
Zurück zum Zitat Anjum, N., Cavallaro, A.: Multifeature object trajectory clustering for video analysis. IEEE Trans. Circuits Syst. Video Technol. 18(11), 1555–1564 (2008) CrossRef Anjum, N., Cavallaro, A.: Multifeature object trajectory clustering for video analysis. IEEE Trans. Circuits Syst. Video Technol. 18(11), 1555–1564 (2008) CrossRef
2.
Zurück zum Zitat Bashir, F., Khokhar, A., Schonfeld, D.: Object trajectory-based activity classification and recognition using hidden Markov model. IEEE Trans. Image Process. 16, 1912–1919 (2007) MathSciNetCrossRef Bashir, F., Khokhar, A., Schonfeld, D.: Object trajectory-based activity classification and recognition using hidden Markov model. IEEE Trans. Image Process. 16, 1912–1919 (2007) MathSciNetCrossRef
3.
Zurück zum Zitat Bolshakova, N., Azuaje, F.: Cluster validation techniques for genome expression data. Signal Process. 83(4), 825–833 (2003) MATHCrossRef Bolshakova, N., Azuaje, F.: Cluster validation techniques for genome expression data. Signal Process. 83(4), 825–833 (2003) MATHCrossRef
4.
Zurück zum Zitat Comaniciu, D., Ramesh, V., Meer, P.: Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25(5), 564–575 (2003) CrossRef Comaniciu, D., Ramesh, V., Meer, P.: Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25(5), 564–575 (2003) CrossRef
5.
Zurück zum Zitat Doretto, G., Chiuso, A., Wu, Y., Soatto, S.: Dynamic textures. Int. J. Comput. Vis. 51(2), 91–109 (2003) MATHCrossRef Doretto, G., Chiuso, A., Wu, Y., Soatto, S.: Dynamic textures. Int. J. Comput. Vis. 51(2), 91–109 (2003) MATHCrossRef
6.
Zurück zum Zitat Fowlkes, C., Belongie, S., Chung, F.R.K., Malik, J.: Spectral grouping using the Nyström method. IEEE Trans. Pattern Anal. Mach. Intell. 26(2), 214–225 (2004) CrossRef Fowlkes, C., Belongie, S., Chung, F.R.K., Malik, J.: Spectral grouping using the Nyström method. IEEE Trans. Pattern Anal. Mach. Intell. 26(2), 214–225 (2004) CrossRef
7.
Zurück zum Zitat Günter, S., Bunke, H.: Validation indices for graph clustering. Pattern Recogn. Lett. 24(8), 1107–1113 (2003) MATHCrossRef Günter, S., Bunke, H.: Validation indices for graph clustering. Pattern Recogn. Lett. 24(8), 1107–1113 (2003) MATHCrossRef
8.
Zurück zum Zitat Halkidi, M., Batistakis, Y., Vazirgiannis, M.: On clustering validation techniques. J. Intell. Inf. Syst. 17, 107–145 (2001) MATHCrossRef Halkidi, M., Batistakis, Y., Vazirgiannis, M.: On clustering validation techniques. J. Intell. Inf. Syst. 17, 107–145 (2001) MATHCrossRef
9.
Zurück zum Zitat Hu, W., Xiao, X., Fu, Z., Xie, D., Tan, T., Maybank, S.: A system for learning statistical motion patterns. IEEE Trans. Pattern Anal. Mach. Intell. 28(9), 1450–1464 (2006) CrossRef Hu, W., Xiao, X., Fu, Z., Xie, D., Tan, T., Maybank, S.: A system for learning statistical motion patterns. IEEE Trans. Pattern Anal. Mach. Intell. 28(9), 1450–1464 (2006) CrossRef
10.
Zurück zum Zitat Ivanov, Y., Bobick, A.: Recognition of visual activities and interactions by stochastic parsing. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 852–872 (2000) CrossRef Ivanov, Y., Bobick, A.: Recognition of visual activities and interactions by stochastic parsing. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 852–872 (2000) CrossRef
11.
Zurück zum Zitat Fei-Fei, L., Niebles, J.C., Wang, H.: Unsupervised learning of human action categories using spatial-temporal words. In: Proc. of BMVC (2006) Fei-Fei, L., Niebles, J.C., Wang, H.: Unsupervised learning of human action categories using spatial-temporal words. In: Proc. of BMVC (2006)
12.
Zurück zum Zitat Jebara, T., Kondor, R.I., Howard, A.: Probability product kernels. J. Mach. Learn. Res. 5, 819–844 (2004) MathSciNetMATH Jebara, T., Kondor, R.I., Howard, A.: Probability product kernels. J. Mach. Learn. Res. 5, 819–844 (2004) MathSciNetMATH
13.
Zurück zum Zitat Jebara, T., Song, Y., Thadani, K.: Spectral clustering and embedding with hidden Markov models. In: Kok, J.N., Koronacki, J., López de Mántaras, R., Matwin, S., Mladenic, D., Skowron, A. (eds.) ECML. Lecture Notes in Computer Science, vol. 4701, pp. 164–175. Springer, Berlin (2007) Jebara, T., Song, Y., Thadani, K.: Spectral clustering and embedding with hidden Markov models. In: Kok, J.N., Koronacki, J., López de Mántaras, R., Matwin, S., Mladenic, D., Skowron, A. (eds.) ECML. Lecture Notes in Computer Science, vol. 4701, pp. 164–175. Springer, Berlin (2007)
14.
Zurück zum Zitat Liao, T.W.: Clustering of time series data: a survey. Pattern Recogn. 38(11) (2005) Liao, T.W.: Clustering of time series data: a survey. Pattern Recogn. 38(11) (2005)
15.
Zurück zum Zitat Lin, W., Orgun, M.A., Williams, G.J.: Temporal data mining using multilevel-local polynomial models. In: International Conference IDEAL. Lecture Notes in Computer Science, vol. 1983. Springer, Berlin (2000) Lin, W., Orgun, M.A., Williams, G.J.: Temporal data mining using multilevel-local polynomial models. In: International Conference IDEAL. Lecture Notes in Computer Science, vol. 1983. Springer, Berlin (2000)
16.
Zurück zum Zitat Lo Gerfo, L., Rosasco, L., Odone, F., De Vito, E., Verri, A.: Spectral algorithms for supervised learning. Neural Comput. 20, 1873–1897 (2008) MathSciNetMATHCrossRef Lo Gerfo, L., Rosasco, L., Odone, F., De Vito, E., Verri, A.: Spectral algorithms for supervised learning. Neural Comput. 20, 1873–1897 (2008) MathSciNetMATHCrossRef
17.
Zurück zum Zitat Medioni, G., Cohen, I., Bremond, F., Hongeng, S., Nevatia, R.: Event detection and analysis from video streams. IEEE Trans. Pattern Anal. Mach. Intell. 23, 873–889 (2001) CrossRef Medioni, G., Cohen, I., Bremond, F., Hongeng, S., Nevatia, R.: Event detection and analysis from video streams. IEEE Trans. Pattern Anal. Mach. Intell. 23, 873–889 (2001) CrossRef
18.
Zurück zum Zitat Morris, B., Trivedi, M.M.: Learning trajectory patterns by clustering: experimental studies and comparative evaluation. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR ’09 (2009) Morris, B., Trivedi, M.M.: Learning trajectory patterns by clustering: experimental studies and comparative evaluation. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR ’09 (2009)
19.
Zurück zum Zitat Noceti, N., Santoro, M., Odone, F.: String-based spectral clustering for understanding human behaviours. In: THEMIS-BMVC (2008) Noceti, N., Santoro, M., Odone, F.: String-based spectral clustering for understanding human behaviours. In: THEMIS-BMVC (2008)
20.
Zurück zum Zitat Noceti, N., Santoro, M., Odone, F.: Unsupervised learning of behavioural patterns for video-surveillance. In: Workshop MLVMA-ECCV (2008) Noceti, N., Santoro, M., Odone, F.: Unsupervised learning of behavioural patterns for video-surveillance. In: Workshop MLVMA-ECCV (2008)
21.
Zurück zum Zitat Noceti, N., Destrero, A., Lovato, A., Odone, F.: Combined motion and appearance models for robust object tracking in real-time. In: AVSS (2009) Noceti, N., Destrero, A., Lovato, A., Odone, F.: Combined motion and appearance models for robust object tracking in real-time. In: AVSS (2009)
22.
Zurück zum Zitat Piciarelli, C., Micheloni, C., Foresti, G.L.: Trajectory-based anomalous event detection. IEEE Trans. Circuits Syst. Video Technol. 18(11), 1544–1554 (2008) CrossRef Piciarelli, C., Micheloni, C., Foresti, G.L.: Trajectory-based anomalous event detection. IEEE Trans. Circuits Syst. Video Technol. 18(11), 1544–1554 (2008) CrossRef
23.
Zurück zum Zitat Pittore, M., Campani, M., Verri, A.: Learning to recognize visual dynamic events from examples. In: IJCV (2000) Pittore, M., Campani, M., Verri, A.: Learning to recognize visual dynamic events from examples. In: IJCV (2000)
24.
Zurück zum Zitat Rabiner, L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77, 257–286 (1989) CrossRef Rabiner, L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77, 257–286 (1989) CrossRef
25.
Zurück zum Zitat Rieck, K., Laskov, P.: Linear-time computation of similarity measures for sequential data. J. Mach. Learn. Res. 9, 23–48 (2008) MATH Rieck, K., Laskov, P.: Linear-time computation of similarity measures for sequential data. J. Mach. Learn. Res. 9, 23–48 (2008) MATH
26.
Zurück zum Zitat Shawe Taylor, J., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge University Press, Cambridge (2004) CrossRef Shawe Taylor, J., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge University Press, Cambridge (2004) CrossRef
27.
Zurück zum Zitat Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 888–905 (2000) CrossRef Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 888–905 (2000) CrossRef
28.
Zurück zum Zitat Special issue on event analysis in videos. IEEE Trans. Circuits Syst. Video Technol. 18(11) (2008) Special issue on event analysis in videos. IEEE Trans. Circuits Syst. Video Technol. 18(11) (2008)
29.
Zurück zum Zitat Stauffer, C., Grimson, E.: Learning patterns of activity using real-time tracking. IEEE Trans. Pattern Recogn. Mach. Intell. 22(8), 747–757 (2000) CrossRef Stauffer, C., Grimson, E.: Learning patterns of activity using real-time tracking. IEEE Trans. Pattern Recogn. Mach. Intell. 22(8), 747–757 (2000) CrossRef
30.
Zurück zum Zitat Tommasi, T., Orabona, F., Caputo, B.: Discriminative cue integration for medical image annotation. Pattern Recognit. Lett. 29(15), 1996–2002 (2008) CrossRef Tommasi, T., Orabona, F., Caputo, B.: Discriminative cue integration for medical image annotation. Pattern Recognit. Lett. 29(15), 1996–2002 (2008) CrossRef
31.
Zurück zum Zitat Vishwanathan, S.V., Smola, A.J., Vidal, R.: Binet–Cauchy kernels on dynamical systems and its application to the analysis of dynamic scenes. Int. J. Comput. Vis. 73(1), 95–119 (2007) CrossRef Vishwanathan, S.V., Smola, A.J., Vidal, R.: Binet–Cauchy kernels on dynamical systems and its application to the analysis of dynamic scenes. Int. J. Comput. Vis. 73(1), 95–119 (2007) CrossRef
Metadaten
Titel
Learning Behavioral Patterns of Time Series for Video-Surveillance
verfasst von
Nicoletta Noceti
Matteo Santoro
Francesca Odone
Copyright-Jahr
2011
Verlag
Springer London
DOI
https://doi.org/10.1007/978-0-85729-057-1_11