Skip to main content
Erschienen in: Pattern Analysis and Applications 4/2004

01.12.2004 | Theoretical Advances

A framework of joint object tracking and event detection

verfasst von: Ruoyu Roy Wang, Thomas Huang

Erschienen in: Pattern Analysis and Applications | Ausgabe 4/2004

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper describes a probabilistic framework for simultaneously performing object tracking and event detection in monocular videos. Mathematically, we cast the problem of jointly tracking and detecting semantic events as a principled model-based search problem in a multi-dimensional state space, where the tracking trajectory and event type are discovered via maximum a posteriori (MAP) optimization. The benefit of this approach comes from its combined utilization of particle probabilistic representation, multiple hypothesis retention, efficient particle propagation, and temporal optimization. We present qualitative and quantitative results from realistic video sequences to demonstrate the effectiveness of this approach.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Naphades MR, Wang RR, Huang TS (2001) Audio-visual query and retrieval: a system that uses dynamic programming and relevance feedback. J Electron Imaging 10:861–870CrossRef Naphades MR, Wang RR, Huang TS (2001) Audio-visual query and retrieval: a system that uses dynamic programming and relevance feedback. J Electron Imaging 10:861–870CrossRef
2.
Zurück zum Zitat Viterbi AJ (1967) Error bounds for convolutional codes and an asymptotically optimal decoding algorithm. IEEE Trans Inform Theory IT-13:260–269CrossRef Viterbi AJ (1967) Error bounds for convolutional codes and an asymptotically optimal decoding algorithm. IEEE Trans Inform Theory IT-13:260–269CrossRef
3.
Zurück zum Zitat Forney G (1973) The Viterbi algorithm. Proc IEEE 61:268–278 Forney G (1973) The Viterbi algorithm. Proc IEEE 61:268–278
4.
Zurück zum Zitat Wolf JK, Viterbi A, Dixon G (1989) Finding the best set of k paths through a trellis with application to multitarget tracking. IEEE Trans Aero Electron Sys 25:287–295CrossRef Wolf JK, Viterbi A, Dixon G (1989) Finding the best set of k paths through a trellis with application to multitarget tracking. IEEE Trans Aero Electron Sys 25:287–295CrossRef
5.
Zurück zum Zitat Isard M, Blake A (1996) Visual tracking by stochastic propagation of conditional density. In: Proceedings of the 4th European conference on computer vision (Eccv’96), Cambridge, UK, April 1996, pp 343–356 Isard M, Blake A (1996) Visual tracking by stochastic propagation of conditional density. In: Proceedings of the 4th European conference on computer vision (Eccv’96), Cambridge, UK, April 1996, pp 343–356
6.
Zurück zum Zitat Li B, Chellappa R (2000) Simultaneous tracking and verification via sequential posterior estimation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR 2000), Hilton Head Island, South Carolina, June 2000 Li B, Chellappa R (2000) Simultaneous tracking and verification via sequential posterior estimation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR 2000), Hilton Head Island, South Carolina, June 2000
7.
Zurück zum Zitat Doucet A, Godsill S, Andrieu C (2000) On sequential Monte Carlo sampling methods for Bayesian filtering. Stat Comput 10:197–208CrossRef Doucet A, Godsill S, Andrieu C (2000) On sequential Monte Carlo sampling methods for Bayesian filtering. Stat Comput 10:197–208CrossRef
8.
Zurück zum Zitat Godsill S, Doucet A, West M (2001) Maximum a posteriori sequence estimation using Monte Carlo particle filters. Ann Inst Stat Math 52(1):82–96MathSciNet Godsill S, Doucet A, West M (2001) Maximum a posteriori sequence estimation using Monte Carlo particle filters. Ann Inst Stat Math 52(1):82–96MathSciNet
9.
Zurück zum Zitat Dempster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the EM algorithm. J Roy Stat Soc B 39:1–38 Dempster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the EM algorithm. J Roy Stat Soc B 39:1–38
10.
Zurück zum Zitat Cham T-J, Rehg JM (1999) A multiple hypothesis approach to figure tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’99), Fort Collins, Colorado, June 1999, pp 239–244 Cham T-J, Rehg JM (1999) A multiple hypothesis approach to figure tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’99), Fort Collins, Colorado, June 1999, pp 239–244
11.
Zurück zum Zitat Morris DD, Rehg J (1998) Singularity analysis for articulated object tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’98), Santa Barbara, California, June 1998, pp 289–296 Morris DD, Rehg J (1998) Singularity analysis for articulated object tracking. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’98), Santa Barbara, California, June 1998, pp 289–296
12.
Zurück zum Zitat Birchfield S (1998) Elliptical head tracking using intensity gradients and color histograms. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’98), Santa Barbara, California, June 1998, pp 232–237 Birchfield S (1998) Elliptical head tracking using intensity gradients and color histograms. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’98), Santa Barbara, California, June 1998, pp 232–237
13.
Zurück zum Zitat Comaniciu D, Ramesh V, Meer P (2000) Real-time tracking of nonrigid objects using mean shift. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR 2000), Hilton Head Island, South Carolina, June 2000, vol 2, pp 142–149 Comaniciu D, Ramesh V, Meer P (2000) Real-time tracking of nonrigid objects using mean shift. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR 2000), Hilton Head Island, South Carolina, June 2000, vol 2, pp 142–149
14.
Zurück zum Zitat McKenna S, Raja Y, Gong S (1998) Object tracking using adaptive colour mixture models. In: Proceedings of the Asian conference on computer vision (ACCV’98), Hong Kong, China, January 1998 McKenna S, Raja Y, Gong S (1998) Object tracking using adaptive colour mixture models. In: Proceedings of the Asian conference on computer vision (ACCV’98), Hong Kong, China, January 1998
15.
Zurück zum Zitat Hager G, Belhumeur P (1996) Real-time tracking of image regions with changes in geometry and illumination. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’96), San Francisco, California, June 1996, pp 88–93 Hager G, Belhumeur P (1996) Real-time tracking of image regions with changes in geometry and illumination. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’96), San Francisco, California, June 1996, pp 88–93
16.
Zurück zum Zitat Gavrila DM (2000) Pedestrian detection from a moving vehicle. In: Proceedings of the 6th IEEE European conference on computer vision (Eccv 2000), Dublin, Ireland, June/July 2000 Gavrila DM (2000) Pedestrian detection from a moving vehicle. In: Proceedings of the 6th IEEE European conference on computer vision (Eccv 2000), Dublin, Ireland, June/July 2000
17.
Zurück zum Zitat Ju SX, Black MJ, Yacoob Y (1996) Cardboard people: a parameterized model of articulated motion. In: Proceedings of the 2nd international conference on automatic face and gesture recognition (FG’96), Killington, Vermont, October 1996, pp 38–44 Ju SX, Black MJ, Yacoob Y (1996) Cardboard people: a parameterized model of articulated motion. In: Proceedings of the 2nd international conference on automatic face and gesture recognition (FG’96), Killington, Vermont, October 1996, pp 38–44
18.
Zurück zum Zitat Wren C, Azarbayejani A, Darrell T, Pentland A (1997) Pfinder: realtime tracking of the human body. IEEE Trans Pattern Recogn Mach Intell 19(7):780–785CrossRef Wren C, Azarbayejani A, Darrell T, Pentland A (1997) Pfinder: realtime tracking of the human body. IEEE Trans Pattern Recogn Mach Intell 19(7):780–785CrossRef
19.
Zurück zum Zitat Blake A, Isard M (1998) Active contours. Springer, Berlin Heidelberg New York Blake A, Isard M (1998) Active contours. Springer, Berlin Heidelberg New York
20.
Zurück zum Zitat Toyama K, Blake A (2001) Probabilistic tracking in a metric space. In: Proceedings of the 8th IEEE international conference on computer vision (ICCV 2001), Vancouver, Canada, July 2001, vol 2, pp 50–57 Toyama K, Blake A (2001) Probabilistic tracking in a metric space. In: Proceedings of the 8th IEEE international conference on computer vision (ICCV 2001), Vancouver, Canada, July 2001, vol 2, pp 50–57
21.
Zurück zum Zitat Bobick A, Davis J (2001) The recognition of human movement using temporal templates. IEEE Trans Pattern Recogn Mach Intell 23(3):257–267CrossRef Bobick A, Davis J (2001) The recognition of human movement using temporal templates. IEEE Trans Pattern Recogn Mach Intell 23(3):257–267CrossRef
22.
Zurück zum Zitat Polana R, Nelson R (1997) Detection and recognition of periodic, nonrigid motion. Int J Comput Vis 23(3):261–282CrossRef Polana R, Nelson R (1997) Detection and recognition of periodic, nonrigid motion. Int J Comput Vis 23(3):261–282CrossRef
23.
Zurück zum Zitat Chomat O, Crowley JL (1999) Probabilistic recognition of activity using local appearance. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’99), Fort Collins, Colorado, June 1999, vol 2, pp 104–109 Chomat O, Crowley JL (1999) Probabilistic recognition of activity using local appearance. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’99), Fort Collins, Colorado, June 1999, vol 2, pp 104–109
24.
Zurück zum Zitat Niyogi SA, Adelson EH (1994) Analyzing and recognizing walking figures in XYT. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’94), Seattle, Washington, June 1994, pp 469–474 Niyogi SA, Adelson EH (1994) Analyzing and recognizing walking figures in XYT. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’94), Seattle, Washington, June 1994, pp 469–474
25.
Zurück zum Zitat Gavrila D, Davis L (1996) 3D model-based tracking of humans in action: a multi-view approach. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’96), San Francisco, California, June 1996, pp 73–80 Gavrila D, Davis L (1996) 3D model-based tracking of humans in action: a multi-view approach. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’96), San Francisco, California, June 1996, pp 73–80
26.
Zurück zum Zitat Clarkson B, Pentland A (2000) Framing through peripheral perception. In: Proceedings of the IEEE international conference on image processing (ICIP 2000), Vancouver, Canada, September 2000, vol 3, pp 38–41 Clarkson B, Pentland A (2000) Framing through peripheral perception. In: Proceedings of the IEEE international conference on image processing (ICIP 2000), Vancouver, Canada, September 2000, vol 3, pp 38–41
27.
Zurück zum Zitat Bregler C (1997) Learning and recognizing human dynamics in video sequences. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’97), San Juan, Puerto Rico, June 1997, pp 568–574 Bregler C (1997) Learning and recognizing human dynamics in video sequences. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR’97), San Juan, Puerto Rico, June 1997, pp 568–574
28.
Zurück zum Zitat Zelnik-Manor L, Irani M (2001) Event-based analysis of video. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR 2001), Kauai, Hawaii, December 2001, vol 2, pp 123–130 Zelnik-Manor L, Irani M (2001) Event-based analysis of video. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR 2001), Kauai, Hawaii, December 2001, vol 2, pp 123–130
29.
Zurück zum Zitat Medioni G, Cohen I, Bremond F, Hongeng S, Nevatia R (2001) Event detection and analysis from video streams. IEEE Trans Pattern Recogn Mach Intell 23(8):873–889CrossRef Medioni G, Cohen I, Bremond F, Hongeng S, Nevatia R (2001) Event detection and analysis from video streams. IEEE Trans Pattern Recogn Mach Intell 23(8):873–889CrossRef
30.
Zurück zum Zitat Isard M, Blake A (1998) CONDENSATION—conditional density propagation for visual tracking. Int J Comput Vis 29(1):5–28CrossRef Isard M, Blake A (1998) CONDENSATION—conditional density propagation for visual tracking. Int J Comput Vis 29(1):5–28CrossRef
31.
Zurück zum Zitat Bar-Shalom Y, Fortmann TE (1988) Tracking and data association. Academic Press, San Diego, California Bar-Shalom Y, Fortmann TE (1988) Tracking and data association. Academic Press, San Diego, California
32.
Zurück zum Zitat Arulampalam MS, Maskell S, Gordon N, Clapp T (2002) A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans Signal Process 50(2):174–188CrossRef Arulampalam MS, Maskell S, Gordon N, Clapp T (2002) A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans Signal Process 50(2):174–188CrossRef
33.
Zurück zum Zitat Rabiner LR, Juang BH (1993) Fundamentals of speech recognition. Prentice Hall, Englewood Cliffs, New Jersey Rabiner LR, Juang BH (1993) Fundamentals of speech recognition. Prentice Hall, Englewood Cliffs, New Jersey
34.
Zurück zum Zitat Jesorsky O, Kirchberg K, Frischholz R (2001) Robust face detection using the Hausdorff distance. In: Proceedings of the 3rd international conference on audio- and video-based biometric person authentication (AVBPA 2001), Halmstad. Sweden, June 2001, pp 90–95 Jesorsky O, Kirchberg K, Frischholz R (2001) Robust face detection using the Hausdorff distance. In: Proceedings of the 3rd international conference on audio- and video-based biometric person authentication (AVBPA 2001), Halmstad. Sweden, June 2001, pp 90–95
35.
Zurück zum Zitat Johnson SC (1967) Hierarchical clustering schemes. Psychometrika 2:241–254MATH Johnson SC (1967) Hierarchical clustering schemes. Psychometrika 2:241–254MATH
36.
Zurück zum Zitat D’andrade R (1978) U-statistic hierarchical clustering. Psychometrika 4:58–67 D’andrade R (1978) U-statistic hierarchical clustering. Psychometrika 4:58–67
Metadaten
Titel
A framework of joint object tracking and event detection
verfasst von
Ruoyu Roy Wang
Thomas Huang
Publikationsdatum
01.12.2004
Erschienen in
Pattern Analysis and Applications / Ausgabe 4/2004
Print ISSN: 1433-7541
Elektronische ISSN: 1433-755X
DOI
https://doi.org/10.1007/s10044-004-0231-4

Weitere Artikel der Ausgabe 4/2004

Pattern Analysis and Applications 4/2004 Zur Ausgabe

Premium Partner