Skip to main content
Top
Published in:
Cover of the book

2014 | OriginalPaper | Chapter

Automatic Detection and Tracking of Pedestrians in Videos with Various Crowd Densities

Authors : Afshin Dehghan, Haroon Idrees, Amir Roshan Zamir, Mubarak Shah

Published in: Pedestrian and Evacuation Dynamics 2012

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Manual analysis of pedestrians and crowds is often impractical for massive datasets of surveillance videos. Automatic tracking of humans is one of the essential abilities for computerized analysis of such videos. In this keynote paper, we present two state of the art methods for automatic pedestrian tracking in videos with low and high crowd density. For videos with low density, first we detect each person using a part-based human detector. Then, we employ a global data association method based on Generalized Graphs for tracking each individual in the whole video. In videos with high crowd-density, we track individuals using a scene structured force model and crowd flow modeling. Additionally, we present an alternative approach which utilizes contextual information without the need to learn the structure of the scene. Performed evaluations show the presented methods outperform the currently available algorithms on several benchmarks.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference E. Osuna, R. Freund, and F. Girosi, “Training Support Vector Machines: An Application to Face Detection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 130–136, 1997. E. Osuna, R. Freund, and F. Girosi, “Training Support Vector Machines: An Application to Face Detection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 130–136, 1997.
2.
go back to reference C. Papageorgiou, T. Evgeniou, and T. Poggio, “A Trainable Pedestrian Detection System,” Proc. Symp. Intelligent Vehicles, pp. 241–246, 1998. C. Papageorgiou, T. Evgeniou, and T. Poggio, “A Trainable Pedestrian Detection System,” Proc. Symp. Intelligent Vehicles, pp. 241–246, 1998.
3.
go back to reference P. Viola and M. Jones, “Rapid Object Detection Using a Boosted Cascade of Simple Features,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 511–518, 2001. P. Viola and M. Jones, “Rapid Object Detection Using a Boosted Cascade of Simple Features,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 511–518, 2001.
4.
go back to reference Y. Wu, T. Yu, and G. Hua, “A Statistical Field Model for Pedestrian Detection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 1023–1030, 2005. Y. Wu, T. Yu, and G. Hua, “A Statistical Field Model for Pedestrian Detection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 1023–1030, 2005.
5.
go back to reference N. Dalal and B. Triggs, “Histograms of Oriented Gradients for Human Detection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 886–893, 2005. N. Dalal and B. Triggs, “Histograms of Oriented Gradients for Human Detection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 886–893, 2005.
6.
go back to reference P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan. Object detection with discriminatively trained part based models. In PAMI, 2010. P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan. Object detection with discriminatively trained part based models. In PAMI, 2010.
7.
go back to reference B. Benfold and I. Reid. Stable multi-target tracking in realtime surveillance video. In CVPR, 2011. B. Benfold and I. Reid. Stable multi-target tracking in realtime surveillance video. In CVPR, 2011.
8.
go back to reference M. Rodriguez, I. Laptev, J. Sivic, and J.-Y. Audibert. Density-aware person detection and tracking in crowds. In ICCV, 2011. M. Rodriguez, I. Laptev, J. Sivic, and J.-Y. Audibert. Density-aware person detection and tracking in crowds. In ICCV, 2011.
9.
go back to reference G. Shu, A. Dehghan, O. Oreifej, E. Hand, M. Shah. Part-based Multiple-Person Tracking with Partial Occlusion Handling. In CVPR, 2012. G. Shu, A. Dehghan, O. Oreifej, E. Hand, M. Shah. Part-based Multiple-Person Tracking with Partial Occlusion Handling. In CVPR, 2012.
10.
go back to reference Amir Roshan Zamir, Afshin Dehghan, and M. Shah. GMCP-Tracker: Global Multi-object Tracking Using Generalized Minimum Clique Graphs. In ECCV, 2012. Amir Roshan Zamir, Afshin Dehghan, and M. Shah. GMCP-Tracker: Global Multi-object Tracking Using Generalized Minimum Clique Graphs. In ECCV, 2012.
11.
go back to reference Feremans, C., Labbe, M., Laporte, G.. Generalized network design problems. In: EJOR, 2003. Feremans, C., Labbe, M., Laporte, G.. Generalized network design problems. In: EJOR, 2003.
12.
go back to reference Kasturi, R., et al.: Framework for performance evaluation of face, text, and vehicle detection and tracking in video: Data, metrics, and protocol. In: PAMI. (2009). Kasturi, R., et al.: Framework for performance evaluation of face, text, and vehicle detection and tracking in video: Data, metrics, and protocol. In: PAMI. (2009).
13.
go back to reference Benfold, B., Reid, I.: Stable multi-target tracking in real time surveillance video. In: CVPR.(2011) Benfold, B., Reid, I.: Stable multi-target tracking in real time surveillance video. In: CVPR.(2011)
14.
go back to reference Zhang, L., Li, Y., Nevatia, R.: Global data association for multi-object tracking using networkflows. In: CVPR. (2008) Zhang, L., Li, Y., Nevatia, R.: Global data association for multi-object tracking using networkflows. In: CVPR. (2008)
15.
go back to reference Pellegrini, S., Ess, A., Van Gool, L.: Improving data association by joint modeling of pedestrian trajectories and groupings. In: ECCV. (2010) Pellegrini, S., Ess, A., Van Gool, L.: Improving data association by joint modeling of pedestrian trajectories and groupings. In: ECCV. (2010)
16.
go back to reference Yamaguchi, K., Berg, A., Ortiz, L., Berg, T.: who are you with and where are you going? In: CVPR. (2011) Yamaguchi, K., Berg, A., Ortiz, L., Berg, T.: who are you with and where are you going? In: CVPR. (2011)
17.
go back to reference Leal-Taixe, L., Pons-Moll, G., Rosenhahn, B.: Everybody needs somebody: Modeling social and grouping behavior on a linear programming multiple people tracker. In: ICCV Workshops. (2011) Leal-Taixe, L., Pons-Moll, G., Rosenhahn, B.: Everybody needs somebody: Modeling social and grouping behavior on a linear programming multiple people tracker. In: ICCV Workshops. (2011)
18.
go back to reference Breitenstein, M.D., Reichlin, F., Leibe, B., Koller-Meier, E., Gool, L.V.: Robust tracking-by-detection using a detector confidence particle filter. In: ICCV. (2009) Breitenstein, M.D., Reichlin, F., Leibe, B., Koller-Meier, E., Gool, L.V.: Robust tracking-by-detection using a detector confidence particle filter. In: ICCV. (2009)
19.
go back to reference Brendel, W., Amer, M., Todorovic, S.: Multiobject tracking as maximum weight independent set. In: CVPR. (2011) Brendel, W., Amer, M., Todorovic, S.: Multiobject tracking as maximum weight independent set. In: CVPR. (2011)
20.
go back to reference Andriyenko, A., Schindler, K.: Multi-target tracking by continuous energy minimization. In:CVPR. (2011) Andriyenko, A., Schindler, K.: Multi-target tracking by continuous energy minimization. In:CVPR. (2011)
21.
go back to reference Berclaz, J., Fleuret, F., Turetken, E., Fua, P.: Multiple object tracking using k-shortest paths optimization. In: PAMI. (2011) Berclaz, J., Fleuret, F., Turetken, E., Fua, P.: Multiple object tracking using k-shortest paths optimization. In: PAMI. (2011)
22.
go back to reference Shitrit, H.B., Berclaz, J., Fleuret, F., Fua, P.: Tracking multiple people under global appearance constraints. In: ICCV. (2011) Shitrit, H.B., Berclaz, J., Fleuret, F., Fua, P.: Tracking multiple people under global appearance constraints. In: ICCV. (2011)
23.
go back to reference Henriques, J.F., Caseiro, R., Batista, J.: Globally optimal solution to multi-object tracking with merged measurements. In: ICCV. (2011) Henriques, J.F., Caseiro, R., Batista, J.: Globally optimal solution to multi-object tracking with merged measurements. In: ICCV. (2011)
24.
go back to reference S. Ali and M. Shah, A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis, IEEE CVPR, 2007. S. Ali and M. Shah, A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis, IEEE CVPR, 2007.
25.
go back to reference S. Ali and M. Shah, Floor Fields for Tracking in High Density Crowded Scenes, ECCV 2008. S. Ali and M. Shah, Floor Fields for Tracking in High Density Crowded Scenes, ECCV 2008.
26.
go back to reference H.Idrees, N. Warner and M.Shah, Tracking in Dense Crowds using Prominence and Neighborhood Motion Concurrence, Submitted to CVIU Journal, 2012. H.Idrees, N. Warner and M.Shah, Tracking in Dense Crowds using Prominence and Neighborhood Motion Concurrence, Submitted to CVIU Journal, 2012.
Metadata
Title
Automatic Detection and Tracking of Pedestrians in Videos with Various Crowd Densities
Authors
Afshin Dehghan
Haroon Idrees
Amir Roshan Zamir
Mubarak Shah
Copyright Year
2014
DOI
https://doi.org/10.1007/978-3-319-02447-9_1

Premium Partner