Skip to main content
Top
Published in: International Journal of Computer Vision 1/2014

01-10-2014

Detection and Tracking of Occluded People

Authors: Siyu Tang, Mykhaylo Andriluka, Bernt Schiele

Published in: International Journal of Computer Vision | Issue 1/2014

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We consider the problem of detection and tracking of multiple people in crowded street scenes. State-of-the-art methods perform well in scenes with relatively few people, but are severely challenged by scenes with many subjects that partially occlude each other. This limitation is due to the fact that current people detectors fail when persons are strongly occluded. We observe that typical occlusions are due to overlaps between people and propose a people detector tailored to various occlusion levels. Instead of treating partial occlusions as distractions, we leverage the fact that person/person occlusions result in very characteristic appearance patterns that can help to improve detection results. We demonstrate the performance of our occlusion-aware person detector on a new dataset of people with controlled but severe levels of occlusion and on two challenging publicly available benchmarks outperforming single person detectors in each case.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Andriluka, M., Roth, S., & Schiele, B. (2008). People-tracking-by-detection and people-detection-by-tracking. In CVPR’08. Andriluka, M., Roth, S., & Schiele, B. (2008). People-tracking-by-detection and people-detection-by-tracking. In CVPR’08.
go back to reference Andriyenko, A., & Schindler, K. (2011). Multi-target tracking by continuous energy minimization. In CVPR’11. Andriyenko, A., & Schindler, K. (2011). Multi-target tracking by continuous energy minimization. In CVPR’11.
go back to reference Andriyenko, A., Schindler, K., & Roth, S. (2012). Discrete-continuous optimization for multi-target tracking. In CVPR’12. Andriyenko, A., Schindler, K., & Roth, S. (2012). Discrete-continuous optimization for multi-target tracking. In CVPR’12.
go back to reference Barinova, O., Lempitsky, V., & Kohli, P. (2010). On detection of multiple object instances using hough transform. In CVPR’10. Barinova, O., Lempitsky, V., & Kohli, P. (2010). On detection of multiple object instances using hough transform. In CVPR’10.
go back to reference Bernardin, K. & Stiefelhagen, R. (2008). Evaluating multiple object tracking performance: The CLEAR MOT metrics. Image and Video Processing, 1, 1–10. Bernardin, K. & Stiefelhagen, R. (2008). Evaluating multiple object tracking performance: The CLEAR MOT metrics. Image and Video Processing, 1, 1–10.
go back to reference Bourdev, L., & Malik J. (2009). Poselets: Body part detectors trained using 3D human pose annotations. In ICCV’09. Bourdev, L., & Malik J. (2009). Poselets: Body part detectors trained using 3D human pose annotations. In ICCV’09.
go back to reference Breitenstein, M., Reichlin, F., Leibe, B., Koller-Meier, E., & Van Gool, L. (2009). Robust tracking-by-detection using a detector confidence particle filter. In ICCV’09. Breitenstein, M., Reichlin, F., Leibe, B., Koller-Meier, E., & Van Gool, L. (2009). Robust tracking-by-detection using a detector confidence particle filter. In ICCV’09.
go back to reference Desai, C., & Ramanan, D. (2012). Detecting actions, poses, and objects with relational phraselets. In ECCV’12. Desai, C., & Ramanan, D. (2012). Detecting actions, poses, and objects with relational phraselets. In ECCV’12.
go back to reference Dollár, P., Wojek, C., Schiele, B., & Perona, P. (2009). Pedestrian detection: A benchmark. In CVPR’09. Dollár, P., Wojek, C., Schiele, B., & Perona, P. (2009). Pedestrian detection: A benchmark. In CVPR’09.
go back to reference Enzweiler, M., Eigenstetter, A., Schiele, B., & Gavrila, D. M. (2010). Multi-cue pedestrian classification with partial occlusion handling. In CVPR’10. Enzweiler, M., Eigenstetter, A., Schiele, B., & Gavrila, D. M. (2010). Multi-cue pedestrian classification with partial occlusion handling. In CVPR’10.
go back to reference Farhadi, A., & Sadeghi, M. A. (2011). Recognition using visual phrases. In CVPR’11. Farhadi, A., & Sadeghi, M. A. (2011). Recognition using visual phrases. In CVPR’11.
go back to reference Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010). Object detection with discriminatively trained part-based models. In PAMI’10. Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010). Object detection with discriminatively trained part-based models. In PAMI’10.
go back to reference Girshick, R. B., Felzenszwalb, P. F., & McAllester, D. (2010). LSVM-MDPM Release 4 Notes. Girshick, R. B., Felzenszwalb, P. F., & McAllester, D. (2010). LSVM-MDPM Release 4 Notes.
go back to reference Huang, C., Wu, B., & Nevatia, R. (2008). Robust object tracking by hierarchical association of detection responses. In ECCV’08. Huang, C., Wu, B., & Nevatia, R. (2008). Robust object tracking by hierarchical association of detection responses. In ECCV’08.
go back to reference Leibe, B., Seemann, E., & Schiele, B. (2005). Pedestrian detection in crowded scenes. In CVPR’05. Leibe, B., Seemann, E., & Schiele, B. (2005). Pedestrian detection in crowded scenes. In CVPR’05.
go back to reference Marin, J., Vazquez, D., Geronimo, D., & Lopez, A. M. (2010). Learning appearance in virtual scenarios for pedestrian detection. In CVPR’10. Marin, J., Vazquez, D., Geronimo, D., & Lopez, A. M. (2010). Learning appearance in virtual scenarios for pedestrian detection. In CVPR’10.
go back to reference Ouyang, W., & Wang, X. (2013). Single-pedestrian detection aided by multi-pedestrian detection. In CVPR’13. Ouyang, W., & Wang, X. (2013). Single-pedestrian detection aided by multi-pedestrian detection. In CVPR’13.
go back to reference Pepik, B., Stark, M., Gehler, P., & Schiele, B. (2013). Occlusion patterns for object class detection. In CVPR’13. Pepik, B., Stark, M., Gehler, P., & Schiele, B. (2013). Occlusion patterns for object class detection. In CVPR’13.
go back to reference Pirsiavash, H., Ramanan, D., & Fowlkes, C. C. (2011). Globally-optimal greedy algorithms for tracking a variable number of objects. In CVPR’11. Pirsiavash, H., Ramanan, D., & Fowlkes, C. C. (2011). Globally-optimal greedy algorithms for tracking a variable number of objects. In CVPR’11.
go back to reference Pishchulin, L., Jain, A., Wojek, C., Andriluka, M., Thormählen, T., & Schiele, B. (2011). Learning people detection models from few training samples. In CVPR’11. Pishchulin, L., Jain, A., Wojek, C., Andriluka, M., Thormählen, T., & Schiele, B. (2011). Learning people detection models from few training samples. In CVPR’11.
go back to reference Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., & Blake, A. (2011). Real-time human pose recognition in parts from a single depth image. In CVPR’11. Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., & Blake, A. (2011). Real-time human pose recognition in parts from a single depth image. In CVPR’11.
go back to reference Tang, S., Andriluka, M., Milan, A., Schindler, K., Roth, S., & Schiele, B. (2013). Learning people detectors for tracking in crowded scenes. In ICCV’13. Tang, S., Andriluka, M., Milan, A., Schindler, K., Roth, S., & Schiele, B. (2013). Learning people detectors for tracking in crowded scenes. In ICCV’13.
go back to reference Tang, S., Andriluka, M., & Schiele, B. (2012). Detection and tracking of occluded people. In BMVC’12. Tang, S., Andriluka, M., & Schiele, B. (2012). Detection and tracking of occluded people. In BMVC’12.
go back to reference Walk, S., Majer, N., Schindler, K., & Schiele, B. (2010). New features and insights for pedestrian detection. In CVPR’10. Walk, S., Majer, N., Schindler, K., & Schiele, B. (2010). New features and insights for pedestrian detection. In CVPR’10.
go back to reference Wang, X., Han, T. X., & Yan, S. (2009). An hog-lbp human detector with partial occlusion handling. In ICCV’09. Wang, X., Han, T. X., & Yan, S. (2009). An hog-lbp human detector with partial occlusion handling. In ICCV’09.
go back to reference Wojek, C., Walk, S., Roth, S., & Schiele, B. (2011). Monocular 3d scene understanding with explicit occlusion reasoning. In CVPR’11. Wojek, C., Walk, S., Roth, S., & Schiele, B. (2011). Monocular 3d scene understanding with explicit occlusion reasoning. In CVPR’11.
go back to reference Wu, B., & Nevatia, R. (2007). Detection and tracking of multiple, partially occluded humans by Bayesian combination of edgelet based part detectors. In IJCV’07. Wu, B., & Nevatia, R. (2007). Detection and tracking of multiple, partially occluded humans by Bayesian combination of edgelet based part detectors. In IJCV’07.
Metadata
Title
Detection and Tracking of Occluded People
Authors
Siyu Tang
Mykhaylo Andriluka
Bernt Schiele
Publication date
01-10-2014
Publisher
Springer US
Published in
International Journal of Computer Vision / Issue 1/2014
Print ISSN: 0920-5691
Electronic ISSN: 1573-1405
DOI
https://doi.org/10.1007/s11263-013-0664-6

Other articles of this Issue 1/2014

International Journal of Computer Vision 1/2014 Go to the issue

Premium Partner