Skip to main content
Top

2016 | OriginalPaper | Chapter

A Multiple Object Tracking Evaluation Analysis Framework

Authors : Dao Huu Hung, Do Anh Tuan, Nguyen Ngoc Khanh, Tran Duc Hien, Nguyen Hai Duong

Published in: Advances in Visual Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Recently, CLEAR and trajectory-based evaluation protocols which generate particular scores such as MOTA and MOTP, etc., are often used in evaluating multiple object tracking (MOT) methods. These scores, indicating how good of tracking methods, seem to be good enough to compare their performances. However, we argue that it is insufficient since failure causes of tracking methods are not discovered. Understanding failure causes will definitely not only help improve their algorithms but also assess merits and demerits of algorithms explicitly. Thus this paper presents Tracking Evaluation Analysis (TEA) by answering the question: “why do tracking failures happen?” TEA comes out as an automatic solution, rather than a conventional way of manually analyzing tracking results, which are notorious for being time-consuming and tedious. In this preliminary version, we demonstrate the validity of TEA by comparing the performances of MOT methods, submitted to MOT 2015 Challenge, tested on TownCentre dataset.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
We do not consider all methods in MOT 2015 challenge and only test with TownCentre dataset, because of space limitation.
 
2
It is trivial to consider the person giving id to the noise.
 
3
It is also trivial to consider the unmatched track receiving id from a nearby person.
 
Literature
1.
go back to reference Zamir, A.R., Dehghan, A., Shah, M.: GMCP-tracker: global multi-object tracking using generalized minimum clique graphs. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, pp. 343–356. Springer, Heidelberg (2012) Zamir, A.R., Dehghan, A., Shah, M.: GMCP-tracker: global multi-object tracking using generalized minimum clique graphs. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, pp. 343–356. Springer, Heidelberg (2012)
2.
go back to reference Solera, F., Calderara, S., Cucchiara, R.: Learning to divide and conquer for online multi-target object tracking. In: ICCV, pp. 1–12 (2015) Solera, F., Calderara, S., Cucchiara, R.: Learning to divide and conquer for online multi-target object tracking. In: ICCV, pp. 1–12 (2015)
3.
go back to reference Benfold, B., Reid, I.: Stable multi-target tracking in real-time surveillance video. In: CVPR, pp. 3457–3464 (2011) Benfold, B., Reid, I.: Stable multi-target tracking in real-time surveillance video. In: CVPR, pp. 3457–3464 (2011)
4.
go back to reference Milan, A., Roth, S., Schindler, K.: Continuous energy minimization for multitarget tracking. PAMI 36, 58–72 (2014)CrossRef Milan, A., Roth, S., Schindler, K.: Continuous energy minimization for multitarget tracking. PAMI 36, 58–72 (2014)CrossRef
5.
go back to reference Dicle, C., Camps, O., Sznaier, M.: The way they move: tracking multiple targets with similar appearance. In: ICCV, pp. 2304–2311 (2013) Dicle, C., Camps, O., Sznaier, M.: The way they move: tracking multiple targets with similar appearance. In: ICCV, pp. 2304–2311 (2013)
6.
go back to reference Hamid Rezatofighi, S., Milan, A., Zhang, Z., Shi, Q., Dick, A., Reid, I.: Joint probabilistic data association revisited. In: ICCV, pp. 3047–3055 (2015) Hamid Rezatofighi, S., Milan, A., Zhang, Z., Shi, Q., Dick, A., Reid, I.: Joint probabilistic data association revisited. In: ICCV, pp. 3047–3055 (2015)
7.
go back to reference Solera, F., Calderara, S., Cucchiara, R.: Learning to divide and conquer for online multi-target tracking. In: ICCV, pp. 4373–4381 (2015) Solera, F., Calderara, S., Cucchiara, R.: Learning to divide and conquer for online multi-target tracking. In: ICCV, pp. 4373–4381 (2015)
8.
go back to reference Kim, C., Li, F., Ciptadi, A., Rehg, J.M.: Multiple hypothesis tracking revisited. In: ICCV, pp. 4696–4704 (2015) Kim, C., Li, F., Ciptadi, A., Rehg, J.M.: Multiple hypothesis tracking revisited. In: ICCV, pp. 4696–4704 (2015)
9.
go back to reference Yoon, J.H., Yang, M.H., Lim, J., Yoon, K.J.: Bayesian multi-object tracking using motion context from multiple objects. In: WACV, pp. 33–40 (2015) Yoon, J.H., Yang, M.H., Lim, J., Yoon, K.J.: Bayesian multi-object tracking using motion context from multiple objects. In: WACV, pp. 33–40 (2015)
10.
go back to reference Geiger, A., Lauer, M., Wojek, C., Stiller, C., Urtasun, R.: 3d traffic scene understanding from movable platforms. PAMI 36, 1012–1025 (2014)CrossRef Geiger, A., Lauer, M., Wojek, C., Stiller, C., Urtasun, R.: 3d traffic scene understanding from movable platforms. PAMI 36, 1012–1025 (2014)CrossRef
11.
13.
go back to reference Leal-Taixé, L.: Linear programming on 2D image coordinates (LP2D) (2015) Leal-Taixé, L.: Linear programming on 2D image coordinates (LP2D) (2015)
14.
go back to reference Bernardin, K., Stiefelhagen, R.: Evaluating multiple object tracking performance: the clear mot metrics. J. Image Video Process. 1, 1–10 (2008)CrossRef Bernardin, K., Stiefelhagen, R.: Evaluating multiple object tracking performance: the clear mot metrics. J. Image Video Process. 1, 1–10 (2008)CrossRef
15.
go back to reference Li, Y., Huang, C., Nevatia, R.: Learning to associate: hybrid boosted multi-target tracker for crowded scene. In: CVPR, pp. 2953–2960 (2009) Li, Y., Huang, C., Nevatia, R.: Learning to associate: hybrid boosted multi-target tracker for crowded scene. In: CVPR, pp. 2953–2960 (2009)
16.
go back to reference Milan, A., Schindler, K., Roth, S.: Challenges of ground truth evaluation of multi-target tracking. In: CVPR, pp. 735–742 (2013) Milan, A., Schindler, K., Roth, S.: Challenges of ground truth evaluation of multi-target tracking. In: CVPR, pp. 735–742 (2013)
17.
go back to reference Ferryman, J., Ellis, A.: Pets 2010: dataset and challenge. In: AVSS, pp. 143–150 (2010) Ferryman, J., Ellis, A.: Pets 2010: dataset and challenge. In: AVSS, pp. 143–150 (2010)
18.
go back to reference Leal-Taixé, L., Milan, A., Reid, I., Roth, S., Schindler, K.: Motchallenge 2015: towards a benchmark for multi-target tracking. arxiv:1504.01942 [cs] (2015) Leal-Taixé, L., Milan, A., Reid, I., Roth, S., Schindler, K.: Motchallenge 2015: towards a benchmark for multi-target tracking. arxiv:​1504.​01942 [cs] (2015)
19.
go back to reference Shu, G., Dehghan, A., Oreifej, O., Hand, E., Shah, M.: Part-based multiple-person tracking with partial occlusion handling. In: CVPR, pp. 1815–1821 (2012) Shu, G., Dehghan, A., Oreifej, O., Hand, E., Shah, M.: Part-based multiple-person tracking with partial occlusion handling. In: CVPR, pp. 1815–1821 (2012)
20.
go back to reference Andriluka, M., Roth, S., Schiele, B.: Monocular 3d pose estimation and tracking by detection. In: CVPR, pp. 623–630 (2010) Andriluka, M., Roth, S., Schiele, B.: Monocular 3d pose estimation and tracking by detection. In: CVPR, pp. 623–630 (2010)
21.
go back to reference Andriluka, M., Roth, S., Schiele, B.: People-tracking-by-detection and people-detection-by-tracking. In: CVPR, pp. 1–8 (2008) Andriluka, M., Roth, S., Schiele, B.: People-tracking-by-detection and people-detection-by-tracking. In: CVPR, pp. 1–8 (2008)
22.
go back to reference Ess, A., Leibe, B., Schindler, K., van Gool, L.: A mobile vision system for robust multi-person tracking. In: CVPR (2008) Ess, A., Leibe, B., Schindler, K., van Gool, L.: A mobile vision system for robust multi-person tracking. In: CVPR (2008)
23.
go back to reference Milan, A., Gade, R., Dick, A., Moeslund, T.B., Reid, I.: Improving global multi-target tracking with local updates. In: Agapito, L., Bronstein, M.M., Rother, C. (eds.) ECCV 2014. LNCS, vol. 8927, pp. 174–190. Springer, Heidelberg (2015). doi:10.1007/978-3-319-16199-0_13 Milan, A., Gade, R., Dick, A., Moeslund, T.B., Reid, I.: Improving global multi-target tracking with local updates. In: Agapito, L., Bronstein, M.M., Rother, C. (eds.) ECCV 2014. LNCS, vol. 8927, pp. 174–190. Springer, Heidelberg (2015). doi:10.​1007/​978-3-319-16199-0_​13
24.
go back to reference Zhang, J., Presti, L.L., Sclaroff, S.: Online multi-person tracking by tracker hierarchy. In: AVSS, pp. 379–385 (2012) Zhang, J., Presti, L.L., Sclaroff, S.: Online multi-person tracking by tracker hierarchy. In: AVSS, pp. 379–385 (2012)
25.
go back to reference Benfold, B., Reid, I.: Guiding visual surveillance by tracking human attention. In: BMVC, pp. 1–11 (2009) Benfold, B., Reid, I.: Guiding visual surveillance by tracking human attention. In: BMVC, pp. 1–11 (2009)
Metadata
Title
A Multiple Object Tracking Evaluation Analysis Framework
Authors
Dao Huu Hung
Do Anh Tuan
Nguyen Ngoc Khanh
Tran Duc Hien
Nguyen Hai Duong
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-50835-1_16

Premium Partner