Skip to main content
Top
Published in: Machine Vision and Applications 5-6/2017

29-04-2017 | Original Paper

Predicting multiple target tracking performance for applications on video sequences

Authors: Juan E. Tapiero, Henry Medeiros, Robert H. Bishop

Published in: Machine Vision and Applications | Issue 5-6/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper presents a framework to predict the performance of multiple target tracking (MTT) techniques. The framework is based on the mathematical descriptors of point processes, the probability generating functional (p.g.fl). It is shown that conceptually the p.g.fls of MTT techniques can be interpreted as a transform that can be marginalized to an expression that encodes all the information regarding the likelihood model as well as the underlying assumptions present in a given tracking technique. In order to use this approach for tracker performance prediction in video sequences, a framework that combines video quality assessment concepts and the marginalized transform is introduced. The multiple hypothesis tracker and Markov Chain Monte Carlo data association methods are used as test cases. We introduce their transforms and perform a numerical comparison to predict their performance under identical conditions.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Footnotes
1
Although this is a relatively strong assumption, it provides reasonable results. Making this assumption weaker is subject of future work, as explained in more detail in our concluding remarks.
 
Literature
1.
go back to reference Antunes, D.M., de Matos, D.M., Gaspar, J.: A library for implementing the multiple hypothesis tracking algorithm. arXiv preprint (2011) Antunes, D.M., de Matos, D.M., Gaspar, J.: A library for implementing the multiple hypothesis tracking algorithm. arXiv preprint (2011)
2.
go back to reference Cancela, B., Ortega, M., Penedo, M.G.: Multiple human tracking system for unpredictable trajectories. Mach. Vis. Appl. 25(2), 511–527 (2014)CrossRef Cancela, B., Ortega, M., Penedo, M.G.: Multiple human tracking system for unpredictable trajectories. Mach. Vis. Appl. 25(2), 511–527 (2014)CrossRef
3.
go back to reference Chikkerur, S., Sundaram, V., Reisslein, M., Karam, L.J.: Objective video quality assessment methods: A classification, review, and performance comparison. IEEE Trans. Broadcast. 57(2), 165–182 (2011)CrossRef Chikkerur, S., Sundaram, V., Reisslein, M., Karam, L.J.: Objective video quality assessment methods: A classification, review, and performance comparison. IEEE Trans. Broadcast. 57(2), 165–182 (2011)CrossRef
5.
go back to reference Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 1, pp. 886–893. doi:10.1109/CVPR.2005.177 (2005) Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 1, pp. 886–893. doi:10.​1109/​CVPR.​2005.​177 (2005)
6.
go back to reference Danchick, R., Newnam, G.: Reformulating Reid’s MHT method with generalised murty k-best ranked linear assignment algorithm. In: IEEE Proceedings on Radar, Sonar and Navigation, vol. 153, pp. 13–22. IEE (2006) Danchick, R., Newnam, G.: Reformulating Reid’s MHT method with generalised murty k-best ranked linear assignment algorithm. In: IEEE Proceedings on Radar, Sonar and Navigation, vol. 153, pp. 13–22. IEE (2006)
7.
go back to reference EmBree, J.D.: Spatial temporal exponential-family point processes for the evolution of social systems. Ph.D. thesis, University of California Los Angeles (2015) EmBree, J.D.: Spatial temporal exponential-family point processes for the evolution of social systems. Ph.D. thesis, University of California Los Angeles (2015)
8.
go back to reference Fortmann, T.E., Bar-Shalom, Y., Scheffe, M.: Sonar tracking of multiple targets using joint probabilistic data association. IEEE J. Ocean. Eng. 8(3), 173–184 (1983)CrossRef Fortmann, T.E., Bar-Shalom, Y., Scheffe, M.: Sonar tracking of multiple targets using joint probabilistic data association. IEEE J. Ocean. Eng. 8(3), 173–184 (1983)CrossRef
9.
go back to reference Hartikainen, J., Särkkä, S.: RBMCDAbox-Matlab toolbox of rao-blackwellized data association particle filters. Documentation of RBMCDA Toolbox for Matlab V (2008) Hartikainen, J., Särkkä, S.: RBMCDAbox-Matlab toolbox of rao-blackwellized data association particle filters. Documentation of RBMCDA Toolbox for Matlab V (2008)
10.
go back to reference Hoak, A., Medeiros, H., Povinelli, R.J.: Image-based multi-target tracking through multi-bernoulli filtering with interactive likelihoods. Sensors 17(3), 501 (2017). doi:10.3390/s17030501 CrossRef Hoak, A., Medeiros, H., Povinelli, R.J.: Image-based multi-target tracking through multi-bernoulli filtering with interactive likelihoods. Sensors 17(3), 501 (2017). doi:10.​3390/​s17030501 CrossRef
12.
go back to reference Leal-Taixá, L., Milan, A., Reid, I., Roth, S., Schindler, K.: Motchallenge 2015: towards a benchmark for multi-target tracking. arXiv preprint (2015) Leal-Taixá, L., Milan, A., Reid, I., Roth, S., Schindler, K.: Motchallenge 2015: towards a benchmark for multi-target tracking. arXiv preprint (2015)
13.
14.
go back to reference Mahler, R.P.: Statistical Multisource-Multitarget Information Fusion. Artech House Inc, Norwood (2007)MATH Mahler, R.P.: Statistical Multisource-Multitarget Information Fusion. Artech House Inc, Norwood (2007)MATH
15.
go back to reference Medeiros, H., Holguin, G., Shin, P.J., Park, J.: A parallel histogram-based particle filter for object tracking on simd-based smart cameras. Comput. Vis. Image Underst. 114(11), 1264–1272 (2010)CrossRef Medeiros, H., Holguin, G., Shin, P.J., Park, J.: A parallel histogram-based particle filter for object tracking on simd-based smart cameras. Comput. Vis. Image Underst. 114(11), 1264–1272 (2010)CrossRef
16.
go back to reference Milan, A., Leal-Taixé, L., Reid, I.D., Roth, S., Schindler, K.: MOT16: a benchmark for multi-object tracking. CoRR arXiv:1603.00831 [abs] Milan, A., Leal-Taixé, L., Reid, I.D., Roth, S., Schindler, K.: MOT16: a benchmark for multi-object tracking. CoRR arXiv:​1603.​00831 [abs]
17.
go back to reference Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)MathSciNetCrossRef Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)MathSciNetCrossRef
19.
go back to reference Oh, S., Russell, S., Sastry, S.: Markov chain Monte Carlo data association for general multiple-target tracking problems. In: 43rd Conference on Decision and Control, vol. 1, pp. 735–742. IEEE (2004) Oh, S., Russell, S., Sastry, S.: Markov chain Monte Carlo data association for general multiple-target tracking problems. In: 43rd Conference on Decision and Control, vol. 1, pp. 735–742. IEEE (2004)
20.
go back to reference Pemantle, R., Wilson, M.C.: Analytic Combinatorics in Several Variables, vol. 140. Cambridge University Press, Cambridge (2013)CrossRefMATH Pemantle, R., Wilson, M.C.: Analytic Combinatorics in Several Variables, vol. 140. Cambridge University Press, Cambridge (2013)CrossRefMATH
21.
go back to reference Pulford, G.W.: Taxonomy of multiple target tracking methods. IEEE Proc. Radar Sonar Navig. 152(5), 291–304 (2005)CrossRef Pulford, G.W.: Taxonomy of multiple target tracking methods. IEEE Proc. Radar Sonar Navig. 152(5), 291–304 (2005)CrossRef
22.
go back to reference Reid, D.B.: An algorithm for tracking multiple targets. IEEE Trans. Autom. Control 24(6), 843–854 (1979)CrossRef Reid, D.B.: An algorithm for tracking multiple targets. IEEE Trans. Autom. Control 24(6), 843–854 (1979)CrossRef
23.
go back to reference Ristic, B., Vo, B.N., Clark, D., Vo, B.T.: A metric for performance evaluation of multi-target tracking algorithms. IEEE Trans. Signal Process. 59(7), 3452–3457 (2011)MathSciNetCrossRef Ristic, B., Vo, B.N., Clark, D., Vo, B.T.: A metric for performance evaluation of multi-target tracking algorithms. IEEE Trans. Signal Process. 59(7), 3452–3457 (2011)MathSciNetCrossRef
24.
go back to reference Spinelli, B.M.: Statistical inference for stable point processes. Ph.D. thesis (2012) Spinelli, B.M.: Statistical inference for stable point processes. Ph.D. thesis (2012)
25.
go back to reference Streit, R.: The probability generating functional for finite point processes, and its application to the comparison of PHD and intensity filters. J. Adv. Inf. Fusion 8(2) (2013) Streit, R.: The probability generating functional for finite point processes, and its application to the comparison of PHD and intensity filters. J. Adv. Inf. Fusion 8(2) (2013)
26.
go back to reference Streit, R.: Saddle point method for JPDA and related filters. In: 2015 18th International Conference on Information Fusion (Fusion), pp. 1680–1687. IEEE (2015) Streit, R.: Saddle point method for JPDA and related filters. In: 2015 18th International Conference on Information Fusion (Fusion), pp. 1680–1687. IEEE (2015)
27.
go back to reference Streit, R., Degen, C., Koch, W.: The pointillist family of multitarget tracking filters. arXiv preprint (2015) Streit, R., Degen, C., Koch, W.: The pointillist family of multitarget tracking filters. arXiv preprint (2015)
28.
go back to reference Streit, R.L.: Poisson Point Processes: Imaging, Tracking, and Sensing. Springer, New York (2010)CrossRef Streit, R.L.: Poisson Point Processes: Imaging, Tracking, and Sensing. Springer, New York (2010)CrossRef
29.
go back to reference Tapiero, J.E., Bishop, R.H.: Bayesian estimation for tracking of spiraling reentry vehicles. In: AIAA Guidance, Navigation, and Control (GNC) Conference (2013) Tapiero, J.E., Bishop, R.H.: Bayesian estimation for tracking of spiraling reentry vehicles. In: AIAA Guidance, Navigation, and Control (GNC) Conference (2013)
30.
go back to reference Tinne, D.: Rigorously Bayesian multitarget tracking and localization. Ph.D. thesis (2010) Tinne, D.: Rigorously Bayesian multitarget tracking and localization. Ph.D. thesis (2010)
31.
go back to reference Vo, B., Vo, B., Cantoni, A.: The cardinalized probability hypothesis density filter for linear Gaussian multi-target models. In: 40th Annual Conference on Information Sciences and Systems, pp. 681–686. IEEE (2006) Vo, B., Vo, B., Cantoni, A.: The cardinalized probability hypothesis density filter for linear Gaussian multi-target models. In: 40th Annual Conference on Information Sciences and Systems, pp. 681–686. IEEE (2006)
32.
go back to reference Vo, B.N., Ma, W.K.: The Gaussian mixture probability hypothesis density filter. IEEE Trans. Signal Process. 54(11), 4091–4104 (2006)CrossRef Vo, B.N., Ma, W.K.: The Gaussian mixture probability hypothesis density filter. IEEE Trans. Signal Process. 54(11), 4091–4104 (2006)CrossRef
33.
go back to reference Vo, B.T., Vo, B.N., Cantoni, A.: The cardinality balanced multi-target multi-bernoulli filter and its implementations. IEEE Trans. Signal Process. 57(2), 409–423 (2009)MathSciNetCrossRef Vo, B.T., Vo, B.N., Cantoni, A.: The cardinality balanced multi-target multi-bernoulli filter and its implementations. IEEE Trans. Signal Process. 57(2), 409–423 (2009)MathSciNetCrossRef
34.
go back to reference Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)CrossRef
35.
go back to reference Wang, Z., Sheikh, H.R., Bovik, A.C.: Objective Video Quality Assessment. The Handbook of Video Databases: Design and Applications, pp. 1041–1078. CRC Press, Boca Raton (2003). ISBN: 9780849370069 Wang, Z., Sheikh, H.R., Bovik, A.C.: Objective Video Quality Assessment. The Handbook of Video Databases: Design and Applications, pp. 1041–1078. CRC Press, Boca Raton (2003). ISBN: 9780849370069
36.
go back to reference Wang, Z., Simoncelli, E.P., Bovik, A.C.: Multiscale Structural Similarity for Image Quality Assessment, pp. 1398–1402. IEEE, New York (2003) Wang, Z., Simoncelli, E.P., Bovik, A.C.: Multiscale Structural Similarity for Image Quality Assessment, pp. 1398–1402. IEEE, New York (2003)
38.
go back to reference Yeddanapudi, M.K.: Estimation and data association algorithms for multisensor-multitarget tracking. Ph.D. thesis (1996) Yeddanapudi, M.K.: Estimation and data association algorithms for multisensor-multitarget tracking. Ph.D. thesis (1996)
39.
go back to reference Zuriarrain, I., Mekonnen, A.A., Lerasle, F., Arana, N.: Tracking-by-detection of multiple persons by a resample-move particle filter. Mach. Vis. Appl. 24(8), 1751–1765 (2013)CrossRef Zuriarrain, I., Mekonnen, A.A., Lerasle, F., Arana, N.: Tracking-by-detection of multiple persons by a resample-move particle filter. Mach. Vis. Appl. 24(8), 1751–1765 (2013)CrossRef
Metadata
Title
Predicting multiple target tracking performance for applications on video sequences
Authors
Juan E. Tapiero
Henry Medeiros
Robert H. Bishop
Publication date
29-04-2017
Publisher
Springer Berlin Heidelberg
Published in
Machine Vision and Applications / Issue 5-6/2017
Print ISSN: 0932-8092
Electronic ISSN: 1432-1769
DOI
https://doi.org/10.1007/s00138-017-0840-8

Other articles of this Issue 5-6/2017

Machine Vision and Applications 5-6/2017 Go to the issue

Premium Partner