Skip to main content
Erschienen in: Multimedia Systems 3/2015

01.06.2015 | Regular Paper

Multi-object tracking via MHT with multiple information fusion in surveillance video

verfasst von: Long Ying, Tianzhu Zhang, Changsheng Xu

Erschienen in: Multimedia Systems | Ausgabe 3/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Tracking multiple objects is critical to automatic video content analysis and virtual reality. The major problem is how to solve data association problem when ambiguous measurements are caused by objects in close proximity. To tackle this problem, we propose a multiple information fusion-based multiple hypotheses tracking algorithm integrated with appearance feature, local motion pattern feature and repulsion–inertia model for multi-object tracking. Appearance model based on HSV–local binary patterns histogram and local motion pattern based on optical flow are adopted to describe objects. A likelihood calculation framework is proposed to incorporate the similarities of appearance, dynamic process and local motion pattern. To consider the changes in appearance and motion pattern over time, we make use of an effective template updating strategy for each object. In addition, a repulsion–inertia model is adopted to explore more useful information from ambiguous detections. Experimental results show that the proposed approach generates better trajectories with less missing objects and identity switches.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hofmann, M., Rigoll, G., Huang, T.: Dense spatio-temporal motion segmentation for tracking multiple self-occluding people. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 9–14 (2010) Hofmann, M., Rigoll, G., Huang, T.: Dense spatio-temporal motion segmentation for tracking multiple self-occluding people. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 9–14 (2010)
2.
Zurück zum Zitat Zhang, T., Liu, J., Liu, S., Ouyang, Y., Lu, H.: Boosted exemplar learning for human action recognition. In: 2009 IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops), pp. 538–545(2009) Zhang, T., Liu, J., Liu, S., Ouyang, Y., Lu, H.: Boosted exemplar learning for human action recognition. In: 2009 IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops), pp. 538–545(2009)
3.
Zurück zum Zitat Wang, C., Gorce, M., Paragios, N.: Segmentation, ordering and multi-object tracking using graphical models. In: 2009 IEEE 12th International Conference on Computer Vision (2009) Wang, C., Gorce, M., Paragios, N.: Segmentation, ordering and multi-object tracking using graphical models. In: 2009 IEEE 12th International Conference on Computer Vision (2009)
4.
Zurück zum Zitat Xing, J., Ai, H., Lao, S.: Multi-object tracking through occlusions by local tracklets filtering and global tracklets association with detection responses. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, CVPR, pp. 1200–1207 (2009) Xing, J., Ai, H., Lao, S.: Multi-object tracking through occlusions by local tracklets filtering and global tracklets association with detection responses. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, CVPR, pp. 1200–1207 (2009)
5.
Zurück zum Zitat Yu, Q., Medioni, G.: Multiple-target tracking by spatio-temporal Monte Carlo Markov chain data association. TPAMI 31(12), 2196–2210 (2009)CrossRef Yu, Q., Medioni, G.: Multiple-target tracking by spatio-temporal Monte Carlo Markov chain data association. TPAMI 31(12), 2196–2210 (2009)CrossRef
6.
Zurück zum Zitat Popp, R.L., Pattipati, K.R., Bar-Shalom, Y.: Dynamically adaptable m-best 2-D assignment algorithm and multilevel parallelization. IEEE Trans. Aerosp. Electron. Syst. 35(4), 1145–1160 (1999)CrossRef Popp, R.L., Pattipati, K.R., Bar-Shalom, Y.: Dynamically adaptable m-best 2-D assignment algorithm and multilevel parallelization. IEEE Trans. Aerosp. Electron. Syst. 35(4), 1145–1160 (1999)CrossRef
7.
Zurück zum Zitat Bar-Shalom, Y., Daum, F., Huang, J.: The probabilistic data association filter. IEEE Control Syst. 29(6), 82–100 (2009)CrossRefMathSciNet Bar-Shalom, Y., Daum, F., Huang, J.: The probabilistic data association filter. IEEE Control Syst. 29(6), 82–100 (2009)CrossRefMathSciNet
8.
Zurück zum Zitat Knan, Z., Balch, T., Dellaert, F.: MCMC-based particle filtering for tracking a variable number of interacting targets. IEEE Trans. Pattern Anal. Mach. Intell. 27(11), 1805–1819 (2005)CrossRef Knan, Z., Balch, T., Dellaert, F.: MCMC-based particle filtering for tracking a variable number of interacting targets. IEEE Trans. Pattern Anal. Mach. Intell. 27(11), 1805–1819 (2005)CrossRef
9.
Zurück zum Zitat Qu, W., Schonfeld, D., Mohamed, M.: Real time distributed multi-object tracking using multiple interactive trackers and a magnetic-inertia potential model. IEEE Trans. Multimed. 9(3), 511–519 (2007)CrossRef Qu, W., Schonfeld, D., Mohamed, M.: Real time distributed multi-object tracking using multiple interactive trackers and a magnetic-inertia potential model. IEEE Trans. Multimed. 9(3), 511–519 (2007)CrossRef
10.
Zurück zum Zitat Breitenstein, M.D., Reichlin, F., et al.: Robust tracking-by-detection using a detector confidence particle filter. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 1515–1522 (2009) Breitenstein, M.D., Reichlin, F., et al.: Robust tracking-by-detection using a detector confidence particle filter. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 1515–1522 (2009)
11.
Zurück zum Zitat Reid, D.: An algorithm for tracking multiple targets. IEEE Trans. Autom. Control 24(6), 843–854 (1979)CrossRef Reid, D.: An algorithm for tracking multiple targets. IEEE Trans. Autom. Control 24(6), 843–854 (1979)CrossRef
12.
Zurück zum Zitat Cox, I., Hingorani, S.: An efficient implementation of Reid’s multiple hypothesis tracking algorithm and its evaluation for the purpose of visual tracking. IEEE Trans. Pattern Anal. Mach. Intell. 18(2), 138–150 (1996)CrossRef Cox, I., Hingorani, S.: An efficient implementation of Reid’s multiple hypothesis tracking algorithm and its evaluation for the purpose of visual tracking. IEEE Trans. Pattern Anal. Mach. Intell. 18(2), 138–150 (1996)CrossRef
13.
Zurück zum Zitat Miller, M., Stone, H., Cox, I.: Optimizing Murty’s ranked assignment method. IEEE Trans. Aerosp. Electron. Syst. 33(3), 851–862 (1997)CrossRef Miller, M., Stone, H., Cox, I.: Optimizing Murty’s ranked assignment method. IEEE Trans. Aerosp. Electron. Syst. 33(3), 851–862 (1997)CrossRef
14.
Zurück zum Zitat Ryoo, M., Aggarwal, J.: Observe-and-explain: a new approach for multiple hypotheses tracking of humans and objects. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, CVPR, pp. 1–8 (2008) Ryoo, M., Aggarwal, J.: Observe-and-explain: a new approach for multiple hypotheses tracking of humans and objects. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, CVPR, pp. 1–8 (2008)
15.
Zurück zum Zitat Oh, S., Russell, S., Sastry, S.: Markov Chain Monte Carlo data association for multi-target tracking. IEEE Trans. Autom. Control 54(3), 481–497 (2009)CrossRefMathSciNet Oh, S., Russell, S., Sastry, S.: Markov Chain Monte Carlo data association for multi-target tracking. IEEE Trans. Autom. Control 54(3), 481–497 (2009)CrossRefMathSciNet
16.
Zurück zum Zitat Benfold, B., Reid, I.: Stable multi-target tracking in real-time surveillance video. In: 2011 IEEE conference on computer vision and pattern recognition (CVPR), pp. 3457–3464 (2011) Benfold, B., Reid, I.: Stable multi-target tracking in real-time surveillance video. In: 2011 IEEE conference on computer vision and pattern recognition (CVPR), pp. 3457–3464 (2011)
17.
Zurück zum Zitat Shitrit, H., Berclaz, J., Fleuret, F., et al.: Tracking multiple people under global appearance constraints. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 137–144 (2011) Shitrit, H., Berclaz, J., Fleuret, F., et al.: Tracking multiple people under global appearance constraints. In: 2011 IEEE International Conference on Computer Vision (ICCV), pp. 137–144 (2011)
18.
Zurück zum Zitat Zhang, L., Li, Y., Nevatia, R.: Global data association for multi-object tracking using network flows. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, CVPR, pp. 1–8 (2008) Zhang, L., Li, Y., Nevatia, R.: Global data association for multi-object tracking using network flows. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition, CVPR, pp. 1–8 (2008)
19.
Zurück zum Zitat Pirsiavash, H., Ramanan, D., Fowlkes, C.: Globally-optimal greedy algorithms for tracking a variable number of objects. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1201–1208 (2011) Pirsiavash, H., Ramanan, D., Fowlkes, C.: Globally-optimal greedy algorithms for tracking a variable number of objects. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1201–1208 (2011)
20.
Zurück zum Zitat Brendel, W., Amer, M., Todorovic, S.: Multiobject tracking as maximum weight independent set. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1273–1280 (2011) Brendel, W., Amer, M., Todorovic, S.: Multiobject tracking as maximum weight independent set. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1273–1280 (2011)
21.
Zurück zum Zitat Yang, B., Huang, C., Nevatia, R.: Learning affinities and dependencies for multi-target tracking using a CRF model. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1233–1240 (2011) Yang, B., Huang, C., Nevatia, R.: Learning affinities and dependencies for multi-target tracking using a CRF model. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1233–1240 (2011)
22.
Zurück zum Zitat Ying, L., Xu, C.S., Guo, W.: Extended MHT algorithm for multiple object tracking. In: Proceedings of the 4th International Conference on Internet Multimedia Computing and Service, pp. 75–79 (2012) Ying, L., Xu, C.S., Guo, W.: Extended MHT algorithm for multiple object tracking. In: Proceedings of the 4th International Conference on Internet Multimedia Computing and Service, pp. 75–79 (2012)
23.
Zurück zum Zitat Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Anal. Mach. Intell. 24(7), 971–987 (2002)CrossRef Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Anal. Mach. Intell. 24(7), 971–987 (2002)CrossRef
24.
Zurück zum Zitat Black, M., Anandan, P.: The robust estimation of multiple motions: parametric and piecewise smooth flow fields. Comput. Vis. Image Underst. 63(1), 75–104 (1996)CrossRef Black, M., Anandan, P.: The robust estimation of multiple motions: parametric and piecewise smooth flow fields. Comput. Vis. Image Underst. 63(1), 75–104 (1996)CrossRef
25.
Zurück zum Zitat Zhang, T., Liu, S., Xu, C., Lu, H.: Mining semantic context information for intelligent video surveillance of traffic scenes. In: IEEE transactions on industrial informatics (2012) Zhang, T., Liu, S., Xu, C., Lu, H.: Mining semantic context information for intelligent video surveillance of traffic scenes. In: IEEE transactions on industrial informatics (2012)
26.
Zurück zum Zitat Tran, D., Sorokin, A.: Human activity recognition with metric learning. In: Computer vision—ECCV 2008. Springer, Berlin/Heidelberg, pp. 548–561 (2008) Tran, D., Sorokin, A.: Human activity recognition with metric learning. In: Computer vision—ECCV 2008. Springer, Berlin/Heidelberg, pp. 548–561 (2008)
27.
Zurück zum Zitat Liu, C.: Classifier combination based on confidence transformation. Pattern Recogn. 38(1), 11–28 (2005)CrossRefMATH Liu, C.: Classifier combination based on confidence transformation. Pattern Recogn. 38(1), 11–28 (2005)CrossRefMATH
28.
Zurück zum Zitat Zhang, T.Z., Ghanem, B., Liu, S., Ahuja, N.: Robust visual tracking via structured multi-task sparse learning. Int. J. Comput. Vis. 101(2), 367–383 (2012)CrossRefMathSciNet Zhang, T.Z., Ghanem, B., Liu, S., Ahuja, N.: Robust visual tracking via structured multi-task sparse learning. Int. J. Comput. Vis. 101(2), 367–383 (2012)CrossRefMathSciNet
29.
Zurück zum Zitat Zhang, T.Z., Ghanem, B., Liu, S., Ahuja, N.: Robust visual tracking via multi-task sparse learning. In: IEEE International Conference on Computer Vision and Pattern Recognition (2012) Zhang, T.Z., Ghanem, B., Liu, S., Ahuja, N.: Robust visual tracking via multi-task sparse learning. In: IEEE International Conference on Computer Vision and Pattern Recognition (2012)
30.
Zurück zum Zitat Zhang, T.Z., Ghanem, B., Liu, S., Ahuja, N.: Low-rank sparse learning for robust visual tracking. In: European Conference on Computer Vision (2012) Zhang, T.Z., Ghanem, B., Liu, S., Ahuja, N.: Low-rank sparse learning for robust visual tracking. In: European Conference on Computer Vision (2012)
31.
Zurück zum Zitat Bernardin, K., Stiefelhagen, R.: Evaluating multiple object tracking performance: the CLEAR MOT metrics. EURASIP J Image Video Process (2008) Bernardin, K., Stiefelhagen, R.: Evaluating multiple object tracking performance: the CLEAR MOT metrics. EURASIP J Image Video Process (2008)
32.
Zurück zum Zitat Zha, Zheng-Jun, Wang, Meng, Zheng, Yan-Tao, Yang, Yi, Hong, Richang, Chua, Tat-Seng: Interactive video indexing with statistical active learning. IEEE Trans. Multimed. 14(1), 17–27 (2012)CrossRef Zha, Zheng-Jun, Wang, Meng, Zheng, Yan-Tao, Yang, Yi, Hong, Richang, Chua, Tat-Seng: Interactive video indexing with statistical active learning. IEEE Trans. Multimed. 14(1), 17–27 (2012)CrossRef
33.
Zurück zum Zitat Zha, Z.-J., Yang, L., Mei, T., Wang, M., Wang, Z., Chua, T.-S., Hua, X.-S.: Visual query suggestion: towards capturing user intent in internet image search. ACM Trans. Multimed. Comput. Commun. Appl (TOMMCAP) 6(3), article no 13 (2010) Zha, Z.-J., Yang, L., Mei, T., Wang, M., Wang, Z., Chua, T.-S., Hua, X.-S.: Visual query suggestion: towards capturing user intent in internet image search. ACM Trans. Multimed. Comput. Commun. Appl (TOMMCAP) 6(3), article no 13 (2010)
34.
Zurück zum Zitat Zha, Z-J., Hua, X-S., Mei, T., Wang, J., Qi, G-J., Wang, Z.: Joint multi-label multi-instance l earning for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR (2008) Zha, Z-J., Hua, X-S., Mei, T., Wang, J., Qi, G-J., Wang, Z.: Joint multi-label multi-instance l earning for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR (2008)
Metadaten
Titel
Multi-object tracking via MHT with multiple information fusion in surveillance video
verfasst von
Long Ying
Tianzhu Zhang
Changsheng Xu
Publikationsdatum
01.06.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
Multimedia Systems / Ausgabe 3/2015
Print ISSN: 0942-4962
Elektronische ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-014-0361-5

Weitere Artikel der Ausgabe 3/2015

Multimedia Systems 3/2015 Zur Ausgabe

Neuer Inhalt