Skip to main content
Top

2014 | OriginalPaper | Chapter

10. Soft-Biometrics and Reference Set Integrated Model for Tracking Across Cameras

Authors : Xiaojing Chen, Le An, Bir Bhanu

Published in: Distributed Embedded Smart Cameras

Publisher: Springer New York

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Multi-target tracking in non-overlapping cameras is challenging due to the vast appearance change of the targets across camera views caused by variations in illumination conditions, poses, and camera imaging characteristics. Therefore, direct track association based on color information only is difficult and prone to error. In most previous methods the appearance similarity is computed either using color histograms directly or based on pre-trained Brightness Transfer Function (BTF) that maps color between cameras. In this chapter, besides color histograms, other soft-biometric features that are invariant to illumination and view changes are also integrated into the feature representation of a target. A novel reference set based appearance model is proposed to improve multi-target tracking in a network of non-overlapping video cameras. Unlike previous work, a reference set is constructed for a pair of cameras, containing targets appearing in both camera views. For track association, instead of comparing the appearance of two targets in different camera views directly, they are compared to the reference set. The reference set acts as a basis to represent a target by measuring the similarity between the target and each of the individuals in the reference set. The effectiveness of the proposed method over the baseline models on challenging real-world multi-camera video data is validated by the experiments.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Abdi H (2007) Kendall rank correlation. SAGE Publications, Inc., California, pp 509–511 Abdi H (2007) Kendall rank correlation. SAGE Publications, Inc., California, pp 509–511
2.
go back to reference An L, Chen X, Kafai M, Yang S, Bhanu B (2013) Improving person re-identification by soft biometrics based reranking. In: ACM/IEEE international conference on distributed smart cameras (ICDSC), pp 1–6 An L, Chen X, Kafai M, Yang S, Bhanu B (2013) Improving person re-identification by soft biometrics based reranking. In: ACM/IEEE international conference on distributed smart cameras (ICDSC), pp 1–6
3.
go back to reference An L, Kafai M, Yang S, Bhanu B (2013) Reference-based person re-identification. In: IEEE international conference on advanced video and signal-based surveillance (AVSS) An L, Kafai M, Yang S, Bhanu B (2013) Reference-based person re-identification. In: IEEE international conference on advanced video and signal-based surveillance (AVSS)
4.
go back to reference Candamo J, Shreve M, Goldgof D, Sapper D, Kasturi R (2010) Understanding transit scenes: a survey on human behavior-recognition algorithms. IEEE Trans Intell Transp Syst 11(1): 206–224 Candamo J, Shreve M, Goldgof D, Sapper D, Kasturi R (2010) Understanding transit scenes: a survey on human behavior-recognition algorithms. IEEE Trans Intell Transp Syst 11(1): 206–224
5.
go back to reference Chu CT, Hwang JN, Lan KM, Wang SZ (2011) Tracking across multiple cameras with overlapping views based on brightness and tangent transfer functions. In: Fifth ACM/IEEE international conference on distributed smart cameras (ICDSC), pp 1–6 Chu CT, Hwang JN, Lan KM, Wang SZ (2011) Tracking across multiple cameras with overlapping views based on brightness and tangent transfer functions. In: Fifth ACM/IEEE international conference on distributed smart cameras (ICDSC), pp 1–6
6.
go back to reference Chu CT, Hwang JN, Yu JY, Lee KZ (2012) Tracking across nonoverlapping cameras based on the unsupervised learning of camera link models. In: Sixth International conference on distributed smart cameras (ICDSC), pp 1–6 Chu CT, Hwang JN, Yu JY, Lee KZ (2012) Tracking across nonoverlapping cameras based on the unsupervised learning of camera link models. In: Sixth International conference on distributed smart cameras (ICDSC), pp 1–6
7.
8.
go back to reference Dantcheva A, Velardo C, D’angelo A, Dugelay JL (2011) Bag of soft biometrics for person identification. Multimedia Tools Appl 51(2):739–777CrossRef Dantcheva A, Velardo C, D’angelo A, Dugelay JL (2011) Bag of soft biometrics for person identification. Multimedia Tools Appl 51(2):739–777CrossRef
9.
go back to reference D’Orazio T, Mazzeo P, Spagnolo P (2009) Color brightness transfer function evaluation for non overlapping multi camera tracking. In: Third ACM/IEEE international conference on distributed smart cameras (ICDSC), pp 1–6 D’Orazio T, Mazzeo P, Spagnolo P (2009) Color brightness transfer function evaluation for non overlapping multi camera tracking. In: Third ACM/IEEE international conference on distributed smart cameras (ICDSC), pp 1–6
10.
go back to reference Gilbert A, Bowden R (2006) Tracking objects across cameras by incrementally learning inter-camera colour calibration and patterns of activity. In: European conference on computer vision 3952:125–136 Gilbert A, Bowden R (2006) Tracking objects across cameras by incrementally learning inter-camera colour calibration and patterns of activity. In: European conference on computer vision 3952:125–136
11.
go back to reference Guo G, Mu G, Ricanek K (2010) Cross-age face recognition on a very large database: the performance versus age intervals and improvement using soft biometric traits. In: 20th International conference on pattern recognition (ICPR), pp 3392–3395 Guo G, Mu G, Ricanek K (2010) Cross-age face recognition on a very large database: the performance versus age intervals and improvement using soft biometric traits. In: 20th International conference on pattern recognition (ICPR), pp 3392–3395
12.
go back to reference Hu W, Hu M, Zhou X, Tan T, Lou J, Maybank S (2006) Principal axis-based correspondence between multiple cameras for people tracking. IEEE Trans Pattern Anal Mach Intell 28(4): 663–671 Hu W, Hu M, Zhou X, Tan T, Lou J, Maybank S (2006) Principal axis-based correspondence between multiple cameras for people tracking. IEEE Trans Pattern Anal Mach Intell 28(4): 663–671
13.
go back to reference Jain AK, Park U (2009) Facial marks: soft biometric for face recognition. In: ICIP Jain AK, Park U (2009) Facial marks: soft biometric for face recognition. In: ICIP
14.
go back to reference Javed O, Shafique K, Rasheed Z, Shah M (2008) Modeling inter-camera space-time and appearance relationships for tracking across non-overlapping views. Comput Vision Image Underst 109:146–162CrossRef Javed O, Shafique K, Rasheed Z, Shah M (2008) Modeling inter-camera space-time and appearance relationships for tracking across non-overlapping views. Comput Vision Image Underst 109:146–162CrossRef
15.
go back to reference Munkres J (1957) Algorithms for the assignment and transportation problems. J Soc Ind Appl Math 5(1) Munkres J (1957) Algorithms for the assignment and transportation problems. J Soc Ind Appl Math 5(1)
16.
go back to reference Prosser B, Gong S, Xiang T (2008) Multi-camera matching using bi-directional cumulative brightness transfer functions. In: Proceedings of the British machine vision conference Prosser B, Gong S, Xiang T (2008) Multi-camera matching using bi-directional cumulative brightness transfer functions. In: Proceedings of the British machine vision conference
17.
go back to reference Qin Z, Shelton CR (2012) Improving multi-target tracking via social grouping. In: IEEE conference on computer vision and pattern recognition Qin Z, Shelton CR (2012) Improving multi-target tracking via social grouping. In: IEEE conference on computer vision and pattern recognition
18.
go back to reference Reid D, Samangooei S, Chen C, Nixon M, Ross A (2013) Soft biometrics for surveillance: an overview. In: Machine learning: theory and applications. Elsevier, pp 327–352 Reid D, Samangooei S, Chen C, Nixon M, Ross A (2013) Soft biometrics for surveillance: an overview. In: Machine learning: theory and applications. Elsevier, pp 327–352
19.
go back to reference Reid DA, Nixon M (2011) Using comparative human descriptions for soft biometrics. In: International joint conference on biometrics (IJCB), pp 1–6 Reid DA, Nixon M (2011) Using comparative human descriptions for soft biometrics. In: International joint conference on biometrics (IJCB), pp 1–6
20.
go back to reference Saleemi I, Shafique K, Shah M (2009) Probabilistic modeling of scene dynamics for applications in visual surveillance. IEEE Trans Pattern Anal Mach Intell 31(8):1472–1485 Saleemi I, Shafique K, Shah M (2009) Probabilistic modeling of scene dynamics for applications in visual surveillance. IEEE Trans Pattern Anal Mach Intell 31(8):1472–1485
21.
go back to reference Schroff F, Treibitz T, Kriegman D, Belongie S (2011) Pose, illumination and expression invariant pairwise face-similarity measure via doppelgänger list comparison. In: IEEE international conference on computer vision (ICCV), pp 2494–2501 Schroff F, Treibitz T, Kriegman D, Belongie S (2011) Pose, illumination and expression invariant pairwise face-similarity measure via doppelgänger list comparison. In: IEEE international conference on computer vision (ICCV), pp 2494–2501
22.
go back to reference Siebel NT, Maybank SJ (2004) The advisor visual surveillance system. In: ECCV 2004 workshop applications of computer vision (ACV) Siebel NT, Maybank SJ (2004) The advisor visual surveillance system. In: ECCV 2004 workshop applications of computer vision (ACV)
23.
go back to reference Wang X (2013) Intelligent multi-camera video surveillance: a review. Pattern recognition letters 34(1):3–19 Wang X (2013) Intelligent multi-camera video surveillance: a review. Pattern recognition letters 34(1):3–19
24.
go back to reference Yin Q, Tang X, Sun J (2011) An associate-predict model for face recognition. In: 2011 IEEE conference on computer vision and pattern recognition (CVPR), pp 497–504 Yin Q, Tang X, Sun J (2011) An associate-predict model for face recognition. In: 2011 IEEE conference on computer vision and pattern recognition (CVPR), pp 497–504
25.
go back to reference Zhu Y, Nayak N, Roy-Chowdhury A (2013) Context-aware activity recognition and anomaly detection in video. IEEE J Sel Top Sign Proces 7(1):91–101CrossRef Zhu Y, Nayak N, Roy-Chowdhury A (2013) Context-aware activity recognition and anomaly detection in video. IEEE J Sel Top Sign Proces 7(1):91–101CrossRef
Metadata
Title
Soft-Biometrics and Reference Set Integrated Model for Tracking Across Cameras
Authors
Xiaojing Chen
Le An
Bir Bhanu
Copyright Year
2014
Publisher
Springer New York
DOI
https://doi.org/10.1007/978-1-4614-7705-1_10