Skip to main content
Erschienen in: International Journal of Computer Vision 3/2015

01.02.2015

Mapping Appearance Descriptors on 3D Body Models for People Re-identification

verfasst von: Davide Baltieri, Roberto Vezzani, Rita Cucchiara

Erschienen in: International Journal of Computer Vision | Ausgabe 3/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

People Re-identification aims at associating multiple instances of a person’s appearance acquired from different points of view, different cameras, or after a spatial or a limited temporal gap to the same identifier. The basic hypothesis is that the person’s appearance is mostly constant. Many appearance descriptors have been adopted in the past, but they are often subject to severe perspective and view-point issues. In this paper, we propose a complete re-identification framework which exploits non-articulated 3D body models to spatially map appearance descriptors (color and gradient histograms) into the vertices of a regularly sampled 3D body surface. The matching and the shot integration steps are directly handled in the 3D body model, reducing the effects of occlusions, partial views or pose changes, which normally afflict 2D descriptors. A fast and effective model to image alignment is also proposed. It allows operation on common surveillance cameras or image collections. A comprehensive experimental evaluation is presented using the benchmark suite 3DPeS.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Albu, A., Laurendeau, D., Comtois, S., Ouellet, D., Hebert, P., Zaccarin, A., Parizeau, M., Bergevin, R., Maldague, X., Drouin, R., Drouin, S., Martel-Brisson, N., Jean, F., Torresan, H., Gagnon, L., & Laliberte, F. (2006). MONNET: Monitoring pedestrians with a network of loosely-coupled cameras. In Proceedings of ICPR (pp. 924–928), IEEE. Albu, A., Laurendeau, D., Comtois, S., Ouellet, D., Hebert, P., Zaccarin, A., Parizeau, M., Bergevin, R., Maldague, X., Drouin, R., Drouin, S., Martel-Brisson, N., Jean, F., Torresan, H., Gagnon, L., & Laliberte, F. (2006). MONNET: Monitoring pedestrians with a network of loosely-coupled cameras. In Proceedings of ICPR (pp. 924–928), IEEE.
Zurück zum Zitat Andriluka, M., Roth, S., & Schiele, B. (2010). Monocular 3d pose estimation and tracking by detection. In CVPR, pp. 623–630. Andriluka, M., Roth, S., & Schiele, B. (2010). Monocular 3d pose estimation and tracking by detection. In CVPR, pp. 623–630.
Zurück zum Zitat Andriluka, M., Roth, S., & Schiele, B. (2010). Monocular 3d pose estimation and tracking by detection. In Proceedings of CVPR (pp. 623–630). Andriluka, M., Roth, S., & Schiele, B. (2010). Monocular 3d pose estimation and tracking by detection. In Proceedings of CVPR (pp. 623–630).
Zurück zum Zitat Bak, S., Corvee, E., Bremond, F., & Thonnat, M. (2010). Person re-identification using spatial covariance regions of human body parts. In Proceedings of AVSS (pp. 435–440). Bak, S., Corvee, E., Bremond, F., & Thonnat, M. (2010). Person re-identification using spatial covariance regions of human body parts. In Proceedings of AVSS (pp. 435–440).
Zurück zum Zitat Baltieri, D., Vezzani, R., & Cucchiara, R. (2010). 3d body model construction and matching for real time people re-identification. In Proceedings of eurographics Italian chapter conference 2010 (EG-IT 2010), Genova, Italy. Baltieri, D., Vezzani, R., & Cucchiara, R. (2010). 3d body model construction and matching for real time people re-identification. In Proceedings of eurographics Italian chapter conference 2010 (EG-IT 2010), Genova, Italy.
Zurück zum Zitat Baltieri, D., Vezzani, R., & Cucchiara, R. (2011). 3dpes: 3d people dataset for surveillance and forensics. In Proceedings of the 1st international ACM workshop on multimedia access to 3D human objects (pp. 59–64), Scottsdale, Arizona, USA. Baltieri, D., Vezzani, R., & Cucchiara, R. (2011). 3dpes: 3d people dataset for surveillance and forensics. In Proceedings of the 1st international ACM workshop on multimedia access to 3D human objects (pp. 59–64), Scottsdale, Arizona, USA.
Zurück zum Zitat Baltieri, D., Vezzani, R., & Cucchiara, R. (2011). Sarc3d: A new 3d body model for people tracking and re-identification. In Proceedings of IEEE international conference on image analysis and processing (pp. 197–206), Ravenna, Italy. Baltieri, D., Vezzani, R., & Cucchiara, R. (2011). Sarc3d: A new 3d body model for people tracking and re-identification. In Proceedings of IEEE international conference on image analysis and processing (pp. 197–206), Ravenna, Italy.
Zurück zum Zitat Baltieri, D., Vezzani, R., & Cucchiara, R. (2012). People orientation recognition by mixtures of wrapped distributions on random trees. In Proceedings of the 12th European conference on computer vision, Firenze, Italy. Baltieri, D., Vezzani, R., & Cucchiara, R. (2012). People orientation recognition by mixtures of wrapped distributions on random trees. In Proceedings of the 12th European conference on computer vision, Firenze, Italy.
Zurück zum Zitat Barbosa, I. B., Cristani, M., Bue, A. D., Bazzani, L., & Murino, V. (2012). Re-identification with rgb-d sensors. In A. Fusiello, V. Murino, & R. Cucchiara (Eds.), ECCV Workshops (1). Lecture Notes in Computer Science (Vol. 7583, pp. 433–442). Springer. Barbosa, I. B., Cristani, M., Bue, A. D., Bazzani, L., & Murino, V. (2012). Re-identification with rgb-d sensors. In A. Fusiello, V. Murino, & R. Cucchiara (Eds.), ECCV Workshops (1). Lecture Notes in Computer Science (Vol. 7583, pp. 433–442). Springer.
Zurück zum Zitat Bird, N., Masoud, O., Papanikolopoulos, N., & Isaacs, A. (2005). Detection of loitering individuals in public transportation areas. IEEE Transactions on Intelligent Transportation Systems, 6, 167–177.CrossRef Bird, N., Masoud, O., Papanikolopoulos, N., & Isaacs, A. (2005). Detection of loitering individuals in public transportation areas. IEEE Transactions on Intelligent Transportation Systems, 6, 167–177.CrossRef
Zurück zum Zitat Bk, S., Corve, E., Brmond, F., & Thonnat, M. (2012). Boosted human re-identification using riemannian manifolds. Image and Vision Computing, 30, 443–452.CrossRef Bk, S., Corve, E., Brmond, F., & Thonnat, M. (2012). Boosted human re-identification using riemannian manifolds. Image and Vision Computing, 30, 443–452.CrossRef
Zurück zum Zitat Cai, Q., & Aggarwal, J. (1999). Tracking human motion in structured environments using a distributed-camera system. IEEE Transactions on Pattern Analysis and Machine Intelligence 21, 1241–1247. Cai, Q., & Aggarwal, J. (1999). Tracking human motion in structured environments using a distributed-camera system. IEEE Transactions on Pattern Analysis and Machine Intelligence 21, 1241–1247.
Zurück zum Zitat Calderara, S., Cucchiara, R., & Prati, A. (2008). Bayesian-competitive consistent labeling for people surveillance. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 354–360. Calderara, S., Cucchiara, R., & Prati, A. (2008). Bayesian-competitive consistent labeling for people surveillance. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 354–360.
Zurück zum Zitat Colombo, C., Del Bimbo, A., & Valli, A. (2008). A real-time full body tracking and humanoid animation system. Parallel Computing, 34, 718–726.CrossRef Colombo, C., Del Bimbo, A., & Valli, A. (2008). A real-time full body tracking and humanoid animation system. Parallel Computing, 34, 718–726.CrossRef
Zurück zum Zitat Dalal, N., & Triggs, B. (2005). Histograms of oriented gradients for human detection. In Proceedings of CVPR (Vol 1, pp. 886–893). Washington, DC: IEEE Computer Society. Dalal, N., & Triggs, B. (2005). Histograms of oriented gradients for human detection. In Proceedings of CVPR (Vol 1, pp. 886–893). Washington, DC: IEEE Computer Society.
Zurück zum Zitat Dikmen, M., Akbas, E., Huang, T. S., & Ahuja, N. (2011). Pedestrian recognition with a learned metric. In Proceedings of the 10th Asian conference on computer vision—Volume Part IV. ACCV’10 (pp. 501–512). Berlin: Springer. Dikmen, M., Akbas, E., Huang, T. S., & Ahuja, N. (2011). Pedestrian recognition with a learned metric. In Proceedings of the 10th Asian conference on computer vision—Volume Part IV. ACCV’10 (pp. 501–512). Berlin: Springer.
Zurück zum Zitat Doretto, G., Sebastian, T., Tu, P. H., & Rittscher, J. (2011). Appearance-based person reidentification in camera networks: problem overview and current approaches. Journal of Ambient Intelligence and Humanized Computing, 2, 127–151.CrossRef Doretto, G., Sebastian, T., Tu, P. H., & Rittscher, J. (2011). Appearance-based person reidentification in camera networks: problem overview and current approaches. Journal of Ambient Intelligence and Humanized Computing, 2, 127–151.CrossRef
Zurück zum Zitat Enzweiler, M., & Gavrila, D. M. (2010). Integrated pedestrian classification and orientation estimation. In CVPR (pp. 982–989). Enzweiler, M., & Gavrila, D. M. (2010). Integrated pedestrian classification and orientation estimation. In CVPR (pp. 982–989).
Zurück zum Zitat Farenzena, M., Bazzani, L., Perina, A., Murino, V., & Cristani, M. (2010). Person re-identification by symmetry-driven accumulation of local features. In Proceedings of CVPR (pp. 2360–2367). Farenzena, M., Bazzani, L., Perina, A., Murino, V., & Cristani, M. (2010). Person re-identification by symmetry-driven accumulation of local features. In Proceedings of CVPR (pp. 2360–2367).
Zurück zum Zitat Gandhi, T., & Trivedi, M. (2006). Panoramic Appearance Map (PAM) for multi-camera based person re-identification. In Proceedings of AVSS (pp. 78–78). IEEE. Gandhi, T., & Trivedi, M. (2006). Panoramic Appearance Map (PAM) for multi-camera based person re-identification. In Proceedings of AVSS (pp. 78–78). IEEE.
Zurück zum Zitat Gandhi, T., & Trivedi, M. M. (2007). Person tracking and reidentification: Introducing Panoramic Appearance Map (PAM) for feature representation. Machine Vision and Applications, 18, 207–220.CrossRefMATH Gandhi, T., & Trivedi, M. M. (2007). Person tracking and reidentification: Introducing Panoramic Appearance Map (PAM) for feature representation. Machine Vision and Applications, 18, 207–220.CrossRefMATH
Zurück zum Zitat Geurts, P., Ernst, D., & Wehenkel, L. (2006). Extremely randomized trees. Machine Learning, 63, 3–42.CrossRefMATH Geurts, P., Ernst, D., & Wehenkel, L. (2006). Extremely randomized trees. Machine Learning, 63, 3–42.CrossRefMATH
Zurück zum Zitat Gijsenij, A., Gevers, T., & van de Weijer, J. (2011). Computational color constancy: Survey and experiments. IEEE Transactions on Image Processing, 20, 2475–2489.CrossRefMathSciNet Gijsenij, A., Gevers, T., & van de Weijer, J. (2011). Computational color constancy: Survey and experiments. IEEE Transactions on Image Processing, 20, 2475–2489.CrossRefMathSciNet
Zurück zum Zitat Gilbert, A., & Bowden, R. (2006). Tracking objects across cameras by incrementally learning inter-camera colour calibration and patterns of activity. In Proceedings of ECCV (pp. 125–136). Gilbert, A., & Bowden, R. (2006). Tracking objects across cameras by incrementally learning inter-camera colour calibration and patterns of activity. In Proceedings of ECCV (pp. 125–136).
Zurück zum Zitat Gong, S., Cristani, M., Yan, S., & Loy, C. (Eds.). (2014). Person re-identification. Advances in computer vision and pattern recognition (Vol. XVIII). London: Springer. Gong, S., Cristani, M., Yan, S., & Loy, C. (Eds.). (2014). Person re-identification. Advances in computer vision and pattern recognition (Vol. XVIII). London: Springer.
Zurück zum Zitat Grana, C., Vezzani, R., & Cucchiara, R. (2007). Enhancing hsv histograms with achromatic points detection for video retrieval. Proceedings of the ACM International Conference on Image and Video Retrieval, CIVR, 2007, 302–308.CrossRef Grana, C., Vezzani, R., & Cucchiara, R. (2007). Enhancing hsv histograms with achromatic points detection for video retrieval. Proceedings of the ACM International Conference on Image and Video Retrieval, CIVR, 2007, 302–308.CrossRef
Zurück zum Zitat Gray, D., & Tao, H. (2008). Viewpoint invariant pedestrian recognition with an ensemble of localized features. In Proceedings of ECCV, Berlin: Springer (pp. 262–275). Gray, D., & Tao, H. (2008). Viewpoint invariant pedestrian recognition with an ensemble of localized features. In Proceedings of ECCV, Berlin: Springer (pp. 262–275).
Zurück zum Zitat Gray, D., Brennan, S., & Tao, H. (2007). Evaluating appearance models for recognition, reacquisition, and tracking. In Proceedings of 10th IEEE international workshop on performance evaluation of tracking and surveillance (PETS). Gray, D., Brennan, S., & Tao, H. (2007). Evaluating appearance models for recognition, reacquisition, and tracking. In Proceedings of 10th IEEE international workshop on performance evaluation of tracking and surveillance (PETS).
Zurück zum Zitat Gualdi, G., Prati, A., & Cucchiara, R. (2010). Multi-stage sampling with boosting cascades for pedestrian detection in images and videos. In Proceedings of ECCV, Crete, Greece, pp. 196–209. Gualdi, G., Prati, A., & Cucchiara, R. (2010). Multi-stage sampling with boosting cascades for pedestrian detection in images and videos. In Proceedings of ECCV, Crete, Greece, pp. 196–209.
Zurück zum Zitat Hartley, R. I., & Zisserman, A. (2004). Multiple view geometry in computer vision (2nd ed.) Cambridge University Press, ISBN: 0521540518. Hartley, R. I., & Zisserman, A. (2004). Multiple view geometry in computer vision (2nd ed.) Cambridge University Press, ISBN: 0521540518.
Zurück zum Zitat Hellinger, E. (1909). Neue begrndung der theorie quadratischer formen von unendlichvielen vernderlichen. Journal für die Reine und Angewandte Mathematik, 136, 210–271. Hellinger, E. (1909). Neue begrndung der theorie quadratischer formen von unendlichvielen vernderlichen. Journal für die Reine und Angewandte Mathematik, 136, 210–271.
Zurück zum Zitat Hirzer, M., Roth, P. M., Köstinger, M., & Bischof, H. (2012). Relaxed pairwise learned metric for person re-identification. In A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, & C. Schmid (Eds.), Computer Vision—ECCV 2012. Lecture Notes in Computer Science (Vol. 7577, pp. 780–793). Springer. Hirzer, M., Roth, P. M., Köstinger, M., & Bischof, H. (2012). Relaxed pairwise learned metric for person re-identification. In A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, & C. Schmid (Eds.), Computer Vision—ECCV 2012. Lecture Notes in Computer Science (Vol. 7577, pp. 780–793). Springer.
Zurück zum Zitat Javed, O., & Shafique, K. (2005). Appearance modeling for tracking in multiple non-overlapping cameras. In Proceedings of CVPR (pp. 26–33). IEEE. Javed, O., & Shafique, K. (2005). Appearance modeling for tracking in multiple non-overlapping cameras. In Proceedings of CVPR (pp. 26–33). IEEE.
Zurück zum Zitat Jungling, K., & Arens, M. (2011). View-invariant person re-identification with an implicit shape model. In Proceedings of AVSS (pp. 197–202). Jungling, K., & Arens, M. (2011). View-invariant person re-identification with an implicit shape model. In Proceedings of AVSS (pp. 197–202).
Zurück zum Zitat Kotoulas, L., & Andreadis, I. (2003). Colour histogram content-based image retrieval and hardware implementation. IEE Proceedings on Circuits, Devices and Systems, 150, 387–93.CrossRef Kotoulas, L., & Andreadis, I. (2003). Colour histogram content-based image retrieval and hardware implementation. IEE Proceedings on Circuits, Devices and Systems, 150, 387–93.CrossRef
Zurück zum Zitat Krumm, J., Harris, S., Meyers, B., Brumitt, B., Hale, M., & Shafer, S. (2000). Multi-camera multi-person tracking for EasyLiving. In Proceedings of third IEEE International workshop on visual surveillance (pp. 3–10). IEEE Comput. Soc. Krumm, J., Harris, S., Meyers, B., Brumitt, B., Hale, M., & Shafer, S. (2000). Multi-camera multi-person tracking for EasyLiving. In Proceedings of third IEEE International workshop on visual surveillance (pp. 3–10). IEEE Comput. Soc.
Zurück zum Zitat Monari, E., Maerker, J., & Kroschel, K. (2009). A robust and efficient approach for human tracking in multi-camera systems. In Proceedings of AVSS (pp. 134–139). IEEE. Monari, E., Maerker, J., & Kroschel, K. (2009). A robust and efficient approach for human tracking in multi-camera systems. In Proceedings of AVSS (pp. 134–139). IEEE.
Zurück zum Zitat Nilski, A. (2008). Evaluating multiple camera tracking systems—The i-lids 5th scenario. In 42nd annual IEEE international carnahan conference on security technology, 2008. ICCST 2008 (pp. 277–279). Nilski, A. (2008). Evaluating multiple camera tracking systems—The i-lids 5th scenario. In 42nd annual IEEE international carnahan conference on security technology, 2008. ICCST 2008 (pp. 277–279).
Zurück zum Zitat Porikli, F. (2003). Inter-camera color calibration by correlation model function. In Proceedings of ICIP (Vols. 2, 3, pp. 133–136). Porikli, F. (2003). Inter-camera color calibration by correlation model function. In Proceedings of ICIP (Vols. 2, 3, pp. 133–136).
Zurück zum Zitat Roullot, E. (2008). A unifying framework for color image calibration. 15th international conference on systems, signals and image processing, 2008. IWSSIP 2008 (pp. 97–100). Roullot, E. (2008). A unifying framework for color image calibration. 15th international conference on systems, signals and image processing, 2008. IWSSIP 2008 (pp. 97–100).
Zurück zum Zitat Schügerl, P., Sorschag, R., Bailer, W., & Thallinger, G. (2007). Object re-detection using SIFT and MPEG-7 color descriptors. Lecture Notes in Computer Science, pp. 305–314. Schügerl, P., Sorschag, R., Bailer, W., & Thallinger, G. (2007). Object re-detection using SIFT and MPEG-7 color descriptors. Lecture Notes in Computer Science, pp. 305–314.
Zurück zum Zitat Schwartz, W., & Davis, L. (2009). Learning discriminative appearance-based models using partial least squares. In Proceedings of the XXII Brazilian symposium on computer graphics and image processing. Schwartz, W., & Davis, L. (2009). Learning discriminative appearance-based models using partial least squares. In Proceedings of the XXII Brazilian symposium on computer graphics and image processing.
Zurück zum Zitat Vezzani, R., & Cucchiara, R. (2010). Video surveillance online repository (visor): An integrated framework. Multimedia Tools and Applications, 50, 359–380.CrossRef Vezzani, R., & Cucchiara, R. (2010). Video surveillance online repository (visor): An integrated framework. Multimedia Tools and Applications, 50, 359–380.CrossRef
Zurück zum Zitat Vezzani, R., & Cucchiara, R. (2014). In Benchmarking for person re-identification (pp. 333–349). London: Springer. Vezzani, R., & Cucchiara, R. (2014). In Benchmarking for person re-identification (pp. 333–349). London: Springer.
Zurück zum Zitat Vezzani, R., Baltieri, D., & Cucchiara, R. (2014). People re-identification in surveillance and forensics: A survey. ACM Computing Surveys, 46, 29:1–29:3. Vezzani, R., Baltieri, D., & Cucchiara, R. (2014). People re-identification in surveillance and forensics: A survey. ACM Computing Surveys, 46, 29:1–29:3.
Zurück zum Zitat Vezzani, R., Grana, C., & Cucchiara, R. (2011). Probabilistic people tracking with appearance models and occlusion classification: The ad-hoc system. Pattern Recognition Letters, 32, 867–877.CrossRef Vezzani, R., Grana, C., & Cucchiara, R. (2011). Probabilistic people tracking with appearance models and occlusion classification: The ad-hoc system. Pattern Recognition Letters, 32, 867–877.CrossRef
Zurück zum Zitat Zheng, W. S., Gong, S., & Xiang, T. (2011). Person re-identification by probabilistic relative distance comparison. In Proceedings of CVPR (pp. 649–656). Zheng, W. S., Gong, S., & Xiang, T. (2011). Person re-identification by probabilistic relative distance comparison. In Proceedings of CVPR (pp. 649–656).
Metadaten
Titel
Mapping Appearance Descriptors on 3D Body Models for People Re-identification
verfasst von
Davide Baltieri
Roberto Vezzani
Rita Cucchiara
Publikationsdatum
01.02.2015
Verlag
Springer US
Erschienen in
International Journal of Computer Vision / Ausgabe 3/2015
Print ISSN: 0920-5691
Elektronische ISSN: 1573-1405
DOI
https://doi.org/10.1007/s11263-014-0747-z

Weitere Artikel der Ausgabe 3/2015

International Journal of Computer Vision 3/2015 Zur Ausgabe