Skip to main content
Top
Published in: Neural Processing Letters 3/2019

25-08-2018

Body Part-Based Person Re-identification Integrating Semantic Attributes

Authors: Xin Ye, Wen-yuan Zhou, Lu-an Dong

Published in: Neural Processing Letters | Issue 3/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Person re-identification is an important task to match pedestrian images from disjointed camera views. Most existing approaches seek a target by learning a global ranking model with the entire information of the image, which ignores the individuality of each person and the different contributions of each body part. In this work, considering the different contributions of each pedestrian’s feature representation and each body part, Sample-Specific SVM (SSSVM) is learned for each individual upper and lower body part. Finally, we combine the distances of the upper and lower body parts between images to obtain their final distances. In addition, we introduce semantic attributes as the complement to appearance features, thus making the feature representation robust to viewpoint and illumination changes. Experimental results on three challenging datasets (including VIPeR, QMUL GRID and PRID 2011) demonstrate that the personal re-identification algorithm proposed in this work performs favourably against the state-of-the-art approaches.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Layne R, Hospedales TM, Gong S (2012) Person re-identification by attributes. In: Proceedings of the British machine vision conference, vol 2, pp 1–11 Layne R, Hospedales TM, Gong S (2012) Person re-identification by attributes. In: Proceedings of the British machine vision conference, vol 2, pp 1–11
3.
go back to reference Farenzena M, Bazzani L, Perina A et al (2010) Person re-identification by symmetry-driven accumulation of local features. Proc Comput Vis Pattern Recognit 23(3):2360–2367 Farenzena M, Bazzani L, Perina A et al (2010) Person re-identification by symmetry-driven accumulation of local features. Proc Comput Vis Pattern Recognit 23(3):2360–2367
4.
go back to reference Zeng Mingyong Wu, Zemin Tian Chang, Yi Fu, Feiran Jie (2014) Fusing appearance statistical features for person re-identification. J Electron Inf Technol 36(8):1844–1851 Zeng Mingyong Wu, Zemin Tian Chang, Yi Fu, Feiran Jie (2014) Fusing appearance statistical features for person re-identification. J Electron Inf Technol 36(8):1844–1851
5.
go back to reference Caixia Fan, Hong Zhu, Guangfeng Lin, Lei Luo (2013) Person re-identification based on multi-features. J Image Graph 18(6):711–717 Caixia Fan, Hong Zhu, Guangfeng Lin, Lei Luo (2013) Person re-identification based on multi-features. J Image Graph 18(6):711–717
6.
go back to reference Liu X, Wang H, Wu Y et al (2015) An ensemble color model for human re-identification. In: 2015 IEEE winter conference on applications of computer vision (WACV), pp 868–875 Liu X, Wang H, Wu Y et al (2015) An ensemble color model for human re-identification. In: 2015 IEEE winter conference on applications of computer vision (WACV), pp 868–875
7.
go back to reference Zhao R, Ouyang W, Wang X (2013) Unsupervised salience learning for person re-identification. Proc Comput Vis Pattern Recognit 9(4):3586–3593 Zhao R, Ouyang W, Wang X (2013) Unsupervised salience learning for person re-identification. Proc Comput Vis Pattern Recognit 9(4):3586–3593
8.
go back to reference Almazan EJ, Jones GA (2013) Tracking people across multiple non-overlapping RGB-D sensors. Proc Comput Vis Pattern Recognit 13(4):831–837 Almazan EJ, Jones GA (2013) Tracking people across multiple non-overlapping RGB-D sensors. Proc Comput Vis Pattern Recognit 13(4):831–837
9.
go back to reference Zheng W S, Gong S G, Xiang T (2011) Person re-identification by probabilistic relative distance comparison. In: Proceedings of the 2011 IEEE conference on computer vision and pattern recognition, vol 42, no 7, pp 649–656 Zheng W S, Gong S G, Xiang T (2011) Person re-identification by probabilistic relative distance comparison. In: Proceedings of the 2011 IEEE conference on computer vision and pattern recognition, vol 42, no 7, pp 649–656
10.
go back to reference Yu-Ning Du, Hai-Zhou Ai (2014) A statistical inference approach for person re-identification. J Electron Inf Technol 36(7):1612–1618 Yu-Ning Du, Hai-Zhou Ai (2014) A statistical inference approach for person re-identification. J Electron Inf Technol 36(7):1612–1618
11.
go back to reference Kostinger M, Hirzer M, Wohlhart P, Roth P M, Bischof H (2012) Large scale metric learning from equivalence constraints. In: Proceedings of the 2012 IEEE conference on computer vision and pattern recognition, pp 2288–2295 Kostinger M, Hirzer M, Wohlhart P, Roth P M, Bischof H (2012) Large scale metric learning from equivalence constraints. In: Proceedings of the 2012 IEEE conference on computer vision and pattern recognition, pp 2288–2295
12.
go back to reference Mignon A, Jurie F (2012) Pcca: a new approach for distance learning from sparse pairwise constraints. In: Proceedings of the 2012 IEEE conference on computer vision and pattern recognition (CVPR), vol 157, no 10, pp 2666–2672 Mignon A, Jurie F (2012) Pcca: a new approach for distance learning from sparse pairwise constraints. In: Proceedings of the 2012 IEEE conference on computer vision and pattern recognition (CVPR), vol 157, no 10, pp 2666–2672
13.
go back to reference Ikmen M, Akbas E, Huang T S, Ahuja N (2010) Pedestrian recognition with a learned metric. In: Proceedings of the 10th Asian conference on computer vision, vol 6495, pp 501–512 Ikmen M, Akbas E, Huang T S, Ahuja N (2010) Pedestrian recognition with a learned metric. In: Proceedings of the 10th Asian conference on computer vision, vol 6495, pp 501–512
14.
go back to reference Hirzer M, Roth P M, Kostinger M, Bischof H (2012) Relaxed pairwise learned metric for person re-identification. In: Proceedings of the 12th European conference on computer vision, vol 7577, pp 780–793 Hirzer M, Roth P M, Kostinger M, Bischof H (2012) Relaxed pairwise learned metric for person re-identification. In: Proceedings of the 12th European conference on computer vision, vol 7577, pp 780–793
15.
go back to reference Prosser B, Zheng WS, Gong SG, Xiang T (2010) Person reidentification by support vector ranking. In: Proceedings of the 22th British machine vision conference (BMVC), vol 42, no 7, pp 1–11 Prosser B, Zheng WS, Gong SG, Xiang T (2010) Person reidentification by support vector ranking. In: Proceedings of the 22th British machine vision conference (BMVC), vol 42, no 7, pp 1–11
16.
go back to reference Li W, Zhao R, Wang XG (2012) Human re-identification with transferred metric learning. In: Proceedings of the 11th Asian conference on computer vision, vol 7724, pp 31–44 Li W, Zhao R, Wang XG (2012) Human re-identification with transferred metric learning. In: Proceedings of the 11th Asian conference on computer vision, vol 7724, pp 31–44
17.
go back to reference Loy CC, Liu CX, Gong SG (2013) Person re-identification by manifold ranking. In: Proceedings of the 20th IEEE international conference on image processing (ICIP), vol 42, no 7, pp 3567–3571 Loy CC, Liu CX, Gong SG (2013) Person re-identification by manifold ranking. In: Proceedings of the 20th IEEE international conference on image processing (ICIP), vol 42, no 7, pp 3567–3571
18.
go back to reference Zhang Y, Li B, Lu H et al (2016) Sample-specific SVM learning for person re-identification. In: IEEE conference on computer vision and pattern recognition, pp 1278–1287 Zhang Y, Li B, Lu H et al (2016) Sample-specific SVM learning for person re-identification. In: IEEE conference on computer vision and pattern recognition, pp 1278–1287
19.
go back to reference Yin Q, Tang X, Sun J (2011) An associate-predict model for face recognition. In: Proceedings of the IEEE international conference on computer vision and pattern recognition, vol 42, no 7, pp 497–504 Yin Q, Tang X, Sun J (2011) An associate-predict model for face recognition. In: Proceedings of the IEEE international conference on computer vision and pattern recognition, vol 42, no 7, pp 497–504
20.
go back to reference Wang X, Qiu S, Liu K, Tang X (2013) Web image re-ranking using query-specific semantic signatures. IEEE Trans 34(3):436–450 Wang X, Qiu S, Liu K, Tang X (2013) Web image re-ranking using query-specific semantic signatures. IEEE Trans 34(3):436–450
21.
go back to reference Farhadi A, Endres I, Hoiem D, Forsyth D (2009) Describing objects by their attributes. In: Proceedings of IEEE international conference on computer vision and pattern recognition, pp 1778–1785 Farhadi A, Endres I, Hoiem D, Forsyth D (2009) Describing objects by their attributes. In: Proceedings of IEEE international conference on computer vision and pattern recognition, pp 1778–1785
22.
go back to reference Liu J, Kuipers B (2011) Recognizing human actions by attributes. IEEE Conf Comput Vis Pattern Recognit 42(7):3337–3344 Liu J, Kuipers B (2011) Recognizing human actions by attributes. IEEE Conf Comput Vis Pattern Recognit 42(7):3337–3344
24.
go back to reference Farenzena M, Bazzani L, Perina A et al (2010) Person re-identification by symmetry-driven accumulation of local features. Comput Vis Pattern Recognit 23(3):2360–2367 Farenzena M, Bazzani L, Perina A et al (2010) Person re-identification by symmetry-driven accumulation of local features. Comput Vis Pattern Recognit 23(3):2360–2367
25.
go back to reference Mazzon R, Tahir SF, Cavallaro A (2012) Person reidentification in crowd. Pattern Recognit Lett 33(14):1828–1837CrossRef Mazzon R, Tahir SF, Cavallaro A (2012) Person reidentification in crowd. Pattern Recognit Lett 33(14):1828–1837CrossRef
26.
go back to reference Ahmed E, Jones M, Marks TK (2015) An improved deep learning architecture for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3908–3916 Ahmed E, Jones M, Marks TK (2015) An improved deep learning architecture for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3908–3916
27.
go back to reference Liao S, Hu Y, Zhu X, Li SZ (2015) Person re-identification by local maximal occurrence representation and metric learning. In: Proceedings of IEEE conference on computer vision and pattern recognition, vol 8, no 4, pp 2197–2206 Liao S, Hu Y, Zhu X, Li SZ (2015) Person re-identification by local maximal occurrence representation and metric learning. In: Proceedings of IEEE conference on computer vision and pattern recognition, vol 8, no 4, pp 2197–2206
28.
go back to reference Chang C-C, Lin C-J (2011) LIBSVM : a library for support vector machines. ACM Trans Intell Syst Technol 2(27):1–27CrossRef Chang C-C, Lin C-J (2011) LIBSVM : a library for support vector machines. ACM Trans Intell Syst Technol 2(27):1–27CrossRef
29.
go back to reference Gray D, Brennan S, Tao H (2007) Evaluating appearance models for recognition, reacquisition, and tracking. In: IEEE international workshop on performance evaluation for tracking and surveillance (PETS), vol 3 Gray D, Brennan S, Tao H (2007) Evaluating appearance models for recognition, reacquisition, and tracking. In: IEEE international workshop on performance evaluation for tracking and surveillance (PETS), vol 3
30.
go back to reference Loy CC, Xiang T, Gong S (2009) Multi-camera activity correlation analysis. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 1988–1995 Loy CC, Xiang T, Gong S (2009) Multi-camera activity correlation analysis. In: Proceedings of IEEE conference on computer vision and pattern recognition, pp 1988–1995
31.
go back to reference Martin H, Csaba B, Peter RM, Bischof H (2011) Person re-identification by descriptive and discriminative classification. Scand Conf Image Anal 6688(12):91–102 Martin H, Csaba B, Peter RM, Bischof H (2011) Person re-identification by descriptive and discriminative classification. Scand Conf Image Anal 6688(12):91–102
32.
go back to reference Chen YC, Zheng WS, Lai J (2015) Mirror representation for modeling view-specific transform in person re-identification. In: International conference on artificial intelligence, pp 3402–3408 Chen YC, Zheng WS, Lai J (2015) Mirror representation for modeling view-specific transform in person re-identification. In: International conference on artificial intelligence, pp 3402–3408
33.
go back to reference Chen D, Yuan Z, Hua G et al (2015) Similarity learning on an explicit polynomial kernel feature map for person re-identification. In: Conference on computer vision and pattern recognition, pp 1565–1573 Chen D, Yuan Z, Hua G et al (2015) Similarity learning on an explicit polynomial kernel feature map for person re-identification. In: Conference on computer vision and pattern recognition, pp 1565–1573
34.
go back to reference Jing XY, Zhu X, Wu F et al (2017) Super-resolution person re-identification with semi-coupled low-rank discriminant dictionary learning. IEEE Trans Image Process 26(3):1363–1378MathSciNetMATHCrossRef Jing XY, Zhu X, Wu F et al (2017) Super-resolution person re-identification with semi-coupled low-rank discriminant dictionary learning. IEEE Trans Image Process 26(3):1363–1378MathSciNetMATHCrossRef
35.
go back to reference Liu X, Wang H, Wu Y et al (2015) An ensemble color model for human reidentification. In: IEEE winter conference on applications of computer vision, pp 868–875 Liu X, Wang H, Wu Y et al (2015) An ensemble color model for human reidentification. In: IEEE winter conference on applications of computer vision, pp 868–875
36.
go back to reference Ma AJ, Li P (2014) Query based adaptive re-ranking for person re-identification. Lect Notes Comput Sci 9007:397–412CrossRef Ma AJ, Li P (2014) Query based adaptive re-ranking for person re-identification. Lect Notes Comput Sci 9007:397–412CrossRef
37.
go back to reference Ma B, Su Y, Jurie F (2014) Covariance descriptor based on bio-inspired features for person re-identification and face verification. Image Vis Comput 32(6–7):379–390CrossRef Ma B, Su Y, Jurie F (2014) Covariance descriptor based on bio-inspired features for person re-identification and face verification. Image Vis Comput 32(6–7):379–390CrossRef
38.
go back to reference Zhao R, Ouyang W, Wang X (2014) Learning mid-level filters for person re-identification. In: IEEE conference on computer vision and pattern recognition, pp 144–151 Zhao R, Ouyang W, Wang X (2014) Learning mid-level filters for person re-identification. In: IEEE conference on computer vision and pattern recognition, pp 144–151
39.
go back to reference Ma L, Yang X, Tao D (2014) Person re-identification over camera networks using multi-task distance metric learning. IEEE Trans Image Process Publ IEEE Signal Process Soc 23(8):3656–3670MathSciNetMATH Ma L, Yang X, Tao D (2014) Person re-identification over camera networks using multi-task distance metric learning. IEEE Trans Image Process Publ IEEE Signal Process Soc 23(8):3656–3670MathSciNetMATH
40.
go back to reference Li Z, Chang S, Liang F et al (2013) Learning locally-adaptive decision functions for person verification. Comput Vis Pattern Recognit 9(4):3610–3617 Li Z, Chang S, Liang F et al (2013) Learning locally-adaptive decision functions for person verification. Comput Vis Pattern Recognit 9(4):3610–3617
41.
go back to reference Zhao R, Ouyang W, Wang X (2014) Person Re-identification by salience matching. In: IEEE international conference on computer vision, pp 2528–2535 Zhao R, Ouyang W, Wang X (2014) Person Re-identification by salience matching. In: IEEE international conference on computer vision, pp 2528–2535
42.
go back to reference Chen J, Zhang Z, Wang Y (2014) Relevance metric learning for person re-identification by exploiting global similarities. Int Conf Pattern Recognit 24(12):1657–1662 Chen J, Zhang Z, Wang Y (2014) Relevance metric learning for person re-identification by exploiting global similarities. Int Conf Pattern Recognit 24(12):1657–1662
43.
go back to reference Chen CL, Liu C, Gong S (2013) Person re-identification by manifold ranking. In: IEEE International conference on image processing, vol 42, no 7, pp 3567–3571 Chen CL, Liu C, Gong S (2013) Person re-identification by manifold ranking. In: IEEE International conference on image processing, vol 42, no 7, pp 3567–3571
44.
go back to reference Zheng WS, Gong S, Xiang T (2011) Person re-identification by probabilistic relative distance comparison. Comput Vis Pattern Recognit 42(7):649–656 Zheng WS, Gong S, Xiang T (2011) Person re-identification by probabilistic relative distance comparison. Comput Vis Pattern Recognit 42(7):649–656
45.
go back to reference Engel C, Baumgartner P, Holzmann M et al (2010) Person re-identification by support vector ranking. Br Mach Vis Conf 42(7):1–11 Engel C, Baumgartner P, Holzmann M et al (2010) Person re-identification by support vector ranking. Br Mach Vis Conf 42(7):1–11
46.
go back to reference Hirzer M, Roth PM, Bischof H (2012) Person re-identification by efficient impostor-based metric learning. In: IEEE ninth international conference on advanced video and signal-based surveillance, pp 203–208 Hirzer M, Roth PM, Bischof H (2012) Person re-identification by efficient impostor-based metric learning. In: IEEE ninth international conference on advanced video and signal-based surveillance, pp 203–208
47.
go back to reference Roth PM, Hirzer M, Kostinger M et al (2014) Mahalanobis distance learning for person re-identification. Springer, LondonMATHCrossRef Roth PM, Hirzer M, Kostinger M et al (2014) Mahalanobis distance learning for person re-identification. Springer, LondonMATHCrossRef
48.
go back to reference Weinberger KQ, Saul LK (2009) Distance metric learning for large margin nearest neighbor classification. J Mach Learn Re 10(1):207–244MATH Weinberger KQ, Saul LK (2009) Distance metric learning for large margin nearest neighbor classification. J Mach Learn Re 10(1):207–244MATH
49.
go back to reference Dikmen M, Akbas E, Huang TS et al (2010) Pedestrian recognition with a learned metric. Lect Notes Comput Sci 6495:501–512CrossRef Dikmen M, Akbas E, Huang TS et al (2010) Pedestrian recognition with a learned metric. Lect Notes Comput Sci 6495:501–512CrossRef
Metadata
Title
Body Part-Based Person Re-identification Integrating Semantic Attributes
Authors
Xin Ye
Wen-yuan Zhou
Lu-an Dong
Publication date
25-08-2018
Publisher
Springer US
Published in
Neural Processing Letters / Issue 3/2019
Print ISSN: 1370-4621
Electronic ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-018-9887-4

Other articles of this Issue 3/2019

Neural Processing Letters 3/2019 Go to the issue