Skip to main content
Top
Published in: Neural Computing and Applications 17/2020

11-03-2020 | Original Article

Semi-supervised person re-identification by similarity-embedded cycle GANs

Authors: Xinyu Zhang, Xiao-Yuan Jing, Xiaoke Zhu, Fei Ma

Published in: Neural Computing and Applications | Issue 17/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Recently, person re-identification (PR-ID) has attracted numerous of research interest because of its broad applications. However, most of the existing PR-ID models always follow the supervised framework, which requires substantial labeled data. In fact, it is often very hard to get enough labeled training samples in many practical application scenarios. To overcome this limitation, some semi-supervised PR-ID methods have been presented more recently. Although some of these semi-supervised models achieve satisfied results, there is still much space to improve. In this paper, we propose a novel semi-supervised PR-ID by similarity-embedded cycle GANs (SECGAN). Our SECGAN model can learn cross-view features with limited labeled data by using cycle GANs. Simultaneously, to further enhance the ability of cycle GANs so that it can extract more discriminative and robust features, similarity metric subnet and specific features extracting subnet are embedded into cycle GANs. Extensive experiments have been conducted on three public PR-ID benchmark datasets, and the experimental results show that our proposed SECGAN approach outperforms several typical supervised methods and the existing state-of-the-art semi-supervised methods including traditional and deep learning semi-supervised methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Liao S, Li SZ (2015) Efficient PSD constrained asymmetric metric learning for person re-identification. In: IEEE international conference on computer vision, pp 3685–3693 Liao S, Li SZ (2015) Efficient PSD constrained asymmetric metric learning for person re-identification. In: IEEE international conference on computer vision, pp 3685–3693
2.
go back to reference Shen Y, Lin W, Yan J, Xu M, Wu J, Wang J (2015) Person re-identification with correspondence structure learning. In: IEEE international conference on computer vision, pp 3200–3208 Shen Y, Lin W, Yan J, Xu M, Wu J, Wang J (2015) Person re-identification with correspondence structure learning. In: IEEE international conference on computer vision, pp 3200–3208
3.
go back to reference Yang Y, Yang J, Yan J, Liao S, Yi D, Li SZ (2014) Salient color names for person re-identification. In: 13th European computer vision conference, pp 536–551 Yang Y, Yang J, Yan J, Liao S, Yi D, Li SZ (2014) Salient color names for person re-identification. In: 13th European computer vision conference, pp 536–551
4.
go back to reference Ma B, Su Y, Jurie F (2014) Covariance descriptor based on bio-inspired features for person re-identification and face verification. Image Vis Comput 32(6–7):379–390CrossRef Ma B, Su Y, Jurie F (2014) Covariance descriptor based on bio-inspired features for person re-identification and face verification. Image Vis Comput 32(6–7):379–390CrossRef
5.
go back to reference Wu Y, Lin Y, Dong X, Yan Y, Ouyang W, Yang Y (2018) Exploit the unknown gradually: one-shot video-based person re-identification by stepwise learning. In: IEEE conference on computer vision and pattern recognition, pp 5177–5186 Wu Y, Lin Y, Dong X, Yan Y, Ouyang W, Yang Y (2018) Exploit the unknown gradually: one-shot video-based person re-identification by stepwise learning. In: IEEE conference on computer vision and pattern recognition, pp 5177–5186
6.
go back to reference Wu Z, Li Y, Radke RJ (2015) Viewpoint invariant human re-identification in camera networks using pose priors and subject-discriminative features. IEEE Trans Pattern Anal Mach Intell 37(5):1095–1108CrossRef Wu Z, Li Y, Radke RJ (2015) Viewpoint invariant human re-identification in camera networks using pose priors and subject-discriminative features. IEEE Trans Pattern Anal Mach Intell 37(5):1095–1108CrossRef
7.
go back to reference Ma L, Yang X, Tao D (2014) Person re-identification over camera networks using multi-task distance metric learning. IEEE Trans Image Process 23(8):3656–3670MathSciNetCrossRef Ma L, Yang X, Tao D (2014) Person re-identification over camera networks using multi-task distance metric learning. IEEE Trans Image Process 23(8):3656–3670MathSciNetCrossRef
8.
go back to reference Ahmed E, Jones MJ, Marks TK (2015) An improved deep learning architecture for person re-identification. In: IEEE conference on computer vision and pattern, pp 3908–3916 Ahmed E, Jones MJ, Marks TK (2015) An improved deep learning architecture for person re-identification. In: IEEE conference on computer vision and pattern, pp 3908–3916
9.
go back to reference Xiao T, Li H, Ouyang W, Wang X (2016) Learning deep feature representations with domain guided dropout for person re-identification. In: IEEE conference on computer vision and pattern recognition, pp 1249–1258 Xiao T, Li H, Ouyang W, Wang X (2016) Learning deep feature representations with domain guided dropout for person re-identification. In: IEEE conference on computer vision and pattern recognition, pp 1249–1258
10.
go back to reference Li A, Liu L, Wang K, Liu S, Yan S (2015) Clothing attributes assisted person reidentification. IEEE Trans Circuits Syst Video Technol 25(5):869–878CrossRef Li A, Liu L, Wang K, Liu S, Yan S (2015) Clothing attributes assisted person reidentification. IEEE Trans Circuits Syst Video Technol 25(5):869–878CrossRef
11.
go back to reference Zhao R, Ouyang W, Wang X (2013) Person re-identification by salience matching. In: IEEE International conference on computer vision, pp 2528–2535 Zhao R, Ouyang W, Wang X (2013) Person re-identification by salience matching. In: IEEE International conference on computer vision, pp 2528–2535
12.
go back to reference Zhao R, Ouyang W, Wang X (2014) Learning mid-level filters for person re-identification. In: IEEE conference on computer vision and pattern recognition, pp 144–151 Zhao R, Ouyang W, Wang X (2014) Learning mid-level filters for person re-identification. In: IEEE conference on computer vision and pattern recognition, pp 144–151
13.
go back to reference Luo Y, Liu T, Tao D, Xu C (2014) Decomposition-based transfer distance metric learning for image classification. IEEE Trans Image Process 23(9):3789–3801MathSciNetCrossRef Luo Y, Liu T, Tao D, Xu C (2014) Decomposition-based transfer distance metric learning for image classification. IEEE Trans Image Process 23(9):3789–3801MathSciNetCrossRef
14.
go back to reference Zhong G, Zheng Y, Li S, Fu Y (2016) Scalable large margin online metric learning. In: International joint conference on neural networks, pp 2252–2259 Zhong G, Zheng Y, Li S, Fu Y (2016) Scalable large margin online metric learning. In: International joint conference on neural networks, pp 2252–2259
15.
go back to reference Wang F, Zuo W, Lin L, Zhang D, Zhang L (2016) Joint learning of single-image and cross-image representations for person re-identification. In: IEEE conference on computer vision and pattern recognition, pp 1288–1296 Wang F, Zuo W, Lin L, Zhang D, Zhang L (2016) Joint learning of single-image and cross-image representations for person re-identification. In: IEEE conference on computer vision and pattern recognition, pp 1288–1296
16.
go back to reference Varior RR, Haloi M, Wang G (2016) Gated siamese convolutional neural network architecture for human re-identification. In: European conference on computer vision, pp 791–808 Varior RR, Haloi M, Wang G (2016) Gated siamese convolutional neural network architecture for human re-identification. In: European conference on computer vision, pp 791–808
17.
go back to reference Wang J, Song Y, Leung T, Rosenberg C, Wang J, Philbin J, Chen B, Wu Y (2014) Learning fine-grained image similarity with deep ranking. In: IEEE conference on computer vision and pattern recognition 2014, pp 1386–1393 Wang J, Song Y, Leung T, Rosenberg C, Wang J, Philbin J, Chen B, Wu Y (2014) Learning fine-grained image similarity with deep ranking. In: IEEE conference on computer vision and pattern recognition 2014, pp 1386–1393
18.
go back to reference Li J, Ma AJ, Yuen PC (2018) Semi-supervised region metric learning for person re-identification. Int J Comput Vis 126(8):855–874CrossRef Li J, Ma AJ, Yuen PC (2018) Semi-supervised region metric learning for person re-identification. Int J Comput Vis 126(8):855–874CrossRef
19.
go back to reference Zhu X, Jing X, Yang L, You X, Chen D, Gao G, Wang Y (2018) Semi-supervised cross-view projection-based dictionary learning for video-based person re-identification. IEEE Trans Circuits Syst Video Technol 28(10):2599–2611CrossRef Zhu X, Jing X, Yang L, You X, Chen D, Gao G, Wang Y (2018) Semi-supervised cross-view projection-based dictionary learning for video-based person re-identification. IEEE Trans Circuits Syst Video Technol 28(10):2599–2611CrossRef
20.
go back to reference Liu W, Chang X, Chen L, Yang Y (2018) Semi-supervised bayesian attribute learning for person re-identification. In: Proceedings of the thirty-second conference on artificial intelligence, pp 7162–7169 Liu W, Chang X, Chen L, Yang Y (2018) Semi-supervised bayesian attribute learning for person re-identification. In: Proceedings of the thirty-second conference on artificial intelligence, pp 7162–7169
21.
go back to reference Xin X, Wang J, Xie R, Zhou S, Huang W, Zheng N (2019) Semi-supervised person re-identification using multi-view clustering. Pattern Recognit 88:285–297CrossRef Xin X, Wang J, Xie R, Zhou S, Huang W, Zheng N (2019) Semi-supervised person re-identification using multi-view clustering. Pattern Recognit 88:285–297CrossRef
22.
go back to reference Zheng W, Gong S, Xiang T (2011) Person re-identification by probabilistic relative distance comparison. In: The 24th IEEE conference on computer vision and pattern recognition, pp 649–656 Zheng W, Gong S, Xiang T (2011) Person re-identification by probabilistic relative distance comparison. In: The 24th IEEE conference on computer vision and pattern recognition, pp 649–656
23.
go back to reference Liao S, Hu Y, Zhu X, Li SZ (2015) Person re-identification by local maximal occurrence representation and metric learning. In: IEEE conference on computer vision and pattern recognition, pp 2197–2206 Liao S, Hu Y, Zhu X, Li SZ (2015) Person re-identification by local maximal occurrence representation and metric learning. In: IEEE conference on computer vision and pattern recognition, pp 2197–2206
24.
go back to reference Dong H, Lu P, Zhong S, Liu C, Ji Y, Gong S (2018) Person re-identification by enhanced local maximal occurrence representation and generalized similarity metric learning. Neurocomputing 307:25–37CrossRef Dong H, Lu P, Zhong S, Liu C, Ji Y, Gong S (2018) Person re-identification by enhanced local maximal occurrence representation and generalized similarity metric learning. Neurocomputing 307:25–37CrossRef
25.
go back to reference Lisanti G, Masi I, Bagdanov AD, Bimbo AD (2015) Person re-identification by iterative re-weighted sparse ranking. IEEE Trans Pattern Anal Mach Intell 37(8):1629–1642CrossRef Lisanti G, Masi I, Bagdanov AD, Bimbo AD (2015) Person re-identification by iterative re-weighted sparse ranking. IEEE Trans Pattern Anal Mach Intell 37(8):1629–1642CrossRef
26.
go back to reference Zhao R, Ouyang W, Wang X (2013) Unsupervised salience learning for person re-identification. In: IEEE conference on computer vision and pattern recognition, pp 3586–3593 Zhao R, Ouyang W, Wang X (2013) Unsupervised salience learning for person re-identification. In: IEEE conference on computer vision and pattern recognition, pp 3586–3593
27.
go back to reference Yu H, Wu A, Zheng W (2017) Cross-view asymmetric metric learning for unsupervised person re-identification. In: IEEE international conference on computer vision, pp 994–1002 Yu H, Wu A, Zheng W (2017) Cross-view asymmetric metric learning for unsupervised person re-identification. In: IEEE international conference on computer vision, pp 994–1002
28.
go back to reference Ye M, Ma AJ, Zheng L, Li J, Yuen PC (2017) Dynamic label graph matching for unsupervised video re-identification. In: IEEE international conference on computer vision, pp 5152–5160 Ye M, Ma AJ, Zheng L, Li J, Yuen PC (2017) Dynamic label graph matching for unsupervised video re-identification. In: IEEE international conference on computer vision, pp 5152–5160
29.
go back to reference Kviatkovsky I, Adam A, Rivlin E (2013) Color invariants for person reidentification. IEEE Trans Pattern Anal Mach Intell 35(7):1622–1634CrossRef Kviatkovsky I, Adam A, Rivlin E (2013) Color invariants for person reidentification. IEEE Trans Pattern Anal Mach Intell 35(7):1622–1634CrossRef
30.
go back to reference Gao Y, Ma J, Yuille AL (2017) Semi-supervised sparse representation based classification for face recognition with insufficient labeled samples. IEEE Trans Image Process 26(5):2545–2560MathSciNetCrossRef Gao Y, Ma J, Yuille AL (2017) Semi-supervised sparse representation based classification for face recognition with insufficient labeled samples. IEEE Trans Image Process 26(5):2545–2560MathSciNetCrossRef
31.
go back to reference Müller E, Otto C, Ewerth R (2016) Semi-supervised identification of rarely appearing persons in video by correcting weak labels. In: International conference on multimedia retrieval, pp 381–384 Müller E, Otto C, Ewerth R (2016) Semi-supervised identification of rarely appearing persons in video by correcting weak labels. In: International conference on multimedia retrieval, pp 381–384
32.
go back to reference Bartz C, Yang H, Meinel C (2018) SEE: towards semi-supervised end-to-end scene text recognition. In: Proceedings of the thirty-second AAAI conference on artificial intelligence, pp 6674–6681 Bartz C, Yang H, Meinel C (2018) SEE: towards semi-supervised end-to-end scene text recognition. In: Proceedings of the thirty-second AAAI conference on artificial intelligence, pp 6674–6681
33.
go back to reference Chen F, Chai J, Ren D, Liu X, Yang Y (2017) Semi-supervised distance metric learning for person re-identification. In: 16th IEEE/ACIS international conference on computer and information science, pp 733–738 Chen F, Chai J, Ren D, Liu X, Yang Y (2017) Semi-supervised distance metric learning for person re-identification. In: 16th IEEE/ACIS international conference on computer and information science, pp 733–738
35.
go back to reference Mao X, Li Q, Xie H, Lau RYK, Wang Z, Smolley SP (2017) Least squares generative adversarial networks. In: IEEE international conference on computer vision, ICCV 2017, Venice, Italy, Oct 22–29, 2017, pp. 2813–2821 Mao X, Li Q, Xie H, Lau RYK, Wang Z, Smolley SP (2017) Least squares generative adversarial networks. In: IEEE international conference on computer vision, ICCV 2017, Venice, Italy, Oct 22–29, 2017, pp. 2813–2821
36.
go back to reference Mao X, Li Q, Xie H, Lau RYK, Wang Z, Smolley SP (2019) On the effectiveness of least squares generative adversarial networks. IEEE Trans Pattern Anal Mach Intell 41(12):2947–2960CrossRef Mao X, Li Q, Xie H, Lau RYK, Wang Z, Smolley SP (2019) On the effectiveness of least squares generative adversarial networks. IEEE Trans Pattern Anal Mach Intell 41(12):2947–2960CrossRef
37.
go back to reference Zhang H, Sun Y, Liu L, Wang X, Li L, Liu W (2018) Clothingout: a category-supervised gan model for clothing segmentation and retrieval. In: Neural computing and applications, 1–12 Zhang H, Sun Y, Liu L, Wang X, Li L, Liu W (2018) Clothingout: a category-supervised gan model for clothing segmentation and retrieval. In: Neural computing and applications, 1–12
38.
go back to reference Zhong Z, Zheng L, Zheng Z, Li S, Yang Y (2018) Camera style adaptation for person re-identification. In: 2018 IEEE conference on computer vision and pattern recognition, CVPR 2018, Salt Lake City, UT, USA, June 18–22, pp 5157–5166 Zhong Z, Zheng L, Zheng Z, Li S, Yang Y (2018) Camera style adaptation for person re-identification. In: 2018 IEEE conference on computer vision and pattern recognition, CVPR 2018, Salt Lake City, UT, USA, June 18–22, pp 5157–5166
39.
go back to reference Liu X, Tan H, Tong X, Cao J, Zhou J (2019) Feature preserving GAN and multi-scale feature enhancement for domain adaption person re-identification. Neurocomputing 364:108–118CrossRef Liu X, Tan H, Tong X, Cao J, Zhou J (2019) Feature preserving GAN and multi-scale feature enhancement for domain adaption person re-identification. Neurocomputing 364:108–118CrossRef
40.
go back to reference Wei L, Zhang S, Gao W, Tian Q (2018) Person transfer GAN to bridge domain gap for person re-identification. In: 2018 IEEE conference on computer vision and pattern recognition, CVPR 2018, Salt Lake City, UT, USA, June 18–22, 2018, pp 79–88 Wei L, Zhang S, Gao W, Tian Q (2018) Person transfer GAN to bridge domain gap for person re-identification. In: 2018 IEEE conference on computer vision and pattern recognition, CVPR 2018, Salt Lake City, UT, USA, June 18–22, 2018, pp 79–88
41.
go back to reference Zhou S, Ke M, Luo P (2019) Multi-camera transfer GAN for person re-identification. J Vis Commun Image Represent 59:393–400CrossRef Zhou S, Ke M, Luo P (2019) Multi-camera transfer GAN for person re-identification. J Vis Commun Image Represent 59:393–400CrossRef
42.
go back to reference Zhu X, Jing X, Wu F, Zheng W, Hu R, Xiao C, Liang C (2016) Distance learning by treating negative samples differently and exploiting impostors with symmetric triplet constraint for person re-identification. In: IEEE international conference on multimedia and expo, pp 1–6 Zhu X, Jing X, Wu F, Zheng W, Hu R, Xiao C, Liang C (2016) Distance learning by treating negative samples differently and exploiting impostors with symmetric triplet constraint for person re-identification. In: IEEE international conference on multimedia and expo, pp 1–6
43.
go back to reference Gray D, Brennan S, Tao H (2007) Evaluating appearance models for recognition, reacquisition, and tracking. In: IEEE international workshop on performance evaluation for tracking and surveillance, vol 3, no 5, pp 1–7 Gray D, Brennan S, Tao H (2007) Evaluating appearance models for recognition, reacquisition, and tracking. In: IEEE international workshop on performance evaluation for tracking and surveillance, vol 3, no 5, pp 1–7
44.
go back to reference Zheng W, Gong S, Xiang T (2009) Associating groups of people. In: British machine vision conference, pp 1–11 Zheng W, Gong S, Xiang T (2009) Associating groups of people. In: British machine vision conference, pp 1–11
45.
go back to reference Zheng L, Shen L, Tian L, Wang S, Wang J, Tian Q (2015) Scalable person re-identification: a benchmark. In: IEEE international conference on computer vision, pp 1116–1124 Zheng L, Shen L, Tian L, Wang S, Wang J, Tian Q (2015) Scalable person re-identification: a benchmark. In: IEEE international conference on computer vision, pp 1116–1124
46.
go back to reference Köstinger M, Hirzer M, Wohlhart P, Roth PM, Bischof H (2012) Large scale metric learning from equivalence constraints. In: IEEE conference on computer vision and pattern recognition, pp 2288–2295 Köstinger M, Hirzer M, Wohlhart P, Roth PM, Bischof H (2012) Large scale metric learning from equivalence constraints. In: IEEE conference on computer vision and pattern recognition, pp 2288–2295
47.
go back to reference Zheng W, Gong S, Xiang T (2013) Reidentification by relative distance comparison. IEEE Trans Pattern Anal Mach Intell 35(3):653–668CrossRef Zheng W, Gong S, Xiang T (2013) Reidentification by relative distance comparison. IEEE Trans Pattern Anal Mach Intell 35(3):653–668CrossRef
48.
go back to reference Ma AJ, Li P (2014) Semi-supervised ranking for re-identification with few labeled image pairs. In: 12th Asian conference on computer vision, pp 598–613 Ma AJ, Li P (2014) Semi-supervised ranking for re-identification with few labeled image pairs. In: 12th Asian conference on computer vision, pp 598–613
49.
go back to reference Su C, Zhang S, Xing J, Gao W, Tian Q (2016) Deep attributes driven multi-camera person re-identification. In: 14th European conference on computer vision, pp 475–491 Su C, Zhang S, Xing J, Gao W, Tian Q (2016) Deep attributes driven multi-camera person re-identification. In: 14th European conference on computer vision, pp 475–491
50.
go back to reference Wang J, Zhu X, Gong S, Li W (2018) Transferable joint attribute-identity deep learning for unsupervised person re-identification. In: IEEE conference on computer vision and pattern recognition, pp 2275–2284 Wang J, Zhu X, Gong S, Li W (2018) Transferable joint attribute-identity deep learning for unsupervised person re-identification. In: IEEE conference on computer vision and pattern recognition, pp 2275–2284
51.
go back to reference Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M, Kudlur M, Levenberg J, Monga R, Moore S, Murray DG, Steiner B, Tucker PA, Vasudevan V, Warden P, Wicke M, Yu Y, Zheng X (2016) Tensorflow: a system for large-scale machine learning. In: 12th USENIX symposium on operating systems design and implementation, pp 265–283 Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M, Kudlur M, Levenberg J, Monga R, Moore S, Murray DG, Steiner B, Tucker PA, Vasudevan V, Warden P, Wicke M, Yu Y, Zheng X (2016) Tensorflow: a system for large-scale machine learning. In: 12th USENIX symposium on operating systems design and implementation, pp 265–283
52.
go back to reference Schroff F, Kalenichenko D, Philbin J (2015) Facenet: A unified embedding for face recognition and clustering. In: IEEE conference on computer vision and pattern recognition, pp 815–823 Schroff F, Kalenichenko D, Philbin J (2015) Facenet: A unified embedding for face recognition and clustering. In: IEEE conference on computer vision and pattern recognition, pp 815–823
Metadata
Title
Semi-supervised person re-identification by similarity-embedded cycle GANs
Authors
Xinyu Zhang
Xiao-Yuan Jing
Xiaoke Zhu
Fei Ma
Publication date
11-03-2020
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 17/2020
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-04809-7

Other articles of this Issue 17/2020

Neural Computing and Applications 17/2020 Go to the issue

Premium Partner