Skip to main content
Top
Published in: Multimedia Systems 4/2023

28-05-2023 | Regular Paper

Dual semantic-aligned clustering for cross-domain person re-identification

Authors: Changshui Yang, Yan Liu, Qiang Liu, Riaz Ullah Khan, Bin Chen, Wenyong Wang

Published in: Multimedia Systems | Issue 4/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Person re-identification (ReID) intends to link people with common identities captured by various cameras spread across a big, fragmented area. Due to the imbalance in the distribution of data between input and output variables and the absence of labeled information in the target domain, cross-domain person re-identification (ReID) is a high demanding assignment. This paper presents a contemporary dual semantic-aligned (DSA) clustering approach, which jointly learns latent semantic subspaces of source and target domains to group target samples. More specifically, we present an innovative subspace learning model which jointly finds intra-domain basis and inter-domain multi-granularity basis. After the subspaces are learned, target samples are correspondingly projected and clustered automatically in each subspace. The clusters allow the model to attribute imaginary labels to the target samples and then impose supervised constraints throughout the training phase. Experiment results on DukeMTMC-reID, Market-1501, and MSMT17 benchmarks validate that our scheme significantly outperformed the state-of-the-art schemes. Our approach obtains performance of 86.82%/63.06% (Duke\(\rightarrow\)Market), 76.3%/58.35% (Market\(\rightarrow\)Duke) and 52.97%/22.44% (Duke\(\rightarrow\)MSMT17) in Rank-1/mAP, correspondingly.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Aharon, M., Elad, M., Bruckstein, A.: K-svd: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans Signal Proc 54(11), 4311–4322 (2006)CrossRefMATH Aharon, M., Elad, M., Bruckstein, A.: K-svd: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans Signal Proc 54(11), 4311–4322 (2006)CrossRefMATH
2.
go back to reference Bai Z, Wang Z, Wang J, et al (2021) Unsupervised multi-source domain adaptation for person re-identification. In: CVPR Bai Z, Wang Z, Wang J, et al (2021) Unsupervised multi-source domain adaptation for person re-identification. In: CVPR
3.
go back to reference Cao Z, Simon T, Wei SE, et al (2017) Realtime multi-person 2d pose estimation using part affinity fields. In: CVPR Cao Z, Simon T, Wei SE, et al (2017) Realtime multi-person 2d pose estimation using part affinity fields. In: CVPR
4.
go back to reference Chang X, Yang Y, Xiang T, et al (2019) Disjoint label space transfer learning with common factorised space. In: AAAI Chang X, Yang Y, Xiang T, et al (2019) Disjoint label space transfer learning with common factorised space. In: AAAI
5.
go back to reference Chen H, Lagadec B, Bremond F (2021a) Ice: inter-instance contrastive encoding for unsupervised person re-identification. In: ICCV Chen H, Lagadec B, Bremond F (2021a) Ice: inter-instance contrastive encoding for unsupervised person re-identification. In: ICCV
6.
go back to reference Chen H, Wang Y, Lagadec B, et al (2021b) Joint generative and contrastive learning for unsupervised person re-identification. In: CVPR Chen H, Wang Y, Lagadec B, et al (2021b) Joint generative and contrastive learning for unsupervised person re-identification. In: CVPR
7.
go back to reference Chen Y, Zhu X, Gong S (2019) Instance-guided context rendering for cross-domain person re-identification. In: ICCV Chen Y, Zhu X, Gong S (2019) Instance-guided context rendering for cross-domain person re-identification. In: ICCV
8.
go back to reference Cho Y, Kim WJ, Hong S, et al (2022) Part-based pseudo label refinement for unsupervised person re-identification. In: CVPR Cho Y, Kim WJ, Hong S, et al (2022) Part-based pseudo label refinement for unsupervised person re-identification. In: CVPR
9.
go back to reference Deng J, Dong W, Socher R, et al (2009) Imagenet: a large-scale hierarchical image database. In: CVPR Deng J, Dong W, Socher R, et al (2009) Imagenet: a large-scale hierarchical image database. In: CVPR
10.
go back to reference Deng W, Zheng L, Ye Q, et al (2018) Image-image domain adaptation with preserved self-similarity and domain-dissimilarity for person reidentification. In: CVPR Deng W, Zheng L, Ye Q, et al (2018) Image-image domain adaptation with preserved self-similarity and domain-dissimilarity for person reidentification. In: CVPR
11.
go back to reference Ester M, Kriegel HP, Sander J, et al (1996) A density-based algorithm for discovering clusters a density-based algorithm for discovering clusters in large spatial databases with noise. In: KDD Ester M, Kriegel HP, Sander J, et al (1996) A density-based algorithm for discovering clusters a density-based algorithm for discovering clusters in large spatial databases with noise. In: KDD
12.
go back to reference Fan, H., Zheng, L., Yang, Y.: Unsupervised person re-identification: clustering and fine-tuning. ACM Trans Multimed Comput Commun Appl 14(4), 1–8 (2018)CrossRef Fan, H., Zheng, L., Yang, Y.: Unsupervised person re-identification: clustering and fine-tuning. ACM Trans Multimed Comput Commun Appl 14(4), 1–8 (2018)CrossRef
13.
go back to reference Fu Y, Wei Y, Wang G, et al (2019) Self-similarity grouping: a simple unsupervised cross domain adaptation approach for person re-identification. In: ICCV Fu Y, Wei Y, Wang G, et al (2019) Self-similarity grouping: a simple unsupervised cross domain adaptation approach for person re-identification. In: ICCV
14.
go back to reference Goodfellow IJ, Pouget-Abadie J, Mirza M, et al (2014) Generative adversarial nets. In: NeurIPS Goodfellow IJ, Pouget-Abadie J, Mirza M, et al (2014) Generative adversarial nets. In: NeurIPS
15.
go back to reference Guler RA, Neverova N, Kokkinos I (2018) Densepose: dense human pose estimation in the wild. In: CVPR Guler RA, Neverova N, Kokkinos I (2018) Densepose: dense human pose estimation in the wild. In: CVPR
16.
go back to reference He K, Zhang X, Ren S, et al (2016) Deep residual learning for image recognition. In: CVPR He K, Zhang X, Ren S, et al (2016) Deep residual learning for image recognition. In: CVPR
17.
18.
go back to reference Huang H, Yang W, Chen X, et al (2018) Eanet: enhancing alignment for cross-domain person re-identification. arXiv preprint arXiv:1812.11369 Huang H, Yang W, Chen X, et al (2018) Eanet: enhancing alignment for cross-domain person re-identification. arXiv preprint arXiv:​1812.​11369
19.
go back to reference Huang Y, Wu Q, Xu J, et al (2019) Sbsgan: suppression of inter-domain background shift for person. In: ICCV Huang Y, Wu Q, Xu J, et al (2019) Sbsgan: suppression of inter-domain background shift for person. In: ICCV
20.
go back to reference Isobe T, Li D, Tian L, et al (2021) Towards discriminative representation learning for unsupervised person re-identification. In: ICCV Isobe T, Li D, Tian L, et al (2021) Towards discriminative representation learning for unsupervised person re-identification. In: ICCV
21.
go back to reference Ji H, Wang L, Zhou S, et al (2021) Meta pairwise relationship distillation for unsupervised person re-identification. In: ICCV Ji H, Wang L, Zhou S, et al (2021) Meta pairwise relationship distillation for unsupervised person re-identification. In: ICCV
22.
go back to reference Kalayeh MM, Basaran E, Gokmen M, et al (2018) Human semantic parsing for person re-identification. In: CVPR Kalayeh MM, Basaran E, Gokmen M, et al (2018) Human semantic parsing for person re-identification. In: CVPR
23.
go back to reference Kodirov E, Xiang T, Gong S (2015) Dictionary learning with iterative laplacian regularisation for unsupervised person reidentification. In: BMVC Kodirov E, Xiang T, Gong S (2015) Dictionary learning with iterative laplacian regularisation for unsupervised person reidentification. In: BMVC
24.
go back to reference Li, H., Dong, N., Yu, Z., et al.: Triple adversarial learning and multi-view imaginative reasoning for unsupervised domain adaptation person re-identification. IEEE Trans Circuits Syst Video Technol 32(5), 2814–2830 (2022)MathSciNetCrossRef Li, H., Dong, N., Yu, Z., et al.: Triple adversarial learning and multi-view imaginative reasoning for unsupervised domain adaptation person re-identification. IEEE Trans Circuits Syst Video Technol 32(5), 2814–2830 (2022)MathSciNetCrossRef
25.
go back to reference Li W, Zhu X, Gong S (2018) Harmonious attention network for person re-identification. In: CVPR Li W, Zhu X, Gong S (2018) Harmonious attention network for person re-identification. In: CVPR
26.
go back to reference Li YJ, Lin CS, Lin YB, et al (2019) Cross-dataset person re-identification via unsupervised pose disentanglement and adaptation. In: ICCV Li YJ, Lin CS, Lin YB, et al (2019) Cross-dataset person re-identification via unsupervised pose disentanglement and adaptation. In: ICCV
27.
go back to reference Liao S, Hu Y, Zhu X, et al (2015) Person re-identification by local maximal occurrence representation and metric learning. In: CVPR Liao S, Hu Y, Zhu X, et al (2015) Person re-identification by local maximal occurrence representation and metric learning. In: CVPR
28.
go back to reference Lin S, Li H, Li CT, et al (2018) Multi-task mid-level feature alignment network for unsupervised cross-dataset person re-identification. In: BMVC Lin S, Li H, Li CT, et al (2018) Multi-task mid-level feature alignment network for unsupervised cross-dataset person re-identification. In: BMVC
29.
go back to reference Lin Y, Xie L, Wu Y, et al (2020) Unsupervised person re-identification via softened similarity learning. In: CVPR Lin Y, Xie L, Wu Y, et al (2020) Unsupervised person re-identification via softened similarity learning. In: CVPR
30.
go back to reference Lisanti, G., Masi, I., Bagdanov, A.D., et al.: Person re-identification by iterative re-weighted sparse ranking. IEEE Trans Patt Analy Mach Intell 37(8), 1629–1642 (2015)CrossRef Lisanti, G., Masi, I., Bagdanov, A.D., et al.: Person re-identification by iterative re-weighted sparse ranking. IEEE Trans Patt Analy Mach Intell 37(8), 1629–1642 (2015)CrossRef
31.
go back to reference Liu J, Zha ZJ, Chen D, et al (2019) Adaptive transfer network for cross-domain person re-identification. In: CVPR Liu J, Zha ZJ, Chen D, et al (2019) Adaptive transfer network for cross-domain person re-identification. In: CVPR
32.
go back to reference Long M, Cao Y, Wang J, et al (2015) Learning transferable features with deep adaptation networks. In: ICML Long M, Cao Y, Wang J, et al (2015) Learning transferable features with deep adaptation networks. In: ICML
33.
go back to reference Lv J, Chen W, Li Q, et al (2018) Unsupervised cross-dataset person re-identification by transfer learning of spatial-temporal patterns. In: CVPR Lv J, Chen W, Li Q, et al (2018) Unsupervised cross-dataset person re-identification by transfer learning of spatial-temporal patterns. In: CVPR
34.
go back to reference Qi L, Wang L, Huo J, et al (2019) A novel unsupervised camera-aware domain adaptation framework for person re-identification. In: ICCV Qi L, Wang L, Huo J, et al (2019) A novel unsupervised camera-aware domain adaptation framework for person re-identification. In: ICCV
35.
go back to reference Qian X, Fu Y, Xiang T, et al (2018) Pose-normalized image generation for person re-identification. In: ECCV Qian X, Fu Y, Xiang T, et al (2018) Pose-normalized image generation for person re-identification. In: ECCV
36.
go back to reference Rubinstein, R., Bruckstein, M.A., et al.: Dictionaries for sparse representation modeling. Proc IEEE 98(6), 1045–1057 (2010)CrossRef Rubinstein, R., Bruckstein, M.A., et al.: Dictionaries for sparse representation modeling. Proc IEEE 98(6), 1045–1057 (2010)CrossRef
37.
go back to reference Song L, Wang C, Zhang L, et al (2018) Unsupervised domain adaptive re-identification: theory and practice. arXiv preprint arXiv:1807.11334 Song L, Wang C, Zhang L, et al (2018) Unsupervised domain adaptive re-identification: theory and practice. arXiv preprint arXiv:​1807.​11334
38.
go back to reference Su C, Zhang S, Xing J, et al (2016) Deep attributes driven multi-camera person re-identification. In: ECCV Su C, Zhang S, Xing J, et al (2016) Deep attributes driven multi-camera person re-identification. In: ECCV
39.
go back to reference Sun B, Saenko K (2016) Deep coral: correlation alignment for deep domain adaptation. In: ECCV Sun B, Saenko K (2016) Deep coral: correlation alignment for deep domain adaptation. In: ECCV
40.
go back to reference Torralba A, Efros AA (2011) Unbiased look at dataset bias. In: CVPR Torralba A, Efros AA (2011) Unbiased look at dataset bias. In: CVPR
41.
go back to reference Verma A, Subramanyam AV, Wang Z, et al (2021) Unsupervised domain adaptation for person re-identification via individual-preserving and environmental-switching cyclic generation. IEEE Transactions on Multimedia. vol. 25, pp. 364–377 Verma A, Subramanyam AV, Wang Z, et al (2021) Unsupervised domain adaptation for person re-identification via individual-preserving and environmental-switching cyclic generation. IEEE Transactions on Multimedia. vol. 25, pp. 364–377
42.
go back to reference Wang D, Zhang S (2020) Unsupervised person re-identification via multi-label classification. In: CVPR Wang D, Zhang S (2020) Unsupervised person re-identification via multi-label classification. In: CVPR
43.
go back to reference Wang G, Lai JH, Liang W, et al (2020) Smoothing adversarial domain attack and p-memory reconsolidation for cross-domain person re-identification. In: CVPR Wang G, Lai JH, Liang W, et al (2020) Smoothing adversarial domain attack and p-memory reconsolidation for cross-domain person re-identification. In: CVPR
44.
go back to reference Wang J, Zhu X, Gong S, et al (2018) Transferable joint attribute-identity deep learning for unsupervised person re-identification. In: CVPR Wang J, Zhu X, Gong S, et al (2018) Transferable joint attribute-identity deep learning for unsupervised person re-identification. In: CVPR
45.
go back to reference Wei L, Zhang S, Gao W, et al (2018) Person transfer gan to bridge domain gap for person re-identification. In: CVPR Wei L, Zhang S, Gao W, et al (2018) Person transfer gan to bridge domain gap for person re-identification. In: CVPR
46.
go back to reference Xuan S, Zhang S (2021) Intra-inter camera similarity for unsupervised person re-identification. In: CVPR Xuan S, Zhang S (2021) Intra-inter camera similarity for unsupervised person re-identification. In: CVPR
47.
go back to reference Yang, F., Yan, K., Lu, S., et al.: Attention driven person re-identification. Patt Recogn 86, 143–155 (2019)CrossRef Yang, F., Yan, K., Lu, S., et al.: Attention driven person re-identification. Patt Recogn 86, 143–155 (2019)CrossRef
48.
go back to reference Yang F, Zhong Z, Luo Z, et al (2021a) Joint noise-tolerant learning and meta camera shift adaptation for unsupervised person re-identification. In: CVPR Yang F, Zhong Z, Luo Z, et al (2021a) Joint noise-tolerant learning and meta camera shift adaptation for unsupervised person re-identification. In: CVPR
49.
go back to reference Yang F, Zhong Z, Luo Z, et al (2021b) Joint noise-tolerant learning and meta camera shift adaptation for unsupervised person re-identification. In: CVPR Yang F, Zhong Z, Luo Z, et al (2021b) Joint noise-tolerant learning and meta camera shift adaptation for unsupervised person re-identification. In: CVPR
50.
go back to reference Yang Q, Yu HX, Wu A, et al (2019b) Patch-based discriminative feature learning for unsupervised person re-identification. In: CVPR Yang Q, Yu HX, Wu A, et al (2019b) Patch-based discriminative feature learning for unsupervised person re-identification. In: CVPR
51.
go back to reference Yu HX, Wu A, Zheng WS (2017) Cross-view asymmetric metric learning for unsupervised person re-identification. In: ICCV Yu HX, Wu A, Zheng WS (2017) Cross-view asymmetric metric learning for unsupervised person re-identification. In: ICCV
52.
go back to reference Yu HX, Zheng WS, Wu A, et al (2019) Unsupervised person re-identification by soft multilabel learning. In: CVPR Yu HX, Zheng WS, Wu A, et al (2019) Unsupervised person re-identification by soft multilabel learning. In: CVPR
53.
go back to reference Zeng K, Ning M, Wang Y, et al (2020) Hierarchical clustering with hard-batch triplet loss for person re-identification. In: CVPR Zeng K, Ning M, Wang Y, et al (2020) Hierarchical clustering with hard-batch triplet loss for person re-identification. In: CVPR
54.
go back to reference Zhang, H., Cao, H., Yang, X., et al.: Self-training with progressive representation enhancement for unsupervised cross-domain person re-identification. IEEE Trans Image Proc 30, 5287–5298 (2021)CrossRef Zhang, H., Cao, H., Yang, X., et al.: Self-training with progressive representation enhancement for unsupervised cross-domain person re-identification. IEEE Trans Image Proc 30, 5287–5298 (2021)CrossRef
55.
go back to reference Zhang X, Cao J, Shen C, et al (2019) Self-training with progressive augmentation for unsupervised cross-domain person re-identification. In: ICCV Zhang X, Cao J, Shen C, et al (2019) Self-training with progressive augmentation for unsupervised cross-domain person re-identification. In: ICCV
56.
go back to reference Zhang X, Li D, Wang Z, et al (2022) Implicit sample extension for unsupervised person re-identification. In: CVPR Zhang X, Li D, Wang Z, et al (2022) Implicit sample extension for unsupervised person re-identification. In: CVPR
57.
go back to reference Zheng L, Shen L, Tian L, et al (2015) Scalable person re-identification: a benchmark. In: ICCV Zheng L, Shen L, Tian L, et al (2015) Scalable person re-identification: a benchmark. In: ICCV
58.
go back to reference Zheng Z, Zheng L, Yang Y (2017) Unlabeled samples generated by gan improve the person re-identification baseline in vitro. In: ICCV Zheng Z, Zheng L, Yang Y (2017) Unlabeled samples generated by gan improve the person re-identification baseline in vitro. In: ICCV
59.
go back to reference Zhong Z, Zheng L, Li S, et al (2018) Generalizing a person retrieval model hetero- and homogeneously. In: ECCV Zhong Z, Zheng L, Li S, et al (2018) Generalizing a person retrieval model hetero- and homogeneously. In: ECCV
60.
go back to reference Zhong Z, Zheng L, Luo Z, et al (2019a) Invariance matters: exemplar memory for domain adaptive person re-identification. In: CVPR Zhong Z, Zheng L, Luo Z, et al (2019a) Invariance matters: exemplar memory for domain adaptive person re-identification. In: CVPR
61.
go back to reference Zhong, Z., Zheng, L., Zheng, Z., et al.: Camstyle: a novel data augmentation method for person re-identification. IEEE Trans Image Proc 28(3), 1176–1190 (2019)MathSciNetCrossRef Zhong, Z., Zheng, L., Zheng, Z., et al.: Camstyle: a novel data augmentation method for person re-identification. IEEE Trans Image Proc 28(3), 1176–1190 (2019)MathSciNetCrossRef
62.
go back to reference Zhong, Z., Zheng, L., Luo, Z., et al.: Learning to adapt invariance in memory for person re-identification. IEEE Trans Patt Analy Mach Intell 43(8), 2723–2738 (2021) Zhong, Z., Zheng, L., Luo, Z., et al.: Learning to adapt invariance in memory for person re-identification. IEEE Trans Patt Analy Mach Intell 43(8), 2723–2738 (2021)
Metadata
Title
Dual semantic-aligned clustering for cross-domain person re-identification
Authors
Changshui Yang
Yan Liu
Qiang Liu
Riaz Ullah Khan
Bin Chen
Wenyong Wang
Publication date
28-05-2023
Publisher
Springer Berlin Heidelberg
Published in
Multimedia Systems / Issue 4/2023
Print ISSN: 0942-4962
Electronic ISSN: 1432-1882
DOI
https://doi.org/10.1007/s00530-023-01111-z

Other articles of this Issue 4/2023

Multimedia Systems 4/2023 Go to the issue