Skip to main content
Erschienen in: Neural Processing Letters 1/2023

26.05.2022

Multi-information Constraint Learning for Unsupervised Domain Adaptive Person Re-identification

verfasst von: Chen Dongyue, Bing Haozhe, Tang Chunren, Tian Miaoting, Jia Tong

Erschienen in: Neural Processing Letters | Ausgabe 1/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Person re-identification (ReID) aims at identifying the same person’s images across different cameras. However large domain gaps between source and target domains, as well as lack of label information in the target domain poses a huge challenge for unsupervised domain adaptive the ReID model. This paper tackles the challenge through three aspects : (1) we design a robust visual-spatiotemporal fusion model, which improves the quality of pseudo labels based on visual probability evaluation, spatiotemporal probability evaluation and visual-spatiotemporal fusion. (2) we propose a novel sampling strategy for deep mutual information estimation and maximization algorithm (DIM), which employs data augmentation and dynamic storage stack to improve the reliability of the selected samples. (3) We combine the DIM loss and other supervised losses together to construct a new multi-objective loss function and present a corresponding dynamic adjustment strategy for the weights of loss functions, which contribute to stable the convergence of the training process. As shown in experimental results, our model has achieved excellent results on two ReID datasets, Market-1501 and DukeMTMC-ReID.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bell AJ, Sejnowski TJ (1995) An information-maximization approach to blind separation and blind deconvolution. Neural Comput 7(6):1129–1159CrossRef Bell AJ, Sejnowski TJ (1995) An information-maximization approach to blind separation and blind deconvolution. Neural Comput 7(6):1129–1159CrossRef
2.
Zurück zum Zitat Chen P, Jia T, Wu P, et al (2019) Learning deep representations by mutual information for person re-identification. arXiv preprint arXiv:1908.05860 Chen P, Jia T, Wu P, et al (2019) Learning deep representations by mutual information for person re-identification. arXiv preprint arXiv:​1908.​05860
3.
Zurück zum Zitat Chen T, Kornblith S, Norouzi M, et al (2020) A simple framework for contrastive learning of visual representations. In: International conference on machine learning, PMLR, pp 1597–1607 Chen T, Kornblith S, Norouzi M, et al (2020) A simple framework for contrastive learning of visual representations. In: International conference on machine learning, PMLR, pp 1597–1607
4.
Zurück zum Zitat Cheng ZQ, Li JX, Dai Q, et al (2019) Improving the learning of multi-column convolutional neural network for crowd counting. In: Proceedings of the 27th ACM international conference on multimedia, pp. 1897–1906 Cheng ZQ, Li JX, Dai Q, et al (2019) Improving the learning of multi-column convolutional neural network for crowd counting. In: Proceedings of the 27th ACM international conference on multimedia, pp. 1897–1906
5.
Zurück zum Zitat Deng W, Zheng L, Ye Q, et al (2018) Image-image domain adaptation with preserved self-similarity and domain-dissimilarity for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 994–1003 Deng W, Zheng L, Ye Q, et al (2018) Image-image domain adaptation with preserved self-similarity and domain-dissimilarity for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 994–1003
6.
Zurück zum Zitat Fan H, Zheng L, Yan C, et al (2018) Unsupervised person re-identification: Clustering and fine-tuning. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 14(4):1–18 Fan H, Zheng L, Yan C, et al (2018) Unsupervised person re-identification: Clustering and fine-tuning. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 14(4):1–18
7.
Zurück zum Zitat Fu Y, Wei Y, Wang G, et al (2019) Self-similarity grouping: A simple unsupervised cross domain adaptation approach for person re-identification. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 6112–6121 Fu Y, Wei Y, Wang G, et al (2019) Self-similarity grouping: A simple unsupervised cross domain adaptation approach for person re-identification. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 6112–6121
8.
Zurück zum Zitat Ge Y, Chen D, Li H (2020) Mutual mean-teaching: Pseudo label refinery for unsupervised domain adaptation on person re-identification. In: International Conference on Learning Representations Ge Y, Chen D, Li H (2020) Mutual mean-teaching: Pseudo label refinery for unsupervised domain adaptation on person re-identification. In: International Conference on Learning Representations
9.
Zurück zum Zitat Gray D, Tao H (2008) Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: European Conference on Computer Vision, Springer, pp. 262–275 Gray D, Tao H (2008) Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: European Conference on Computer Vision, Springer, pp. 262–275
10.
Zurück zum Zitat Hjelm RD, Fedorov A, Lavoie-Marchildon S, et al (2018) Learning deep representations by mutual information estimation and maximization. In: International Conference on Learning Representations Hjelm RD, Fedorov A, Lavoie-Marchildon S, et al (2018) Learning deep representations by mutual information estimation and maximization. In: International Conference on Learning Representations
11.
Zurück zum Zitat Ishmael Belghazi M, Baratin A, Rajeswar S, et al (2018) Mine: Mutual information neural estimation. arXiv e-prints pp arXiv–1801 Ishmael Belghazi M, Baratin A, Rajeswar S, et al (2018) Mine: Mutual information neural estimation. arXiv e-prints pp arXiv–1801
12.
Zurück zum Zitat Li H, Kuang Z, Yu Z et al (2020) Structure alignment of attributes and visual features for cross-dataset person re-identification. Pattern Recogn 106(107):414 Li H, Kuang Z, Yu Z et al (2020) Structure alignment of attributes and visual features for cross-dataset person re-identification. Pattern Recogn 106(107):414
13.
Zurück zum Zitat Li YJ, Lin CS, Lin YB, et al (2019) Cross-dataset person re-identification via unsupervised pose disentanglement and adaptation. In: Proceedings of the IEEE international conference on computer vision, pp. 7919–7929 Li YJ, Lin CS, Lin YB, et al (2019) Cross-dataset person re-identification via unsupervised pose disentanglement and adaptation. In: Proceedings of the IEEE international conference on computer vision, pp. 7919–7929
14.
Zurück zum Zitat Liao S, Shao L (2020) Interpretable and generalizable person re-identification with query-adaptive convolution and temporal lifting. In: European conference on computer vision, Springer, pp. 456–474 Liao S, Shao L (2020) Interpretable and generalizable person re-identification with query-adaptive convolution and temporal lifting. In: European conference on computer vision, Springer, pp. 456–474
15.
Zurück zum Zitat Liao S, Hu Y, Zhu X, et al (2015) Person re-identification by local maximal occurrence representation and metric learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2197–2206 Liao S, Hu Y, Zhu X, et al (2015) Person re-identification by local maximal occurrence representation and metric learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2197–2206
16.
Zurück zum Zitat Liao X, He L, Yang Z, et al (2018) Video-based person re-identification via 3d convolutional networks and non-local attention. In: Asian Conference on Computer Vision, Springer, pp 620–634 Liao X, He L, Yang Z, et al (2018) Video-based person re-identification via 3d convolutional networks and non-local attention. In: Asian Conference on Computer Vision, Springer, pp 620–634
17.
Zurück zum Zitat Linsker R (1988) Self-organization in a perceptual network. Computer 21(3):105–117CrossRef Linsker R (1988) Self-organization in a perceptual network. Computer 21(3):105–117CrossRef
18.
Zurück zum Zitat Liu H, Qin L, Cheng Z, et al (2013) Set-based classification for person re-identification utilizing mutual-information. In: IEEE International Conference on Image Processing, IEEE, pp 3078–3082 Liu H, Qin L, Cheng Z, et al (2013) Set-based classification for person re-identification utilizing mutual-information. In: IEEE International Conference on Image Processing, IEEE, pp 3078–3082
19.
Zurück zum Zitat Liu H, Ma B, Qin L et al (2015) Set-label modeling and deep metric learning on person re-identification. Neurocomputing 151:1283–1292CrossRef Liu H, Ma B, Qin L et al (2015) Set-label modeling and deep metric learning on person re-identification. Neurocomputing 151:1283–1292CrossRef
20.
Zurück zum Zitat Lv J, Chen W, Li Q, et al (2018) Unsupervised cross-dataset person re-identification by transfer learning of spatial-temporal patterns. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7948–7956 Lv J, Chen W, Li Q, et al (2018) Unsupervised cross-dataset person re-identification by transfer learning of spatial-temporal patterns. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7948–7956
21.
Zurück zum Zitat Mekhazni D, Bhuiyan A, Ekladious G, et al (2020) Unsupervised domain adaptation in the dissimilarity space for person re-identification. In: European Conference on Computer Vision, Springer, pp 159–174 Mekhazni D, Bhuiyan A, Ekladious G, et al (2020) Unsupervised domain adaptation in the dissimilarity space for person re-identification. In: European Conference on Computer Vision, Springer, pp 159–174
22.
Zurück zum Zitat Ristani E, Solera F, Zou R, et al (2016) Performance measures and a data set for multi-target, multi-camera tracking. In: European conference on computer vision, Springer, pp 17–35 Ristani E, Solera F, Zou R, et al (2016) Performance measures and a data set for multi-target, multi-camera tracking. In: European conference on computer vision, Springer, pp 17–35
23.
Zurück zum Zitat Sun FY, Hoffman J, Verma V, et al (2020) Infograph: Unsupervised and semi-supervised graph-level representation learning via mutual information maximization. In: International Conference on Learning Representations Sun FY, Hoffman J, Verma V, et al (2020) Infograph: Unsupervised and semi-supervised graph-level representation learning via mutual information maximization. In: International Conference on Learning Representations
24.
Zurück zum Zitat Vinh NX, Epps J, Bailey J (2010) Information theoretic measures for clusterings comparison: variants, properties, normalization and correction for chance. J Mach Learn Res 11:2837–2854MathSciNetMATH Vinh NX, Epps J, Bailey J (2010) Information theoretic measures for clusterings comparison: variants, properties, normalization and correction for chance. J Mach Learn Res 11:2837–2854MathSciNetMATH
25.
Zurück zum Zitat Wang G, Lai J, Huang P, et al (2019) Spatial-temporal person re-identification. In: Proceedings of the AAAI conference on artificial intelligence, pp 8933–8940 Wang G, Lai J, Huang P, et al (2019) Spatial-temporal person re-identification. In: Proceedings of the AAAI conference on artificial intelligence, pp 8933–8940
26.
Zurück zum Zitat Wei L, Zhang S, Gao W, et al (2018) Person transfer gan to bridge domain gap for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 79–88 Wei L, Zhang S, Gao W, et al (2018) Person transfer gan to bridge domain gap for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 79–88
27.
Zurück zum Zitat Wu G, Zhu X, Gong S (2020) Tracklet self-supervised learning for unsupervised person re-identification. Proc AAAI Conf Artif Intell 34(7):12362–12369 Wu G, Zhu X, Gong S (2020) Tracklet self-supervised learning for unsupervised person re-identification. Proc AAAI Conf Artif Intell 34(7):12362–12369
28.
Zurück zum Zitat Yan Y, Qin J, Chen J, et al (2020) Learning multi-granular hypergraphs for video-based person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2899–2908 Yan Y, Qin J, Chen J, et al (2020) Learning multi-granular hypergraphs for video-based person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2899–2908
29.
Zurück zum Zitat Yang J, Zheng WS, Yang Q, et al (2020) Spatial-temporal graph convolutional network for video-based person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3289–3299 Yang J, Zheng WS, Yang Q, et al (2020) Spatial-temporal graph convolutional network for video-based person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3289–3299
30.
Zurück zum Zitat Yu HX, Zheng WS (2020) Weakly supervised discriminative feature learning with state information for person identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5528–5538 Yu HX, Zheng WS (2020) Weakly supervised discriminative feature learning with state information for person identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5528–5538
31.
Zurück zum Zitat Yu HX, Zheng WS, Wu A, et al (2019) Unsupervised person re-identification by soft multilabel learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2148–2157 Yu HX, Zheng WS, Wu A, et al (2019) Unsupervised person re-identification by soft multilabel learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2148–2157
32.
Zurück zum Zitat Zhao Y, Lu H (2020) Neighbor similarity and soft-label adaptation for unsupervised cross-dataset person re-identification. Neurocomputing 388:246–254CrossRef Zhao Y, Lu H (2020) Neighbor similarity and soft-label adaptation for unsupervised cross-dataset person re-identification. Neurocomputing 388:246–254CrossRef
33.
Zurück zum Zitat Zhao Y, Shen X, Jin Z, et al (2019) Attribute-driven feature disentangling and temporal aggregation for video person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4913–4922 Zhao Y, Shen X, Jin Z, et al (2019) Attribute-driven feature disentangling and temporal aggregation for video person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4913–4922
34.
Zurück zum Zitat Zhao Y, Shu Q, Fu K et al (2020) Joint patch and instance discrimination learning for unsupervised person re-identification. Image Vision Comput 103(104):000 Zhao Y, Shu Q, Fu K et al (2020) Joint patch and instance discrimination learning for unsupervised person re-identification. Image Vision Comput 103(104):000
35.
Zurück zum Zitat Zheng L, Shen L, Tian L, et al (2015) Scalable person re-identification: A benchmark. In: Proceedings of the IEEE international conference on computer vision, pp 1116–1124 Zheng L, Shen L, Tian L, et al (2015) Scalable person re-identification: A benchmark. In: Proceedings of the IEEE international conference on computer vision, pp 1116–1124
36.
Zurück zum Zitat Zhong Z, Zheng L, Cao D, et al (2017) Re-ranking person re-identification with k-reciprocal encoding. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1318–1327 Zhong Z, Zheng L, Cao D, et al (2017) Re-ranking person re-identification with k-reciprocal encoding. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1318–1327
37.
Zurück zum Zitat Zhong Z, Zheng L, Li S, et al (2018a) Generalizing a person retrieval model hetero-and homogeneously. In: European Conference on Computer Vision, Springer, pp 176–192 Zhong Z, Zheng L, Li S, et al (2018a) Generalizing a person retrieval model hetero-and homogeneously. In: European Conference on Computer Vision, Springer, pp 176–192
38.
Zurück zum Zitat Zhong Z, Zheng L, Zheng Z et al (2018) Camstyle: A novel data augmentation method for person re-identification. IEEE Trans Image Process 28(3):1176–1190MathSciNetCrossRef Zhong Z, Zheng L, Zheng Z et al (2018) Camstyle: A novel data augmentation method for person re-identification. IEEE Trans Image Process 28(3):1176–1190MathSciNetCrossRef
39.
Zurück zum Zitat Zhong Z, Zheng L, Luo Z, et al (2019) Invariance matters: Exemplar memory for domain adaptive person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 598–607 Zhong Z, Zheng L, Luo Z, et al (2019) Invariance matters: Exemplar memory for domain adaptive person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 598–607
Metadaten
Titel
Multi-information Constraint Learning for Unsupervised Domain Adaptive Person Re-identification
verfasst von
Chen Dongyue
Bing Haozhe
Tang Chunren
Tian Miaoting
Jia Tong
Publikationsdatum
26.05.2022
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 1/2023
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-022-10883-w

Weitere Artikel der Ausgabe 1/2023

Neural Processing Letters 1/2023 Zur Ausgabe

Neuer Inhalt