Skip to main content
Erschienen in: Neural Processing Letters 3/2023

23.08.2022

Rapid Person Re-Identification via Sub-space Consistency Regularization

verfasst von: Qingze Yin, Guan’an Wang, Guodong Ding, Qilei Li, Shaogang Gong, Zhenmin Tang

Erschienen in: Neural Processing Letters | Ausgabe 3/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Person Re-Identification (ReID) matches pedestrian across disjoint cameras. Existing ReID methods adopting real-value feature descriptors have achieved high accuracy, but they are low in efficiency due to the slow Euclidean distance computation as well as complex quick-sort algorithms. Recently, some works propose to yield binary encoded person descriptors which instead only require fast Hamming distance computation and simple counting-sort algorithms. However, the performances of such binary encoded descriptors, especially with short code (e.g, 32 and 64 bits), are hardly satisfactory given the sparse binary space. To strike a balance between the model accuracy and efficiency, we propose a novel Sub-space Consistency Regularization (SCR) algorithm that can speed up the ReID procedure by 0.25 times than real-value features under same dimensions whilst maintain a competitive accuracy, especially under short codes. SCR transforms real-value features vector (e.g, 2048 float32) with short binary codes (e.g, 64 bits) by first dividing real-value features vector into M sub-spaces, each with C clustered centroids. Thus the distance between two samples can be expressed as the summation of respective distance to the centroids, which can be sped up by offline calculation and maintained via a look-up-table. On the other side, these real-value centroids help to achieve significantly higher accuracy than using binary code. Lastly, we convert the distance look-up-table to be integer and apply the counting-sort algorithm to speed up the ranking stage. We also propose a novel consistency regularization with an iterative framework. Experimental results on Market-1501 and DukeMTMC-reID show promising and exciting results. Under short code, our proposed SCR enjoys Real-value-level accuracy and Hashing-level speed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bajpai K, Kots A (2014) Implementing and analyzing an efficient version of counting sort (e-counting sort). Int J Comput Appl 98:1–2 Bajpai K, Kots A (2014) Implementing and analyzing an efficient version of counting sort (e-counting sort). Int J Comput Appl 98:1–2
2.
Zurück zum Zitat Cao Z, Long M, Wang J, et al (2017) Hashnet: deep learning to hash by continuation. In: ICCV, pp 5609–5618 Cao Z, Long M, Wang J, et al (2017) Hashnet: deep learning to hash by continuation. In: ICCV, pp 5609–5618
3.
Zurück zum Zitat Chen J, Wang Y, Wu R (2016) Person re-identification by distance metric learning to discrete hashing. In: ICIP, pp 789–793 Chen J, Wang Y, Wu R (2016) Person re-identification by distance metric learning to discrete hashing. In: ICIP, pp 789–793
4.
Zurück zum Zitat Chen J, Wang Y, Qin J, et al (2017) Fast person re-identification via cross-camera semantic binary transformation. In: CVPR, pp 5330–5339 Chen J, Wang Y, Qin J, et al (2017) Fast person re-identification via cross-camera semantic binary transformation. In: CVPR, pp 5330–5339
5.
Zurück zum Zitat Cheng D, Gong Y, Zhou S, et al (2016) Person re-identification by multi-channel parts-based cnn with improved triplet loss function. In: CVPR, pp 1335–1344 Cheng D, Gong Y, Zhou S, et al (2016) Person re-identification by multi-channel parts-based cnn with improved triplet loss function. In: CVPR, pp 1335–1344
6.
Zurück zum Zitat Ding G, Zhang S, Khan S, et al (2018) Center based pseudo-labeling for semi-supervised person re-identification. In: ICME Ding G, Zhang S, Khan S, et al (2018) Center based pseudo-labeling for semi-supervised person re-identification. In: ICME
7.
Zurück zum Zitat Ding G, Khan S, Tang Z et al (2019) Feature mask network for person re-identification. Pattern Recogn Lett 137:91CrossRef Ding G, Khan S, Tang Z et al (2019) Feature mask network for person re-identification. Pattern Recogn Lett 137:91CrossRef
8.
Zurück zum Zitat Ding G, Zhang S, Khan S et al (2019) Feature affinity based pseudo labeling for semi-supervised person re-identification. IEEE Trans Multim 21(11):2891–2902CrossRef Ding G, Zhang S, Khan S et al (2019) Feature affinity based pseudo labeling for semi-supervised person re-identification. IEEE Trans Multim 21(11):2891–2902CrossRef
9.
Zurück zum Zitat Fang W, Hu HM, Hu Z et al (2017) Perceptual hash-based feature description for person re-identification. Neurocomputing 272:520CrossRef Fang W, Hu HM, Hu Z et al (2017) Perceptual hash-based feature description for person re-identification. Neurocomputing 272:520CrossRef
10.
Zurück zum Zitat Farenzena M, Bazzani L, Perina A, et al (2010) Person re-identification by symmetry-driven accumulation of local features. In: CVPR, pp 2360–2367 Farenzena M, Bazzani L, Perina A, et al (2010) Person re-identification by symmetry-driven accumulation of local features. In: CVPR, pp 2360–2367
11.
Zurück zum Zitat Feng G, Liu W, Tao D et al (2019) Hessian regularized distance metric learning for people re-identification. Neural Process Lett 50(3):2087–2100CrossRef Feng G, Liu W, Tao D et al (2019) Hessian regularized distance metric learning for people re-identification. Neural Process Lett 50(3):2087–2100CrossRef
12.
Zurück zum Zitat Gong S, Cristani M, Yan S, et al (2013) Person Re-Identification Gong S, Cristani M, Yan S, et al (2013) Person Re-Identification
13.
Zurück zum Zitat He K, Zhang X, Ren S, et al (2016) Deep residual learning for image recognition. In: CVPR, pp 770–778 He K, Zhang X, Ren S, et al (2016) Deep residual learning for image recognition. In: CVPR, pp 770–778
15.
Zurück zum Zitat Kalayeh MM, Basaran E, Gokmen M, et al (2018) Human semantic parsing for person re-identification. In: CVPR, pp 1062–1071 Kalayeh MM, Basaran E, Gokmen M, et al (2018) Human semantic parsing for person re-identification. In: CVPR, pp 1062–1071
16.
Zurück zum Zitat Köstinger M, Hirzer M, Wohlhart P, et al (2012) Large scale metric learning from equivalence constraints. In: CVPR, pp 2288–2295 Köstinger M, Hirzer M, Wohlhart P, et al (2012) Large scale metric learning from equivalence constraints. In: CVPR, pp 2288–2295
17.
Zurück zum Zitat Li D, Hu R, Huang W et al (2021) Trajectory association for person re-identification. Neural Process Lett 53(5):3267–3285CrossRef Li D, Hu R, Huang W et al (2021) Trajectory association for person re-identification. Neural Process Lett 53(5):3267–3285CrossRef
18.
Zurück zum Zitat Li H, Pang J, Tao D et al (2021) Cross adversarial consistency self-prediction learning for unsupervised domain adaptation person re-identification. Inf Sci 559:46–60CrossRef Li H, Pang J, Tao D et al (2021) Cross adversarial consistency self-prediction learning for unsupervised domain adaptation person re-identification. Inf Sci 559:46–60CrossRef
19.
Zurück zum Zitat Li H, Dong N, Yu Z et al (2022) Triple adversarial learning and multi-view imaginative reasoning for unsupervised domain adaptation person re-identification. IEEE Transa Circuits Syst Video Technol 32(5):2814–2830MathSciNetCrossRef Li H, Dong N, Yu Z et al (2022) Triple adversarial learning and multi-view imaginative reasoning for unsupervised domain adaptation person re-identification. IEEE Transa Circuits Syst Video Technol 32(5):2814–2830MathSciNetCrossRef
20.
Zurück zum Zitat Li Y, Lin C, Lin Y, et al (2019) Cross-dataset person re-identification via unsupervised pose disentanglement and adaptation. In: ICCV, pp 7918–7928 Li Y, Lin C, Lin Y, et al (2019) Cross-dataset person re-identification via unsupervised pose disentanglement and adaptation. In: ICCV, pp 7918–7928
21.
Zurück zum Zitat Liao S, Li SZ (2015) Efficient psd constrained asymmetric metric learning for person re-identification. In: ICCV, pp 3685–3693 Liao S, Li SZ (2015) Efficient psd constrained asymmetric metric learning for person re-identification. In: ICCV, pp 3685–3693
22.
Zurück zum Zitat Liao S, Shao L (2022) Graph sampling based deep metric learning for generalizable person re-identification. In: CVPR Liao S, Shao L (2022) Graph sampling based deep metric learning for generalizable person re-identification. In: CVPR
23.
Zurück zum Zitat Liao S, Hu Y, Zhu X, et al (2015) Person re-identification by local maximal occurrence representation and metric learning. In: CVPR, pp 2197–2206 Liao S, Hu Y, Zhu X, et al (2015) Person re-identification by local maximal occurrence representation and metric learning. In: CVPR, pp 2197–2206
24.
Zurück zum Zitat Lin Y, Dong X, Zheng L, et al (2019) A bottom-up clustering approach to unsupervised person re-identification. In: AAAI, pp 1–8 Lin Y, Dong X, Zheng L, et al (2019) A bottom-up clustering approach to unsupervised person re-identification. In: AAAI, pp 1–8
25.
Zurück zum Zitat Liu Z, Qin J, Li A, et al (2019) Adversarial binary coding for efficient person re-identification. In: ICME, pp 700–705 Liu Z, Qin J, Li A, et al (2019) Adversarial binary coding for efficient person re-identification. In: ICME, pp 700–705
26.
Zurück zum Zitat Luo H, Gu Y, Liao X, et al (2019) Bag of tricks and a strong baseline for deep person re-identification. In: CVPR Workshops Luo H, Gu Y, Liao X, et al (2019) Bag of tricks and a strong baseline for deep person re-identification. In: CVPR Workshops
27.
Zurück zum Zitat Nister D, Stewenius H (2006) Scalable recognition with a vocabulary tree. In: CVPR, pp 2161–2168 Nister D, Stewenius H (2006) Scalable recognition with a vocabulary tree. In: CVPR, pp 2161–2168
28.
Zurück zum Zitat Qian X, Fu Y, Xiang T, et al (2018) Pose-normalized image generation for person re-identification. In: ECCV, pp 650–667 Qian X, Fu Y, Xiang T, et al (2018) Pose-normalized image generation for person re-identification. In: ECCV, pp 650–667
29.
Zurück zum Zitat Ratcliffe JG (1994) Foundations of hyperbolic manifolds Ratcliffe JG (1994) Foundations of hyperbolic manifolds
30.
Zurück zum Zitat Sarfraz MS, Schumann A, Eberle A, et al (2018) A pose-sensitive embedding for person re-identification with expanded cross neighborhood re-ranking. In: CVPR, pp 420–429 Sarfraz MS, Schumann A, Eberle A, et al (2018) A pose-sensitive embedding for person re-identification with expanded cross neighborhood re-ranking. In: CVPR, pp 420–429
31.
Zurück zum Zitat Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: ICLR Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: ICLR
32.
Zurück zum Zitat Sun Y, Zheng L, Yang Y, et al (2018) Beyond part models: Person retrieval with refined part pooling (and a strong convolutional baseline). In: ECCV, pp 501–518 Sun Y, Zheng L, Yang Y, et al (2018) Beyond part models: Person retrieval with refined part pooling (and a strong convolutional baseline). In: ECCV, pp 501–518
33.
Zurück zum Zitat Sun Y, Xu Q, Li Y, et al (2019) Perceive where to focus: Learning visibility-aware part-level features for partial person re-identification. In: CVPR, pp 393–402 Sun Y, Xu Q, Li Y, et al (2019) Perceive where to focus: Learning visibility-aware part-level features for partial person re-identification. In: CVPR, pp 393–402
34.
Zurück zum Zitat Tan H, Liu X, Tian S, et al (2020) Mhsa-net: Multi-head self-attention network for occluded person re-identification. arXiv:2008.04015 Tan H, Liu X, Tian S, et al (2020) Mhsa-net: Multi-head self-attention network for occluded person re-identification. arXiv:​2008.​04015
35.
Zurück zum Zitat Wang G, Zhang T, Cheng J, et al (2019) Rgb-infrared cross-modality person re-identification via joint pixel and feature alignment. In: ICCV Wang G, Zhang T, Cheng J, et al (2019) Rgb-infrared cross-modality person re-identification via joint pixel and feature alignment. In: ICCV
36.
Zurück zum Zitat Wang G, Gong S, Cheng J, et al (2020) Faster person re-identification. In: ECCV Wang G, Gong S, Cheng J, et al (2020) Faster person re-identification. In: ECCV
37.
Zurück zum Zitat Wang G, Yang S, Liu H, et al (2020a) High-order information matters: Learning relation and topology for occluded person re-identification. In: CVPR Wang G, Yang S, Liu H, et al (2020a) High-order information matters: Learning relation and topology for occluded person re-identification. In: CVPR
38.
Zurück zum Zitat Wang G, Yang Y, Zhang T et al (2020) Cross-modality paired-images generation and augmentation for rgb-infrared person re-identification. Neural Netw 128:294–304CrossRef Wang G, Yang Y, Zhang T et al (2020) Cross-modality paired-images generation and augmentation for rgb-infrared person re-identification. Neural Netw 128:294–304CrossRef
39.
Zurück zum Zitat Wang G, Zhang T, Yang Y, et al (2020) Cross-modality paired-images generation for rgb-infrared person re-identification. In: AAAI Wang G, Zhang T, Yang Y, et al (2020) Cross-modality paired-images generation for rgb-infrared person re-identification. In: AAAI
40.
Zurück zum Zitat Wang G, Hu Q, Yang Y, et al (2021) Adversarial binary mutual learning for semi-supervised deep hashing. IEEE Transactions on Neural Networks and Learning Systems pp 1–15 Wang G, Hu Q, Yang Y, et al (2021) Adversarial binary mutual learning for semi-supervised deep hashing. IEEE Transactions on Neural Networks and Learning Systems pp 1–15
41.
Zurück zum Zitat Wang H, Bi X (2021) Person re-identification based on graph relation learning. Neural Process Lett 53(2):1401–1415CrossRef Wang H, Bi X (2021) Person re-identification based on graph relation learning. Neural Process Lett 53(2):1401–1415CrossRef
42.
Zurück zum Zitat Wu C, Ge W, Wu A, et al (2022) Camera-conditioned stable feature generation for isolated camera supervised person re-identification. In: CVPR Wu C, Ge W, Wu A, et al (2022) Camera-conditioned stable feature generation for isolated camera supervised person re-identification. In: CVPR
43.
Zurück zum Zitat Wu L, Wang Y, Ge Z, et al (2018) Structured deep hashing with convolutional neural networks for fast person re-identification. arXiv:1702.04179 Wu L, Wang Y, Ge Z, et al (2018) Structured deep hashing with convolutional neural networks for fast person re-identification. arXiv:​1702.​04179
44.
Zurück zum Zitat Xiang X, Lv N, Zhai M et al (2020) Dual-path part-level method for visible-infrared person re-identification. Neural Process Lett 52(1):313–328CrossRef Xiang X, Lv N, Zhai M et al (2020) Dual-path part-level method for visible-infrared person re-identification. Neural Process Lett 52(1):313–328CrossRef
45.
Zurück zum Zitat Yao Y, Chen T, Xie GS, et al (2021a) Non-salient region object mining for weakly supervised semantic segmentation. In: CVPR, pp 2623–2632 Yao Y, Chen T, Xie GS, et al (2021a) Non-salient region object mining for weakly supervised semantic segmentation. In: CVPR, pp 2623–2632
46.
Zurück zum Zitat Yin HF, Wu XJ, Song X (2021) Competitive non-negative representation with image gradient orientations for face recognition. Neural Process Lett 54:657CrossRef Yin HF, Wu XJ, Song X (2021) Competitive non-negative representation with image gradient orientations for face recognition. Neural Process Lett 54:657CrossRef
47.
Zurück zum Zitat Yin Q, Wang G, Ding G, et al (2021b) Multi-view label prediction for unsupervised learning person re-identification. IEEE Signal Processing Letters pp 1–1 Yin Q, Wang G, Ding G, et al (2021b) Multi-view label prediction for unsupervised learning person re-identification. IEEE Signal Processing Letters pp 1–1
48.
Zurück zum Zitat Yin Q, Wang G, Wu J et al (2022) Dynamic re-weighting and cross-camera learning for unsupervised person re-identification. Mathematics 10(10):1654CrossRef Yin Q, Wang G, Wu J et al (2022) Dynamic re-weighting and cross-camera learning for unsupervised person re-identification. Mathematics 10(10):1654CrossRef
49.
Zurück zum Zitat Lin L, Zhang R, Zhang R et al (2015) Bit-scalable deep hashing with regularized similarity learning for image retrieval and person re-identification. IEEE Trans Image Process 24(12):4766–4779MathSciNetCrossRefMATH Lin L, Zhang R, Zhang R et al (2015) Bit-scalable deep hashing with regularized similarity learning for image retrieval and person re-identification. IEEE Trans Image Process 24(12):4766–4779MathSciNetCrossRefMATH
50.
Zurück zum Zitat Zhang X, Yang Y, Li T et al (2021) CMC: A consensus multi-view clustering model for predicting Alzheimer’s Disease Progression. Computer Methods and Programs in Biomedicine 199:105895CrossRef Zhang X, Yang Y, Li T et al (2021) CMC: A consensus multi-view clustering model for predicting Alzheimer’s Disease Progression. Computer Methods and Programs in Biomedicine 199:105895CrossRef
51.
Zurück zum Zitat Zhao C, Chen Y, Wei Z et al (2019) Qrkiss: a two-stage metric learning via qr-decomposition and kiss for person re-identification. Neural Process Lett 49(3):899–922CrossRef Zhao C, Chen Y, Wei Z et al (2019) Qrkiss: a two-stage metric learning via qr-decomposition and kiss for person re-identification. Neural Process Lett 49(3):899–922CrossRef
52.
Zurück zum Zitat Zhao Y, Li Y, Wang S (2019) Open-world person re-identification with deep hash feature embedding. IEEE Signal Process Lett 26(12):1758–1762CrossRef Zhao Y, Li Y, Wang S (2019) Open-world person re-identification with deep hash feature embedding. IEEE Signal Process Lett 26(12):1758–1762CrossRef
53.
Zurück zum Zitat Zheng F, Shao L (2016) Learning cross-view binary identities for fast person re-identification. In: IJCAI, pp 2399-2406 Zheng F, Shao L (2016) Learning cross-view binary identities for fast person re-identification. In: IJCAI, pp 2399-2406
54.
Zurück zum Zitat Zheng L, Shen L, Tian L, et al (2015) Scalable person re-identification: a benchmark. In: ICCV, pp 1116–1124 Zheng L, Shen L, Tian L, et al (2015) Scalable person re-identification: a benchmark. In: ICCV, pp 1116–1124
56.
Zurück zum Zitat Zheng WS, Gong S, Xiang T (2013) Reidentification by relative distance comparison. IEEE Trans Pattern Ana Mach Intell 35(3):653–668CrossRef Zheng WS, Gong S, Xiang T (2013) Reidentification by relative distance comparison. IEEE Trans Pattern Ana Mach Intell 35(3):653–668CrossRef
57.
Zurück zum Zitat Zheng Z, Zheng L, Yang Y (2017) Unlabeled samples generated by gan improve the person re-identification baseline in vitro. In: ICCV Zheng Z, Zheng L, Yang Y (2017) Unlabeled samples generated by gan improve the person re-identification baseline in vitro. In: ICCV
58.
Zurück zum Zitat Zhong Z, Zheng L, Zheng Z, et al (2018) Camera style adaptation for person re-identification. In: CVPR, pp 5157–5166 Zhong Z, Zheng L, Zheng Z, et al (2018) Camera style adaptation for person re-identification. In: CVPR, pp 5157–5166
59.
Zurück zum Zitat Zhou W, Lian C, Zeng Z et al (2021) Improve semi-supervised learning with metric learning clusters and auxiliary fake samples. Neural Process Lett 53(5):3427–3443CrossRef Zhou W, Lian C, Zeng Z et al (2021) Improve semi-supervised learning with metric learning clusters and auxiliary fake samples. Neural Process Lett 53(5):3427–3443CrossRef
60.
Zurück zum Zitat Zhu F, Kong X, Zheng L, et al (2017) Part-based deep hashing for large-scale person re-identification. IEEE Transactions on Image Processing pp 1–1 Zhu F, Kong X, Zheng L, et al (2017) Part-based deep hashing for large-scale person re-identification. IEEE Transactions on Image Processing pp 1–1
Metadaten
Titel
Rapid Person Re-Identification via Sub-space Consistency Regularization
verfasst von
Qingze Yin
Guan’an Wang
Guodong Ding
Qilei Li
Shaogang Gong
Zhenmin Tang
Publikationsdatum
23.08.2022
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 3/2023
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-022-11002-5

Weitere Artikel der Ausgabe 3/2023

Neural Processing Letters 3/2023 Zur Ausgabe

Neuer Inhalt