Skip to main content
Erschienen in: Neural Processing Letters 5/2021

03.06.2021

Trajectory Association for Person Re-identification

verfasst von: Dongyang Li, Ruimin Hu, Wenxin Huang, Dengshi Li, Xiaochen Wang, Chenhao Hu

Erschienen in: Neural Processing Letters | Ausgabe 5/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Person re-identification (reID) aims at finding the same person in different camera views. In real-world scenarios, it is quite often that the suspect’s appearance is not known while the suspect’s escape route is known. This paper introduces a new person reID setting, where the query includes both the real suspect’s trajectory and several possible suspects. The goal is to identify the actual suspect and retrieve images of the real suspect. Prior work focuses on extracting pedestrians’ discriminative visual features or using spatial-temporal information while neglecting the importance of cross-camera trajectory information. Due to the spatial-temporal consistency, the trajectory and image complement each other and the trajectory is associated with the image data. Therefore, we consider retrieving the suspect’s image based on the trajectory and introducing a Hidden Markov Model based trajectory framework to jointly analyze image data and trajectory information. We evaluate our methods on two datasets containing person images and trajectory information, demonstrating our approach’s effectiveness.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Li J, Zhang S, Wang J, Gao W, Tian Q (2019) Global-local temporal representations for video person re-identification. In: IEEE international conference on computer vision (ICCV). Seoul, Korea, pp 3957–3966 Li J, Zhang S, Wang J, Gao W, Tian Q (2019) Global-local temporal representations for video person re-identification. In: IEEE international conference on computer vision (ICCV). Seoul, Korea, pp 3957–3966
2.
Zurück zum Zitat Yao H, Zhang S, Zhang D, Zhang Y, Li J, Wang Y, Tian Q (2017) Large-scale person re-identification as retrieval. In: ICME Hong Kong, China, pp 1440-1445 Yao H, Zhang S, Zhang D, Zhang Y, Li J, Wang Y, Tian Q (2017) Large-scale person re-identification as retrieval. In: ICME Hong Kong, China, pp 1440-1445
3.
Zurück zum Zitat Huang Y, Zha Z, Fu X, Hong R, Li L (2020) Real-world person re-identification via degradation invariance learning. CVPR. Seattle, USA, pp 14072–14082 Huang Y, Zha Z, Fu X, Hong R, Li L (2020) Real-world person re-identification via degradation invariance learning. CVPR. Seattle, USA, pp 14072–14082
4.
Zurück zum Zitat Zeng Z, Wang Z, Wang Z, Chuang Y, Satoh S (2020) Illumination-adaptive person re-identification abs/1905.04525 Zeng Z, Wang Z, Wang Z, Chuang Y, Satoh S (2020) Illumination-adaptive person re-identification abs/1905.04525
5.
Zurück zum Zitat Cong DNT, Khoudour L, Achard C, Bruyelle J (2011) Intelligent distributed surveillance system for people reidentification in a transportation environment. J Intell Transp Syst 15(3):133–146CrossRef Cong DNT, Khoudour L, Achard C, Bruyelle J (2011) Intelligent distributed surveillance system for people reidentification in a transportation environment. J Intell Transp Syst 15(3):133–146CrossRef
6.
Zurück zum Zitat Zheng Y, Capra L, Wolfson O, Yang H (2014) Urban computing: concepts, methodologies, and applications. ACM TIST 5(3):38:1-38:55 Zheng Y, Capra L, Wolfson O, Yang H (2014) Urban computing: concepts, methodologies, and applications. ACM TIST 5(3):38:1-38:55
7.
Zurück zum Zitat Huang Y, Zha Z, Fu X, Hong R, Li L (2020) Real-world person re-identification via degradation invariance learning, in: CVPR 2020, Seattle, USA,2020, pp 14072-14082 Huang Y, Zha Z, Fu X, Hong R, Li L (2020) Real-world person re-identification via degradation invariance learning, in: CVPR 2020, Seattle, USA,2020, pp 14072-14082
8.
Zurück zum Zitat Fu M, Sun S, Chen N, Wang D, Tong X (2019) Deep fusion feature presentations for nonaligned person re-identification. IEEE Access 7:73253–73261CrossRef Fu M, Sun S, Chen N, Wang D, Tong X (2019) Deep fusion feature presentations for nonaligned person re-identification. IEEE Access 7:73253–73261CrossRef
9.
Zurück zum Zitat Sun Y, Xu Q, Li Y, Zhang C, Li Y, Wang S, Sun J (2019) Perceive where to focus: Learning visibility-aware part-level features for partial person re-identification. CVPR. Long Beach, USA, pp 393–402 Sun Y, Xu Q, Li Y, Zhang C, Li Y, Wang S, Sun J (2019) Perceive where to focus: Learning visibility-aware part-level features for partial person re-identification. CVPR. Long Beach, USA, pp 393–402
10.
Zurück zum Zitat Chen Y, Zhu X, Gong S (2017) Person re-identification by deep learning multi-scale representations. ICCV Workshops. Venice, Italy, pp 2590–2600 Chen Y, Zhu X, Gong S (2017) Person re-identification by deep learning multi-scale representations. ICCV Workshops. Venice, Italy, pp 2590–2600
11.
Zurück zum Zitat Lin Y, Zheng L, Zheng Z, Wu Y, Hu Z, Yan C, Yang Y (2019) Improving person re-identification by attribute and identity learning. Pattern Recognit 95:151–161CrossRef Lin Y, Zheng L, Zheng Z, Wu Y, Hu Z, Yan C, Yang Y (2019) Improving person re-identification by attribute and identity learning. Pattern Recognit 95:151–161CrossRef
12.
Zurück zum Zitat Sanakoyeu A, Tschernezki V, Buchler U, Ommer B (2019) Divide and conquer the embedding space for metric learning. CVPR. Long Beach, USA, pp 471–480 Sanakoyeu A, Tschernezki V, Buchler U, Ommer B (2019) Divide and conquer the embedding space for metric learning. CVPR. Long Beach, USA, pp 471–480
13.
Zurück zum Zitat Zhong Z, Zheng L, Luo Z, Li S, Yang Y (2019) Invariance matters: exemplar memory for domain adaptive person re-identification. CVPR. Long Beach, USA, pp 598–607 Zhong Z, Zheng L, Luo Z, Li S, Yang Y (2019) Invariance matters: exemplar memory for domain adaptive person re-identification. CVPR. Long Beach, USA, pp 598–607
14.
Zurück zum Zitat Wang Z, Hu R, Chen C, Yu Y, Jiang J, Liang C, Satoh S (2018) Person reidentification via discrepancy matrix and matrix metric. IEEE Trans Cybern 48(10):3006–3020CrossRef Wang Z, Hu R, Chen C, Yu Y, Jiang J, Liang C, Satoh S (2018) Person reidentification via discrepancy matrix and matrix metric. IEEE Trans Cybern 48(10):3006–3020CrossRef
15.
Zurück zum Zitat Wang Z, Jiang J, Yu Y, Satoh S (2019) Incremental re-identification by cross-direction and cross-ranking adaption. IEEE Trans Multimed 21(9):2376–2386CrossRef Wang Z, Jiang J, Yu Y, Satoh S (2019) Incremental re-identification by cross-direction and cross-ranking adaption. IEEE Trans Multimed 21(9):2376–2386CrossRef
16.
Zurück zum Zitat Wang N, Ma S, Li J, Zhang Y, Zhang L (2020) Multistage attention network for image inpainting. Pattern Recognit 106:107448CrossRef Wang N, Ma S, Li J, Zhang Y, Zhang L (2020) Multistage attention network for image inpainting. Pattern Recognit 106:107448CrossRef
17.
Zurück zum Zitat Wang N, Zhang Y, Zhang L (2021) Dynamic selection network for image inpainting. IEEE Trans Image Process 30:1784–1798 Wang N, Zhang Y, Zhang L (2021) Dynamic selection network for image inpainting. IEEE Trans Image Process 30:1784–1798
18.
Zurück zum Zitat Lian G, Lai J, Zheng W (2011) Spatial-temporal consistent labeling of tracked pedestrians across non-overlapping camera views. Pattern Recognit 44(5):1121–1136CrossRef Lian G, Lai J, Zheng W (2011) Spatial-temporal consistent labeling of tracked pedestrians across non-overlapping camera views. Pattern Recognit 44(5):1121–1136CrossRef
19.
Zurück zum Zitat Meng J, Yuan J, Yang J, Wang G, Tan Y (2016) Object instance search in videos via spatio-temporal trajectory discovery. IEEE Trans Multimed 18(1):116–127CrossRef Meng J, Yuan J, Yang J, Wang G, Tan Y (2016) Object instance search in videos via spatio-temporal trajectory discovery. IEEE Trans Multimed 18(1):116–127CrossRef
20.
Zurück zum Zitat Martinel N, Foresti GL, Micheloni C (2017) Person reidentification in a distributed camera network framework. IEEE Trans Cybern 47(11):3530–3541CrossRef Martinel N, Foresti GL, Micheloni C (2017) Person reidentification in a distributed camera network framework. IEEE Trans Cybern 47(11):3530–3541CrossRef
21.
Zurück zum Zitat Li D, Hu R, Huang W, Wang X, Li D, Zheng F (2020) Hmm-based person re-identification in large-scale open scenario. MMM. Daejeon, South Korea, pp 813–825 Li D, Hu R, Huang W, Wang X, Li D, Zheng F (2020) Hmm-based person re-identification in large-scale open scenario. MMM. Daejeon, South Korea, pp 813–825
22.
Zurück zum Zitat Lv J, Lin H, Yang C, Yu Z, Chen Y, Deng M (2014) Identify and trace criminal suspects in the crowd aided by fast trajectories retrieval. In: DASFAA, Bali, Indonesia, pp 16-30 Lv J, Lin H, Yang C, Yu Z, Chen Y, Deng M (2014) Identify and trace criminal suspects in the crowd aided by fast trajectories retrieval. In: DASFAA, Bali, Indonesia, pp 16-30
23.
Zurück zum Zitat Montjoye YAD, Hidalgo CA, Verleysen M, Blondel VD (2013) Unique in the crowd: The privacy bounds of human mobility. entific Reports 3(3):1376 Montjoye YAD, Hidalgo CA, Verleysen M, Blondel VD (2013) Unique in the crowd: The privacy bounds of human mobility. entific Reports 3(3):1376
24.
Zurück zum Zitat Niu X, Li M, Cui X, Liu J, Liu S, Chowdhury KR (2014) Wtrack: Hmm-based walk pattern recognition and indoor pedestrian tracking using phone inertial sensors. Pers Ubiquitous Comput 18(8):1901–1915CrossRef Niu X, Li M, Cui X, Liu J, Liu S, Chowdhury KR (2014) Wtrack: Hmm-based walk pattern recognition and indoor pedestrian tracking using phone inertial sensors. Pers Ubiquitous Comput 18(8):1901–1915CrossRef
25.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. CVPR. Las Vegas, USA, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. CVPR. Las Vegas, USA, pp 770–778
26.
Zurück zum Zitat Huang G, Liu Z, van der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. CVPR. Honolulu, USA, pp 2261–2269 Huang G, Liu Z, van der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. CVPR. Honolulu, USA, pp 2261–2269
27.
Zurück zum Zitat Sun Y, Zheng L, Yang Y, Tian Q, Wang S (2018) Beyond part models: Person retrieval with refined part pooling (and A strong convolutional baseline). ECCV. Munich, Germany, pp 501–518 Sun Y, Zheng L, Yang Y, Tian Q, Wang S (2018) Beyond part models: Person retrieval with refined part pooling (and A strong convolutional baseline). ECCV. Munich, Germany, pp 501–518
28.
Zurück zum Zitat Yuan Y, Zhang J, Wang Q (2020) Deep gabor convolution network for person re-identification. Neurocomputing 378:387–398CrossRef Yuan Y, Zhang J, Wang Q (2020) Deep gabor convolution network for person re-identification. Neurocomputing 378:387–398CrossRef
29.
Zurück zum Zitat Wei L, Zhang S, Yao H, Gao W, Tian Q (2017) GLAD: global-local-alignment descriptor for pedestrian retrieval. MM. Mountain View, USA, pp 420–428 Wei L, Zhang S, Yao H, Gao W, Tian Q (2017) GLAD: global-local-alignment descriptor for pedestrian retrieval. MM. Mountain View, USA, pp 420–428
30.
Zurück zum Zitat Luo H, Jiang W, Zhang X, Fan X, Zhang C (2019) Alignedreid++: Dynamically matching local information for person re-identification. Pattern Recognit 94:53–61CrossRef Luo H, Jiang W, Zhang X, Fan X, Zhang C (2019) Alignedreid++: Dynamically matching local information for person re-identification. Pattern Recognit 94:53–61CrossRef
31.
Zurück zum Zitat Zhang Z, Lan C, Zeng W, Jin X, Chen Z (2020) Relation-aware global attention for person re-identification. CVPR 2020. Seattle, USA, pp 3183–3192 Zhang Z, Lan C, Zeng W, Jin X, Chen Z (2020) Relation-aware global attention for person re-identification. CVPR 2020. Seattle, USA, pp 3183–3192
32.
Zurück zum Zitat Fu C, Zhao Y, Feng F, Song J, Ji R, Yang Y (2020) Salience-guided cascaded suppression network for person re-identification. CVPR 2020. Seattle, USA, pp 3297–3307 Fu C, Zhao Y, Feng F, Song J, Ji R, Yang Y (2020) Salience-guided cascaded suppression network for person re-identification. CVPR 2020. Seattle, USA, pp 3297–3307
33.
Zurück zum Zitat Zheng Z, Zheng L, Yang Y (2019) Pedestrian alignment network for large-scale person re-identification. IEEE Trans Circuits Syst Video Tech 29(10):3037–3045CrossRef Zheng Z, Zheng L, Yang Y (2019) Pedestrian alignment network for large-scale person re-identification. IEEE Trans Circuits Syst Video Tech 29(10):3037–3045CrossRef
34.
Zurück zum Zitat Zheng Z, Zheng L, Yang Y (2018) A discriminatively learned CNN embedding for person reidentification. ACM Trans Multim Comput Commun Appl 14(1):13:1-13:20MathSciNetCrossRef Zheng Z, Zheng L, Yang Y (2018) A discriminatively learned CNN embedding for person reidentification. ACM Trans Multim Comput Commun Appl 14(1):13:1-13:20MathSciNetCrossRef
35.
Zurück zum Zitat Wang G, Lin L, Ding S, Li Y, Wang Q (2016) DARI: distance metric and representation integration for person verification. AAAI. Arizona, USA, Phoenix, pp 3611–3617 Wang G, Lin L, Ding S, Li Y, Wang Q (2016) DARI: distance metric and representation integration for person verification. AAAI. Arizona, USA, Phoenix, pp 3611–3617
36.
Zurück zum Zitat Wu D, Zheng S, Bao W, Zhang XS, Yuan C, Huang D (2019) A novel deep model with multi-loss and efficient training for person re-identification. Neurocomputing 324:69–75CrossRef Wu D, Zheng S, Bao W, Zhang XS, Yuan C, Huang D (2019) A novel deep model with multi-loss and efficient training for person re-identification. Neurocomputing 324:69–75CrossRef
37.
Zurück zum Zitat Yu H, Zheng W, Wu A, Guo X, Gong S, Lai J (2019) Unsupervised person re-identification by soft multilabel learning. CVPR. Long Beach, USA, pp 2148–2157 Yu H, Zheng W, Wu A, Guo X, Gong S, Lai J (2019) Unsupervised person re-identification by soft multilabel learning. CVPR. Long Beach, USA, pp 2148–2157
38.
Zurück zum Zitat Luo C, Song C, Zhang Z (2020) Generalizing Person Re-Identification by Camera-Aware Invariance Learning and Cross-Domain Mixup. ECCV. Glasgow, UK, pp 224–241 Luo C, Song C, Zhang Z (2020) Generalizing Person Re-Identification by Camera-Aware Invariance Learning and Cross-Domain Mixup. ECCV. Glasgow, UK, pp 224–241
39.
Zurück zum Zitat Huang Y, Peng P, Jin Y, Li Y, Xing J (2020) Domain adaptive attention learning for unsupervised person re-identification. In: AAAI, New York, USA, pp 11069-11076 Huang Y, Peng P, Jin Y, Li Y, Xing J (2020) Domain adaptive attention learning for unsupervised person re-identification. In: AAAI, New York, USA, pp 11069-11076
40.
Zurück zum Zitat Huang W, Hu R, Liang C, Yu Y, Zhang C (2016) Camera network based person re-identification by leveraging spatial-temporal constraint and multiple cameras relations. In: International Conference on Multimedia Modeling, 2016 Huang W, Hu R, Liang C, Yu Y, Zhang C (2016) Camera network based person re-identification by leveraging spatial-temporal constraint and multiple cameras relations. In: International Conference on Multimedia Modeling, 2016
41.
Zurück zum Zitat Lv J, Chen W, Li Q, Yang C (2018) Unsupervised cross-dataset person re-identification by transfer learning of spatial-temporal patterns. CVPR. Salt Lake City, USA, pp 7948–7956 Lv J, Chen W, Li Q, Yang C (2018) Unsupervised cross-dataset person re-identification by transfer learning of spatial-temporal patterns. CVPR. Salt Lake City, USA, pp 7948–7956
42.
Zurück zum Zitat Wang G, Lai J, Huang P, Xie X (2019) Spatial-temporal person re-identification. Proc AAAI Conf Artif Intell 33:8933–8940 Wang G, Lai J, Huang P, Xie X (2019) Spatial-temporal person re-identification. Proc AAAI Conf Artif Intell 33:8933–8940
43.
Zurück zum Zitat Xiang X, Lv N, Zhai M, Abdeen R, Saddik A (2020) Dual-Path Part-Level Method for Visible-Infrared Person Re-identification. Neural Process Lett 52(1):313–328CrossRef Xiang X, Lv N, Zhai M, Abdeen R, Saddik A (2020) Dual-Path Part-Level Method for Visible-Infrared Person Re-identification. Neural Process Lett 52(1):313–328CrossRef
44.
Zurück zum Zitat Marras M, Reyes P, Navarro J, Santana M, Fenu G (2019) Deep multi-biometric fusion for audio-visual user re-identification and verification. ICPRAM. Czech Republic, Prague, pp 136–157 Marras M, Reyes P, Navarro J, Santana M, Fenu G (2019) Deep multi-biometric fusion for audio-visual user re-identification and verification. ICPRAM. Czech Republic, Prague, pp 136–157
45.
Zurück zum Zitat Chen A, Abgari M, Wang K (2019) Investigating fast re-identification for multi-camera indoor person tracking. Comput Electr Eng 77:273–288CrossRef Chen A, Abgari M, Wang K (2019) Investigating fast re-identification for multi-camera indoor person tracking. Comput Electr Eng 77:273–288CrossRef
46.
Zurück zum Zitat Jiang N, Bai S, Xu Y, Xing C, Zhou Z, Wu W (2018) Online inter-camera trajectory association exploiting person re-identification and camera topology. MM. Seoul, Korea, pp 1457–1465 Jiang N, Bai S, Xu Y, Xing C, Zhou Z, Wu W (2018) Online inter-camera trajectory association exploiting person re-identification and camera topology. MM. Seoul, Korea, pp 1457–1465
47.
Zurück zum Zitat Zheng L, Shen L, Tian L, Wang S, Wang J, Tian Q (2015) Scalable person re-identification: A benchmark. ICCV. Santiago, Chile, pp 1116–1124 Zheng L, Shen L, Tian L, Wang S, Wang J, Tian Q (2015) Scalable person re-identification: A benchmark. ICCV. Santiago, Chile, pp 1116–1124
48.
Zurück zum Zitat Zheng Z, Zheng L, Yang Y (2017) Unlabeled samples generated by GAN improve the person re-identification baseline in vitro. ICCV. Venice, Italy, pp 3774–3782 Zheng Z, Zheng L, Yang Y (2017) Unlabeled samples generated by GAN improve the person re-identification baseline in vitro. ICCV. Venice, Italy, pp 3774–3782
49.
Zurück zum Zitat Felzenszwalb PF, McAllester DA, Ramanan D (2008) A discriminatively trained, multiscale, deformable part model. In: CVPR, Anchorage, Alaska, USA Felzenszwalb PF, McAllester DA, Ramanan D (2008) A discriminatively trained, multiscale, deformable part model. In: CVPR, Anchorage, Alaska, USA
50.
Zurück zum Zitat Bolle RM, Connell JH, Pankanti S, Ratha NK, Senior AW (2005) The relation between the ROC curve and the CMC. In: Proceedings of the Fourth IEEE workshop on automatic identification advanced technologies, Buffalo,NY, USA Bolle RM, Connell JH, Pankanti S, Ratha NK, Senior AW (2005) The relation between the ROC curve and the CMC. In: Proceedings of the Fourth IEEE workshop on automatic identification advanced technologies, Buffalo,NY, USA
51.
Zurück zum Zitat Zhong Z, Zheng L, Cao D, Li S (2017) Re-ranking person re-identification with k-reciprocal encoding. In: CVPR Zhong Z, Zheng L, Cao D, Li S (2017) Re-ranking person re-identification with k-reciprocal encoding. In: CVPR
Metadaten
Titel
Trajectory Association for Person Re-identification
verfasst von
Dongyang Li
Ruimin Hu
Wenxin Huang
Dengshi Li
Xiaochen Wang
Chenhao Hu
Publikationsdatum
03.06.2021
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 5/2021
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-021-10540-8

Weitere Artikel der Ausgabe 5/2021

Neural Processing Letters 5/2021 Zur Ausgabe