Top

International Journal of Multimedia Information Retrieval

Published in:

01-03-2024 | Regular Paper

Augmented inputs for surveillance re-identification

Authors: Rangwan Kasantikul, Worapan Kusakunniran

Published in: International Journal of Multimedia Information Retrieval | Issue 1/2024

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Person Re-Identification (Re-ID) is one of the important applications for Surveillance. However, the performance of Re-ID is dependent on the input quality, which cannot be guaranteed from the surveillance systems. We explored the technique from Gait Re-ID to address viewpoint changes. From our findings, adding horizontally mirrored image into an auxiliary pipeline can achieve a modest performance uplift in our test (0.8% net increase in mean average precision and 0.9% increase in Rank-1 accuracy) in MARS dataset. This extra pipeline can be substituted by Heterogeneous Input Triplet Loss (hiTri) for minimal performance loss. The overall performance of the proposed method outperforms state-of-the-art techniques on well-known datasets. Further investigations on other auxiliary input types are warranted.

previous article Image enhancement with bi-directional normalization and color attention-guided generative adversarial networks

next article Text-assisted attention-based cross-modal hashing

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Zheng L, Yang Y, Hauptmann AG (2016) Person Re-identification: Past, present and future. arXiv. https://doi.org/10.48550/ARXIV.1610.02984

Köstinger M, Hirzer M, Wohlhart P, Roth PM, Bischof H (2012) Large scale metric learning from equivalence constraints. In: 2012 IEEE Conference on computer vision and pattern recognition, pp. 2288–2295. https://doi.org/10.1109/CVPR.2012.6247939

Xing EP, Ng AY, Jordan MI, Russell S (2002) Distance metric learning, with application to clustering with side-information. In: Proceedings of the 15th International conference on neural information processing systems. NIPS’02, pp. 521–528. MIT Press, Cambridge, MA, USA

Forssen PE (2007) Maximally stable colour regions for recognition and matching. In: 2007 IEEE Conference on computer vision and pattern recognition, pp. 1–8. https://doi.org/10.1109/CVPR.2007.383120

Lowe DG (1999) Object recognition from local scale-invariant features. In: Proceedings of the seventh IEEE International conference on computer vision, vol 2, pp 1150–11572. https://doi.org/10.1109/ICCV.1999.790410

Liao S, Hu Y, Zhu X, Li SZ (2015) Person re-identification by local maximal occurrence representation and metric learning. In: 2015 IEEE Conference on computer vision and pattern recognition (CVPR), pp 2197–2206. https://doi.org/10.1109/CVPR.2015.7298832

Gray D, Tao H (2008) Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: Forsyth D, Torr P, Zisserman A (eds) Computer vision—ECCV 2008. Springer, Berlin, Heidelberg, pp 262–275CrossRef

Sathish PK, Balaji S (2018) A complete person re-identification model using kernel-PCA-based gabor-filtered hybrid descriptors. Int J Multimed Inform Retr 7(4):221–229. https://doi.org/10.1007/s13735-018-0153-3CrossRef

Patrikar DR, Parate MR (2022) Anomaly detection using edge computing in video surveillance system: review. Int J Multimed Inform Retr 11(2):85–110. https://doi.org/10.1007/s13735-022-00227-8CrossRef

10.

Schmid C (2001) Constructing models for content-based image retrieval. In: Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition. CVPR 2001, vol 2, https://doi.org/10.1109/CVPR.2001.990922

11.

Fogel I, Sagi D (1989) Gabor filters as texture discriminator. Biol Cybern 61(2):103–113. https://doi.org/10.1007/BF00204594CrossRef

12.

Layne R, Hospedales TM, Gong S (2012) Person re-identification by attributes. In: British machine vision conference

13.

Klaser A, Marszałek M, Schmid C (2008) A spatio-temporal descriptor based on 3d-gradients. In: BMVC 2008-19th British machine vision conference, pp 275–1. British machine vision association

14.

Han J, Bhanu B (2006) Individual recognition using gait energy image. IEEE Trans Pattern Anal Mach Intell 28(2):316–322. https://doi.org/10.1109/TPAMI.2006.38CrossRef

15.

Wang T, Gong S, Zhu X, Wang S (2014) Person re-identification by video ranking. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T (eds) Computer vision—ECCV 2014. Springer, Cham, pp 688–703CrossRef

16.

Dong S, Wang P, Abbas K (2021) A survey on deep learning and its applications. Comput Sci Rev 40:100379. https://doi.org/10.1016/j.cosrev.2021.100379MathSciNetCrossRef

17.

Ye M, Shen J, Lin G, Xiang T, Shao L, Hoi SCH (2022) Deep learning for person re-identification: a survey and outlook. IEEE Trans Pattern Anal Mach Intell 44(6):2872–2893. https://doi.org/10.1109/TPAMI.2021.3054775CrossRef

18.

Gao J, Nevatia R (2018) Revisiting temporal modeling for video-based person reid. CoRR abs/1805.02104

19.

Fu Y, Wang X, Wei Y, Huang TS (2018) STA: spatial-temporal attention for large-scale video-based person re-identification. CoRR abs/1811.04129

20.

Hou R, Ma B, Chang H, Gu X, Shan S, Chen X (2019) VRSTC: occlusion-free video person re-identification. CoRR abs/1907.08427

21.

Ding W, Wei X, Hong X, Gong Y (2020) Complex spatial-temporal attention aggregation for video person re-identification. In: 2020 IEEE International Conference on Image Processing (ICIP), pp 2441–2445. https://doi.org/10.1109/ICIP40778.2020.9191166

22.

Zhang G, Chen Y, Dai Y, Zheng Y, Wu Y (2021) Reference-aided part-aligned feature disentangling for video person re-identification. In: 2021 IEEE International conference on multimedia and expo (ICME), pp 1–6. https://doi.org/10.1109/ICME51207.2021.9428118

23.

Fu H, Zhang K, Li H, Wang J, Wang Z (2022) Spatial temporal and channel aware network for video-based person re-identification. Image Vis Comput 118:104356. https://doi.org/10.1016/j.imavis.2021.104356CrossRef

24.

Zheng L, Bie Z, Sun Y, Wang J, Su C, Wang S, Tian Q (2016) Mars: a video benchmark for large-scale person re-identification. In: Leibe B, Matas J, Sebe N, Welling M (eds) Computer vision—ECCV 2016. Springer, Cham, pp 868–884CrossRef

25.

Sarkar S, Phillips PJ, Liu Z, Vega IR, Grother P, Bowyer KW (2005) The humanid gait challenge problem: data sets, performance, and analysis. IEEE Trans Pattern Anal Mach Intell 27(2):162–177. https://doi.org/10.1109/TPAMI.2005.39CrossRef

26.

Kusakunniran W, Wu Q, Zhang J, Ma Y, Li H (2013) A new view-invariant feature for cross-view gait recognition. IEEE Trans Inf Forensics Secur 8(10):1642–1653. https://doi.org/10.1109/TIFS.2013.2252342CrossRef

27.

Kusakunniran W, Wu Q, Zhang J, Li H, Wang L (2014) Recognizing gaits across views through correlated motion co-clustering. IEEE Trans Image Process 23(2):696–709. https://doi.org/10.1109/TIP.2013.2294552MathSciNetCrossRef

28.

Yao L, Kusakunniran W, Wu Q, Zhang J, Tang Z, Yang W (2021) Robust gait recognition using hybrid descriptors based on skeleton gait energy image. Pattern Recognit Lett 150:289–296. https://doi.org/10.1016/j.patrec.2019.05.012CrossRef

29.

Nambiar A, Bernardino A, Nascimento JC (2019) Gait-based person re-identification: a survey. ACM Comput Surv CSUR 52(2):1–34. https://doi.org/10.1145/3243043CrossRef

30.

Chao H, Wang K, He Y, Zhang J, Feng J (2022) Gaitset: cross-view gait recognition through utilizing gait as a deep set. IEEE Trans Pattern Anal Mach Intell 44(7):3467–3478. https://doi.org/10.1109/TPAMI.2021.3057879CrossRef

31.

Yao L, Kusakunniran W, Wu Q, Zhang J (2021) Gait recognition using a few gait frames. Peer J Comput Sci 7:382. https://doi.org/10.7717/peerj-cs.382CrossRef

32.

Fang HS, Xie S, Tai YW, Lu C (2017) RMPE: Regional multi-person pose estimation. In: ICCV

33.

Li J, Wang C, Zhu H, Mao Y, Fang HS, Lu C (2018) Crowdpose: Efficient crowded scenes pose estimation and a new benchmark. arXiv preprint arXiv:1812.00324

34.

Xiu Y, Li J, Wang H, Fang Y, Lu C (2018) Pose flow: efficient online pose tracking. In: BMVC

35.

Zhu JY, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Computer Vision (ICCV), 2017 IEEE international conference on computer vision pp 2223-2232

36.

Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT press, Cambridge, M.A

37.

Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. CoRR abs/1502.03167

38.

Li M, Zhu X, Gong S (2018) Unsupervised person re-identification by deep learning tracklet association. CoRR abs/1809.02874

39.

Luo H, Gu Y, Liao X, Lai S, Jiang W (2019) Bag of tricks and a strong baseline for deep person re-identification. In: 2019 IEEE/CVF Conference on computer vision and pattern recognition workshops (CVPRW), pp 1487–1495. https://doi.org/10.1109/CVPRW.2019.00190

40.

Hermans A, Beyer L, Leibe B (2017) In defense of the triplet loss for person re-identification. arXiv (2017). https://doi.org/10.48550/ARXIV.1703.07737

41.

Zhang R, Li J, Sun H, Ge Y, Luo P, Wang X, Lin L (2019) Scan: self-and-collaborative attention network for video person re-identification. IEEE Trans Image Process 28(10):4870–4882. https://doi.org/10.1109/TIP.2019.2911488MathSciNetCrossRef

42.

Michael Jones SSR (2019) Body part alignment and temporal attention for video-based person re-identification

43.

Wang X, Zhao X (2019) Temporal regularized spatial attention for video-based person re-identification. In: 2019 IEEE International conference on image processing (ICIP), pp 2249–2253. https://doi.org/10.1109/ICIP.2019.8803321

44.

Ye M, Shen J, Shao L (2021) Visible-infrared person re-identification via homogeneous augmented tri-modal learning. IEEE Trans Inf Forensics Secur 16:728–739. https://doi.org/10.1109/TIFS.2020.3001665

45.

Yim J, Sohn K (2017) Enhancing the performance of convolutional neural networks on quality degraded datasets. CoRR abs/1710.06805

46.

Xu K, Qin M, Sun F, Wang Y, Chen Y, Ren F (2020) Learning in the frequency domain. CoRR abs/2002.12416

Title: Augmented inputs for surveillance re-identification
Authors: Rangwan Kasantikul
Worapan Kusakunniran
Publication date: 01-03-2024
Publisher: Springer London
Published in: International Journal of Multimedia Information Retrieval / Issue 1/2024
Print ISSN: 2192-6611
Electronic ISSN: 2192-662X
DOI: https://doi.org/10.1007/s13735-023-00309-1

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 1/2024

Image enhancement with bi-directional normalization and color attention-guided generative adversarial networks

A new CNN-based semantic object segmentation for autonomous vehicles in urban traffic scenes

An emotion-driven, transformer-based network for multimodal fake news detection

Text-assisted attention-based cross-modal hashing

VERITE: a Robust benchmark for multimodal misinformation detection accounting for unimodal bias

Opinion convergence-based sentiment prediction of image advertisement

Premium Partner