Skip to main content
Top
Published in: International Journal of Multimedia Information Retrieval 4/2017

23-10-2017 | Regular Paper

Multi-frame twin-channel descriptor for person re-identification in real-time surveillance videos

Authors: P. K. Sathish, S. Balaji

Published in: International Journal of Multimedia Information Retrieval | Issue 4/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Automatic re-identification of people entering the camera network is an important and challenging task. Multiple frames of the same person will be easily available in surveillance videos for re-identification. Dealing with pose variations of the person in the image and partial occlusion issues is major challenge in single-frame re-identification process. The use of more frames from the surveillance videos can generate robust descriptor to tackle issues of pose variations and occlusion. In this paper, we have emphasized on using multiple frames from the same video to generate a multi-frame twin-channel descriptor. The work deals with building a spatial-temporal descriptor which takes advantage of the twin paths to extract features of the person image. Mahalanobis distance metric learning algorithms is used for matching and evaluation. Our descriptor is evaluated on two benchmark datasets and found to surpass the performance of the existing methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Bak S, Corvee E, Bremond F, Thonnat M (2010) Person re-identification using haar-based and dcd-based signature. In: Proceedings of 7th IEEE international confernce on advanced video and signal based surveillance (AVSS), pp 1–8 Bak S, Corvee E, Bremond F, Thonnat M (2010) Person re-identification using haar-based and dcd-based signature. In: Proceedings of 7th IEEE international confernce on advanced video and signal based surveillance (AVSS), pp 1–8
2.
go back to reference Bazzani L, Cristani M, Perina A, Farenzena M, Murino V (2010) Multiple-shot person re-identification by HPE signature. In: 20th international conference on pattern recognition (ICPR) Bazzani L, Cristani M, Perina A, Farenzena M, Murino V (2010) Multiple-shot person re-identification by HPE signature. In: 20th international conference on pattern recognition (ICPR)
3.
go back to reference Bazzani L, Cristani M, Perina A, Murino V (2012) Multipleshot person re-identification by chromatic and epitomic analyses. Pattern Recogn Lett 33:898–903CrossRef Bazzani L, Cristani M, Perina A, Murino V (2012) Multipleshot person re-identification by chromatic and epitomic analyses. Pattern Recogn Lett 33:898–903CrossRef
4.
go back to reference Bingpeng MA, Su Y, Jurie F (2012) Bicov: A novel image representation for person re-identification and face verification. In: British machine vision conference Bingpeng MA, Su Y, Jurie F (2012) Bicov: A novel image representation for person re-identification and face verification. In: British machine vision conference
5.
go back to reference Cheng DS, Cristani M, Stoppa M, Bazzani L, Murino V (2011) Custom pictorial structures for re-identification. In: British machine vision conference Cheng DS, Cristani M, Stoppa M, Bazzani L, Murino V (2011) Custom pictorial structures for re-identification. In: British machine vision conference
6.
go back to reference Cho Y-J, Yoon K-J (2016) Improving person re-identification via pose-aware multi-shot matching. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1354–1362 Cho Y-J, Yoon K-J (2016) Improving person re-identification via pose-aware multi-shot matching. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1354–1362
7.
go back to reference Davis JV, Kulis B, Jain PS, Dhillon IS (2007) Information-theoretic metric learning. In: Proceedings of international conference on machine learning Davis JV, Kulis B, Jain PS, Dhillon IS (2007) Information-theoretic metric learning. In: Proceedings of international conference on machine learning
8.
go back to reference Farenzena M, Bazzani L, Perina A, Murino V, Cristani M (2010) Person re-identification by symmetry-driven accumulation of local features. In: IEEE conference on computer vision and pattern recognition Farenzena M, Bazzani L, Perina A, Murino V, Cristani M (2010) Person re-identification by symmetry-driven accumulation of local features. In: IEEE conference on computer vision and pattern recognition
9.
go back to reference Gray D, Tao H (2008) Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: European Conference on computer vision. Marseille, France, pp 262–275 Gray D, Tao H (2008) Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: European Conference on computer vision. Marseille, France, pp 262–275
10.
go back to reference Hamdoun O, Moutarde F, Stanciulescu B, Steux B (2008) Person re-identification in multi-camera system by signature based on in-terest point descriptors collected on short video sequences. In: ACM international conference on distributed smart cameras, pp 1–6 Hamdoun O, Moutarde F, Stanciulescu B, Steux B (2008) Person re-identification in multi-camera system by signature based on in-terest point descriptors collected on short video sequences. In: ACM international conference on distributed smart cameras, pp 1–6
11.
go back to reference Hirzer M, Beleznai C, Roth PM, Bischof H (2011) Person re-identification by descriptive and discriminative classification. In: Proceedings of Scandinavian conference on image analysis (SCIA) Hirzer M, Beleznai C, Roth PM, Bischof H (2011) Person re-identification by descriptive and discriminative classification. In: Proceedings of Scandinavian conference on image analysis (SCIA)
12.
go back to reference Hirzer M, Roth PM, Bischof H (2012) Person re-identification by efficient metric learning. In: Proceedings IEEE international conference on advanced video and signal-based surveillance Hirzer M, Roth PM, Bischof H (2012) Person re-identification by efficient metric learning. In: Proceedings IEEE international conference on advanced video and signal-based surveillance
13.
go back to reference Ijiri Y, Lao S (2012) Human re-identification through distance metric learning based on Jensen-Shannon Kernel. In: Visapp, (c), pp 603–612 Ijiri Y, Lao S (2012) Human re-identification through distance metric learning based on Jensen-Shannon Kernel. In: Visapp, (c), pp 603–612
14.
go back to reference Köostinger M, Hirzer M, Wohlhart P, Roth P M, Bischof H (2012) Large scale metric learning from equivalence constraints. In: Proceedings of IEEE conference on computer vision and pattern recognition Köostinger M, Hirzer M, Wohlhart P, Roth P M, Bischof H (2012) Large scale metric learning from equivalence constraints. In: Proceedings of IEEE conference on computer vision and pattern recognition
15.
go back to reference Lowe D (2004) Distinctive image features from scale invariant features. Int J Comput Vis 60:91–110CrossRef Lowe D (2004) Distinctive image features from scale invariant features. Int J Comput Vis 60:91–110CrossRef
16.
go back to reference Leng Q, Hu R, Liang C, Wang Y, Chen J (2015) Person re-identification with content and context re-ranking. Multimed Tool Appl 74(17):6989–7014CrossRef Leng Q, Hu R, Liang C, Wang Y, Chen J (2015) Person re-identification with content and context re-ranking. Multimed Tool Appl 74(17):6989–7014CrossRef
17.
go back to reference Liao S, Hu Y, Zhu X, Li SZ (2015) Person re-identification by local maximal occurrence representation and metric learning. In: CVPR, IEEE Liao S, Hu Y, Zhu X, Li SZ (2015) Person re-identification by local maximal occurrence representation and metric learning. In: CVPR, IEEE
18.
go back to reference Pedagadi S, Orwell J, Velastin S, Boghossian B (2013) Local fisher discriminant analysis for pedestrian re-identification. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, pp 3318–3325 Pedagadi S, Orwell J, Velastin S, Boghossian B (2013) Local fisher discriminant analysis for pedestrian re-identification. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, pp 3318–3325
19.
go back to reference Roth PM, Hirzer M, Kstinger M, Beleznai C, Bischof H (2014) Mahalanobis distance learning for person re-identification. Springer, Berlin, pp 247–267CrossRefMATH Roth PM, Hirzer M, Kstinger M, Beleznai C, Bischof H (2014) Mahalanobis distance learning for person re-identification. Springer, Berlin, pp 247–267CrossRefMATH
20.
go back to reference Schölkopf B, Smola A, Mller K-R (1998) Nonlinear component analysis as a Kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef Schölkopf B, Smola A, Mller K-R (1998) Nonlinear component analysis as a Kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef
21.
go back to reference Schwartz W, Davis LS (2009) Learning discriminative appearance-based models using partial least squares. In: Brazilian symposium on computer graphics and image processing Schwartz W, Davis LS (2009) Learning discriminative appearance-based models using partial least squares. In: Brazilian symposium on computer graphics and image processing
22.
go back to reference Štruc V, Pavešic N (2009) Gabor-based Kernel partial-least-squares discrimination features for face recognition. Informatica (Vilnius) 20(1):115–138MATH Štruc V, Pavešic N (2009) Gabor-based Kernel partial-least-squares discrimination features for face recognition. Informatica (Vilnius) 20(1):115–138MATH
23.
go back to reference Štruc V, Pavešic N (2010) The complete Gabor-Fisher classifier for robust face recognition, EURASIP Adv Signal Process 26 Štruc V, Pavešic N (2010) The complete Gabor-Fisher classifier for robust face recognition, EURASIP Adv Signal Process 26
25.
go back to reference Wang T, Gong S, Zhu X, Wang S (2014) Person re-identification by video ranking. In: European Conference on Computer Vision, Zurich, Switzerland, pp 688–703 Wang T, Gong S, Zhu X, Wang S (2014) Person re-identification by video ranking. In: European Conference on Computer Vision, Zurich, Switzerland, pp 688–703
26.
go back to reference Weber M, Buml M, Stiefelhagen R (2011) Part-based clothing segmentation for person retrieval. In: 2011 8th IEEE international conference on advanced video and signal based surveillance, AVSS, pp 361–366 Weber M, Buml M, Stiefelhagen R (2011) Part-based clothing segmentation for person retrieval. In: 2011 8th IEEE international conference on advanced video and signal based surveillance, AVSS, pp 361–366
27.
go back to reference Weinberger KQ, Saul LK (2008) Fast solvers and efficient implementations for distance metric learning. In: Proceedings of international conference on machine learning Weinberger KQ, Saul LK (2008) Fast solvers and efficient implementations for distance metric learning. In: Proceedings of international conference on machine learning
28.
go back to reference Xiang ZJ, Chen Q, Liu Y (2014) Person re-identification by fuzzy space colour histogram. Multimed Tool Appl 73(1):91–107CrossRef Xiang ZJ, Chen Q, Liu Y (2014) Person re-identification by fuzzy space colour histogram. Multimed Tool Appl 73(1):91–107CrossRef
29.
go back to reference Zheng WS, Gong S, Xiang T (2009) Associating groups of people. In: BMVC Zheng WS, Gong S, Xiang T (2009) Associating groups of people. In: BMVC
Metadata
Title
Multi-frame twin-channel descriptor for person re-identification in real-time surveillance videos
Authors
P. K. Sathish
S. Balaji
Publication date
23-10-2017
Publisher
Springer London
Published in
International Journal of Multimedia Information Retrieval / Issue 4/2017
Print ISSN: 2192-6611
Electronic ISSN: 2192-662X
DOI
https://doi.org/10.1007/s13735-017-0136-9

Other articles of this Issue 4/2017

International Journal of Multimedia Information Retrieval 4/2017 Go to the issue

Premium Partner