Skip to main content
Erschienen in: International Journal of Multimedia Information Retrieval 4/2017

23.10.2017 | Regular Paper

Multi-frame twin-channel descriptor for person re-identification in real-time surveillance videos

verfasst von: P. K. Sathish, S. Balaji

Erschienen in: International Journal of Multimedia Information Retrieval | Ausgabe 4/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Automatic re-identification of people entering the camera network is an important and challenging task. Multiple frames of the same person will be easily available in surveillance videos for re-identification. Dealing with pose variations of the person in the image and partial occlusion issues is major challenge in single-frame re-identification process. The use of more frames from the surveillance videos can generate robust descriptor to tackle issues of pose variations and occlusion. In this paper, we have emphasized on using multiple frames from the same video to generate a multi-frame twin-channel descriptor. The work deals with building a spatial-temporal descriptor which takes advantage of the twin paths to extract features of the person image. Mahalanobis distance metric learning algorithms is used for matching and evaluation. Our descriptor is evaluated on two benchmark datasets and found to surpass the performance of the existing methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bak S, Corvee E, Bremond F, Thonnat M (2010) Person re-identification using haar-based and dcd-based signature. In: Proceedings of 7th IEEE international confernce on advanced video and signal based surveillance (AVSS), pp 1–8 Bak S, Corvee E, Bremond F, Thonnat M (2010) Person re-identification using haar-based and dcd-based signature. In: Proceedings of 7th IEEE international confernce on advanced video and signal based surveillance (AVSS), pp 1–8
2.
Zurück zum Zitat Bazzani L, Cristani M, Perina A, Farenzena M, Murino V (2010) Multiple-shot person re-identification by HPE signature. In: 20th international conference on pattern recognition (ICPR) Bazzani L, Cristani M, Perina A, Farenzena M, Murino V (2010) Multiple-shot person re-identification by HPE signature. In: 20th international conference on pattern recognition (ICPR)
3.
Zurück zum Zitat Bazzani L, Cristani M, Perina A, Murino V (2012) Multipleshot person re-identification by chromatic and epitomic analyses. Pattern Recogn Lett 33:898–903CrossRef Bazzani L, Cristani M, Perina A, Murino V (2012) Multipleshot person re-identification by chromatic and epitomic analyses. Pattern Recogn Lett 33:898–903CrossRef
4.
Zurück zum Zitat Bingpeng MA, Su Y, Jurie F (2012) Bicov: A novel image representation for person re-identification and face verification. In: British machine vision conference Bingpeng MA, Su Y, Jurie F (2012) Bicov: A novel image representation for person re-identification and face verification. In: British machine vision conference
5.
Zurück zum Zitat Cheng DS, Cristani M, Stoppa M, Bazzani L, Murino V (2011) Custom pictorial structures for re-identification. In: British machine vision conference Cheng DS, Cristani M, Stoppa M, Bazzani L, Murino V (2011) Custom pictorial structures for re-identification. In: British machine vision conference
6.
Zurück zum Zitat Cho Y-J, Yoon K-J (2016) Improving person re-identification via pose-aware multi-shot matching. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1354–1362 Cho Y-J, Yoon K-J (2016) Improving person re-identification via pose-aware multi-shot matching. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1354–1362
7.
Zurück zum Zitat Davis JV, Kulis B, Jain PS, Dhillon IS (2007) Information-theoretic metric learning. In: Proceedings of international conference on machine learning Davis JV, Kulis B, Jain PS, Dhillon IS (2007) Information-theoretic metric learning. In: Proceedings of international conference on machine learning
8.
Zurück zum Zitat Farenzena M, Bazzani L, Perina A, Murino V, Cristani M (2010) Person re-identification by symmetry-driven accumulation of local features. In: IEEE conference on computer vision and pattern recognition Farenzena M, Bazzani L, Perina A, Murino V, Cristani M (2010) Person re-identification by symmetry-driven accumulation of local features. In: IEEE conference on computer vision and pattern recognition
9.
Zurück zum Zitat Gray D, Tao H (2008) Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: European Conference on computer vision. Marseille, France, pp 262–275 Gray D, Tao H (2008) Viewpoint invariant pedestrian recognition with an ensemble of localized features. In: European Conference on computer vision. Marseille, France, pp 262–275
10.
Zurück zum Zitat Hamdoun O, Moutarde F, Stanciulescu B, Steux B (2008) Person re-identification in multi-camera system by signature based on in-terest point descriptors collected on short video sequences. In: ACM international conference on distributed smart cameras, pp 1–6 Hamdoun O, Moutarde F, Stanciulescu B, Steux B (2008) Person re-identification in multi-camera system by signature based on in-terest point descriptors collected on short video sequences. In: ACM international conference on distributed smart cameras, pp 1–6
11.
Zurück zum Zitat Hirzer M, Beleznai C, Roth PM, Bischof H (2011) Person re-identification by descriptive and discriminative classification. In: Proceedings of Scandinavian conference on image analysis (SCIA) Hirzer M, Beleznai C, Roth PM, Bischof H (2011) Person re-identification by descriptive and discriminative classification. In: Proceedings of Scandinavian conference on image analysis (SCIA)
12.
Zurück zum Zitat Hirzer M, Roth PM, Bischof H (2012) Person re-identification by efficient metric learning. In: Proceedings IEEE international conference on advanced video and signal-based surveillance Hirzer M, Roth PM, Bischof H (2012) Person re-identification by efficient metric learning. In: Proceedings IEEE international conference on advanced video and signal-based surveillance
13.
Zurück zum Zitat Ijiri Y, Lao S (2012) Human re-identification through distance metric learning based on Jensen-Shannon Kernel. In: Visapp, (c), pp 603–612 Ijiri Y, Lao S (2012) Human re-identification through distance metric learning based on Jensen-Shannon Kernel. In: Visapp, (c), pp 603–612
14.
Zurück zum Zitat Köostinger M, Hirzer M, Wohlhart P, Roth P M, Bischof H (2012) Large scale metric learning from equivalence constraints. In: Proceedings of IEEE conference on computer vision and pattern recognition Köostinger M, Hirzer M, Wohlhart P, Roth P M, Bischof H (2012) Large scale metric learning from equivalence constraints. In: Proceedings of IEEE conference on computer vision and pattern recognition
15.
Zurück zum Zitat Lowe D (2004) Distinctive image features from scale invariant features. Int J Comput Vis 60:91–110CrossRef Lowe D (2004) Distinctive image features from scale invariant features. Int J Comput Vis 60:91–110CrossRef
16.
Zurück zum Zitat Leng Q, Hu R, Liang C, Wang Y, Chen J (2015) Person re-identification with content and context re-ranking. Multimed Tool Appl 74(17):6989–7014CrossRef Leng Q, Hu R, Liang C, Wang Y, Chen J (2015) Person re-identification with content and context re-ranking. Multimed Tool Appl 74(17):6989–7014CrossRef
17.
Zurück zum Zitat Liao S, Hu Y, Zhu X, Li SZ (2015) Person re-identification by local maximal occurrence representation and metric learning. In: CVPR, IEEE Liao S, Hu Y, Zhu X, Li SZ (2015) Person re-identification by local maximal occurrence representation and metric learning. In: CVPR, IEEE
18.
Zurück zum Zitat Pedagadi S, Orwell J, Velastin S, Boghossian B (2013) Local fisher discriminant analysis for pedestrian re-identification. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, pp 3318–3325 Pedagadi S, Orwell J, Velastin S, Boghossian B (2013) Local fisher discriminant analysis for pedestrian re-identification. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, pp 3318–3325
19.
Zurück zum Zitat Roth PM, Hirzer M, Kstinger M, Beleznai C, Bischof H (2014) Mahalanobis distance learning for person re-identification. Springer, Berlin, pp 247–267CrossRefMATH Roth PM, Hirzer M, Kstinger M, Beleznai C, Bischof H (2014) Mahalanobis distance learning for person re-identification. Springer, Berlin, pp 247–267CrossRefMATH
20.
Zurück zum Zitat Schölkopf B, Smola A, Mller K-R (1998) Nonlinear component analysis as a Kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef Schölkopf B, Smola A, Mller K-R (1998) Nonlinear component analysis as a Kernel eigenvalue problem. Neural Comput 10(5):1299–1319CrossRef
21.
Zurück zum Zitat Schwartz W, Davis LS (2009) Learning discriminative appearance-based models using partial least squares. In: Brazilian symposium on computer graphics and image processing Schwartz W, Davis LS (2009) Learning discriminative appearance-based models using partial least squares. In: Brazilian symposium on computer graphics and image processing
22.
Zurück zum Zitat Štruc V, Pavešic N (2009) Gabor-based Kernel partial-least-squares discrimination features for face recognition. Informatica (Vilnius) 20(1):115–138MATH Štruc V, Pavešic N (2009) Gabor-based Kernel partial-least-squares discrimination features for face recognition. Informatica (Vilnius) 20(1):115–138MATH
23.
Zurück zum Zitat Štruc V, Pavešic N (2010) The complete Gabor-Fisher classifier for robust face recognition, EURASIP Adv Signal Process 26 Štruc V, Pavešic N (2010) The complete Gabor-Fisher classifier for robust face recognition, EURASIP Adv Signal Process 26
25.
Zurück zum Zitat Wang T, Gong S, Zhu X, Wang S (2014) Person re-identification by video ranking. In: European Conference on Computer Vision, Zurich, Switzerland, pp 688–703 Wang T, Gong S, Zhu X, Wang S (2014) Person re-identification by video ranking. In: European Conference on Computer Vision, Zurich, Switzerland, pp 688–703
26.
Zurück zum Zitat Weber M, Buml M, Stiefelhagen R (2011) Part-based clothing segmentation for person retrieval. In: 2011 8th IEEE international conference on advanced video and signal based surveillance, AVSS, pp 361–366 Weber M, Buml M, Stiefelhagen R (2011) Part-based clothing segmentation for person retrieval. In: 2011 8th IEEE international conference on advanced video and signal based surveillance, AVSS, pp 361–366
27.
Zurück zum Zitat Weinberger KQ, Saul LK (2008) Fast solvers and efficient implementations for distance metric learning. In: Proceedings of international conference on machine learning Weinberger KQ, Saul LK (2008) Fast solvers and efficient implementations for distance metric learning. In: Proceedings of international conference on machine learning
28.
Zurück zum Zitat Xiang ZJ, Chen Q, Liu Y (2014) Person re-identification by fuzzy space colour histogram. Multimed Tool Appl 73(1):91–107CrossRef Xiang ZJ, Chen Q, Liu Y (2014) Person re-identification by fuzzy space colour histogram. Multimed Tool Appl 73(1):91–107CrossRef
29.
Zurück zum Zitat Zheng WS, Gong S, Xiang T (2009) Associating groups of people. In: BMVC Zheng WS, Gong S, Xiang T (2009) Associating groups of people. In: BMVC
Metadaten
Titel
Multi-frame twin-channel descriptor for person re-identification in real-time surveillance videos
verfasst von
P. K. Sathish
S. Balaji
Publikationsdatum
23.10.2017
Verlag
Springer London
Erschienen in
International Journal of Multimedia Information Retrieval / Ausgabe 4/2017
Print ISSN: 2192-6611
Elektronische ISSN: 2192-662X
DOI
https://doi.org/10.1007/s13735-017-0136-9

Weitere Artikel der Ausgabe 4/2017

International Journal of Multimedia Information Retrieval 4/2017 Zur Ausgabe