Skip to main content
Top

2020 | OriginalPaper | Chapter

Multi-branch Body Region Alignment Network for Person Re-identification

Authors : Han Fang, Jun Chen, Qi Tian

Published in: MultiMedia Modeling

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Person re-identification (Re-ID) aims to identify the same person images from a gallery set across different cameras. Human pose variations, background clutter and misalignment of detected human images pose challenges for Re-ID tasks. To deal with these issues, we propose a Multi-branch Body Region Alignment Network (MBRAN), to learn discriminative representations for person Re-ID. It consists of two modules, i.e., body region extraction and feature learning. Body region extraction module utilizes a single-person pose estimation method to estimate human keypoints and obtain three body regions. In the feature learning module, four global or local branch-networks share base layers and are designed to learn feature representation on three overlapping body regions and the global image. Extensive experiments have indicated that our method outperforms several state-of-the-art methods on two mainstream person Re-ID datasets.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Xu, J., Zhao, R., Zhu, F., et al.: Attention-aware compositional network for person re-identification. In: CVPR (2018) Xu, J., Zhao, R., Zhu, F., et al.: Attention-aware compositional network for person re-identification. In: CVPR (2018)
2.
go back to reference Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., Tian, Q.: Scalable person re-identification: a benchmark. In: ICCV (2015) Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., Tian, Q.: Scalable person re-identification: a benchmark. In: ICCV (2015)
3.
go back to reference Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D.: Object detection with discriminatively trained partbased models. TPAMI 32(9), 1627–1645 (2010)CrossRef Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D.: Object detection with discriminatively trained partbased models. TPAMI 32(9), 1627–1645 (2010)CrossRef
4.
go back to reference Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: NIPS (2015) Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: NIPS (2015)
5.
go back to reference Zhang, X., et al.: AlignedReID: surpassing human-level performance in person re-identification. arXiv (2017) Zhang, X., et al.: AlignedReID: surpassing human-level performance in person re-identification. arXiv (2017)
6.
go back to reference Yao, H., et al.: Large-scale person re-identication as retrieval. In: ICME (2017) Yao, H., et al.: Large-scale person re-identication as retrieval. In: ICME (2017)
7.
go back to reference Wei, L., Zhang, S., Yao, H., Gao, W., Tian, Q.: GLAD: global-local-alignment descriptor for pedestrian retrieval. In: ACM MM (2017) Wei, L., Zhang, S., Yao, H., Gao, W., Tian, Q.: GLAD: global-local-alignment descriptor for pedestrian retrieval. In: ACM MM (2017)
8.
9.
go back to reference Su, C., Li, J., Zhang, S., Xing, J., Gao, W., Tian, Q.: Pose driven deep convolutional model for person re-identification. In: ICCV (2017) Su, C., Li, J., Zhang, S., Xing, J., Gao, W., Tian, Q.: Pose driven deep convolutional model for person re-identification. In: ICCV (2017)
10.
go back to reference Zhao, L., Li, X., Wang, J., Zhuang, Y.: Deeply-learned part-aligned representations for person re-identification. In: ICCV (2017) Zhao, L., Li, X., Wang, J., Zhuang, Y.: Deeply-learned part-aligned representations for person re-identification. In: ICCV (2017)
11.
go back to reference Zheng, L., Huang, Y., Lu, H., Yang, Y.: Pose invariant embedding for deep person re-identification. arXiv (2017) Zheng, L., Huang, Y., Lu, H., Yang, Y.: Pose invariant embedding for deep person re-identification. arXiv (2017)
12.
go back to reference Saquib Sarfraz, M., Schumann, A., Eberle, A., Stiefelhagen, R.: A pose-sensitive embedding for person reidentification with expanded cross neighborhood re-ranking. In: CVPR (2018) Saquib Sarfraz, M., Schumann, A., Eberle, A., Stiefelhagen, R.: A pose-sensitive embedding for person reidentification with expanded cross neighborhood re-ranking. In: CVPR (2018)
13.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: NIPS (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: NIPS (2012)
14.
go back to reference Liao, S., Hu, Y., Zhu, X., Li, S.Z.: Person reidentification by local maximal occurrence representation and metric learning. In: CVPR (2015) Liao, S., Hu, Y., Zhu, X., Li, S.Z.: Person reidentification by local maximal occurrence representation and metric learning. In: CVPR (2015)
15.
go back to reference Yi, D., Lei, Z., Liao, S., Li, S.Z.: Deep metric learning for person re-identification. In: ICPR (2014) Yi, D., Lei, Z., Liao, S., Li, S.Z.: Deep metric learning for person re-identification. In: ICPR (2014)
16.
go back to reference Zhang, L., Xiang, T., Gong, S.: Learning a discriminative null space for person re-identification. In: CVPR (2016) Zhang, L., Xiang, T., Gong, S.: Learning a discriminative null space for person re-identification. In: CVPR (2016)
17.
go back to reference Zheng, L., Yang, Y., Hauptmann, A.G.: Person reidentification: past, present and future. arXiv (2016) Zheng, L., Yang, Y., Hauptmann, A.G.: Person reidentification: past, present and future. arXiv (2016)
18.
go back to reference Li, W., Zhao, R., Xiao, T., Wang, X.: DeepReID: deep filter pairing neural network for person re-identification. In: CVPR (2014) Li, W., Zhao, R., Xiao, T., Wang, X.: DeepReID: deep filter pairing neural network for person re-identification. In: CVPR (2014)
19.
go back to reference Su, C., Li, J., Zhang, S., Xing, J., Gao, W., Tian, Q.: Posedriven deep convolutional model for person re-identification. In: ICCV (2017) Su, C., Li, J., Zhang, S., Xing, J., Gao, W., Tian, Q.: Posedriven deep convolutional model for person re-identification. In: ICCV (2017)
20.
go back to reference Bai, X., Yang, M., Huang, T., Dou, Z., Yu, R., Xu, Y.: DeepPerson: learning discriminative deep features for person re-identification. arXiv (2017) Bai, X., Yang, M., Huang, T., Dou, Z., Yu, R., Xu, Y.: DeepPerson: learning discriminative deep features for person re-identification. arXiv (2017)
22.
go back to reference Chen, Y., Shen, C., Wei, X.-S., Liu, L., Yang, J.: Adversarial PoseNet: a structure-aware convolutional network for human pose estimation. In: ICCV (2017) Chen, Y., Shen, C., Wei, X.-S., Liu, L., Yang, J.: Adversarial PoseNet: a structure-aware convolutional network for human pose estimation. In: ICCV (2017)
23.
go back to reference Cao, Z., Simon, T., Wei, S.-E., Sheikh, Y.: Realtime multiperson 2D pose estimation using part affinity fields. In: CVPR (2017) Cao, Z., Simon, T., Wei, S.-E., Sheikh, Y.: Realtime multiperson 2D pose estimation using part affinity fields. In: CVPR (2017)
24.
go back to reference Nie, X.: Human pose estimation with parsing induced learner. In: CVPR (2018) Nie, X.: Human pose estimation with parsing induced learner. In: CVPR (2018)
25.
go back to reference Szegedy, C., et al.: Going deeper with convolutions. In: CVPR (2015) Szegedy, C., et al.: Going deeper with convolutions. In: CVPR (2015)
26.
go back to reference Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv (2014) Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv (2014)
27.
go back to reference Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: CVPR (2016) Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: CVPR (2016)
28.
go back to reference Hermans, A., Beyer, L., Leibe, B.: In defense of the triplet loss for person re-identification. arXiv (2017) Hermans, A., Beyer, L., Leibe, B.: In defense of the triplet loss for person re-identification. arXiv (2017)
29.
go back to reference Gong, K., Liang, X., Shen, X., Lin, L.: Look into person: self-supervised structure-sensitive learning and a new benchmark for human parsing. In: CVPR (2017) Gong, K., Liang, X., Shen, X., Lin, L.: Look into person: self-supervised structure-sensitive learning and a new benchmark for human parsing. In: CVPR (2017)
31.
go back to reference Zheng, Z., Zheng, L., Yang, Y.: Unlabeled samples generated by GAN improve the person re-identification baseline in vitro. arXiv (2017) Zheng, Z., Zheng, L., Yang, Y.: Unlabeled samples generated by GAN improve the person re-identification baseline in vitro. arXiv (2017)
32.
go back to reference Li, W., Zhu, X., Gong, S.: Harmonious attention network for person re-identification. In: CVPR (2018) Li, W., Zhu, X., Gong, S.: Harmonious attention network for person re-identification. In: CVPR (2018)
33.
34.
go back to reference Zhao, L., Li, X., Zhuang, Y., Wang, J.: Deeply-learned part-aligned representations for person re-identification. In: ICCV (2017) Zhao, L., Li, X., Zhuang, Y., Wang, J.: Deeply-learned part-aligned representations for person re-identification. In: ICCV (2017)
35.
go back to reference Sun, Y., Zheng, L., Deng, W., Wang, S.: SVDNet for pedestrian retrieval. In: ICCV (2017) Sun, Y., Zheng, L., Deng, W., Wang, S.: SVDNet for pedestrian retrieval. In: ICCV (2017)
36.
go back to reference Ruan, W., Liu, W., Bao, Q., Chen, J., Cheng, Y., Mei, T.: POINet: pose-guided ovonic insight network for multi-person pose tracking. In: ACM MM (2019) Ruan, W., Liu, W., Bao, Q., Chen, J., Cheng, Y., Mei, T.: POINet: pose-guided ovonic insight network for multi-person pose tracking. In: ACM MM (2019)
Metadata
Title
Multi-branch Body Region Alignment Network for Person Re-identification
Authors
Han Fang
Jun Chen
Qi Tian
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-37731-1_28