nach oben

International Journal of Computer Vision

Erschienen in:

08.01.2020

Fine-Grained Person Re-identification

verfasst von: Jiahang Yin, Ancong Wu, Wei-Shi Zheng

Erschienen in: International Journal of Computer Vision | Ausgabe 6/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Person re-identification (re-id) plays a critical role in tracking people via surveillance systems by matching people across non-overlapping camera views at different locations. Although most re-id methods largely depend on the appearance features of a person, such methods always assume that the appearance information (particularly color) is distinguishable. However, distinguishing people who dress in very similar clothes (especially the same type of clothes, e.g. uniform) is ineffective if relying only on appearance cues. We call this problem the fine-grained person re-identification (FG re-id) problem. To solve this problem, rather than relying on clothing color, we propose to exploit two types of local dynamic pose features: motion-attentive local dynamic pose feature and joint-specific local dynamic pose feature. They are complementary to each other and describe identity-specific pose characteristics, which are found to be more unique and discriminative against similar appearance between people. A deep neural network is formed to learn these local dynamic pose features and to jointly quantify motion and global visual cues. Due to the lack of a suitable benchmark dataset for evaluating the FG re-id problem, we also contribute a fine-grained person re-identification (FGPR) dataset, which contains 358 identities. Extensive evaluations on the FGPR dataset show that our proposed model achieves the best performance compared with related person re-id and fine-grained recognition methods for FG re-id. In addition, we verify that our method is still effective for conventional video-based person re-id.

Vorheriger Artikel Scalable Person Re-Identification by Harmonious Attention

Nächster Artikel Siamese Dense Network for Reflection Removal with Flash and No-Flash Image Pairs

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Ahmed, E., Jones, M., & Marks, T. K. (2015). An improved deep learning architecture for person re-identification. In CVPR.

Branson, S., Van Horn, G., Belongie, S., & Perona, P. (2014). Bird species categorization using pose normalized deep convolutional nets. arXiv preprint arXiv:1406.2952.

Cao, Z., Simon, T., Wei, S. E., & Sheikh, Y. (2017). Realtime multi-person 2D pose estimation using part affinity fields. In CVPR.

Cheng, D. S., Cristani, M., Stoppa, M., Bazzani, L., & Murino, V. (2011). Custom pictorial structures for re-identification. In BMVC.

Chung, D., Tahboub, K., & Delp, E. J. (2017). A two stream siamese convolutional neural network for person re-identification. In CVPR.

Dai, J., Zhang, P., Wang, D., Lu, H., & Wang, H. (2018). Video person re-identification by temporal residual learning. IEEE Transactions on Image Processing, 28, 1366–1377.MathSciNetCrossRef

Dalal, N., & Triggs, B. (2005). Histograms of oriented gradients for human detection. In CVPR.

Farenzena, M., Bazzani, L., Perina, A., Murino, V., & Cristani, M. (2010). Person re-identification by symmetry-driven accumulation of local features. In CVPR.

Fu, J., Zheng, H., & Mei, T. (2017). Look closer to see better: Recurrent attention convolutional neural network for fine-grained image recognition. In CVPR.

Ge, Y., Li, Z., Zhao, H., Yin, G., Yi, S., Wang, X., et al. (2018). FD-GAN: Pose-guided feature distilling GAN for robust person re-identification. In NIPS.

Gou, M., Zhang, X., Rates-Borras, A., Asghari-Esfeden, S., Sznaier, M., & Camps, O. (2016). Person re-identification in appearance impaired scenarios. In BMVC.

Gray, D., Brennan, S., & Tao, H. (2007). Evaluating appearance models for recognition, reacquisition, and tracking. In PETS.

Guo, Z., Zhang, L., & Zhang, D. (2010). A completed modeling of local binary pattern operator for texture classification. IEEE Transactions on Image Processing, 19, 1657–1663.MathSciNetCrossRef

He, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017). Mask R-CNN. In ICCV.

He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In CVPR.

Hirzer, M., Beleznai, C., Roth, P. M., & Bischof, H. (2011). Person re-identification by descriptive and discriminative classification. In SCIA.

Huang, S., Xu, Z., Tao, D., & Zhang, Y. (2016). Part-stacked CNN for fine-grained visual categorization. In CVPR.

Johnson, J., Karpathy, A., & Fei-Fei, L. (2016). DenseCap: Fully convolutional localization networks for dense captioning. In CVPR.

Koestinger, M., Hirzer, M., Wohlhart, P., Roth, P. M., & Bischof, H. (2012). Large scale metric learning from equivalence constraints. In CVPR.

Kviatkovsky, I., Adam, A., & Rivlin, E. (2013). Color invariants for person reidentification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 1622–1634.CrossRef

Li, S., Bak, S., Carr, P., & Wang, X. (2018a). Diversity regularized spatiotemporal attention for video-based person re-identification. In CVPR.

Li, W., Zhao, R., & Wang, X. (2012). Human reidentification with transferred metric learning. In ACCV.

Li, W., Zhao, R., Xiao, T., & Wang, X. (2014). DeepReID: Deep filter pairing neural network for person re-identification. In CVPR.

Li, W., Zhu, X., & Gong, S. (2018b). Harmonious attention network for person re-identification. arXiv preprint arXiv:1802.08122.

Li, Z., Chang, S., Liang, F., Huang, T. S., Cao, L., & Smith, J. R. (2013). Learning locally-adaptive decision functions for person verification. In CVPR.

Liao, S., Hu, Y., Zhu, X., & Li, S. Z. (2015). Person re-identification by local maximal occurrence representation and metric learning. In CVPR.

Lin, T. Y., RoyChowdhury, A., & Maji, S. (2015). Bilinear CNN models for fine-grained visual recognition. In ICCV.

Liu, J., Ni, B., Yan, Y., Zhou, P., & Cheng, S., Hu, J. (2018). Pose transferrable person re-identification. In CVPR.

Liu, X., Wang, J., Wen, S., Ding, E., & Lin, Y. (2017a). Localizing by describing: Attribute-guided attention localization for fine-grained recognition. In AAAI.

Liu, X., Zhao, H., Tian, M., Sheng, L., Shao, J., et al. (2017b). Hydraplus-net: Attentive deep features for pedestrian analysis. arXiv preprint arXiv:1709.09930.

Liu, Y., Yan, J., & Ouyang, W. (2017c). Quality aware network for set to set recognition. In CVPR.

Liu, Y., Yuan, Z., Zhou, W., & Li, H. (2019). Spatial and temporal mutual promotion for video-based person re-identification. In AAAI.

Makihara, Y., Suzuki, A., Muramatsu, D., Li, X., & Yagi, Y. (2017). Joint intensity and spatial metric learning for robust gait recognition. In CVPR.

Matsukawa, T., Okabe, T., Suzuki, E., & Sato, Y. (2016). Hierarchical gaussian descriptor for person re-identification. In CVPR.

Pumarola, A., Agudo, A., Sanfeliu, A., & Moreno-Noguer, F. (2018). Unsupervised person image synthesis in arbitrary poses. In CVPR.

Qian, X., Fu, Y., Wang, W., Xiang, T., Wu, Y., Jiang, Y. G., & Xue, X. (2017). Pose-normalized image generation for person re-identification. arXiv preprint arXiv:1712.02225.

Rida, I., Jiang, X., & Marcialis, G. L. (2016). Human body part selection by group lasso of motion for model-free gait recognition. IEEE Signal Processing Letters, 23, 154–158.CrossRef

Ristani, E., Solera, F., Zou, R., Cucchiara, R., & Tomasi, C. (2016). Performance measures and a data set for multi-target, multi-camera tracking. In ECCV.

Si, J., Zhang, H., Li, C. G., Kuen, J., Kong, X., Kot, A. C., & Wang, G. (2018). Dual attention matching network for context-aware feature sequence based person re-identification. arXiv preprint arXiv:1803.09937.

Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556.

Song, G., Leng, B., Liu, Y., Hetang, C., & Cai, S. (2017). Region-based quality estimation network for large-scale person re-identification. arXiv preprint arXiv:1711.08766.

Su, C., Li, J., Zhang, S., Xing, J., Gao, W., & Tian, Q. (2017). Pose-driven deep convolutional model for person re-identification. In ICCV (pp. 3980–3989). IEEE.

Sun, S., Kuang, Z., Sheng, L., Ouyang, W., & Zhang, W. (2018). Optical flow guided feature: A fast and robust motion representation for video action recognition. In CVPR.

Sun, Y., Zheng, L., Yang, Y., Tian, Q., & Wang, S. (2017). Beyond part models: Person retrieval with refined part pooling. arXiv preprint arXiv:1711.09349.

Wang, T., Gong, S., Zhu, X., & Wang, S. (2014). Person re-identification by video ranking. In ECCV. Springer.

Wei, L., Zhang, S., Gao, W., & Tian, Q. (2018). Person transfer GAN to bridge domain gap for person re-identification. In CVPR.

Wei, L., Zhang, S., Yao, H., Gao, W., & Tian, Q. (2017). GLAD: Global-local-alignment descriptor for pedestrian retrieval. In ACM MM.

Wu, L., Wang, Y., Gao, J., & Li, X. (2018). Where-and-when to look: Deep siamese attention networks for video-based person re-identification. IEEE Transactions on Multimedia, 21, 1412–1424.CrossRef

Wu, L., Wang, Y., Shao, L., & Wang, M. (2019). 3-D person VLAD: Learning deep global representations for video-based person reidentification. IEEE Transactions on Neural Networks and Learning Systems, 30, 3347–3359.CrossRef

Wu, Y., Lin, Y., Dong, X., Yan, Y., Ouyang, W., & Yang, Y. (2018). Exploit the unknown gradually: One-shot video-based person re-identification by stepwise learning. In CVPR.

Wu, Z., Huang, Y., Wang, L., Wang, X., & Tan, T. (2017). A comprehensive study on cross-view gait based human identification with deep CNNs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 209–226.CrossRef

Xiao, T., Li, H., Ouyang, W., & Wang, X. (2016). Learning deep feature representations with domain guided dropout for person re-identification. In CVPR.

Xu, S., Cheng, Y., Gu, K., Yang, Y., Chang, S., & Zhou, P. (2017). Jointly attentive spatial-temporal pooling networks for video-based person re-identification. arXiv preprint arXiv:1708.02286.

Ye, M., Li, J., Ma, A. J., Zheng, L., & Yuen, P. C. (2019). Dynamic graph co-matching for unsupervised video-based person re-identification. IEEE Transactions on Image Processing, 28, 2976–2990.MathSciNetCrossRef

Yi, D., Lei, Z., Liao, S., & Li, S. Z. (2014). Deep metric learning for person re-identification. In ICPR.

You, J., Wu, A., Li, X., & Zheng, W. S. (2016). Top-push video-based person re-identification. In CVPR.

Zhang, W., He, X., Lu, W., Qiao, H., & Li, Y. (2019). Feature aggregation with reinforcement learning for video-based person re-identification. IEEE Transactions on Neural Networks and Learning Systems. https://doi.org/10.1109/TNNLS.2019.2899588.CrossRef

Zhang, X., Xiong, H., Zhou, W., Lin, W., & Tian, Q. (2016). Picking deep filter responses for fine-grained image recognition. In CVPR.

Zhao, H., Tian, M., Sun, S., Shao, J., Yan, J., Yi, S., Wang, X., & Tang, X. (2017). Spindle net: Person re-identification with human body region guided feature decomposition and fusion. In CVPR.

Zhao, R., Ouyang, W., & Wang, X. (2013). Unsupervised salience learning for person re-identification. In CVPR.

Zheng, H., Fu, J., Mei, T., & Luo, J. (2017). Learning multi-attention convolutional neural network for fine-grained image recognition. In ICCV.

Zheng, L., Bie, Z., Sun, Y., Wang, J., Su, C., Wang, S., et al. (2016). Mars: A video benchmark for large-scale person re-identification. In ECCV. Springer.

Zheng, L., Shen, L., Tian, L., Wang, S., Wang, J., & Tian, Q. (2015). Scalable person re-identification: A benchmark. In CVPR.

Zheng, L., Zhang, H., Sun, S., Chandraker, M., Yang, Y., Tian, Q., et al. (2017). Person re-identification in the wild. In CVPR.

Zheng, W. S., Gong, S., & Xiang, T. (2013). Reidentification by relative distance comparison. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 653–668.CrossRef

Zhou, Z., Huang, Y., Wang, W., Wang, L., & Tan, T. (2017). See the forest for the trees: Joint spatial and temporal recurrent neural networks for video-based person re-identification. In CVPR.

Zhu, X., Jing, X. Y., You, X., Zhang, X., & Zhang, T. (2018). Video-based person re-identification by simultaneously learning intra-video and inter-video distance metrics. IEEE Transactions on Image Processing, 27, 5683–5695.MathSciNetCrossRef

Titel: Fine-Grained Person Re-identification
verfasst von: Jiahang Yin
Ancong Wu
Wei-Shi Zheng
Publikationsdatum: 08.01.2020
Verlag: Springer US
Erschienen in: International Journal of Computer Vision / Ausgabe 6/2020
Print ISSN: 0920-5691
Elektronische ISSN: 1573-1405
DOI: https://doi.org/10.1007/s11263-019-01259-0

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Weitere Artikel der Ausgabe 6/2020

Multi-task Generative Adversarial Network for Detecting Small Objects in the Wild

Discriminative Training of Conditional Random Fields with Probably Submodular Constraints

A Face Fairness Framework for 3D Meshes

Gated Fusion Network for Degraded Image Super Resolution

Siamese Dense Network for Reflection Removal with Flash and No-Flash Image Pairs

Visual Social Relationship Recognition