Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3394171.3414056acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Black Re-ID: A Head-shoulder Descriptor for the Challenging Problem of Person Re-Identification

Published: 12 October 2020 Publication History

Abstract

Person re-identification (Re-ID) aims at retrieving an input person image from a set of images captured by multiple cameras. Although recent Re-ID methods have made great success, most of them extract features in terms of the attributes of clothing (e.g., color, texture). However, it is common for people to wear black clothes or be captured by surveillance systems in low light illumination, in which cases the attributes of the clothing are severely missing. We call this problem the Black Re-ID problem. To solve this problem, rather than relying on the clothing information, we propose to exploit head-shoulder features to assist person Re-ID. The head-shoulder adaptive attention network (HAA) is proposed to learn the head-shoulder feature and an innovative ensemble method is designed to enhance the generalization of our model. Given the input person image, the ensemble method would focus on the head-shoulder feature by assigning a larger weight if the individual insides the image is in black clothing. Due to the lack of a suitable benchmark dataset for studying the Black Re-ID problem, we also contribute the first Black-reID dataset, which contains 1274 identities in training set. Extensive evaluations on the Black-reID, Market1501 and DukeMTMC-reID datasets show that our model achieves the best result compared with the state-of-the-art Re-ID methods on both Black and conventional Re-ID problems. Furthermore, our method is also proved to be effective in dealing with person Re-ID in similar clothing. Our code and dataset are avaliable on https://github.com/xbq1994/.

Supplementary Material

MP4 File (3394171.3414056.mp4)
It is common for people to wear black clothes or be captured by surveillance systems in low light illumination, in which cases the attributes of the clothing are severely missing. We call this problem the Black Re-ID problem. To solve this problem, rather than relying on the clothing information, we propose to exploit head-shoulder features to assist person Re-ID. The head-shoulder adaptive attention network is proposed to learn the head-shoulder feature and an innovative ensemble method is designed to enhance the generalization of our model. Given the input person image, the ensemble method would focus on the head-shoulder feature by assigning a larger weight if the individual insides the image is in black clothing. We also contribute the first Black-reID dataset. Extensive evaluations show that our model achieves the best result on both Black and conventional Re-ID problems and in dealing with person Re-ID in similar clothing. Our code and dataset are avaliable on https://github.com/xbq1994/.

References

[1]
Xiang Bai, Mingkun Yang, Tengteng Huang, Zhiyong Dou, Rui Yu, and Yongchao Xu. 2020. Deep-Person: Learning Discriminative Deep Features for Person ReIdentification. Pattern Recognit. 98 (2020).
[2]
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Fei-Fei Li. 2009. ImageNet: A large-scale hierarchical image database. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2009), 248--255.
[3]
Yinzheng Gu, Chuanpeng Li, and Jinbin Xie. 2018. Attention-aware Generalized Mean Pooling for Image Retrieval. ArXiv abs/1811.00202 (2018).
[4]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep Residual Learning for Image Recognition. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016), 770--778.
[5]
Lingxiao He, Jian Liang, Haiqing Li, and Zhenan Sun. 2018. Deep spatial feature reconstruction for partial person re-identification: Alignment-free approach. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7073--7082.
[6]
Lingxiao He, Yinggang Wang, Wu Liu, Xingyu Liao, He Zhao, Zhenan Sun, and Jiashi Feng. 2019. Foreground-aware Pyramid Reconstruction for Alignment-free Occluded Person Re-identification. Computer Vision and Pattern Recognition (CVPR) (2019).
[7]
Alexander Hermans, Lucas Beyer, and Bastian Leibe. 2017. In Defense of the Triplet Loss for Person Re-Identification. ArXiv abs/1703.07737 (2017).
[8]
Max Jaderberg, Karen Simonyan, Andrew Zisserman, and Koray Kavukcuoglu. 2015. Spatial Transformer Networks. In NIPS.
[9]
Mahdi M. Kalayeh, Emrah Basaran, Muhittin Gokmen, Mustafa E. Kamasak, and Mubarak Shah. 2018. Human Semantic Parsing for Person Re-identification. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2018), 1062--1071.
[10]
Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. CoRR abs/1412.6980 (2015).
[11]
Dangwei Li, Xiaotang Chen, Zhang Zhang, and Kaiqi Huang. 2017. Learning Deep Context-Aware Features over Body and Latent Parts for Person Re-identification. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017), 7398--7407.
[12]
Jia Li, Yunpeng Zhai, Yaowei Wang, Yemin Shi, and Yonghong Tian. 2018. MultiPose Learning based Head-Shoulder Re-identification. IEEE Conference on Multimedia Information Processing and Retrieval (MIPR) (2018), 238--243.
[13]
Shuangqun Li, Xinchen Liu, Wu Liu, Huadong Ma, and Haitao Zhang. 2016. A discriminative null space based deep learning approach for person re-identification. In 2016 4th International Conference on Cloud Computing and Intelligence Systems (CCIS).
[14]
Wei Li, Rui Zhao, Tong Xiao, and Xiaogang Wang. 2014. DeepReID: Deep Filter Pairing Neural Network for Person Re-identification. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 152--159.
[15]
Jinxian Liu, Bingbing Ni, Yichao Yan, Peng Zhou, Shuo Cheng, and Jianguo Hu. 2018. Pose Transferrable Person Re-identification. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2018), 4099--4108.
[16]
Jiawei Liu, Zheng-Jun Zha, Di Chen, Richang Hong, and Meng Wang. 2019. Adaptive transfer network for cross-domain person re-identification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7202--7211.
[17]
Jiawei Liu, Zheng-Jun Zha, QI Tian, Dong Liu, Ting Yao, Qiang Ling, and Tao Mei. 2016. Multi-Scale Triplet CNN for Person Re-Identification. In Proceedings of the 24th ACM International Conference on Multimedia. 192--196.
[18]
Hao Luo, W. W. Jiang, Xuan Zhang, Xing Fan, Jingjing Qian, and Chi Zhang. 2019. AlignedReID++: Dynamically matching local information for person reidentification. Pattern Recognit. 94 (2019), 53--61.
[19]
Lei Qi, Jing Huo, Lei Wang, Yinghuan Shi, and Yang Gao. 2018. MaskReID: A Mask Based Deep Ranking Neural Network for Person Re-identification. ArXiv abs/1804.03864 (2018).
[20]
Wei qi Li, Xiatian Zhu, and Shaogang Gong. 2018. Harmonious Attention Network for Person Re-identification. IEEE/CVF Conference on Computer Vision and Pattern Recognition (2018), 2285--2294.
[21]
Xuelin Qian, Yanwei Fu, Tao Xiang, Wenxuan Wang, Jie Qiu, Yang Wu, Yu-Gang Jiang, and Xiangyang Xue. 2018. Pose-Normalized Image Generation for Person Re-identification. In European Conference on Computer Vision (ECCV).
[22]
Ergys Ristani, Francesco Solera, Roger S. Zou, Rita Cucchiara, and Carlo Tomasi. 2016. Performance Measures and a Data Set for Multi-target, Multi-camera Tracking. In European Conference on Computer Vision (ECCV) Workshops.
[23]
Weijian Ruan, Wu Liu, Qian Bao, Jun Chen, Yuhao Cheng, and Tao Mei. 2019. POINet: Pose-Guided Ovonic Insight Network for Multi-Person Pose Tracking. In Proceedings of the 27th ACM International Conference on Multimedia. 284--292.
[24]
M. Saquib Sarfraz, Arne Schumann, Andreas Eberle, and Rainer Stiefelhagen. 2018. A Pose-Sensitive Embedding for Person Re-identification with Expanded Cross Neighborhood Re-ranking. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2018), 420--429.
[25]
Jianlou Si, Honggang Zhang, Chun-Guang Li, Jason Kuen, Xiangfei Kong, Alex Chichung Kot, and Gang Wang. 2018. Dual Attention Matching Network for Context-Aware Feature Sequence Based Person Re-identification. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2018), 5363--5372.
[26]
Chunfeng Song, Ying Huang, Wanli Ouyang, and Liang Wang. 2018. Mask-Guided Contrastive Attention Model for Person Re-identification. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2018), 1179--1188.
[27]
Chi Su, Jianing Li, Shiliang Zhang, Junliang Xing, Wen Gao, and Qi Tian. 2017. Pose-Driven Deep Convolutional Model for Person Re-identification. IEEE International Conference on Computer Vision (ICCV) (2017), 3980--3989.
[28]
Yumin Suh, Jingdong Wang, Siyu Tang, Tao Mei, and Kyoung Mu Lee. 2018. Part-Aligned Bilinear Representations for Person Re-identification. ArXiv abs/1804.07094 (2018).
[29]
Yifan Sun, Liang Zheng, Yi Yang, Qi Tian, and Shengjin Wang. 2018. Beyond Part Models: Person Retrieval with Refined Part Pooling. In European Conference on Computer Vision (ECCV).
[30]
Cheng Wang, Qian Zhang, Chang Huang, Wenyu Liu, and Xinggang Wang. 2018. Mancs: A Multi-task Attentional Network with Curriculum Sampling for Person Re-Identification. In European Conference on Computer Vision (ECCV).
[31]
Guanshuo Wang, Yufeng Yuan, Xiong Chen, Jiwei Li, and Xi Zhou. 2018. Learning Discriminative Features with Multiple Granularities for Person Re-Identification. Proceedings of the 26th ACM international conference on Multimedia (2018).
[32]
Jing Xu, Rui Zhao, Feng Zhu, Huaming Wang, and Wanli Ouyang. 2018. Attention Aware Compositional Network for Person Re-identification. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2018), 2119--2128.
[33]
Li Zhang, Tao Xiang, and Shaogang Gong. 2016. Learning a Discriminative Null Space for Person Re-identification. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016), 1239--1248.
[34]
Xuan Zhang, Hao Luo, Xing Fan, Weilai Xiang, Yixiao Sun, Qiqi Xiao, Wei Jiang, Chi Zhang, and Jian Sun. 2017. Aligned ReID: Surpassing Human-Level Performance in Person Re-Identification. ArXiv abs/1711.08184 (2017).
[35]
Haiyu Zhao, Maoqing Tian, Shuyang Sun, Jing Shao, Junjie Yan, Shuai Yi, Xiaogang Wang, and Xiaoou Tang. 2017. Spindle Net: Person Re-identification with Human Body Region Guided Feature Decomposition and Fusion. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017), 907--915.
[36]
Liming Zhao, Xiao jie Li, Yueting Zhuang, and Jingdong Wang. 2017. Deeply Learned Part-Aligned Representations for Person Re-identification. IEEE International Conference on Computer Vision (ICCV) (2017), 3239--3248.
[37]
Liang Zheng, Yujia Huang, Huchuan Lu, and Yi Yang. 2019. Pose-Invariant Embedding for Deep Person Re-Identification. IEEE Transactions on Image Processing 28 (2019), 4500--4509.
[38]
Liang Zheng, Liyue Shen, Lu Tian, Shengjin Wang, Jingdong Wang, and Qi Tian. 2015. Scalable Person Re-identification: A Benchmark. IEEE International Conference on Computer Vision (ICCV) (2015), 1116--1124.
[39]
Wei-Shi Zheng, Xiang Li, Tao Xiang, Shengcai Liao, Jian-Huang Lai, and Shaogang Gong. 2015. Partial Person Re-Identification. In IEEE International Conference on Computer Vision (ICCV). 4678--4686.
[40]
Wei-Shi Zheng, Xiang Li, Tao Xiang, Shengcai Liao, Jian-Huang Lai, and Shaogang Gong. 2015. Partial Person Re-Identification. IEEE International Conference on Computer Vision (ICCV) (2015), 4678--4686.
[41]
Zhedong Zheng, Liang Zheng, and Yi Yang. 2017. A Discriminatively Learned CNN Embedding for Person Reidentification. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 14 (2017), 1 -- 20.
[42]
Zhun Zhong, Liang Zheng, Donglin Cao, and Shaozi Li. 2017. Re-ranking Person Re-identification with k-Reciprocal Encoding. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017), 3652--3661.
[43]
Zhun Zhong, Liang Zheng, Guoliang Kang, Shaozi Li, and Yi Yang. 2017. Random Erasing Data Augmentation. ArXiv abs/1708.04896 (2017).
[44]
Jiaxuan Zhuo, Zeyu Chen, Jian-Huang Lai, and Guangcong Wang. 2018. Occluded Person Re-Identification. IEEE International Conference on Multimedia and Expo (ICME) (2018), 1--6.

Cited By

View all
  • (2024)Pose-guided node and trajectory construction transformer for occluded person re-identificationJournal of Electronic Imaging10.1117/1.JEI.33.4.04302133:04Online publication date: 1-Jul-2024
  • (2024)Separable Spatial-Temporal Residual Graph for Cloth-Changing Group Re-IdentificationIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.336948346:8(5791-5805)Online publication date: Aug-2024
  • (2024)Identity-Guided Collaborative Learning for Cloth-Changing Person ReidentificationIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.333474146:5(2819-2837)Online publication date: May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '20: Proceedings of the 28th ACM International Conference on Multimedia
October 2020
4889 pages
ISBN:9781450379885
DOI:10.1145/3394171
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 October 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. adaptive attention
  2. black person re-identification
  3. head-shoulder descriptor

Qualifiers

  • Research-article

Funding Sources

  • National Natural Science Foundation of China

Conference

MM '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)20
  • Downloads (Last 6 weeks)0
Reflects downloads up to 31 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Pose-guided node and trajectory construction transformer for occluded person re-identificationJournal of Electronic Imaging10.1117/1.JEI.33.4.04302133:04Online publication date: 1-Jul-2024
  • (2024)Separable Spatial-Temporal Residual Graph for Cloth-Changing Group Re-IdentificationIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.336948346:8(5791-5805)Online publication date: Aug-2024
  • (2024)Identity-Guided Collaborative Learning for Cloth-Changing Person ReidentificationIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.333474146:5(2819-2837)Online publication date: May-2024
  • (2024)Illumination Distillation Framework for Nighttime Person Re-Identification and a New BenchmarkIEEE Transactions on Multimedia10.1109/TMM.2023.326606626(406-419)Online publication date: 2024
  • (2024)AG-ReID.v2: Bridging Aerial and Ground Views for Person Re-IdentificationIEEE Transactions on Information Forensics and Security10.1109/TIFS.2024.335307819(2896-2908)Online publication date: 2024
  • (2024)Key Factors Determining the Required Number of Training Images in Person Re-IdentificationIEEE Access10.1109/ACCESS.2024.346173912(135135-135147)Online publication date: 2024
  • (2024)Same-clothes person re-identification with dual-stream networkMultimedia Systems10.1007/s00530-024-01269-030:2Online publication date: 26-Feb-2024
  • (2024)Rethinking Normalization Layers for Domain Generalizable Person Re-identificationComputer Vision – ECCV 202410.1007/978-3-031-72890-7_16(267-284)Online publication date: 7-Dec-2024
  • (2023)Pedestrian-specific Bipartite-aware Similarity Learning for Text-based Person RetrievalProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3612009(8922-8931)Online publication date: 26-Oct-2023
  • (2023)Multi-Biometric Unified Network for Cloth-Changing Person Re-IdentificationIEEE Transactions on Image Processing10.1109/TIP.2023.327967332(4555-4566)Online publication date: 2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media