Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Open access

Pair-based Uncertainty and Diversity Promoting Early Active Learning for Person Re-identification

Published: 27 January 2020 Publication History

Abstract

The effective training of supervised Person Re-identification (Re-ID) models requires sufficient pairwise labeled data. However, when there is limited annotation resource, it is difficult to collect pairwise labeled data. We consider a challenging and practical problem called Early Active Learning, which is applied to the early stage of experiments when there is no pre-labeled sample available as references for human annotating. Previous early active learning methods suffer from two limitations for Re-ID. First, these instance-based algorithms select instances rather than pairs, which can result in missing optimal pairs for Re-ID. Second, most of these methods only consider the representativeness of instances, which can result in selecting less diverse and less informative pairs. To overcome these limitations, we propose a novel pair-based active learning for Re-ID. Our algorithm selects pairs instead of instances from the entire dataset for annotation. Besides representativeness, we further take into account the uncertainty and the diversity in terms of pairwise relations. Therefore, our algorithm can produce the most representative, informative, and diverse pairs for Re-ID data annotation. Extensive experimental results on five benchmark Re-ID datasets have demonstrated the superiority of the proposed pair-based early active learning algorithm.

References

[1]
D. S. Cheng, M. Cristani, M. Stoppa, L. Bazzani, and V. Murino. 2011. Custom pictorial structures for re-identification. In Proceedings of the British Machine Vision Conference (BMVC).
[2]
Frédéric Delbos and Jean Charles Gilbert. 2003. Global Linear Convergence of an Augmented Lagrangian Algorithm for Solving Convex Quadratic Optimization Problems. Ph.D. Dissertation. INRIA.
[3]
Guodong Ding, Shanshan Zhang, Salman Khan, Zhenmin Tang, Jian Zhang, and Fatih Porikli. 2019. Feature affinity based pseudo labeling for semi-supervised person re-identification. IEEE Transactions on Multimedia 21, 11 (2019), 2891--2902.
[4]
Hehe Fan, Liang Zheng, Chenggang Yan, and Yi Yang. 2018. Unsupervised person re-identification: Clustering and fine-tuning. ACM Transations on Multimedia Computing Communications and Applications 14, 4, Article 83 (Oct. 2018), 18 pages.
[5]
Xing Fan, Wei Jiang, Hao Luo, and Mengjuan Fei. 2019. Spherereid: Deep hypersphere manifold embedding for person re-identification. Journal of Visual Communication and Image Representation 60 (2019), 51--58.
[6]
Douglas Gray, Shane Brennan, and Hai Tao. 2007. Evaluating appearance models for recognition, reacquisition, and tracking. In Proceedings of the IEEE International Workshop on Performance Evaluation for Tracking and Surveillance (PETS), Vol. 3.
[7]
Martin Hirzer, Csaba Beleznai, Peter M. Roth, and Horst Bischof. 2011. Person re-identification by descriptive and discriminative classification. In Scandinavian Conference on Image Analysis. Springer, 91--102.
[8]
Sheng-Jun Huang, Rong Jin, and Zhi-Hua Zhou. 2010. Active learning by querying informative and representative examples. In Advances in Neural Information Processing Systems (NIPS). 892--900.
[9]
Srikrishna Karanam, Mengran Gou, Ziyan Wu, Angels Rates-Borras, Octavia Camps, and Richard J. Radke. 2019. A systematic evaluation and benchmark for person re-identification: Features, metrics, and datasets. IEEE Transactions on Pattern Analysis and Machine Intelligence 41, 3 (2019), 523--536.
[10]
Srikrishna Karanam, Yang Li, and Richard J. Radke. 2015. Person re-identification with discriminatively trained viewpoint invariant dictionaries. In Proceedings of the IEEE International Conference on Computer Vision. 4516--4524.
[11]
Elyor Kodirov, Tao Xiang, Zhenyong Fu, and Shaogang Gong. 2016. Person re-identification by unsupervised l 1 graph learning. In Proceedings of the European Conference on Computer Vision. Springer, 178--195.
[12]
David D. Lewis and Jason Catlett. 1994. Heterogeneous uncertainty sampling for supervised learning. In Machine Learning Proceedings 1994. Elsevier, 148--156.
[13]
Zhihui Li, Lina Yao, Xiaojun Chang, Kun Zhan, Jiande Sun, and Huaxiang Zhang. 2019. Zero-shot event detection via event-adaptive concept relevance mining. Pattern Recognition 88 (2019), 595--603.
[14]
Shengcai Liao, Yang Hu, Xiangyu Zhu, and Stan Z. Li. 2015. Person re-identification by local maximal occurrence representation and metric learning. In CVPR. 2197--2206.
[15]
Giuseppe Lisanti, Iacopo Masi, Andrew D. Bagdanov, and Alberto Del Bimbo. 2015. Person re-identification by iterative re-weighted sparse ranking. IEEE Transactions on Pattern Analysis and Machine Intelligence 37, 8 (2015), 1629--1642.
[16]
Giuseppe Lisanti, Iacopo Masi, and Alberto Del Bimbo. 2014. Matching people across camera views using kernel canonical correlation analysis. In Proceedings of the International Conference on Distributed Smart Cameras. ACM, 10.
[17]
Wenhe Liu, Xiaojun Chang, Ling Chen, and Yi Yang. 2017. Early active learning with pairwise constraint for person re-identification. In Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 103--118.
[18]
Wenhe Liu, Xiaojun Chang, Ling Chen, and Yi Yang. 2018. Semi-supervised Bayesian attribute learning for person re-identification. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence.
[19]
Minnan Luo, Xiaojun Chang, Liqiang Nie, Yi Yang, Alexander G. Hauptmann, and Qinghua Zheng. 2018. An adaptive semisupervised feature analysis for video semantic recognition. IEEE Trans. Cybernetics 48, 2 (2018), 648--660.
[20]
Hieu T. Nguyen and Arnold Smeulders. 2004. Active learning using pre-clustering. In Proceedings of the 21st International Conference on Machine Learning. ACM.
[21]
Feiping Nie, Hua Wang, Heng Huang, and Chris H. Q. Ding. 2013. Early active learning via robust representation and structured sparsity. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI).
[22]
Liqiang Nie, Xuemeng Song, and Tat-Seng Chua. 2016. Learning from multiple social networks. Synthesis Lectures on Information Concepts, Retrieval, and Services 8, 2 (2016), 1--118.
[23]
Liqiang Nie, Xiaochi Wei, Dongxiang Zhang, Xiang Wang, Zhipeng Gao, and Yi Yang. 2017. Data-driven answer selection in community QA systems. IEEE Transactions on Knowledge and Data Engineering 29, 6 (2017), 1186--1198.
[24]
Peixi Peng, Tao Xiang, Yaowei Wang, Massimiliano Pontil, Shaogang Gong, Tiejun Huang, and Yonghong Tian. 2016. Unsupervised cross-dataset transfer learning for person re-identification. In CVPR. 1306--1315.
[25]
Ergys Ristani, Francesco Solera, Roger Zou, Rita Cucchiara, and Carlo Tomasi. 2016. Performance measures and a data set for multi-target, multi-camera tracking. In Proceedings of the European Conference on Computer Vision Workshop on Benchmarking Multi-Target Tracking.
[26]
H. Sebastian Seung, Manfred Opper, and Haim Sompolinsky. 1992. Query by committee. In Proceedings of the 5th Annual Workshop on Computational Learning Theory. ACM, 287--294.
[27]
Niall Twomey, Tom Diethe, and Peter Flach. 2015. Bayesian active learning with evidence-based instance selection. In Workshop on Learning over Multiple Contexts, European Conference on Machine Learning.
[28]
Hanmo Wang, Xiaojun Chang, Lei Shi, Yi Yang, and Yi-Dong Shen. 2018. Uncertainty sampling for action recognition via maximizing expected average precision. In IJCAI. 964--970.
[29]
Yu Wu, Yutian Lin, Xuanyi Dong, Yan Yan, Wanli Ouyang, and Yi Yang. 2018. Exploit the unknown gradually: One-shot video-based person re-identification by stepwise learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5177--5186.
[30]
Tong Xiao, Hongsheng Li, Wanli Ouyang, and Xiaogang Wang. 2016. Learning deep feature representations with domain guided dropout for person re-identification. In CVPR. 1249--1258.
[31]
Eric P. Xing, Michael I. Jordan, Stuart J. Russell, and Andrew Y. Ng. 2003. Distance metric learning with application to clustering with side-information. In Advances in Neural Information Processing Systems. 521--528.
[32]
Fei Xiong, Mengran Gou, Octavia Camps, and Mario Sznaier. 2014. Person re-identification using kernel-based metric learning methods. In Proceedings of the European Conference on Computer Vision. Springer, 1--16.
[33]
Shuicheng Yan, Dong Xu, Benyu Zhang, Hong-Jiang Zhang, Qiang Yang, and Stephen Lin. 2007. Graph embedding and extensions: A general framework for dimensionality reduction. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 1 (2007).
[34]
Yi Yang, Zhigang Ma, Feiping Nie, Xiaojun Chang, and Alexander G. Hauptmann. 2015. Multi-class active learning by uncertainty sampling with diversity maximization. International Journal of Computer Vision 113, 2 (2015), 113--127.
[35]
Kai Yu, Jinbo Bi, and Volker Tresp. 2006. Active learning via transductive experimental design. In Proceedings of the 23rd International Conference on Machine Learning. ACM, 1081--1088.
[36]
Li Zhang, Tao Xiang, and Shaogang Gong. 2016. Learning a discriminative null space for person re-identification. In CVPR. 1239--1248.
[37]
Liang Zheng, Yi Yang, and Alexander G. Hauptmann. 2016. Person re-identification: Past, present and future. arXiv preprint arXiv:1610.02984 (2016).
[38]
Liang Zheng, Hengheng Zhang, Shaoyan Sun, Manmohan Chandraker, Yi Yang, and Qi Tian. 2017. Person re-identification in the wild. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1367--1376.
[39]
Miao Zheng, Jiajun Bu, Chun Chen, Can Wang, Lijun Zhang, Guang Qiu, and Deng Cai. 2011. Graph regularized sparse coding for image representation. IEEE Transactions on Image Processing 20, 5 (2011), 1327--1336.

Cited By

View all
  • (2024)Fault diagnosis using variational autoencoder GAN and focal loss CNN under unbalanced dataStructural Health Monitoring10.1177/14759217241254121Online publication date: 24-Jul-2024
  • (2024)Active Learning for Deep Visual TrackingIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2023.326683735:10(13284-13296)Online publication date: Oct-2024
  • (2024)Active Clustering Ensemble With Self-Paced LearningIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2023.325258635:9(12186-12200)Online publication date: Sep-2024
  • Show More Cited By

Index Terms

  1. Pair-based Uncertainty and Diversity Promoting Early Active Learning for Person Re-identification

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Intelligent Systems and Technology
    ACM Transactions on Intelligent Systems and Technology  Volume 11, Issue 2
    Survey Paper and Regular Paper
    April 2020
    274 pages
    ISSN:2157-6904
    EISSN:2157-6912
    DOI:10.1145/3379210
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 January 2020
    Accepted: 01 November 2019
    Revised: 01 October 2019
    Received: 01 May 2019
    Published in TIST Volume 11, Issue 2

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Active learning
    2. person re-identification

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)133
    • Downloads (Last 6 weeks)21
    Reflects downloads up to 03 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Fault diagnosis using variational autoencoder GAN and focal loss CNN under unbalanced dataStructural Health Monitoring10.1177/14759217241254121Online publication date: 24-Jul-2024
    • (2024)Active Learning for Deep Visual TrackingIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2023.326683735:10(13284-13296)Online publication date: Oct-2024
    • (2024)Active Clustering Ensemble With Self-Paced LearningIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2023.325258635:9(12186-12200)Online publication date: Sep-2024
    • (2024)AG-ReID.v2: Bridging Aerial and Ground Views for Person Re-IdentificationIEEE Transactions on Information Forensics and Security10.1109/TIFS.2024.335307819(2896-2908)Online publication date: 1-Jan-2024
    • (2024)Vision transformers are active learners for image copy detectionNeurocomputing10.1016/j.neucom.2024.127687587(127687)Online publication date: Jun-2024
    • (2024)Multi-level self attention for unsupervised learning person re-identificationMultimedia Tools and Applications10.1007/s11042-024-19007-z83:26(68855-68874)Online publication date: 24-Apr-2024
    • (2023)Human Pose Transfer with Augmented Disentangled Feature ConsistencyACM Transactions on Intelligent Systems and Technology10.1145/362624115:1(1-22)Online publication date: 19-Dec-2023
    • (2023)EvoCLINICAL: Evolving Cyber-Cyber Digital Twin with Active Transfer Learning for Automated Cancer Registry SystemProceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3611643.3613897(1973-1984)Online publication date: 30-Nov-2023
    • (2023)AG-ReID 2023: Aerial-Ground Person Re-identification Challenge Results2023 IEEE International Joint Conference on Biometrics (IJCB)10.1109/IJCB57857.2023.10448780(1-10)Online publication date: 25-Sep-2023
    • (2023)Improved prototypical network for active few-shot learningPattern Recognition Letters10.1016/j.patrec.2023.06.015172(188-194)Online publication date: Aug-2023
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Get Access

    Login options

    Full Access

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media