Hongsheng Li   李鴻升 Associate Professor Department of Electronic Engineering Co-affiliated to Multimedia Laboratory The Chinese University of Hong Kong Email: hsli@ee.cuhk.edu.hk Office: SHB 428, CUHK, Hong Kong S.A.R., China

  [Google Scholar]

News

• [09/2024] 11 papers accepted to NeurIPS 2024

• [07/2024] 14 papers accepted to ECCV 2024

• [05/2024] 3 papers accepted to ACL 2024 (Main Conference)

• [05/2024] 2 papers accepted to ICML 2024

• [04/2024] 1 paper accepted to SIGGRAPH 2024

• [04/2024] To serve as a Tutorials Chair for CVPR 2026

• [03/2024] 6 papers accepted to CVPR 2024

• [01/2024] 5 papers accepted to ICLR 2024

Education

• Ph. D., 2008 - 2012, Computer Science, Lehigh University

• M. Eng. student, 2006 - 2007, Pattern Recognition and Intelligent System, Shanghai Jiao Tong Universtiy

• B. Eng., 2002 - 2006, Automation, East China University of Science and Technology

Employment

• Associate Professor, Jul. 2022 - Present, Department of Electronic Enigneering, The Chinese University of Hong Kong

• Huashan Scholar Chair Professor, Apr. 2020 - Apr. 2023, School of Computer Science and Technology, Xidian University

• Assistant Professor, Jul. 2018 - Jun. 2022, Department of Electronic Enigneering, The Chinese University of Hong Kong

• Research Assistant Professor, Aug. 2015 - Jun. 2018, Department of Electronic Enigneering, The Chinese University of Hong Kong

• Postdoctoral Fellow, Feb. 2014 - Jan. 2015, Department of Electronic Engineering, The Chinese University of Hong Kong

• Associate Professor, Jan. 2013 - Jul. 2015, School of Electronic Scicence, University of Electronic Science and Technology of China

Awards & Recognitions

• 2023 AI 2000 Most Influential Scholar Honorable Mention in Computer Vision, 2023

• World's Top 2% Scientists named by Stanford University, 2022

• CUHK Young Researcher Award 2021-2022, 2022

• 2022 AI 2000 Most Influential Scholar Honorable Mention in Computer Vision, 2022

• 2020 IEEE Circuits and System Society Outstanding Young Author Award, 2020

• Winner of ActivityNet Challenge 2020 on Spatio-temporal Action Localization (AVA), 2020

• Winner of ImageNet Video Object Detection/Tracking Challenge with provided data, 2016

• Winner of ImageNet Video Object Detection Challenge with provided data, 2015

Publications

Selected Preprints

• TerDiT: Ternary Diffusion Models with Transformers,
  L. Xu, A. Zhou, Z. Lin, Q. Liu, Y. Xu, R. Zhang, Y. Wen, S. Ren, J. Yan, P. Gao, H. Li.
  arXiv:2405.14854, Technical Report, 2024. [Project]
  


• Trim 3D Gaussian Splatting for Accurate Geometry Representation,
  L. Fan, Y. Yang, M. Li, H. Li, Z. Zhang.
  arXiv:2406.07499, Technical Report, 2024. [Project]
  


• Step-Controlled DPO: Leveraging Stepwise Error for Enhanced Mathematical Reasoning,
  J. Liu, X. Huang, J. Zheng, B. Liu, J. Wang, O. Yoshie, Y. Liu, H. Li.
  arXiv:2407.00782, Technical Report, 2024. [Project]
  


• Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want,
  W. Lin, X. Wei, R. An, P. Gao, B. Zou, Y. Luo, S. Huang, S. Zhang, H. Li.
  arXiv:2403.20271, Technical Report, 2024.
  


• MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment,
  J. Liu, X. Huang, J. Zheng, B. Liu, J. Wang, O. Yoshie, Y. Liu, H. Li.
  arXiv:2406.19736, Technical Report, 2024. [Project]
  


• Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformers,
  P. Gao, L. Zhuo, Z. Lin, C. Liu, J. Chen, R. Du, E. Xie, X. Luo, L. Qiu, Y. Zhang, C. Lin, R. Huang, S. Geng, R. Zhang, J. Xi, W. Shao, Z. Jiang, T. Yang, W. Ye, H. Tong, J. He, Y. Qiao, H. Li.
  arXiv:2405.05945, Technical Report, 2024. [Project][机器之心]
  



2024

• Phased Consistency Model,
  F.-Y. Wang, Z. Huang, A. W. Bergman, D. Shen, P. Gao, M. Lingelbach, K. Sun, W. Bian, G. Song, Y. Liu, X. Wang, H. Li.
  Conference on Neural Information Processing Systems (NeurIPS), 2024. [Project]
  


• Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiT,
  L. Zhuo, R. Du, H. Xiao, Y. Li, D. Liu, R. Huang, W. Liu, L. Zhao, F.-Y. Wang, Z. Ma, X. Luo, Z. Wang, K. Zhang, X. Zhu, S. Liu, X. Yue, D. Liu, W. Ouyang, Z. Liu, Y. Qiao*, H. Li*, P. Gao*.
  Conference on Neural Information Processing Systems (NeurIPS), 2024. [Project]
  


• ZOPP: A Framework of Zero-shot Offboard Panoptic Perception for Autonomous Driving,
  T. Ma, H. Zhou, Q. Huang, X. Yang, J. Guo, B. Zhang, M. Dou, Y. Qiao, B. Shi, H. Li.
  Conference on Neural Information Processing Systems (NeurIPS), 2024. [Project]
  


• CoMat: Aligning Text-to-Image Diffusion Model with Image-to-Text Concept Matching,
  D. Jiang, G. Song, X. Wu, R. Zhang, D. Shen, Z. Zong, Y. Liu, H. Li.
  Conference on Neural Information Processing Systems (NeurIPS) 2024. [Project]
  


• Visual CoT: Unleashing Chain-of-Thought Reasoning in Multi-Modal Language Models,
  H. Shao, S. Qian, H. Xiao, G. Song, Z. Zong, L. Wang, Y. Liu, H. Li.
  Conference on Neural Information Processing Systems (NeurIPS) Dataset and Benchmark Track, 2024 (spotlight presentation). [Project]
  


• Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset,
  K. Wang, J. Pan, W. Shi, Z. Lu, M. Zhan, H. Li.
  Conference on Neural Information Processing Systems (NeurIPS) Dataset and Benchmark Track, 2024. [Project]
  


• MoVA: Adapting Mixture of Vision Experts to Multimodal Context,
  Z. Zong, B. Ma, D. Shen, G. Song, H. Shao, D. Jiang, H. Li, Y. Liu.
  Conference on Neural Information Processing Systems (NeurIPS), 2024. [Project]
  


• Exploring the Role of Large Language Models in Prompt Encoding for Diffusion Models,
  B. Ma, Z. Zong, G. Song, H. Li, Y. Liu.
  Conference on Neural Information Processing Systems (NeurIPS), 2024.
  


• A Global Depth-Range-Free Multi-View Stereo Transformer Network with Pose Embedding,
  Y. Dong, Y. Li, Z. Huang, W. Bian, J. Liu, H. Bao, Z. Cui, H. Li, G. Zhang.
  Conference on Neural Information Processing Systems (NeurIPS), 2024.
  


• Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Control,
  Z. Kuang, S. Cai, H. He, Y. Xu, H. Li, L. Guibas, G. Wetzstein.
  Conference on Neural Information Processing Systems (NeurIPS), 2024. [Project]
  


• Learning 1D Causal Visual Representation with De-focus Attention Networks,
  C. Tao, X. Zhu, S. Su, L. Lu, C. Tian, X. Luo, G. Huang, H. Li, Y. Qiao, J. Zhou, J. Dai.
  Conference on Neural Information Processing Systems (NeurIPS), 2024. [Project]
  


• SPHINX: The Joint Mixing of Weights, Tasks, and Visual Embeddings for Multi-modal Large Language Models,
  Z. Lin, D. Liu, R. Zhang, P. Gao, L. Qiu, H. Xiao, H. Qiu, C. Lin, W. Shao, K. Chen, J. Han, S. Huang, Y. Zhang, X. He, Y. Qiao, H. Li.
  European Conference on Computer Vision (ECCV), 2024. [Project]
  


• Deep Reward Supervisions for Tuning Text-to-Image Diffusion Models,
  X. Wu, Y. Hao, M. Zhang, K. Sun, Z. Huang, G. Song, Y. Liu, H. Li.
  European Conference on Computer Vision (ECCV), 2024.
  


• Be-Your-Outpainter: Mastering Video Outpainting through Input-Specific Adaptation,
  F.-Y. Wang, X. Wu, Z. Huang, X. Shi, D. Shen, G. Song, Y. Liu, H. Li.
  European Conference on Computer Vision (ECCV), 2024. [Project]
  


• ZoLA: Zero-Shot Creative Long Animation Generation with Short Video Model,
  F.-Y. Wang, Z. Huang, Q. Ma, G. Song, X. Lu, W. Bian, Y. Li, Y. Liu, H. Li.
  European Conference on Computer Vision (ECCV), 2024. [Project]
  


• nuCraft: Crafting High Resolution 3D Semantic Occupancy for Unified 3D Scene Understanding,
  B. Zhu, Z. Wang, H. Li.
  European Conference on Computer Vision (ECCV), 2024.
  


• BlinkVision: A Benchmark for Optical Flow, Scene Flow and Point Tracking Estimation using RGB Frames and Events,
  Y. Li, Y. Shen, Z. Huang, S. Chen, W. Bian, X. Shi, F.-Y. Wang, K. Sun, H. Bao, Z. Cui, G. Zhang, H. Li.
  European Conference on Computer Vision (ECCV), 2024.
  


• MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?
  R. Zhang, D. Jiang, Y. Zhang, H. Lin, Z. Guo, P. Qiu, A. Zhou, P. Lu, K.-W. Chang, P. Gao, H. Li.
  European Conference on Computer Vision (ECCV), 2024. [Project]
  


• FouriScale: A Frequency Perspective on Training-Free High-Resolution Image Synthesis,
  L. Huang, R. Fang, A. Zhang, G. Song, S. Liu, Y. Liu, H. Li.
  European Conference on Computer Vision (ECCV), 2024. [Project]
  


• Three Things We Need to Know About Transferring Stable Diffusion to Visual Dense Prediciton Tasks,
  M. Zhang, G. Song, X. Shi, Y. Liu, H. Li.
  European Conference on Computer Vision (ECCV), 2024.
  


• Any2Point: Empowering Any-modality Transformers for Efficient 3D Understanding,
  Y. Tang, R. Zhang, J. Liu, Z. Guo, B. Zhao, Z. Wang, D. Wang, P. Gao, H. Li, X. Li.
  European Conference on Computer Vision (ECCV), 2024. [Project]
  


• Unmasking Bias in Diffusion Model Training,
  H. Yu, L. Shen, J. Huang, H. Li, F. Zhao.
  European Conference on Computer Vision (ECCV), 2024.
  


• Delving Deep into Engagement Prediction of Short Videos,
  D. Li, W. Li, B. Lu, H. Li, S. Ma, G. Krishnan, J. Wang.
  European Conference on Computer Vision (ECCV), 2024.
  


• GiT: Towards Generalist Vision Transformer through Universal Language Interface,
  H. Wang, H. Tang, L. Jiang, S. Shi, M. F. Naeem, H. Li, B. Schiele, L. Wang.
  European Conference on Computer Vision (ECCV), 2024. [Project]
  


• Ponymation: Learning Articulated 3D Animal Motions from Unlabeled Online Videos,
  K. Sun, D. Litvak, Y. Zhang, H. Li, J. Wu, S. Wu.
  European Conference on Computer Vision (ECCV), 2024. [Project]
  


• MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMs,
  Z. Lu, A. Zhou, H. Ren, K. Wang, W. Shi, J. Pan. M. Zhan, H. Li.
  Annual Meeting of the Association for Computational Linguistics (ACL) Main Conference, 2024.
  


• Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models,
  X. Lu, Q. Liu, Y. Xu, A. Zhou, S. Huang, B. Zhang, J. Yan, H. Li.
  Annual Meeting of the Association for Computational Linguistics (ACL) Main Conference, 2024.
  


• Empowering Character-level Text Infilling by Eliminating Sub-Tokens,
  H. Ren, M. Zhan, Z. Wu, H. Li.
  Annual Meeting of the Association for Computational Linguistics (ACL) Main Conference, 2024.
  


• SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models,
  X. Lu, A. Zhou, Y. Xu, R. Zhang, P. Gao, H. Li.
  International Conference on Machine Learning (ICML), 2024.
  


• SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models,
  P. Gao, R. Zhang, C. Liu, L. Qiu, S. Huang, W. Lin, S. Zhao, S. Geng, Z. Lin, P. Jin, K. Zhang, W. Shao, C. Xu, C. He, J. He, H. Shao, P. Lu, H. Li, Y. Qiao.
  International Conference on Machine Learning (ICML), 2024. [Project]
  


• Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modeling,
  X. Shi, Z. Huang, F.-Y. Wang, W. Bian, D. Li, Y. Zhang, M. Zhang, K. C. Cheung, S. See, H. Qin, J. Dai, H. Li.
  ACM SIGGRAPH 2024. [Project]
  


• LMDrive: Closed-Loop End-to-End Driving with Large Language Models,
  H. Shao, Y. Hu, L. Wang, S. L. Waslander, Y. Liu, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024. [Project]
  


• DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generation,
  X. Ju, Z. Huang, Y. Li, G. Zhang, Y. Qiao, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024. [Project]
  


• GLID: Pre-training a Generalist Encoder-Decoder Vision Model,
  J. Liu, J. Zheng, Y. Liu, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.


• SmartRefine: A Scenario-Adaptive Refinement Framework for Efficient Motion Prediction,
  Y. Zhou, H. Shao, L. Wang, S. L. Waslander, H. Li, Y. Liu.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024 [Project]
  


• Efficient Deformable ConvNets: Rethinking Dynamic and Sparse Operator for Vision Applications,
  Y. Xiong, Z. Li, Y. Chen, F. Wang, X. Zhu, J. Luo, W. Wang, T. Lu, H. Li, Y. Qiao, L. Lu, J. Zhou, J. Dai.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024 (highlight presentation).


• Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft,
  H. Li, X. Yang, Z. Wang, X. Zhu, J. Zhou, Y. Qiao, X. Wang, H. Li, L. Lu, J. Dai.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024. [Project]
  


• MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning,
  K. Wang, H. Ren, A. Zhou, Z. Lu, S. Luo, W. Shi, R. Zhang, L. Song, M. Zhan, H. Li.
  International Conference on Learning Representations (ICLR) 2024. [Project]
  


• Solving Challenging Math Word Problems Using GPT-4 Code Interpreter with Code-based Self-Verification,
  A. Zhou, K. Wang, Z. Lu, W. Shi, S. Luo, Z. Qin, S. Lu, A. Jia, L. Song, M. Zhan, H. Li.
  International Conference on Learning Representations (ICLR) 2024.
  


• LLaMA-Adapter: Efficient Fine-tuning of Large Language Models with Zero-initialized Attention,
  R. Zhang, J. Han, C. Liu, A. Zhou, P. Lu, P. Gao H. Li, Y. Qiao.
  International Conference on Learning Representations (ICLR) 2024. [Project]
  
  
• Personalize Segment Anything Model with One Shot,
  R. Zhang, Z. Jiang, Z. Guo, S. Yan, J. Pan, X. Ma, H. Dong, P. Gao, H. Li.
  International Conference on Learning Representations (ICLR) 2024. [Project]
  
  
• ADDP: Learning General Representations for Image Recognition and Generation with Alternating Denoising Diffusion Process,
  H. Tian, C. Tao, J. Dai, H. Li, Z. Li, L. Lu, X. Wang, H. Li, G. Huang, X. Zhu.
  International Conference on Learning Representations (ICLR) 2024.
  
  

  2023

• Context-TAP: Tracking Any Point Demands Spatial Context Features,
  W. Bian, Z. Huang, X. Shi, Y. Dong, Y. Li, H. Li.
  Conference on Neural Information Processing Systems (NeurIPS), 2023 (spotlight presentation). [Project]
  


• A Unified Conditional Framework for Diffusion-based Image Restoration,
  Y. Zhang, X. Shi, D. Li, X. Wang, J. Wang, H. Li.
  Conference on Neural Information Processing Systems (NeurIPS), 2023. [Project]
  


• JourneyDB: A Benchmark for Generative Image Understanding,
  J. Pan, K. Sun, Y. Ge, H. Li, H. Duan, X. Wu, R. Zhang, A. Zhou, Z. Qin, Y. Wang, J. Dai, Y. Qiao, H. Li.
  Conference on Neural Information Processing Systems (NeurIPS) Dataset and Benchmark Track, 2023. [Project]
  


• LightZero: A Unified Benchmark for Monte Carlo Tree Search in General Sequential Decision Scenarios,
  Y. Niu, Y. Pu, Z. Yang, X. Li, T. Zhou, J. Ren, S. Hu, H. Li, Y. Liu.
  Conference on Neural Information Processing Systems (NeurIPS) Dataset and Benchmark Track, 2023. [Project]
  


• Mining multi-center heterogeneous medical data with distributed synthetic learning,
  Q. Chang, Z. Yan, M. Zhou, H. Qu, X. He, H. Zhang, L. Baskaran S. Al’Aref, H. Li*, S. Zhang*, D. N. Metaxas*.
  Nature Communications, Vol. 14, 2023.
  


• Teach-DETR: Better Training DETR with Teachers,
  L. Huang, K. Lu, G. Song, L. Wang, S. Liu, Y. Liu, H. Li
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), Accepted,2023. [code]
  


• Human Preference Score: Better Aligning Text-to-Image Models with Human Preference,
  X. Wu, K. Sun, F. Zhu, R. Zhao, H. Li.
  International Conference on Computer Vision (ICCV), 2023. [Project]
  


• DetZero: Rethinking Offboard 3D Object Detection with Long-term Sequential Point Clouds,
  T. Ma, X. Yang, H. Zhou, X. Li, B. Shi, J. Liu, Y. Yang, Z. Liu, L. He, Y. Qiao, Y. Li, H. Li.
  International Conference on Computer Vision (ICCV), 2023. [Project]
  


• VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimation,
  X. Shi, Z. Huang, W. Bian, D. Li, M. Zhang, K. C. Cheung, S. See, H. Qin, J. Dai, H. Li.
  International Conference on Computer Vision (ICCV), 2023.
  


• Towards Better 3D Knowledge Transfer via Masked Image Modeling for Multi-view 3D Understanding,
  J. Liu, T. Wang, B. Liu, Q. Zhang, Y. Liu, H. Li.
  International Conference on Computer Vision (ICCV), 2023.
  


• SparseMAE: Sparse Training Meets Masked Autoencoders,
  A. Zhou, Y. Li, J. Liu, J. Pan, R. Zhang, P. Gao, R. Zhao, H. Li.
  International Conference on Computer Vision (ICCV), 2023.
  


• TrajectoryFormer: 3D Object Tracking Transformer with Predictive Trajectory Hypotheses,
  X. Chen, S. Shi, C. Zhang, B. Zhu, Q. Wang, K. C. Cheung, S. See, H. Li.
  International Conference on Computer Vision (ICCV), 2023.
  


• Simulating Fluids in Real-World Still Images,
  S. Fan, J. Piao, C. Qian, H. Li*, K.-Y. Lin*.
  International Conference on Computer Vision (ICCV), 2023 (Oral Presentation). [Project]
  


• Decoupled DETR: Spatially Disentangling Localization and Classification for Improved End-to-End Object Detection,
  M. Zhang, G. Song, Y. Liu, H. Li.
  International Conference on Computer Vision (ICCV), 2023.
  


• NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Space,
  J. Yao, C. Li, K. Sun, Y. Cai, H. Li, W. Ouyang, H. Li.
  International Conference on Computer Vision (ICCV), 2023.
  


• MonoDETR: Depth-guided Transformer for Monocular 3D Object Detection,
  R. Zhang, H. Qiu, T. Wang, Z. Guo, X. Xu, Y. Qiao, H. Li*, P. Gao*.
  International Conference on Computer Vision (ICCV), 2023. [Project]
  


• Temporal Enhanced Training of Multi-view 3D Object Detector via Historical Object Prediction,
  Z. Zong, D. Jiang, G. Song, Z. Xue, J. Su, H. Li*, Y. Liu*.
  International Conference on Computer Vision (ICCV), 2023. [Project]
  


• Urban Radiance Field Representation with Deformable Neural Mesh Primitives,
  F. Lu, Y. Xu, G. Chen, H. Li, K.-Y. Lin, C. Jiang.
  International Conference on Computer Vision (ICCV), 2023. [Project]
  


• Omnidirectional Information Gathering for Knowledge Transfer-based Audio-Visual Navigation,
  J. Chen, W. Wang, S. Liu, H. Li, Y. Yang.
  International Conference on Computer Vision (ICCV), 2023.
  


• ConQueR: Query Contrast Voxel-DETR for 3D Object Detection,
  B. Zhu, Z. Wang, S. Shi, H. Xu, L. Hong, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023 (highlight presentation). [Project]


• FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimation,
  X. Shi, Z. Huang, D. Li, M. Zhang, K. C. Cheung, S. See, H. Qin, J. Dai, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.


• Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learners,
  R. Zhang, X. Hu, B. Li, S. Huang, H. Deng, Y. Qiao, P. Gao, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• A Simple Baseline for Video Restoration with Grouped Spatial-temporal Shift,
  D. Li, X. Shi, Y. Zhang, X. Wang, H. Qin, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]
  


• CORA: Adapting CLIP for Open-Vocabulary Detection with Region Prompting and Anchor Pre-Matching,
  X. Wu, F. Zhu, R. Zhao, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoders,
  R. Zhang, L. Wang, Y. Qiao, P. Gao, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• MixMAE: Mixed and Masked Autoencoder for Efficient Pretraining of Hierarchical Vision Transformers,
  J. Liu, X. Huang, J. Zheng, Y. Liu, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• Improving Weakly Supervised Temporal Action Localization by Bridging Train-Test Gap in Pseudo Labels,
  J. Zhou, L. Huang, L. Wang, S. Liu, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.


• ReasonNet: End-to-End Driving with Temporal and Global Reasoning,
  H. Shao, L. Wang, R. Chen, S. Waslander, H. Li, Y. Liu.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• Starting from Non-Parametric Networks for 3D Point Cloud Analysis,
  R. Zhang, L. Wang, Y. Wang, P. Gao, H. Li, J. Shi.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• Adaptive Zone-aware Hierarchical Planner for Vision-Language Navigation,
  C. Gao, X. Peng, M. Yan, H. Wang, L. Wang, H. Ren, H. Li, S. Liu.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.


• InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions,
  W. Wang, J. Dai, Z. Chen, Z. Huang, Z. Li, X. Zhu, X. Hu, H. Lu, L. Lu, H. Li, X. Wang, Y. Qiao.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.


• PATS: Patch Area Transportation with Subdivisionfor Local Feature Matching,
  J. Ni, Y. Li, Z. Huang, H. Li, H. Bao, Z. Cui, G. Zhang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• Uni-Perceiver v2: A Generalist Model for Large-Scale Vision and Vision-Language Tasks,
  H. Li, J. Zhu, X. Jiang, X. Zhu, H. Li, C. Yuan, X. Wang, Y. Qiao, X. Wang, W. Wang, J. Dai.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. [Project]


• 3D Object Detection for Autonomous Driving: A Comprehensive Survey,
  J. Mao, S. Shi, X. Wang, H. Li.
  International Journal of Computer Vision (IJCV), 2023, Accepted.


• PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detection,
  S. Shi, L. Jiang, J. Deng, Z. Wang, C. Guo, J. Shi, X. Wang, H. Li.
  International Journal of Computer Vision (IJCV), Vol. 131, No. 2. pp. 531-551, 2023.



2022

• NeuralMarker: A Framework for Learning General Marker Correspondence,
  Z. Huang, X. Pan, W. Pan, W. Bian, Y. Xu, K. C. Cheung, G. Zhang, H. Li.
  ACM Transactions on Graphics (SIGGRAPH Asia 2022), 2022. [Project]
  


• ConvMAE: Masked Convolution Meets Masked Autoencoders,
  P. Gao, T. Ma, H. Li, J. Dai, Y. Qiao.
  Conference on Neural Information Processing Systems (NeurIPS), 2022. [Project]
  


• Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields,
  K. Sun, S. Wu, Z. Huang, N. Zhang, Q. Wang, H. Li.
  Conference on Neural Information Processing Systems (NeurIPS), 2022. [Project]
  


• Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-training,
  R. Zhang, Z. Guo, P. Gao, R. Fang, B. Zhao, D. Wang, Y. Qiao, H. Li.
  Conference on Neural Information Processing Systems (NeurIPS), 2022. [Project]
  


• ST-Adapter: Parameter-Efficient Image-to-Video Transfer Learning for Action Recognition,
  J. Pan, Z. Lin, X. Zhu, J. Shao, H. Li.
  Conference on Neural Information Processing Systems (NeurIPS), 2022.
  


• Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEs,
  J. Zhu, X. Zhu, W. Wang, X. Wang, H. Li, X. Wang, J. Dai.
  Conference on Neural Information Processing Systems (NeurIPS), 2022. [Project]
  


• MPPNet: Multi-Frame Feature Intertwining with Proxy Points for 3D Temporal Object Detection,
  X. Chen, S. Shi, B. Zhu, K. C. Cheung, H. Xu, H. Li.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  Ranks 1st on Open Waymo 3D object detection benchmark on June 24th, 2022
  


• FlowFormer: A Transformer Architecture for Optical Flow,
  Z. Huang, X. Shi, C. Zhang, Q. Wang, K. C. Cheung, H. Qin, J. Dai, H. Li.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  


• UniNet: Unified Architecture Search with Convolution, Transformer, and MLP,
  J. Liu, H. Li, G. Song, X. Huang, Y. Liu.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  


• Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modeling,
  R. Zhang, R. Fang, W. Zhang, P. Gao, K. Li, J. Dai, Y. Qiao, H. Li.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  


• Towards Robust Face Recognition with Comprehensive Search,
  M. Zhang, G. Song, Y. Liu, H. Li.
  European Conference on Computer Vision (ECCV), 2022.
  


• Frozen CLIP is an Efficient Video Learner,
  Z. Lin, S. Geng, R. Zhang, P. Gao, G. de Melo, X. Wang, J. Dai, Y. Qiao, H. Li.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  


• Learning Degradation Representations for Image Deblurring,
  D. Li, Y. Zhang, K. C. Cheung, X. Wang, H. Qin, H. Li.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  


• TokenMix: Rethinking Image Mixing for Data Augmentation in Vision Transformers,
  J. Liu, B. Liu, Y. Liu, H. Zhou, H. Li.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  


• EdgeViTs: Competing Light-weight CNNs on Mobile Devices with Vision Transformers,
  J. Pan, A. Bulat, F. Tan, X. Zhu, L. Dudziak, H. Li, G. Tzimiropoulos, B. Martinez.
  European Conference on Computer Vision (ECCV), 2022. [Project]
  


• Efficient Burst Raw Denoising with Variance Stabilization and Multi-frequency Denoising Network,
  D. Li, Y. Zhang, K. L. Law, X. Wang, H. Qin, H. Li.
  International Journal of Computer Vision (IJCV), 2022, accepted.


• Structured Domain Adaptation with Online Relation Regularization for Unsupervised Person Re-ID,
  Y. Ge, F. Zhu, D. Chen, R. Zhao, X. Wang, H. Li.
  IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022, accepted. [Project]


• Learning a Structured Latent Space for Unsupervised Point Cloud Completion,
  Y. Cai, K.-Y. Lin, C. Zhang, Q. Wang, X. Wang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022 (oral presentation).


• PointCLIP: Point Cloud Understanding by CLIP,
  R. Zhang, Z. Guo, W. Zhang, K. Li, X. Miao, B. Cui, Y. Qiao, P. Gao, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [Project]


• RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimization,
  Y. Xu, K.-Y. Lin, G. Zhang, X. Wang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [Project]


• IDR: Self-Supervised Image Denoising via Iterative Data Refinement,
  Y. Zhang, D. Li, K. L. Law, X. Wang, H. Qin, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [Project]


• Weakly Supervised Temporal Action Localization via Representative Snippet Knowledge Propagation,
  L. Huang, L. Wang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [Project]


• Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Tasks,
  X. Zhu, J. Zhu, H. Li, X. Wu, X. Wang, H. Li, X. Wang, J. Dai.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [Project]


• AutoLoss-Zero: Searching Loss Functions from Scratch for Generic Tasks,
  H. Li, T. Fu, J. Dai, H. Li, G. Huang, J. Dai.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.


• RBGNet: Ray-based Grouping for 3D Object Detection,
  H. Wang, S. Shi, Z. Yang, R. Fang, Q. Qian, H. Li, B. Schiele, L. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [Project]


• UniFormer: Unified Transformer for Efficient Spatial-Temporal Representation Learning,
  K. Li, Y. Wang, G. Peng, G. Song, Y. Liu, H. Li, Y. Qiao.
  International Conference on Learning Representations (ICLR) 2022. [Project]
  



2021

• DominoSearch: Find Layer-wise Fine-grained N:M Sparse Schemes from Dense Neural Networks,
  W. Sun, A. Zhou, S. Stuijk, R. Wijnhoven, A. O. Nelson, H. Li, H. Corporaal.
  Advances in Neural Information Processing Systems (NeurIPS) 2021. [Project]
  


• Container: Context Aggregation Networks,
  P. Gao, J. Lu, H. Li, R. Mottaghi, A. Aniruddha.
  Advances in Neural Information Processing Systems (NeurIPS) 2021.
  


• A Holistically-Guided Decoder for Deep Representation Learning with Applications to Semantic Segmentation and Object Detection,
  J. Liu, S. Ren, Y. Zheng, X. Wang, H. Li.
  IEEE Trans. Pattern Analysis and Machine Intelligence, 2021. Accpeted.
  


• Fast Convergence of DETR with Spatially Modulated Co-Attention,
  P. Gao, M. Zhang, X. Wang, J. Dai, H. Li.
  International Conference on Computer Vision (ICCV), 2021. [Project]
  


• LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-based 3D Detector,
  X. Guo, S. Shi, X. Wang, H. Li.
  International Conference on Computer Vision (ICCV), 2021.
  


• Rethinking Noise Synthesis and Modeling in Raw Denoising,
  Y. Zhang, H. Qin, X. Wang, H. Li.
  International Conference on Computer Vision (ICCV), 2021.
  


• Foreground-Action Consistency Network for Weakly Supervised Temporal Action Localization,
  L. Huang, L. Wang, H. Li.
  International Conference on Computer Vision (ICCV), 2021.
  


• FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting,
  R. Liu, H. Deng, Y. Huang, X. Shi, L. Lu, W. Sun, X. Wang, J. Dai, H. Li.
  International Conference on Computer Vision (ICCV), 2021.
  


• Encoder-decoder with Multi-level Attention for 3D Human Shape and Pose Estimation,
  M. Tian, Z. Li, Z. Wan, J. Liu, S. Yi, H. Li.
  International Conference on Computer Vision (ICCV), 2021.
  


• Progressive Correspondence Pruning by Consensus Learning,
  C. Zhao, Y. Ge, F. Zhu, R. Zhao, H. Li, M. Salzmann.
  International Conference on Computer Vision (ICCV), 2021.
  


• Unsupervised Domain Adaptive 3D Detection with Multi-Level Consistency,
  Z. Luo, Z. Cai, C. Zhou, G. Zhang, H. Zhao, S. Yi, S. Lu, H. Li, S. Zhang, Z. Liu.
  International Conference on Computer Vision (ICCV), 2021.
  


• SymReg-GAN: Symmetric Image Registration with Generative Adversarial Networks,
  Y. Zheng, X. Sui, Y. Jiang, T. Che, S. Zhang, J. Yang, H. Li.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021, to appear.
  


• Inverting Generative Adversarial Renderer for Face Reconstruction,
  J. Piao, K. Sun, K.-Y. Lin, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021 (oral presentation).
  


• DivCo: Diverse Conditional Image Synthesis via Contrastive Generative Adversarial Network,
  R. Liu, Y. Ge, C. L. Choi, X. Wang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  


• Refining Pseudo Labels with Clustering Consensus over Generations for Unsupervised Object Re-identification,
  X. Zhang, Y. Ge, Y. Qiao, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021. [code]
  


• Actor-Context-Actor Relation Network for Spatio-Temporal Action Localization,
  J. Pan, S. Chen, M. Z. Shou, Y. Liu, J. Shao, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  


• Semantic Scene Completion via Integrating Instances and Scene in-the-Loop,
  Y. Cai, X. Chen, C. Zhang, K.-Y. Lin, X. Wang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  


• VS-Net: Voting with Segmentation for Visual Localization,
  Z. Huang, H. Zhou, Y. Li, B. Yang, Y. Xu, X. Zhou, H. Bao, G. Zhang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021. [Project]
  


• Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentation,
  X. Zhu, H. Zhou, T. Wang, F. Hong, Y. Ma, W. Li, H. Li, D. Lin.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021 (oral presentation).
  


• LiDAR-based Panoptic Segmentation via Dynamic Shifting Network,
  F. Hong, H. Zhou, X. Zhu, H. Li, Z. Liu.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  


• ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detection,
  J. Yang, S. Shi, H. Li, X. Qi.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
  


• Learning N:M Fine-grained Structured Sparse Neural Networks From Scratch,
  A. Zhou, Y. Ma, J. Zhu, J. Liu, Z. Zhang, K. Yuan, W. Sun, H. Li.
  International Conference on Learning Representations (ICLR), 2021.
  


• Efficient Attention: Attention with Linear Complexities,
  Z. Zhao, M. Zhang, H. Zhao, S. Yi, H. Li.
  Winter Conference on Applications of Computer Vision (WACV), 2021.
  


• FocusNetv2: Imbalanced Large and Small Organ Segmentation with Adversarial Shape Constraint for Head and Neck CT Images,
  Y. Gao, R. Huang, Y. Yang, J. Zhang, K. Shao, C. Tao, Y. Chen, D. N. Metaxas, H. Li*, M. Chen* (*Co-corresponding authors).
  Medical Image Analysis (MedIA), Vol. 67, No. 1, pp. 101831, 2021.
  



2020

• SelfVoxeLO: Self-supervised LiDAR Odometry with Voxel-based Deep Neural Networks,
  Y. Xu, Z. Huang, K.-Y. Lin, X. Zhu, J. Shi, H. Bao, G. Zhang, H. Li.
  Conference on Robotic Learning (CoRL), 2020.
  


• Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-ID,
  Y. Ge, F. Zhu, D. Chen, R. Zhao, H. Li.
  Neural Information Processing Systems (NeurIPS), 2020. [code]
  


• Balanced Meta-Softmax for Long-Tailed Visual Recognition,
  J. Ren, C. Yu, S. Sheng, X. Ma, H. Zhao, S. Yi, H. Li.
  Neural Information Processing Systems (NeurIPS), 2020.
  


• Self-supervising Fine-grained Region Similarities for Large-scale Image Localization,
  Y. Ge, H. Wang, F. Zhu, R. Zhao, H. Li.
  European Conference on Computer Vision (ECCV), 2020 (spotlight presentation). [code]
  


• EfficientFCN: Holistically-guided Decoding for Semantic Segmentation,
  J. Liu, J. He, J. Zhang, J. Ren, H. Li.
  European Conference on Computer Vision (ECCV), 2020.
  


• Learning to Predict Context-adaptive Convolution for Semantic Segmentation,
  J. Liu, J. He, J. Zhang, J. Ren, H. Li.
  European Conference on Computer Vision (ECCV), 2020.
  


• Open-Edit: Open-Domain Image Manipulation with Open-Vocabulary Instructions,
  X. Liu, Z. Lin, J. Zhang, H. Zhao, Q. H. Tran, X. Wang, H. Li.
  European Conference on Computer Vision (ECCV), 2020.
  


• RBF-Softmax: Learning Deep Representative Prototypes with Radial Basis Function Softmax,
  X. Zhang, R. Zhao, Y. Qiao, H. Li.
  European Conference on Computer Vision (ECCV), 2020. [code]
  


• Bi-directional Cross-Modality Feature Propagation with Separation-and-Aggregation Gate for RGB-D Semantic Segmentation,
  X. Chen, K.-Y. Lin, J. Wang, W. Wu, C. Qian, H. Li, G. Zeng.
  European Conference on Computer Vision (ECCV), 2020.
  


• Multi-organ Segmentation via Co-training Weight-averaged Models from Few-organ Datasets,
  R. Huang, Z. Hu, S. Zhang, H. Li.
  International Conference on Medical Image Computing and Computer Assisted Interventions (MICCAI), 2020.
  


• PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection,
  S. Shi, C. Guo, L. Jiang, Z. Wang, J. Shi, X. Wang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  Ranks 1st on KITTI 3D object detection benchmark on Jan. 9th, 2020
  


• StereoGAN: Bridging Synthetic-to-Real Domain Gap by Joint Optimization of Domain Translation and Stereo Matching,
  R. Liu, C. Yang, W. Sun, X. Wang, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  


• 3D Sketch-aware Semantic Scene Completion via Semi-supervised Structure Prior,
  X. Chen, K.-Y. Lin, C. Qian, G. Zeng, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  


• Robust Superpixel-Guided Attentional Adversarial Attack,
  Y. Dong, J. Han, D. Chen, J. Liu, H. Bian, Z. Ma, H. Li, W. Zhang, N. Yu.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  


• From Points to Parts: 3D Object Detection From Point Cloud With Part-Aware and Part-Aggregation Network,
  S. Shi, Z. Wang, X. Wang, H. Li.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), Vol. 43, No. 8, pp. 2647-2664, 2021. [code]
  Ranks 1st on KITTI 3D object detection benchmark on July. 9th, 2019
  


• Mutual Mean-Teaching: Pseudo Label Refinery for Unsupervised Domain Adaptation on Person Re-identification,
  Y. Ge, D. Chen, H. Li
  International Conference on Learning Representations (ICLR), 2020. [code]
  


• Monocular 3D Object Detection with Decoupled Structured Polygon Estimation and Height-Guided Depth Estimation,
  Y. Cai, B. Li, Z. Jiao, H. Li, X. Zeng, X. Wang
  AAAI Conference on Artificial Intelligence (AAAI), 2020.
  


• Person Re-identification with Deep Kronecker-Product Matching and Group-shuffling Random Walk,
  Y. Shen, H. Li, T. Xiao, S. Yi, D. Chen, X. Wang, H. Li
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), Vol. 43, No. 5, pp. 1649-1665, 2021. [code]
  


• HMS-Net: Hierarchical Multi-scale Sparsity-invariant Network for Sparse Depth Completion,
  Z. Huang, J. Fan, S. Cheng, S. Yi, X. Wang, H. Li
  IEEE Transactions on Image Processing (TIP), Vol. 29, No. 12, pp. 3429-3441, 2020.
  



2019

• Learning to Predict Layout-to-image Conditional Convolutions for Semantic Image Synthesis,
  X. Liu, G. Yin, J. Shao, X. Wang, H. Li
  Annual Conference on Neural Information Processing Systems (NeurIPS), 2019.
  


• FocusNet: Imbalanced Large and Small Organ Segmentation with an End-to-End Deep Neural Network for Head and Neck CT Images,
  Y. Gao^, R. Huang^, M. Chen, Z. Wang, J. Deng, Y. Chen, Y. Yang, J. Zhang, C. Tao, H. Li (^Equal contribution)
  International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 2019.
  


• Semi-supervised Monocular 3D Face Reconstruction with End-to-end Shape-preserved Domain-transfer,
  J. Piao, Q. Chen, H. Li
  International Conference on Computer Vision (ICCV), 2019 (oral presentation).
  


• Interpolated Convolutional Networks for 3D Point Cloud Understanding,
  J. Mao, X. Wang, H. Li
  International Conference on Computer Vision (ICCV), 2019 (oral presentation).
  


• Multi-modality Latent Interaction Network for Visual Question Answering,
  P. Gao, X. Wang, Z. Zhang, X. Wang, H. Li
  International Conference on Computer Vision (ICCV), 2019.
  


• Depth Completion from Sparse LiDAR Data with Depth-Normal Constraints,
  Y. Xu, X. Zhu, J. Shi, G. Zhang, H. Bao, H. Li
  International Conference on Computer Vision (ICCV), 2019.
  


• CAMP: Cross-modal Adaptive Message Passing for Text-image Retrieval,
  Z. Wang, X. Liu, H. Li, L. Sheng, J. Yan, X. Wang, J. Shao
  International Conference on Computer Vision (ICCV), 2019.
  


• AdaCos: Adaptively Scaling Cosine Logit for Learning Deep Face Representation,
  X. Zhang, R. Zhao, Y. Qiao, X. Wang, H. Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019 (oral presentation).
  


• Dynamic Fusion with Intra- and Inter-modality Attention Flow for Visual Question Answering,
  P. Gao, H. You, Z. Jiang, P. Lu, S. Hoi, X. Wang, H. Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019 (oral presentation).
  


• PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud,
  S. Shi, X. Wang, H. Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019. [code]
  


• P2SGrad: Refined Gradients for Optimizing Deep Face Models,
  X. Zhang, R. Zhao, J. Yan, M. Gao, Y. Qiao, X. Wang, H. Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  


• Group-wise Correlation Stereo Network,
  X. Guo, K. Yang, W. Yang, X. Wang, H. Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019. [code]
  


• Improving Referring Expression Grounding with Cross-modal Attention-guided Erasing,
  X. Liu, Z. Wang, J. Shao, X. Wang, H. Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  


• Conditional Adversarial Generative Flow for Controllable Image Synthesis,
  R. Liu, X. Gong, Y. Liu, X. Wang, H. Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  


• Signet Ring Cell Detection With a Semi-supervised Learning Framework,
  J. Li, S. Yang, X. Huang, Q. Da, X. Yang, Z. Hu, Q. Duan, C. Wang, H. Li
  International Conference on Information Processing in Medical Imaging (IPMI), 2019.
  


• Unsupervised Cross-spectral Stereo Matching by Learning to Synthesize,
  M. Liang, X. Guo, H. Li, X. Wang, Y. Song
  AAAI Conference on Artificial Intelligence (AAAI), 2019 (oral presentation).
  


• A^2-Net: Molecular Structure Estimation for Cryo-EM Density Volumes,
  K. Xu, Z. Wang, J. Shi, H. Li, Q. C. Zhang
  AAAI Conference on Artificial Intelligence (AAAI), 2019.
  



2018

• FD-GAN: Pose-guided Feature Distilling GAN for Robust Person Re-identification,
  Y. Ge, Z. Li, H. Zhao, G. Yin, S. Yi, X. Wang, H. Li
  Annual Conference on Neural Information Processing Systems (NeurIPS), 2018. [code]
  


• StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networks,
  H. Zhang^, T. Xu^, H. Li, S. Zhang, X. Wang, X. Huang, D. N. Metaxas (^co-first authors)
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), Vol. 41, No. 8, pp. 1947-1962, 2019. [code]
  


• Show, Tell and Discriminate: Image Captioning by Self-retrieval with Partially Labeled Data,
  X. Liu, H. Li, J. Shao, D. Chen, X. Wang
  European Conference on Computer Vision (ECCV), 2018.
  


• Question-Guided Hybrid Convolution for Visual Question Answering,
  P. Gao, H. Li, S. Li, P. Lu, Y. Li, S. C. H. Hoi, X. Wang
  European Conference on Computer Vision (ECCV), 2018.
  


• Learning Monocular Depth by Distilling Cross-domain Stereo Networks,
  X. Guo, H. Li, S. Yi, J. Ren, X. Wang
  European Conference on Computer Vision (ECCV), 2018. [code]
  


• Person Re-identification with Deep Similarity-Guided Graph Neural Network,
  Y. Shen, H. Li, S. Yi, D. Chen, X. Wang
  European Conference on Computer Vision (ECCV), 2018.
  


• Improving Deep Visual Representation for Person Re-identification by Global and Local Image-language Association,
  D. Chen, H. Li, X. Liu, Y. Shen, J. Shao, X. Wang
  European Conference on Computer Vision (ECCV), 2018.
  


• Group Consistent Similarity Learning via Deep CRF for Person Re-Identification,
  D. Chen, D. Xu, H. Li, N. Sebe, X. Wang
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018 (oral presentation). [code]
  


• Video Person Re-Identification With Competitive Snippet-Similarity Aggregation and Co-Attentive Snippet Embedding,
  D. Chen, H. Li, T. Xiao, S. Yi, X. Wang
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
  


• Deep Group-Shuffling Random Walk for Person Re-Identification,
  Y. Shen, H. Li, T. Xiao, S. Yi, D. Chen, X. Wang
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018. [code]
  


• End-to-End Deep Kronecker-Product Matching for Person Re-Identification,
  Y. Shen^, T. Xiao^, H. Li, S. Yi, X. Wang (^co-first authors).
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018. [code]
  


• Eliminating Background-Bias for Robust Person Re-Identification,
  M. Tian, S. Yi, H. Li, S. Li, X. Zhang, J. Shi, J. Yan, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
  


• Single View Stereo Matching,
  Y. Luo, J. Ren, M. Lin, J. Pang, W. Sun, H. Li, L. Lin.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018 (spotlight presentation).
  


• 3D Human Pose Estimation in the Wild by Adversarial Learning,
  W. Yang, W. Ouyang, X. Wang, J. Ren, H. Li, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
  


• Deep Continuous Conditional Random Fields with Asymmetric Inter-object Constraints for Online Multi-object Tracking,
  H. Zhou, W. Ouyang, J. Cheng, X. Wang, H. Li.
  IEEE Transactions on Circuits and Systems for Video Technology (T-CSVT), Vol. 29, No. 4, pp. 1011-1022, 2019.
  


• T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videos,
  K. Kang^, H. Li^, J. Yan, X. Zeng, B. Yang, T. Xiao, C. Zhang, Z. Wang, R. Wang, X. Wang, W. Ouyang (^co-first authors).
  IEEE Transactions on Circuits and Systems for Video Technology (T-CSVT), Vol. 28, No. 10, pp. 2896-2907, 2018. [code]
  The winning method for ILSVRC 2015 VID task.


• Co-attending Free-form Regions and Detections with Multi-modal Multiplicative Feature Embedding for Visual Question Answering,
  P. Lu, H. Li, W. Zhang, J. Wang, X. Wang.
  AAAI Conference on Artificial Intelligence (AAAI), 2018. [code]

2017

• L0 Regularized Stationary Time Estimation for Crowd Analysis,
  S. Yi, X. Wang, C. Wu, J. Jia, H. Li.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), vol. 39, no. 5, pp. 981-994, 2017.
  


• StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks,
  H. Zhang, T. Xu, H. Li, S. Zhang, X. Wang, X. Huang, D. Metaxas.
  International Conference on Computer Vision (ICCV), 2017 (oral presentation). [code]


• Identity-Aware Textual-Visual Matching with Latent Co-attention,
  S. Li, T. Xiao, H. Li, W. Yang, X. Wang.
  International Conference on Computer Vision (ICCV), 2017.
  


• Learning Deep Neural Networks for Vehicle Re-ID with Visual-spatio-temporal Path Proposals,
  Y. Shen, T. Xiao, H. Li, S. Yi, X. Wang.
  International Conference on Computer Vision (ICCV), 2017.
  


• Online Multi-Object Tracking Using Single Object Tracker with Spatial and Temporal Attention,
  Q. Chu, W. Ouyang, H. Li, X. Wang, N. Yu.
  International Conference on Computer Vision (ICCV), 2017.
  


• Learning Feature Pyramids for Human Pose Estimation,
  W. Yang, S. Li, W. Ouyang, H. Li, X. Wang.
  International Conference on Computer Vision (ICCV), 2017.
  


• Orientation Invariant Feature Embedding and Spatial Temporal Re-ranking for Vehicle Re-identification,
  Z. Wang, L. Tang, X. Liu, Z. Yao, S. Yi, J. Shao, J. Yan, H. Li, X. Wang.
  International Conference on Computer Vision (ICCV), 2017.
  


• Zoom-in-Net: Deep Mining Lesions for Diabetic Retinopathy Detection,
  Z. Wang, Y. Yin, J. Shi, W. Fang, H. Li, X. Wang.
  Medical Image Computing and Computer Assisted Interventions Conference (MICCAI), 2017.
  


• Learning Spatial Regularization with Image-level Supervisions for Multi-label Image Classification,
  F. Zhu, H. Li, W. Ouyang, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
  


• Object Detection in Videos with Tubelet Proposal Networks,
  K. Kang, H. Li, T. Xiao, W. Ouyang, J. Yan, X. Liu, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
  


• Person Search with Natural Language Description,
  S. Li, T. Xiao, H. Li, B. Zhou, D. Yue, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
  

2016

• Pedestrian Behavior Modeling from Stationary Crowds with Applications to Intelligent Surveillance,
  S. Yi, H. Li, X. Wang.
  IEEE Transactions on Image Processing (TIP), vol. 25, no. 7, pp. 4354-4368, 2016.
  


• Data-Driven Crowd Understanding: A Baseline for a Large-Scale Crowd Dataset,
  C. Zhang, K. Kang, H. Li, X. Wang, R. Xie, X. Yang.
  IEEE Transactions on Multimedia (TMM), vol. 18, no. 6, pp. 1048-1061, 2016.
  


• Pedestrian Behavior Understanding and Prediction with Deep Neural Networks,
  S. Yi, H. Li, X. Wang.
  European Conference on Computer Vision (ECCV), 2016.
  


• Learnable Histogram: Statistical Context Features for Deep Neural Networks,
  Z. Wang, H. Li, W. Ouyang, X. Wang.
  European Conference on Computer Vision (ECCV), 2016.
  


• Crossing-line Crowd Counting with Two-phase Deep Neural Networks,
  Z. Zhao, H. Li, R. Zhao, X. Wang.
  European Conference on Computer Vision (ECCV), 2016.
  


• Learning Deep Feature Representations with Domain Guided Dropout for Person Re-identification,
  T. Xiao, H. Li, W. Ouyang, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
  


• Object Detection from Video Tubelets with Convolutional Neural Networks,
  K. Kang, W. Ouyang, H. Li, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016 (spotlight presentation).
  


• End-to-End Learning of Deformable Mixture of Parts and Deep Convolutional Neural Networks for Human Pose Estimation,
  W. Yang, W. Ouyang, H. Li, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016 (oral presentation).
  


• Structured Feature Learning for Pose Estimation,
  X. Chu, W. Ouyang, H. Li, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
  


• Magnetic Resonance Fingerprinting with Compressed Sensing and Distance Metric Learning,
  Z. Wang, H. Li, Q. Zhang, J. Yuan, X. Wang.
  Neurocomputing, vol. 174, no. 1, pp. 560-570, 2016.
  

2015

• Pedestrian Travel Time Estimation in Crowded Scenes,
  S. Yi, H. Li, X. Wang.
  International Conference on Computer Vision (ICCV), 2015.
  


• Cross-Scene Crowd Counting via Deep Convolutional Neural Networks,
  C. Zhang, H. Li, X. Wang, X. Yang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
  


• Understanding Pedestrian Behaviors From Stationary Crowd Groups,
  S. Yi, H. Li, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
  


• Saliency Detection by Multi-Context Deep Learning,
  R. Zhao, W. Ouyang, H. Li, X. Wang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
  


• DeepID-Net: Deformable Deep Convolutional Neural Networks for Object Detection,
  W. Ouyang, X. Wang, X. Zeng, S. Qiu, P. Luo, Y. Tian, H. Li, S. Yang, Z. Wang, C.-C. Loy, X. Tang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
  

2014

• Feature Matching with Affine-Function Transformation Models,
  H. Li, X. Huang, J. Huang, S. Zhang.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), vol. 36, no. 12, pp. 2407-2422, 2014.
  


• Solving a Special Type of Jigsaw Puzzles: Banknote Reconstruction From a Large Number of Fragments,
  H. Li, Y. Zheng, S. Zhang, J. Cheng.
  IEEE Transactions on Multimedia (T-MM), vol. 16, no. 2, pp. 571-578, 2014.
  


• Silhouette Analysis for Human Action Recognition Based on Maximum Spatio-Temporal Dissimilarity Embedding,
  J. Cheng, H. Liu, H. Li*. (*Corresponding Author)
  Machine Vision and Applications (MVA), vol. 25, no. 4, pp. 1007-1018, 2014.
  


• Preconditioning for Accelerated Iteratively Reweighted Least Squares in Structured Sparsity Reconstruction,
  C. Chen, J. Huang, L. He, H. Li.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014 (oral presentation).
  


• Statistical Background Subtraction Based on Imbalanced Learning,
  X. Zhang, Z. Liu, H. Li, X. Zhao.
  International Conference on Multimedia and Expo (ICME), 2014.
  


• Highly Efficient Forward and Backward Propagation of Convolutional Neural Networks for Pixelwise Classification,
  H. Li, R. Zhao, X. Wang.
  arXiv:1412.4526
  

2013

• Object Matching Using a Locally Affine Invariant and Linear Programming Techniques,
  H. Li, X. Huang, L. He.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), vol. 35, no. 2, pp. 411-424, 2013.
  

2012

• Automatic Image Annotation and Retrieval Using Group Sparsity,
  S. Zhang, J. Huang, H. Li, D.N. Metaxas.
  IEEE Transactions on Systems, Man, and Cybernetics, Part B (TSMC), vol. 42, no. 3, pp. 838-849, 2012.
  


• A Hierarchical Image Clustering Cosegmentation Framework,
  E. Kim, H. Li, X. Huang
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012.
  

2011

• Approximately Global Optimization for Robust Alignment of Generalized Shapes,
  H. Li, T. Shen, X. Huang.
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), vol. 33, no. 6, pp. 1116-1131, 2011.
  


• Composite Splitting Algorithms for Convex Optimization,
  J. Huang, S. Zhang, H. Li, D.N. Metaxas.
  Computer Vision and Image Understanding (CVIU), vol. 115, no. 12, pp. 1610-1622, 2011.
  


• Optimal Object Matching via Convexification and Composition,
  H. Li, J. Huang, S. Zhang, X. Huang.
  International Conference on Computer Vision (ICCV), 2011.
  


• A 3D Laplacian-Driven Parametric Deformable Model,
  T. Shen, X. Huang, H. Li, E. Kim, S. Zhang, J. Huang.
  International Conference on Computer Vision (ICCV), 2011.
  


• Extraction and Analysis of Actin Networks Based on Open Active Contour Models,
  T Xu, H. Li, T. Shen, N. Ojkic, D. Vavylonis, X. Huang
  International Symposium on Biomedical Imaging (ISBI), 2011.
  


• Actin Filament Segmentation Using Dynamic Programming,
  H. Li, T. Shen, X. Huang.
  Information Processing in Medical Imaging (IPMI), 2011.
  

2010

• Segmentation and Tracking of Cytoskeletal Filaments Using Open Active Contours,
  M.B. Smith^, H. Li^, T. Shen^, X. Huang, E. Yusuf, D. Vavylonis. (^Co-first Authors)
  Cytoskeleton, vol. 67, no. 11, pp. 693-705, 2010.
  


• Object Matching with a Locally Affine-Invariant Constraint,
  H. Li, E. Kim, X. Huang, L. He
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010.
  


• Automatic Image Annotation U 節目在sing Group Sparsity,
  S. Zhang, J. Huang, Y. Huang, Y. Yu, H. Li, D.N. Metaxas
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010 (oral presentation).
  


• Actin Filament Segmentation Using Spatiotemporal Active-Surface and Active-Contour Models,
  H. Li, T. Shen, D. Vavylonis, X. Huang.
  International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2010 (oral presentation).
  

2009

• Global Optimization for Alignment of Generalized Shapes,
  H. Li, T. Shen, X. Huang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009.
  


• Actin Filament Tracking Based on Particle Filters and Stretching Open Active Contour Models,
  H. Li, T. Shen, D. Vavylonis, X. Huang.
  International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2009.
  


• Automated Actin Filament Segmentation, Tracking and Tip Elongation Measurements Based on Open Active Contour Models,
  H. Li, T. Shen, M.B. Smith, I. Fujiwara, D. Vavylonis, X. Huang.
  International Symposium on Biomedical Imaging (ISBI), 2009 (oral presentation).
  


• Active Volume Models for 3D Medical Image Segmentation,
  T. Shen, H. Li, X. Huang.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009.
  

Old Code

• FastFPBP: code of fast CNN for pixelwise classification (arXiv:1412.4526) based on Caffe's original implementation.

• PAMI14_ICCV11_matching_demo.zip: demo code for our T-PAMI'14 and ICCV'11 papers.

• PAMI13_CVPR10_Matching_v0.1.zip: demo code for our T-PAMI'13 and CVPR'10 papers.