Yifan Lu (卢亦凡)

Master Student
Shanghai Jiao Tong University
yifan_lu@sjtu.edu.cn

About Me

Bachelor’s degree: Shanghai Jiao Tong University, 2018-2022. Major in Computer Science and Engineering (IEEE Honor Class).
Master’s degree: Shanghai Jiao Tong University, 2022-2025. Research in MediaBrain Lab, supervised by Prof. Siheng Chen.

Experiences

I am an intern at NVIDIA for autonomous driving data generation, directed by Mike Chen. I work closely with Xuanchi Ren, Jiahui Huang and Sanja Fidler from NVIDIA Toronto AI Lab on research and product work.

Research Interests

3D Vision
3D Scene Reconstruction and Generation
Autonomous Driving Simulation
Collaborative Perception

Publications

Tech Report

Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Control

NVIDIA

Technical Report

PDF Project Page

CVPR

GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Control

Xuanchi Ren^*, Tianchang Shen^*, Jiahui Huang, Huan Ling, Yifan Lu, Merlin Nimier-David, Thomas Müller, Alexander Keller, Sanja Fidler, Jun Gao (* denotes equal contribution)

Conference on Computer Vision and Pattern Recognition (CVPR), 2025.

PDF Project Page

Arxiv

InfiniCube: Unbounded and Controllable Dynamic 3D Driving Scene Generation with World-Guided Video Models

Yifan Lu^*, Xuanchi Ren^*, Jiawei Yang, Tianchang Shen, Zhangjie Wu, Jun Gao, Yue Wang, Siheng Chen, Mike Chen, Sanja Fidler, Jiahui Huang (* denotes equal contribution)

Arxiv

PDF Project Page

NeurIPS

SCube: Instant Large-Scale Scene Reconstruction using VoxSplats

Xuanchi Ren^*, Yifan Lu^*, Hanxue Liang, Zhangjie Wu, Huan Ling, Mike Chen, Sanja Fidler, Francis Williams, Jiahui Huang (* denotes equal contribution)

Conference on Neural Information Processing Systems, (NeurIPS), 2024.

PDF Code Project Page

CVPR

Editable Scene Simulation for Autonomous Driving via LLM-Agent Collaboration

Yuxi Wei^*, Zi Wang^*, Yifan Lu^*, Chenxin Xu^*, Changxing Liu, Hao Zhao, Siheng Chen, Yanfeng Wang (* denotes equal contribution)

Conference on Computer Vision and Pattern Recognition (CVPR), 2024. (Highlight, 2.8% acceptance rate)

Code Project Page

ICLR

An Extensible Framework for Open Heterogeneous Collaborative Perception

Yifan Lu, Yue Hu, Yiqi Zhong, Dequan Wang, Siheng Chen, Yanfeng Wang

International Conference on Learning Representations (ICLR), 2024.

PDF Code

NeurIPS

Asynchrony-Robust Collaborative Perception via Bird's Eye View Flow

Sizhe Wei, Yuxi Wei, Yue Hu, Yifan Lu, Yiqi Zhong, Siheng Chen, Ya Zhang

Conference on Neural Information Processing Systems (NeurIPS), 2023.

PDF Code

CVPR

Collaboration Helps Camera Overtake LiDAR in 3D Detection

Yue Hu, Yifan Lu, Runsheng Xu, Weidi Xie, Siheng Chen, Yanfeng Wang

Conference on Computer Vision and Pattern Recognition (CVPR), 2023.

PDF Code

ICRA

Robust Collaborative 3D Object Detection in Presence of Pose Errors

Yifan Lu, Quanhao Li, Baoan Liu, Mehrdad Dianati, Chen Feng, Siheng Chen, Yanfeng Wang

International Conference on Robotics and Automation (ICRA), 2023.

PDF Code

NeurIPS

RainNet: A Large-Scale Imagery Dataset and Benchmark for Spatial Precipitation Downscaling

Xuanhong Chen, Kairui Feng, Naiyuan Liu, Bingbing Ni, Yifan Lu , Zhengyan Tong, Ziang Liu

Conference on Neural Information Processing Systems (NeurIPS), 2022.

PDF Project Page

Services

Conference Reviewers

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2023, 2024, 2025
IEEE/CVF International Conference on Computer Vision (ICCV) 2023
The European Conference on Computer Vision (ECCV) 2024
IEEE International Conference on Robotics and Automation (ICRA) 2024, 2025
International Conference on Learning Representations (ICLR) 2025

Awards

2023-2024 China National Scholarship for Graduate Student
2022-2023 Xiao Mi Scholarship
2022 Outstanding Graduate of Shanghai Jiaotong University
2020-2021 China National Scholarship (ranking top 1)
2020-2021 SJTU Scholarship A Prize
2019-2020 Outstanding Undergraduate Excellence Scholarship
2018-2020 SJTU Scholarship B Prize

Projects

Deploying and Optimizing DNN on Huawei Ascend AI Processor
Reinforcement Learning on Quanser Robot Platform Simulation [link]
Verilog Implement of 5-Level Pipelined CPU (MIPS arch) [link]

Misc

I am a landscape photographer with more than 5 years of photography experience. I’ve traveled to many places with my Sony A7M4 and recorded the beauty of plateaus, snow-capped mountains, and starry skies. I occasionally post some videos on my Bilibili account and welcome your attention.

2025.3.7 Mount Fuji in Japan. I cycled around the lake and felt the majesty of the mountains.

2023.10.18 I climbed over a mountain valley at an altitude of 4650m. Above the clouds, I was waiting for the sunrise.

2023.10.17 I camped on Siguniang Shan and watched the stars in Sichuan Province. I saw the Milky Way hanging on Yaomei Peak.