About
I am a special postdoctoral researcher at RIKEN AIP, actively collaborating with Machine Intelligence Lab
(MIL), UTokyo, led by Tatsuya Harada.
I am also a visiting researcher at Google.
I received my Ph.D. in 2024, from IIS-Lab, UTokyo, supervised by Koji
Yatani, and B.S. from Shanghai Jiao
Tong University in 2018.
I conduct research within the intersection of Human-computer Interaction (HCI) and Computer
Vision (CV), focusing on how these two disciplines can jointly contribute to future interactive systems.
During my PhD program, I specialized in Interactive Machine Teaching, developing interactive systems
that enhance user experience when they prototype AI models.
I am also believe in the potentials of foundational models and interested in exploring how we can
leverage them to create new interactive experiences.
My past research is related to visual programming, low-level CV, LLMs, pose/gesture
detection, and participatory system design.
Be free to email me if you want to collaborate or discuss with me about those research!
News
- May 2024 I started my position as a visiting researcher at Google.
- Apr. 2024 I started my postdoc at RIKEN AIP, working with Tatsuya Harada.
- Mar. 2024 I gave a talk at Google, host by Ruofei Du.
- Mar. 2024 I received my Ph.D. from UTokyo.
- Jan. 2024 I will serve as a poster presentation chair at CHI 2025.
- Oct. 2023 One paper is accepted to IMWUT 2023 (with minor revision).
- Oct. 2023 I am named as a finalist for the 2023 UbiComp Gaetano Borriello Outstanding Student Award.
- Jul. 2023 SoundTraveller receives Best Demo Award at DIS 2023.
- May 2023 One paper is accepted to DIS 2023.
- Apr. 2023 I gave talks at ShanghaiTech and Tsinghua University, host by Quan Li and Chun Yu.
- Apr. 2023 I will be a student researcher at Google, working with Ruofei Du, starting from May 2023.
- Feb. 2023 I will serve as Publication Chair at UbiComp/ISWC 2023.
Publication
Papers
DIPA2: An Image Dataset with Cross-cultural Privacy Perception Annotations
SoundTraveller: Exploring Abstraction and Entanglement in Timbre Creation Interfaces for Synthesizers
Gesture-aware Interactive Machine Teaching with In-situ Object Annotations
Bringing Rolling Shutter Images Alive with Dual Reversed Distortion
SyncUp: Vision-based Practice Support for Synchronized Dancing
An Image-based Approach for Defect Detection on Decorative Sheets
Workshop Papers (posters, demos, etc.)
Experiencing InstructPipe: Building Multi-modal AI Pipelines via Prompting LLMs and Visual Programming
Experiencing Rapid Visual Programming in Visual Blocks for ML
DIPA: An Image Dataset with Cross-cultural Privacy Concern Annotations
Exploiting and Guiding User Interaction in Interactive Machine Teaching
Enhancing Model Assessment in Vision-based Interactive Machine Teaching through Real-time Saliency Map Visualization
Vision-based Scene Analysis toward Dangerous Cycling Behavior Detection Using Smartphones
