Anyi Rao
Also known as 饒安逸
Anyi Rao is a researcher in creative AI whose work spans movie understanding, controllable images and generated video. He coauthored MovieNet in 2020, earned a PhD in information engineering at CUHK in 2022, and was a Stanford postdoctoral scholar in 2023. ControlNet won ICCV's 2023 Marr Prize; in 2024, he coauthored AnimateDiff and received the World Artificial Intelligence Conference Rising Star Award. At ICLR 2025, he coauthored IC-Light, was named to Forbes 30 Under 30 Asia, and his video-generation project received CCF-Tencent Rhino-Bird Fund support. He is an assistant professor in HKUST's Division of Arts and Machine Creativity and directs Multimedia Creativity Lab; Microsoft Research Asia named him a StarTrack Scholar in 2026.
Timeline
-
2020
MovieNet for movie understanding
His interest in storytelling takes root in childhood films starring Jackie Chan and Stephen Chow. In 2020, he coauthors MovieNet, a holistic dataset for movie understanding with 1,100 movies and multimodal annotations.
-
2022
PhD in information engineering
He earns a PhD in Information Engineering at the Chinese University of Hong Kong in 2022, doing his doctoral work in MMLab.
-
September 2023
Postdoctoral work at Stanford
In September 2023, he is a postdoctoral scholar at Stanford with Maneesh Agrawala. His research experience also includes Meta Reality Lab, Vector Institute, University of Toronto, and Hong Kong University.
-
2023
ControlNet and the Marr Prize
With Lvmin Zhang and Maneesh Agrawala, he coauthors ControlNet, a neural network architecture that adds spatial conditioning to large pretrained text-to-image diffusion models. In 2023, the paper wins ICCV's Best Paper Award, the Marr Prize.
-
2024
AnimateDiff and a WAIC award
At ICLR 2024, he coauthors AnimateDiff, a framework with a plug-and-play motion module that animates personalized text-to-image models. He receives the Rising Star Award at the World Artificial Intelligence Conference in 2024.
-
2025
IC-Light and 2025 honors
At ICLR 2025, he coauthors IC-Light, a diffusion-based method for illumination harmonization and editing. He is named to Forbes 30 Under 30 Asia in the Healthcare & Science category, and his video-generation project receives support from the CCF-Tencent Rhino-Bird Fund for film, television and animation.
-
2026
A StarTrack Scholar
He is named a Microsoft Research Asia StarTrack Scholar in 2026.
-
As of October 2026
HKUST professor and lab director
He is an assistant professor in HKUST's Division of Arts and Machine Creativity. He directs the Multimedia Creativity Lab and serves as associate director of HKUST's Media Intelligence Research Center.
Career
- NowHong Kong University of Science and TechnologyAssistant Professor
- From 2023Stanford UniversityPostdoctoral Scholar
Education
Sources and credits
Photo: We have no published photo of Anyi Rao yet. Send us a free-licensed photo.
- MovieNet: A Holistic Dataset for Movie Understanding
- Where AI Meets Humanity: A Scholar Democratizing Storytelling
- Anyi RAO - The Hong Kong University of Science and Technology Research Portal
- Anyi Rao – Brown Institute
- Adding Conditional Control to Text-to-Image Diffusion Models
- Anyi Rao
- AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning
- Scaling In-the-Wild Training for Diffusion-based Illumination Harmonization and Editing by Imposing Consistent Light Transport
- Prof. Anyi RAO selected as Forbes 30 under 30 Asia 2025: Healthcare & Science
- Prof. Anyi RAO receives 2025 CCF-Tencent Rhino-Bird Fund
