Kuo-Hao Zeng
Also known as 曾國豪
Kuo-Hao Zeng is a computer vision and embodied AI researcher whose work trains robots and simulated agents to forecast, navigate and handle objects; since February 2026 he has been a member of the technical staff at Anthropic. After engineering studies at National Sun Yat-sen University and National Tsing Hua University, he completed a PhD in 2023 at the University of Washington's RAIVN Lab with Ali Farhadi and Roozbeh Mottaghi, where one of his projects taught a simulated drone to play catch. At the Allen Institute for AI from 2023 to 2025, he was first author of PoliFormer, a navigation agent that won an Outstanding Paper Award at CoRL 2024, and he coauthored the open Molmo vision-language models. In March 2025, he became a founding research scientist at Vercept, where he worked on computer use.
Timeline
-
2010–2017
Studies at Sun Yat-sen and Tsing Hua
He studies mechanical and electromechanical engineering at National Sun Yat-sen University from 2010 to 2014. From 2014 to 2017, he is an electrical engineering master's student at National Tsing Hua University, advised by Min Sun in the Vision Science Lab.
-
2016–2017
Video titles and accident anticipation
With Tseng-Hung Chen, Juan Carlos Niebles and Min Sun, he presents automatic title generation for user-generated videos at ECCV 2016 and collects the Video Titles in the Wild dataset of 18,100 videos and titles. At CVPR 2017, he is first author of a paper on accident anticipation that introduces the Epic Fail dataset of 3,000 viral videos.
-
2018–2020
Teaching a drone to catch
He begins a computer science PhD at the University of Washington in 2018, advised by Ali Farhadi and Roozbeh Mottaghi in the RAIVN Lab. At CVPR 2020, his visual reaction paper teaches a drone to play catch in simulated environments, using a model that combines a forecaster with a planner and a new dataset of 30,000 throws of 20 object types.
-
2021
A J.P. Morgan PhD fellowship
In 2021, he is named a J.P. Morgan Ph.D. Fellow for his research on forecasting for decision making in AI. His CVPR 2021 paper on interactive visual navigation trains agents with reinforcement learning to unblock paths toward a target, using a neural physics model that learns the outcome of actions.
-
2023–2025
Research scientist at Ai2
He completes his PhD in 2023 and works as a research scientist on embodied AI at the Allen Institute for AI (Ai2) from 2023 to 2025. He is one of six equal-contribution first authors of SPOC, a CVPR 2024 paper whose robot agent learns to navigate, explore and manipulate objects by imitating shortest paths in simulation.
-
2024
PoliFormer wins at CoRL
He is first author of PoliFormer, an RGB-only indoor navigation agent trained with reinforcement learning at scale purely in simulation that generalizes to the real world without adaptation. PoliFormer wins an Outstanding Paper Award at CoRL 2024, and Open X-Embodiment, a robot-learning dataset collaboration he coauthors, wins the ICRA 2024 Best Paper Award.
-
2024–2025
Coauthoring Molmo
He coauthors Molmo, a family of open vision-language models first posted in September 2024 together with PixMo, a collection of new datasets gathered without the use of external vision-language models. The Molmo and PixMo paper receives a Best Paper Honorable Mention at CVPR 2025.
-
Since February 2026
Technical staff at Anthropic
From March 2025 to February 2026, he is a founding research scientist at Vercept, where he works on computer use. In February 2026, he joins Anthropic as a member of the technical staff, working on computer vision, embodied AI and computer-use agents.
Career
- Since 2026AnthropicMember of the technical staff
- 2025–2026VerceptFounding Research Scientist
- 2023–2025Allen Institute for AI (Ai2)Research Scientist
Education
- From 2018University of WashingtonPhD
- 2017National Tsing Hua UniversityMaster's
- 2014National Sun Yat-sen University
Most-cited works
- Open X-Embodiment: Robotic Learning Datasets and RT-X Models: Open X-Embodiment Collaboration 0With Animesh Garg, Aniruddha Kembhavi, Bernhard Schölkopf, Cheng Chi, Deepak Pathak and Gaurav S. Sukhatme
- Leveraging Video Descriptions to Learn Video Question Answering
- Open X-Embodiment: Robotic Learning Datasets and RT-X ModelsWith Animesh Garg, Bernhard Schölkopf, Deepak Pathak, Gaurav S. Sukhatme, Henrik I. Christensen and Ilija Radosavovic
- Omnidirectional CNN for Visual Place Recognition and Navigation
- Title Generation for User Generated Videos
Sources and credits
Photo: We have no published photo of Kuo-Hao Zeng yet. Send us a free-licensed photo.
- Kuo-Hao Zeng | alphaXiv
- [1608.07068] Title Generation for User Generated Videos
- Agent-Centric Risk Assessment: Accident Anticipation and Risky Region Localization
- Visual Reaction: Learning to Play Catch With Your Drone (CVPR 2020 Open Access Repository)
- Allen School student Kuo-Hao Zeng named J.P. Morgan Ph.D. Fellow for his work in visual forecasting in artificial intelligence
- SPOC: Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real World
- Kuo-Hao Zeng
- PoliFormer: Scaling On-Policy RL with Transformers Results in Masterful Navigators
- CoRL 2024 - Awards
- [2409.17146] Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Models


