Jonathan Huang
Also known as Jonathan Chung-Kuan Huang
Jonathan Huang is a computer-vision and machine-learning researcher whose work includes the TensorFlow Object Detection API and the VideoPoet video-generation model. He earned a PhD in Robotics at Carnegie Mellon in 2011 with Carlos Guestrin, then spent 2011 to 2014 as a postdoctoral fellow at Stanford with Leonidas Guibas. After joining Google in 2014, he was tech lead of the object detection team that won the 2016 COCO detection challenge, and the team's system was released as the TensorFlow Object Detection API in 2017. He also coauthored Deep Knowledge Tracing in 2015, Progressive Neural Architecture Search in 2018 and VideoPoet, which won Best Paper at ICML 2024. He is Head of AI at General Robotics.
- Now at
- General Robotics
- Badges
Timeline
-
2005–2011
Robotics PhD at Carnegie Mellon
He works at Carnegie Mellon as a research assistant from 2005 and completes a PhD in Robotics at the School of Computer Science in 2011, working with Carlos Guestrin. His thesis, Probabilistic Reasoning and Learning on Permutations, breaks complex distributions over permutations into smaller parts for problems such as ranking and tracking.
-
2011–2014
Postdoc at Stanford with Guibas
As one of the 2011 Computing Innovation Fellows, he joins Stanford's Computer Science Department as a postdoctoral fellow hosted by Leonidas Guibas. He is a member of Guibas's Geometric Computation Group and of the Lytics Lab, a group focused on learning analytics, until 2014.
-
2014–2015
Google and Deep Knowledge Tracing
He joins Google as a research scientist in 2014. In 2015, he coauthors Deep Knowledge Tracing with Chris Piech, Surya Ganguli, Leonidas Guibas and colleagues, which uses recurrent neural networks to model how students learn.
-
2016–2017
The TensorFlow Object Detection API
As tech lead of Google's object detection team, he helps win first place in the 2016 COCO detection challenge with 41.3% mAP. In June 2017, he and Vivek Rathod release the system as the TensorFlow Object Detection API, and he coauthors the CVPR 2017 paper Speed/accuracy trade-offs for modern convolutional object detectors.
-
2018
Progressive neural architecture search
He coauthors Progressive Neural Architecture Search with Chenxi Liu, Barret Zoph, Li Fei-Fei, Kevin Murphy and others, an ECCV 2018 oral paper. The method searches for convolutional network structures up to 5 times more efficiently than a reinforcement-learning method, measured in models evaluated.
-
2022
The Auto Arborist dataset
He announces the Auto Arborist dataset, which holds over 2 million trees in over 300 genus-level categories across 23 cities in the US and Canada. The dataset is first released with a CVPR 2022 publication.
-
2024
ICML Best Paper for VideoPoet
In December 2023, Google Research introduces VideoPoet, a language model that learns across video, image, audio and text through multiple tokenizers. The paper VideoPoet: A Large Language Model for Zero-Shot Video Generation, with him among its coauthors alongside Dan Kondratyuk and Lu Jiang, wins Best Paper at ICML 2024.
-
As of October 2026
Head of AI at General Robotics
He is Head of AI at General Robotics, whose robot intelligence platform is GRID. In September 2025, he is a core contributor to DreamControl, a workflow that combines diffusion models and reinforcement learning to build whole-body skills for humanoid robots.
Career
- NowGeneral RoboticsHead of AI
- 2014–2017GoogleResearch Scientist, Tech Lead
- 2011–2014Stanford UniversityPostdoctoral Fellow
- 2005–2011Carnegie Mellon UniversityResearch Assistant
Education
- 2011Carnegie Mellon UniversityPhD
Sources and credits
Photo: We have no published photo of Jonathan Huang yet. Send us a free-licensed photo.
- Jonathan Huang | DeepAI
- Jonathan Chung-Kuan Huang
- Probabilistic Reasoning and Learning on Permutations: Exploiting Structural Decompositions of the Symmetric Group - Robotics Institute Carnegie Mellon University
- Announcing the 2011 Computing Innovation Fellows - CCC Blog
- Deep Knowledge Tracing
- Supercharge your Computer Vision models with the TensorFlow Object Detection API
- Speed and accuracy trade-offs for modern convolutional object detectors
- Progressive Neural Architecture Search
- ICML 2024 Awards
- VideoPoet: A large language model for zero-shot video generation
- How we are building Humanoid AI skills with DreamControl
- Jonathan Huang | alphaXiv
- Jonathan Huang - Google Scholar



