Kevin Xie
Also known as Cheng Xie
Kevin Xie is a research scientist at NVIDIA who builds generative models of 3D objects, human motion and simulated worlds for autonomous physical agents. He studied Engineering Physics at the University of British Columbia, where he coauthored the PLAID skill-distillation paper with Michiel van de Panne for ICLR 2018, and did his PhD at the University of Toronto and the Vector Institute, co-supervised by Florian Shkurti and Sanja Fidler. As first author of a 2021 ICCV paper, he used differentiable physics to correct human poses estimated from monocular video. In 2024, he was co-first author of LATTE3D, which turns text into textured 3D meshes in 400 milliseconds, and coauthored the L4GM model for animated 4D objects. His recent work centers on world models, including NVIDIA's Cosmos-Transfer1 in 2025 and the OmniDreams world model for autonomous vehicle simulation in 2026.
Timeline
-
2018
Skill distillation at UBC
He studies Engineering Physics at the University of British Columbia, where he works with Michiel van de Panne. With Glen Berseth, Paul Cernek and van de Panne, he coauthors PLAID at ICLR 2018, a method that merges bipedal locomotion skills by extending policy distillation to continuous actions.
-
2020–2021
Planning with learned models
His doctoral work in computer science at the University of Toronto and the Vector Institute is co-supervised by Florian Shkurti and Sanja Fidler. In April 2020, he, Homanga Bharadhwaj and Shkurti post a model-predictive control method that interleaves the cross-entropy method with gradient descent steps. Latent Skill Planning, posted in November 2020 and published at ICLR 2021, joins a learned world model with skills chosen by online planning.
-
2021
Physics-corrected human motion
In September 2021, he posts Physics-based Human Motion Estimation and Synthesis from Videos as first author, with Tingwu Wang, Umar Iqbal, Yunrong Guo, Sanja Fidler and Florian Shkurti of the University of Toronto and NVIDIA. The ICCV 2021 paper corrects image-based pose estimates with differentiable physics constraints and trains generative models of human motion from monocular RGB video.
-
2023
ATT3D for text-to-3D
He coauthors ATT3D with Jonathan Lorraine, James Lucas, Sanja Fidler and colleagues at NVIDIA, the University of Toronto and the Vector Institute, presented at ICCV 2023. The method trains one model on many text prompts at once, sharing computation across the prompt set and generalizing to unseen prompts.
-
2024
LATTE3D in 400 milliseconds
As co-first author with Jonathan Lorraine and Tianshi Cao, he posts LATTE3D in March 2024. The model produces detailed textured 3D meshes from text in a single forward pass, generating objects in 400 ms, and appears at ECCV 2024.
-
2024
L4GM for animated 4D objects
He is second author, after Jiawei Ren, of L4GM, a NeurIPS 2024 paper. Billed as the first 4D large reconstruction model, it turns a single-view video into an animated object in one feed-forward pass that takes about a second.
-
2025
VideoPanda and Cosmos-Transfer1
In April 2025, he posts VideoPanda as first author; it adds multi-view attention to a video diffusion model to synthesize 360-degree videos from text or a single-view video. He is also among the authors of NVIDIA's Cosmos-Transfer1, an open-source conditional world generation model posted in March 2025 for robotics Sim2Real and autonomous vehicle data enrichment.
-
As of October 2026
World models at NVIDIA
He is a research scientist at NVIDIA working on generative world models for autonomous physical agents. In NVIDIA's DAIR research group, his research covers learning-based simulation and control, including generative modeling, model-based reinforcement learning and character control. In June 2026, he is among the authors of NVIDIA OmniDreams, a real-time generative world model for closed-loop autonomous vehicle simulation trained on 21k hours of driving scenarios.
Career
- Since 2020NVIDIAResearch scientist
Education
- 2021University of TorontoPhD
- 2021Vector InstitutePhD
- 2018University of British Columbia
Most-cited works
- Physics-based Human Motion Estimation and Synthesis from VideosWith Sanja Fidler
- ATT3D: Amortized Text-to-3D Object SynthesisWith Ming-Yu Liu, Sanja Fidler and Tsung-Yi Lin
- gradSim: Differentiable simulation for system identification and visuomotor controlWith Miles Macklin and Sanja Fidler
- KAMA: 3D Keypoint Aware Body Mesh Articulation
- L4GM: Large 4D Gaussian Reconstruction ModelWith Antonio Torralba and Sanja Fidler
Sources and credits
Photo: We have no published photo of Kevin Xie yet. Send us a free-licensed photo.
- Kevin Xie
- Kevin Xie | DAIR @ NVIDIA Research
- [2004.08763] Model-Predictive Control via Cross-Entropy and Gradient-Based Optimization
- [2011.13897] Latent Skill Planning for Exploration and Transfer
- [2109.09913] Physics-based Human Motion Estimation and Synthesis from Videos
- Physics Human Motion
- ATT3D: Amortized Text-to-3D Object Synthesis
- LATTE3D: Large-scale Amortized Text-To-Enhanced3D Synthesis
- [2403.15385] LATTE3D: Large-scale Amortized Text-To-Enhanced3D Synthesis
- L4GM: Large 4D Gaussian Reconstruction Model
- [2504.11389] VideoPanda: Video Panoramic Diffusion with Multi-view Attention
- [2503.14492] Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Control
- [2606.03159] NVIDIA OmniDreams: Real-Time Generative World Model for Closed-Loop Autonomous Vehicle Simulation


