Guodong Zhang
Also known as 张国栋
Guodong Zhang is a machine learning researcher and xAI co-founder whose career spans neural network optimization and AI product leadership. He coauthored research on Bayesian neural networks, weight decay, critical batch sizes and deep networks without shortcuts. In 2023, he joined xAI's founding team after work as a DeepMind research scientist and a PhD at the University of Toronto. In March 2026, he left xAI after leading Grok Code and Grok Imagine. As of October 2026, he is a machine learning researcher focused on training, tuning and aligning large language models.
Timeline
-
2018
Noisy natural-gradient training
He coauthors Noisy Natural Gradient as Variational Inference in 2018, using adaptive weight noise with natural-gradient methods to train Bayesian neural networks.
-
2018
Weight-decay mechanisms
In a 2018 paper, he and his collaborators identify three mechanisms by which weight decay regularizes neural networks, with effects that depend on the optimization algorithm and architecture.
-
2019
Critical batch sizes
His 2019 NeurIPS paper with seven coauthors studies how acceleration and preconditioning affect critical batch sizes through experiments and a noisy quadratic model.
-
2022
Deep networks without shortcuts
In 2022, he and his coauthors develop a tailored activation transformation for deep networks without shortcut connections or normalization layers.
-
2023
xAI's founding team
In 2023, he joins xAI's founding team with prior work as a DeepMind research scientist and a PhD from the University of Toronto.
-
March 2026
Grok Code and Imagine
In March 2026, he leaves xAI after leading Grok Code and Grok Imagine.
-
As of October 2026
Large language model research
As of October 2026, he is a machine learning and AI researcher focused on training, tuning and aligning large language models.
Sources and credits
Photo: We have no published photo of Guodong Zhang yet. Send us a free-licensed photo.
- Noisy Natural Gradient as Variational Inference
- Three Mechanisms of Weight Decay Regularization
- Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model
- Deep Learning without Shortcuts: Shaping the Kernel with Tailored Rectifiers
- Elon Musk Announces xAI: Who’s On the 12-Man Founding Team?
- The xAI exodus: Two more cofounders leave — and Musk says he's rebuilding
- Guodong Zhang