Jay Whang
Jay Whang is a research scientist at Google DeepMind who works on Gemini and was a core contributor to Google's Imagen text-to-image model. He studied computer science and math at USC and Stanford, spent a few years at YouTube, and completed a PhD at UT Austin under Alex Dimakis. A 2021 paper on composing normalizing flows for inverse problems, written with Erik Lindgren and Dimakis, won a Best Paper Award at the UAI 2021 Workshop on Tractable Probabilistic Modeling. In 2022, the Imagen paper received a NeurIPS Outstanding Paper award, and he coauthored Imagen Video, a cascade of video diffusion models. He was among the authors of the Gemini 1.5 report in 2024.
- Now at
- Google DeepMind
Timeline
-
By 2019
USC, Stanford and YouTube
He studies computer science and math at USC and Stanford and spends a few years at YouTube training classifiers and building backend infrastructure. In 2019, he coauthors a paper with Rui Shu, Hung Bui and Stefano Ermon on training variational autoencoders with Buffered Stochastic Variational Inference.
-
2021
Normalizing flows for inverse problems
With Erik Lindgren and Alex Dimakis, his PhD advisor at UT Austin, he publishes "Composing Normalizing Flows for Inverse Problems" at ICML in 2021. The paper wins a Best Paper Award at the UAI 2021 Workshop on Tractable Probabilistic Modeling.
-
2022
Deblurring via stochastic refinement
In 2022, he is first author of the CVPR paper "Deblurring via Stochastic Refinement", written with Mauricio Delbracio, Hossein Talebi, Chitwan Saharia, Alexandros G. Dimakis and Peyman Milanfar. A conditional diffusion model refines the output of a deterministic predictor, and the work is presented as an oral.
-
2022
Core contributor to Imagen
In 2022, he is a core contributor to Imagen, a text-to-image diffusion model from the Google Research Brain Team. The paper finds that generic language models such as T5, pretrained on text-only corpora, encode text well for image synthesis, and Imagen reaches a state-of-the-art FID score of 7.27 on the COCO dataset.
-
2022
A NeurIPS Outstanding Paper
The Imagen paper, "Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding", receives an Outstanding Paper award at NeurIPS 2022. He is one of its fourteen authors.
-
2022
Imagen Video
In 2022, he coauthors Imagen Video, a text-conditional video generation system built on a cascade of video diffusion models that turns a text prompt into high definition video. He shares equal-contribution credit with Jonathan Ho, William Chan, Chitwan Saharia and Tim Salimans.
-
2024
An author of Gemini 1.5
In 2024, he is one of the authors of the Gemini 1.5 report from the Gemini Team at Google. The report introduces Gemini 1.5 Pro and Gemini 1.5 Flash, which reach near-perfect retrieval up to at least 10M tokens of context.
-
As of October 2026
Gemini at Google DeepMind
He is a research scientist at Google DeepMind working on Gemini. In 2026, he joins a Google DeepMind panel at AGI House's Enterprise Build Day, where he makes the case for world models as the substrate for the next jump.
Career
- NowGoogle DeepMindResearch Scientist
Education
Sources and credits
Photo: We have no published photo of Jay Whang yet. Send us a free-licensed photo.
- Jay Whang
- Training Variational Autoencoders with Buffered Stochastic Variational Inference
- Composing Normalizing Flows for Inverse Problems
- Deblurring via Stochastic Refinement (CVPR 2022 Open Access Repository)
- Imagen: Text-to-Image Diffusion Models
- [2205.11487] Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
- NeurIPS 2022 Awards
- [2210.02303] Imagen Video: High Definition Video Generation with Diffusion Models
- Imagen Video
- [2403.05530] Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
- 11 Days After I/O: Inside the Google DeepMind Enterprise Build Day
