Lala Li
Lala Li is a machine learning researcher who made a core contribution to Imagen, the text-to-image diffusion model from Google Research's Brain Team. In 2019, she coauthored a study of optimizers and batch sizes with Roger Grosse and others, and in 2020 and 2021 she worked with Ting Chen on embedding compression and contrastive losses. Pix2Seq, written with Chen, Saurabh Saxena, David Fleet and Geoffrey Hinton in 2021, cast object detection as a language modeling task. The Imagen paper received a NeurIPS 2022 Outstanding Paper award. Her later work used diffusion models for panoptic segmentation in 2023 and for 4D novel view synthesis in 2025, when she coauthored the ICLR paper 4DiM at Google DeepMind.
Timeline
-
2019
Optimizers and critical batch size
In 2019, she coauthors Which Algorithmic Choices Matter at Which Batch Sizes? with Guodong Zhang, Roger Grosse and other coauthors for NeurIPS 2019. The paper shows that preconditioned optimizers such as Adam and K-FAC reach much larger critical batch sizes than stochastic gradient descent with momentum.
-
2020–2021
Embeddings and contrastive learning
In 2020, she coauthors Differentiable Product Quantization with Ting Chen and Yizhou Sun, a framework that compresses embedding layers and appears at ICML 2020. In 2021, she coauthors Intriguing Properties of Contrastive Losses with Ting Chen and Calvin Luo for NeurIPS 2021.
-
2021–2022
Pix2Seq object detection
In 2021, she coauthors Pix2Seq with Ting Chen, Saurabh Saxena, David Fleet and Geoffrey Hinton. The ICLR 2022 paper casts object detection as a language modeling task, with bounding boxes and class labels written as sequences of discrete tokens.
-
May 2022
Co-authoring Imagen
In May 2022, she makes a core contribution to Imagen, a text-to-image diffusion model from Google Research's Brain Team. The model encodes text with a pretrained language model such as T5 and reaches a state-of-the-art FID score of 7.27 on COCO without training on COCO.
-
2022
NeurIPS 2022 Outstanding Paper
She is a coauthor of the Imagen paper, Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding, which receives a NeurIPS 2022 Outstanding Paper award.
-
2022–2023
Sequence and diffusion for vision
In 2022, she coauthors A Unified Sequence Interface for Vision Tasks at NeurIPS, which trains one model on object detection, instance segmentation, keypoint detection and image captioning. In 2023, she coauthors A Generalist Framework for Panoptic Segmentation of Images and Videos at ICCV, which uses a diffusion model to model panoptic masks.
-
May 2023
The FIT transformer
In May 2023, she and Ting Chen post FIT: Far-reaching Interleaved Transformers, which splits tokens into groups and alternates local and global transformer layers. The architecture can serve as an encoder, a diffusion decoder or an autoregressive decoder.
-
2025
4DiM at Google DeepMind
In 2025, she coauthors Controlling Space and Time with Diffusion Models at Google DeepMind, with Daniel Watson, Saurabh Saxena, Andrea Tagliasacchi and David Fleet. The ICLR 2025 paper presents 4DiM, a cascaded diffusion model for 4D novel view synthesis from one or more images.
Career
- 2025Google DeepMind
- 2022Google Brain
Sources and credits
Photo: We have no published photo of Lala Li yet. Send us a free-licensed photo.
- Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model
- Lala Li - Google Research
- Differentiable Product Quantization for End-to-End Embedding Compression
- Intriguing Properties of Contrastive Losses
- Pix2seq: A Language Modeling Framework for Object Detection
- Imagen: Text-to-Image Diffusion Models
- Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
- NeurIPS 2022 Awards
- A Unified Sequence Interface for Vision Tasks
- A Generalist Framework for Panoptic Segmentation of Images and Videos
- FIT: Far-reaching Interleaved Transformers
- Controlling Space and Time with Diffusion Models | ICLR Proceedings
- Controlling Space and Time with Diffusion Models


