Peter J. Liu
Peter J. Liu is a language-model researcher whose work spans summarization, clinical note generation and Transformer training; he holds mathematics and computer science degrees from the University of Toronto, began language-model research on Google Brain in 2015, and coauthored a pointer-generator summarization paper in 2017. His 2018 work includes a clinical note-generation study and a method for generating long Wikipedia articles; he coauthored the text-to-text transfer paper that Google Research presents as T5 in 2020. In 2023, he coauthored research on Transformer training instabilities and joined the AIMO Prize Advisory Committee in 2024. He is a co-founder of Twenty Labs, whose first product is Compound, an AI financial analyst.
Timeline
-
2015
Google Brain language research
He holds degrees in mathematics and computer science from the University of Toronto. In 2015, he begins machine-learning research specializing in language models on the Google Brain team.
-
2017
Pointer-generator summarization
In 2017, he coauthors “Get To The Point: Summarization with Pointer-Generator Networks.” Its network copies source words through a pointer, and coverage tracks summarized content to discourage repetition.
-
2018
Clinical note generation
In 2018, he publishes the solo study “Learning to Write Notes in Electronic Health Records.” It predicts note content from earlier patient-record data and trains generative models on the public, de-identified MIMIC-III dataset.
-
2018
Long-form Wikipedia generation
At ICLR in 2018, he coauthors “Generating Wikipedia by Summarizing Long Sequences.” The paper frames English Wikipedia generation as multi-document summarization and introduces a decoder-only architecture for long inputs.
-
2019–2020
Text-to-text transfer learning
In 2019, he coauthors transfer-learning research that converts text-based language problems into a text-to-text format. Google Research presents the resulting model as T5 in 2020 and lists translation, summarization, question answering and classification among its tasks.
-
2023
Transformer training instabilities
In 2023, he coauthors “Small-scale proxies for large-scale Transformer training instabilities.” The study finds that some instabilities also appear in small models at high learning rates.
-
2024
AIMO Prize Advisory Committee
In 2024, he joins the AIMO Prize Advisory Committee. He is a Research Scientist at Google DeepMind, specializing in language-model research.
-
As of October 2026
Twenty Labs and Compound
As of October 2026, he is a co-founder of Twenty Labs, an applied research lab whose first product is Compound, an AI financial analyst. Before co-founding the lab, he works as a Research Scientist at Google DeepMind on language modeling from pretraining through fine-tuning and post-training. His earlier production experience includes leading machine learning for Gmail Spam, deploying models to millions of users, and using neural networks for financial-fraud detection at banks.
Career
- NowTwenty LabsCo-founder
- From 2024AIMO Prize Advisory CommitteeAdvisory Committee Member
- From 2015Google Brain
- Google DeepMindResearch Scientist
Education
Sources and credits
Photo: We have no published photo of Peter J. Liu yet. Send us a free-licensed photo.
- The AIMO Prize Manager and Advisory Committee
- Get To The Point: Summarization with Pointer-Generator Networks
- Learning to Write Notes in Electronic Health Records
- Generating Wikipedia by Summarizing Long Sequences
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
- Exploring Transfer Learning with T5: the Text-To-Text Transfer Transformer
- Small-scale proxies for large-scale Transformer training instabilities
- AIMO Prize Appoints Further Advisory Committee Members | AIMO Prize
- Peter J Liu
- About Us | Compound


