Max Schwarzer
Max Schwarzer is a reinforcement-learning researcher whose work spans deep-RL evaluation and AI model post-training. He earned a BA in computer science and mathematics at Pomona College in 2018, an MSc at Mila, Université de Montréal, in 2020, and a PhD there in 2024 under Aaron Courville and Marc Bellemare. His 2021 paper on deep-RL evaluation received a NeurIPS Outstanding Paper Award. Work he coauthored in 2022 and 2023 examined primacy bias and introduced the Atari agent BBF. He joined OpenAI in 2023, led post-training for o1 and o3, and became VP of Research in 2025; he is a Member of Technical Staff at Anthropic, which he joined in March 2026.
Timeline
-
2014–2018
Computer science at Pomona
He earns a Bachelor of Arts in computer science and mathematics at Pomona College in 2018.
-
2015–2018
Early research and data roles
He works as a bioinformatics intern at IGM Biosciences in 2015, a lead data science intern at Kaspect in 2016, and a summer research intern at Pomona College in 2016. In 2017 and 2018, he works as a research intern at Numenta.
-
2018–2024
Graduate degrees at Mila
He completes an MSc in computer science at Mila, Université de Montréal, in 2020. He earns a PhD in computer science at Mila in March 2024 under Aaron Courville and Marc Bellemare, studying scaling and sample-efficient reinforcement learning.
-
2021
A NeurIPS Outstanding Paper
He coauthors “Deep Reinforcement Learning at the Edge of the Statistical Precipice” in 2021, arguing that reliable evaluation of few-run deep-RL experiments must account for statistical uncertainty. The paper receives a NeurIPS Outstanding Paper Award in 2021.
-
January 2022–September 2023
Research at Google Brain and Apple
From January 2022 to June 2023, he is a student researcher at Google Brain. In June 2023, he starts a research internship in Samy Bengio’s machine-learning research group at Apple.
-
2022–2023
Primacy bias and Atari 100K
In 2022, he coauthors “The Primacy Bias in Deep Reinforcement Learning,” which describes how deep-RL agents can overfit early experience and neglect later evidence. At ICML 2023, he coauthors “Bigger, Better, Faster: Human-level Atari with human-level efficiency,” which introduces BBF, a value-based agent that achieves super-human performance in Atari 100K.
-
November 2023–March 2026
Post-training at OpenAI
He joins OpenAI as a Member of Technical Staff in November 2023 and becomes VP of Research in September 2025, a role he holds through March 2026. He leads post-training for o1 and o3.
-
Since March 2026
Member of Technical Staff
He joins Anthropic as a Member of Technical Staff in March 2026.
Career
- Since 2026AnthropicMember of Technical Staff
- 2023AppleResearch Intern
- 2023–2026OpenAIMember of Technical Staff, VP of Research
- 2022–2023Google BrainStudent Researcher
- 2017–2018NumentaResearch Intern
- 2016KaspectLead Data Science Intern
- 2016Pomona CollegeSummer Research Intern
- 2015IGM BiosciencesBioinformatics Intern
Education
- 2024Université de MontréalPhD
- 2020Université de MontréalMSc
- 2018Pomona CollegeB.A.
Sources and credits
Photo: We have no published photo of Max Schwarzer yet. Send us a free-licensed photo.
- Background
- About Me
- [2108.13264] Deep Reinforcement Learning at the Edge of the Statistical Precipice
- Deep Reinforcement Learning at the Edge of the Statistical Precipice
- [2205.07802] The Primacy Bias in Deep Reinforcement Learning
- Bigger, Better, Faster: Human-level Atari with human-level efficiency


