Adria Puigdomenech Badia
Also known as Adrià Puigdomènech
Adria Puigdomenech Badia is an AI researcher whose work spans deep reinforcement learning and multimodal models. He coauthored asynchronous reinforcement-learning research, Neural Episodic Control and Imagination-Augmented Agents; Agent57 scored above the human baseline on all 57 Atari games. His 2020 Never Give Up paper doubled a base agent's performance on hard-exploration Atari games. In 2022 he coauthored Human-level Atari 200x faster; he also coauthored Gemini in 2023 and Gemini 1.5 in 2024. ICML gave his 2016 paper the 2026 Test of Time Award, citing its influence on RL post-training for large language models.
Timeline
-
2016
Asynchronous deep reinforcement learning
In 2016, he coauthors Asynchronous Methods for Deep Reinforcement Learning, which presents asynchronous versions of four standard reinforcement-learning algorithms. Its actor-critic variant surpasses Atari's current state of the art while training for half the time on a single multi-core CPU.
-
2017
Neural Episodic Control
Neural Episodic Control, which he coauthors in 2017, is a deep reinforcement-learning agent that rapidly assimilates new experiences. Its semi-tabular value representation pairs a buffer of past experience with rapidly updated estimates, helping it learn quickly across many environments.
-
2017
Imagination-Augmented Agents
He coauthors Imagination-Augmented Agents for Deep Reinforcement Learning in 2017, an architecture that combines model-free and model-based methods. The agents use predictions from a learned environment model to build implicit plans.
-
2020
Agent57 on Atari
In 2020, he coauthors Agent57, the first deep reinforcement-learning agent to score above the human baseline on all 57 Atari 2600 games. Its meta-controller adapts exploration and long- and short-term behavior across a family of policies.
-
2020
Never Give Up exploration
He coauthors Never Give Up: Learning Directed Exploration Strategies in 2020. Its method doubles the base agent's performance on hard-exploration games across the Atari-57 suite while maintaining a high score on the other games.
-
2022
Human-level Atari with less data
Taking Agent57 as its starting point, the 2022 paper Human-level Atari 200x faster, which he coauthors, reduces by 200-fold the experience needed to exceed the human baseline.
-
2023–2024
Gemini and Gemini 1.5
He coauthors Gemini, a family of multimodal models, in 2023. In 2024, he coauthors Gemini 1.5, whose report describes reasoning over millions of tokens and retrieval above 99% up to at least 10 million tokens.
-
2026
A Test of Time Award
In 2026, ICML gives Asynchronous Methods for Deep Reinforcement Learning its Test of Time Award. The award cites the paper's parallel actor-learner method as a major contributor to reinforcement learning in LLM post-training and says it reshaped RL practice.
Sources and credits
Photo: We have no published photo of Adria Puigdomenech Badia yet. Send us a free-licensed photo.
- [1602.01783] Asynchronous Methods for Deep Reinforcement Learning
- [1703.01988] Neural Episodic Control
- [1707.06203] Imagination-Augmented Agents for Deep Reinforcement Learning
- Agent57: Outperforming the human Atari benchmark — Google DeepMind
- [2002.06038] Never Give Up: Learning Directed Exploration Strategies
- [2209.07550] Human-level Atari 200x faster
- [2312.11805] Gemini: A Family of Highly Capable Multimodal Models
- [2403.05530] Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
- Announcing the ICML 2026 Awards – ICML Blog