Mark Rowland
Mark Rowland is a research scientist at Google DeepMind whose work spans reinforcement learning and formal mathematical reasoning. He developed distributional reinforcement-learning methods, coauthored a textbook on the field, and proved convergence results for quantile temporal-difference learning. In 2024, he contributed to AlphaProof, which helped a combined system reach silver-medal level at the International Mathematical Olympiad.
- Now at
- Google DeepMind
- Works
- 67
- Badges
Publication numbers from OpenAlex, as of 22 October 2026. Citations and h-index are hidden because this OpenAlex record may be incomplete or mix in other authors.
Timeline
-
2018
Cambridge degrees and quantile regression
At Cambridge, he studies for a BA and MMath, then a PhD at Clare College, co-supervised by Rich Turner at the Machine Learning Group and John Aston at Statslab. In 2018, he coauthors a quantile-regression algorithm that models the distribution of returns in reinforcement learning.
-
2019
An expectile-based RL algorithm
In 2019, he and his coauthors introduce EDRL, an algorithm based on estimates of the expectiles of a return distribution.
-
2023
A textbook on distributional RL
In 2023, he coauthors the MIT Press textbook Distributional Reinforcement Learning, an introduction to the field.
-
2024
Proving quantile TD convergence
In 2024, he and his coauthors analyze quantile temporal-difference learning and prove its convergence with probability 1 to fixed points of related dynamic-programming procedures.
-
2024
A minimax result for distributional RL
In 2024, he and his coauthors propose a model-based distributional RL algorithm with a minimax-optimal bound, up to logarithmic factors, for approximating return distributions with a generative model.
-
July 2024
AlphaProof at the 2024 IMO
In July 2024, he contributes to AlphaProof, a reinforcement-learning system for formal mathematical reasoning. With AlphaGeometry 2, AlphaProof helps a combined AI system reach silver-medal level at the International Mathematical Olympiad.
-
November 2025
AlphaProof's formal reasoning method
In November 2025, he coauthors the Nature paper presenting AlphaProof as an agent that learns formal proofs through reinforcement learning on millions of auto-formalized problems.
-
As of October 2026
Research scientist at DeepMind
As of October 2026, he is a research scientist at Google DeepMind, where he works on reinforcement learning from theoretical guarantees to large-scale deep-RL applications.
Career
- NowGoogle DeepMindResearch scientist
Education
- University of CambridgeBA and MMath
Sources and credits
Photo: We have no published photo of Mark Rowland yet. Send us a free-licensed photo.
- Mark Rowland – MLG Cambridge
- Distributional Reinforcement Learning With Quantile Regression
- Statistics and Samples in Distributional Reinforcement Learning
- Distributional Reinforcement Learning
- An Analysis of Quantile Temporal-Difference Learning
- Near-Minimax-Optimal Distributional Reinforcement Learning with a Generative Model
- AI achieves silver-medal standard solving International Mathematical Olympiad problems
- Olympiad-level formal mathematical reasoning with reinforcement learning
- Mark Rowland