Toby Pohlen
Also known as Tobias Pohlen
Toby Pohlen is an AI research engineer whose work spans street-scene vision, game-playing systems and agents that use computers. He co-authored the 2016 FRRN paper, was first author on a 2018 Atari study, contributed to DeepMind’s AlphaStar paper and co-authored a 2022 paper on computer control. After more than six years at Google DeepMind, he joined xAI’s founding team in 2023 and helped ship the first Grok model. In February 2026, he left xAI after being chosen to lead Macrohard, and said he planned to sleep, write down what he had learned and decide what to do next.
- Badges
Timeline
-
2016–2017
Full-resolution residual networks
The paper appears on arXiv in November 2016 and becomes an oral at CVPR in 2017. With Alexander Hermans, Markus Mathias and Bastian Leibe, he builds a full-resolution network that reaches 71.8% intersection-over-union on Cityscapes without pre-training; he hosts the FRRN code on GitHub.
-
2018
Observe and Look Further
In May 2018, Tobias Pohlen is the first author of Observe and Look Further, joined by 12 co-authors including Bilal Piot, Todd Hester and Rémi Munos. The algorithm uses human demonstrations to guide exploration, exceeds an average human’s score on 40 of 42 Atari games, and solves the first level of Montezuma’s Revenge, the first deep RL algorithm to do so.
-
2019
AlphaStar in Nature
Nature publishes Grandmaster level in StarCraft II using multi-agent reinforcement learning in 2019, with Pohlen among DeepMind’s authors in London. AlphaStar reaches Grandmaster level for all three StarCraft races and ranks above 99.8% of officially ranked human players.
-
2022
Learning to control computers
In 2022, Pohlen coauthors A data-driven approach for learning to control computers, which trains agents to use keyboard and mouse with natural-language goals and reports human-level mean performance across MiniWob++ tasks.
-
By 2023
Staff research engineer
By November 2023, he has spent more than six years at Google DeepMind, most recently as a staff research engineer.
-
March 2023–November 2023
xAI’s founding team and Grok
Elon Musk founds xAI in March 2023 with Pohlen among its founding researchers. In July 2023, the company unveils its founding team, whose members include former researchers and engineers from Google, DeepMind, OpenAI, Microsoft and Tesla, plus a University of Toronto professor. In November 2023, Pohlen describes a 36-hour push that ships the first Grok model from a partially fine-tuned base model and a basic UI.
-
February 2026
Leading Macrohard
Macrohard aims to create an agent that can do anything a white-collar worker can do on a computer. In February 2026, xAI chooses Pohlen to lead the project.
-
February 2026
Leaving xAI
In February 2026, he leaves xAI as its seventh co-founder to depart since 2023. He says his next priorities are sleep, writing down what he has learned, and deciding what to do next; he names no new role.
Career
- Until 2023Google DeepMindStaff Research Engineer
- 2023–2026xAIFounding researcher
Sources and credits
Photo: We have no published photo of Toby Pohlen yet. Send us a free-licensed photo.
- Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes - Computer Vision
- TobyPDE (Toby Pohlen) · GitHub
- [1611.08323] Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes
- [1805.11593] Observe and Look Further: Achieving Consistent Performance on Atari
- Grandmaster level in StarCraft II using multi-agent reinforcement learning | Nature
- AlphaStar: Grandmaster level in StarCraft II using multi-agent reinforcement learning — Google DeepMind
- [2202.08137] A data-driven approach for learning to control computers
- xAI’s organizational structure: Elon Musk’s top executives at his ChatGPT AI startup | Fortune
- SpaceXAI - Wikipedia
- Elon Musk Announces xAI: Who’s On the 12-Man Founding Team? | Observer
- xAI Founding Member Describes Grok Development Grind | Let’s Data Science
- “Not built right the first time” — Musk’s xAI is starting over again, again | TechCrunch
- xAI founding member Toby Pohlen departs as Elon Musk’s AI startup faces wave of exits - BusinessToday
- Only five xAI co-founders left, as Toby Pohlen latest to exit

