David Rein
David Rein is technical staff at METR, a research nonprofit that measures whether and when AI systems might threaten catastrophic harm to society. He created GPQA, a benchmark of 448 graduate-level questions in biology, physics and chemistry, while a researcher at NYU. Before NYU, he was an early research engineer at Cohere, where he trained embedding models for semantic search. He also co-authored HCAST, a 189-task benchmark, and a randomized trial that found experienced open-source developers took 19% longer when allowed to use early-2025 AI tools. In January 2026, he discussed METR's time-horizon measurements on the AXRP podcast.
Timeline
-
2023
The GPQA benchmark
He creates GPQA while a researcher at NYU; its 448 graduate-level questions in biology, physics and chemistry reach arXiv in November 2023. Before NYU, he works as an early research engineer at Cohere, where he trains embedding models for semantic search.
-
March 2025
The HCAST benchmark
He co-authors HCAST, a benchmark of 189 tasks in machine learning engineering, cybersecurity, software engineering and general reasoning, which reaches arXiv in March 2025.
-
March 2025
A 50% time-horizon metric
He co-authors the paper “Measuring AI Ability to Complete Long Software Tasks”, which reaches arXiv in March 2025 and proposes a 50%-task-completion time horizon as a new metric.
-
July 2025
A developer productivity trial
He is one of four authors of a randomized trial, which reaches arXiv in July 2025 and finds that experienced open-source developers take 19% longer when allowed to use early-2025 AI tools.
-
January 2026
Explaining time horizons on AXRP
He discusses METR's time-horizon measurements as the guest of an AXRP podcast episode published in January 2026.
-
As of October 2026
Technical staff at METR
He is technical staff at METR, a research nonprofit that scientifically measures whether and when AI systems might threaten catastrophic harm to society.
Sources and credits
Photo: We have no published photo of David Rein yet. Send us a free-licensed photo.
- David Rein - METR
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark
- HCAST: Human-Calibrated Autonomy Software Tasks
- Measuring AI Ability to Complete Long Software Tasks
- Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity
- 47 - David Rein on METR Time Horizons | AXRP - the AI X-risk Research Podcast