Collin Burns
Collin Burns is an AI researcher whose work spans language-model evaluation, alignment, and internal model behavior. He coauthored MMLU, ETHICS, and MATH, then studied latent knowledge in language models and whether weak supervision can elicit stronger capabilities. His later research introduced unsupervised skill elicitation and examined unintended behavior from post-training data. He studied machine learning at UC Berkeley with Jacob Steinhardt and Dan Klein and worked at OpenAI and Anthropic. In April 2026, he was selected to lead CAISI and left the role within a week; as of October 2026, he is an AI researcher.
- Works
- 16
- Citations
- 1,678
- h-index
- 11
Publication numbers from OpenAlex, as of 19 October 2026.
Timeline
-
2015
A 5.25-second cube record
In 2015, he breaks the official world record for a single 3x3 solve at 5.25 seconds.
-
2020–2021
MMLU, ETHICS, and MATH
In 2020, he coauthors MMLU, a test that covers 57 tasks, and the ETHICS benchmark for moral judgments. In 2021, he coauthors the MATH dataset paper on mathematical problem solving.
-
2022–2023
A Berkeley machine-learning PhD
In 2023, he is a second-year machine-learning PhD student at UC Berkeley, working with Jacob Steinhardt and Dan Klein. His 2022 paper with Haotian Ye, Dan Klein, and Jacob Steinhardt proposes an unsupervised method that finds latent knowledge in a language model's internal activations.
-
2024
Weak-to-strong generalization
His 2024 ICML paper tests whether weak models can supervise stronger models. It finds that strong models trained on weak-model labels outperform their weak supervisors on natural-language processing, chess, and reward modeling tasks.
-
2025–2026
Unsupervised elicitation and post-training
He coauthors Unsupervised Elicitation of Language Models in 2025; the paper uses models' own generated labels to elicit skills without external supervision. In 2026, he coauthors Chunky Post-Training, which studies spurious correlations arising from post-training data.
-
April 2026
Tapped to lead CAISI
In April 2026, he is tapped to lead the Center for AI Standards and Innovation after work at OpenAI and Anthropic. The White House pushes him out four days into the job, and Chris Fall takes over.
-
As of October 2026
AI researcher
As of October 2026, he is an AI researcher after work at OpenAI and Anthropic.
Career
- 2026US AI Safety Institute / CAISILead
Education
- From 2022University of California, BerkeleyPhD
Most-cited works
- Measuring Massive Multitask Language UnderstandingWith Dawn Song
- Measuring Mathematical Problem Solving With the MATH DatasetWith Dawn Song
- Aligning AI With Shared Human ValuesWith Dawn Song
- GPT-Neo: Large Scale Autoregressive Language Modeling with Mesh-TensorflowWith Dawn Song
- CUAD: An Expert-Annotated NLP Dataset for Legal Contract Review
Sources and credits
Photo: We have no published photo of Collin Burns yet. Send us a free-licensed photo.
- Collin Burns
- Measuring Massive Multitask Language Understanding
- Aligning AI With Shared Human Values
- Measuring Mathematical Problem Solving With the MATH Dataset
- Collin Burns On Discovering Latent Knowledge In Language Models Without Supervision
- Discovering Latent Knowledge in Language Models Without Supervision
- Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision
- Unsupervised Elicitation of Language Models
- Unsupervised Elicitation
- Chunky Post-Training: Data Driven Failures of Generalization
- IBB Econ & Tech INsights — June 2026
- Trump's latest AI czar has already resigned




