Nicholas Schiefer
Nicholas Schiefer is a computer scientist whose work spans molecular computation, database systems and AI safety research. He studied computer science at Caltech, built iCloud database systems at Apple, and pursued graduate study in computer science at MIT under Piotr Indyk. His AI research has covered Constitutional AI, model self-evaluation, deep learning generalization, language model evaluations and deceptive model behavior. As of October 2026, he is a Member of Technical Staff at Anthropic, where he builds evaluations of large language models.
Timeline
-
2015
Quantum and molecular computation
In 2015, he researches quantum computation and molecular programming with Erik Winfree as an undergraduate at Caltech.
-
2015
A Bhansali Prize mention
He earns an honorable mention for the 2015 Bhansali Prize in computer science.
-
2016
A Caltech degree
In 2016, he graduates from Caltech with a degree in computer science.
-
2017–2020
iCloud database systems
From 2017 to 2020, he works as a software engineer at Apple and builds database systems for iCloud, including FoundationDB Record Layer.
-
2022
Riffle and language models
He studies computer science as a graduate student at MIT under Piotr Indyk, where his main project is Riffle; in March 2022, he coauthors an essay describing its reactive relational database for data-centric apps. In July 2022, he coauthors Language Models (Mostly) Know What They Know, which studies whether models can assess their claims and predict which questions they can answer correctly. In December 2022, he coauthors Constitutional AI, which trains a harmless assistant with written principles and AI feedback without human labels identifying harmful outputs.
-
2023
Quantiles and model evaluations
In April 2023, he coauthors “Learned Interpolation for Better Streaming Quantile Approximation with Worst-Case Guarantees,” which applies interpolation to streaming quantiles and aims to improve real-world estimates while keeping worst-case guarantees. He also coauthors “Superposition, Memorization, and Double Descent” in 2023, which uses toy models to study how deep learning models generalize beyond their training data. In October 2023, he coauthors Anthropic’s “Challenges in evaluating AI systems,” which outlines limits in current evaluation suites and the work needed to build robust assessments.
-
2024
Sleeper agents and reward tampering
In January 2024, he coauthors Sleeper Agents, which finds that backdoor behavior can persist through supervised fine-tuning, reinforcement learning and adversarial training. In April 2024, he coauthors Anthropic’s “Simple probes can catch sleeper agents,” which uses residual-stream activations to predict when a sleeper-agent model will follow a hidden goal. In June 2024, he coauthors Sycophancy to Subterfuge, which studies whether language models generalize from specification gaming to reward tampering.
-
As of October 2026
Member of Technical Staff
As of October 2026, he is a Member of Technical Staff at Anthropic and builds evaluations of large language models. He also builds software tools for research on those models.
Career
- Since 2022AnthropicMember of Technical Staff
- 2023–2024University of Oxford
- 2022–2023Massachusetts Institute of Technology
- 2017–2020AppleSoftware engineer
Education
- 2016California Institute of TechnologyComputer science degree
- Massachusetts Institute of TechnologyGraduate study in computer science
Most-cited works
- AI-to-AI Code Reviews of GitHub Pull RequestsWith Cameron McKinnon, Carol Chen, Catherine Olsson, Chris Olah, Danny Hernandez and Dawn Drain
- Discovering Language Model Behaviors with Model-Written EvaluationsWith Cameron McKinnon, Catherine Olsson, Chris Olah, Danny Hernandez, Dawn Drain and Eli Tran-Johnson
- Language Models (Mostly) Know What They KnowWith Catherine Olsson, Chris Olah, Danny Hernandez, Dawn Drain, Eli Tran-Johnson and Ethan Perez
- AI Supported Degradation of the Self Concept: A Theoretical Framework Grounded in Established Cognitive and Computational MechanismsWith David Duvenaud, Esin Durmus, Ethan Perez, Meg Tong, Samuel R. Bowman and Shauna Kravec
- Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons LearnedWith Catherine Olsson, Chris Olah, Danny Hernandez, Dawn Drain, Eli Tran-Johnson and Ethan Perez
Sources and credits
Photo: We have no published photo of Nicholas Schiefer yet. Send us a free-licensed photo.
- 2015 Bhansali Prize Award Winners
- Nicholas Schiefer
- Building data-centric apps with a reactive relational database
- Language Models (Mostly) Know What They Know
- Constitutional AI: Harmlessness from AI Feedback
- Learned Interpolation for Better Streaming Quantile Approximation with Worst-Case Guarantees
- Challenges in evaluating AI systems
- Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training
- Simple probes can catch sleeper agents
- Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models





