Nicholas Joseph
Also known as Nick Joseph
Nicholas Joseph is an Anthropic pre-training leader whose AI work spans assistant alignment, model self-evaluation and large language-model training. He coauthored studies on helpful and harmless assistants, Constitutional AI, and whether models can judge their own answers. Before 2021, he worked on computer vision at Vicarious and joined OpenAI's safety team to study code models; by May 2024, he led more than 40 people training Anthropic's large language models, including Claude. In May 2026, Andrej Karpathy joined Joseph's pre-training team with plans to use Claude to accelerate pre-training research.
- Works
- 45
Publication numbers from OpenAlex, as of 22 October 2026. Citations and h-index are hidden because this OpenAlex record may be incomplete or mix in other authors.
Timeline
-
Before 2021
Computer vision at Vicarious
Before joining Anthropic, he works on computer vision at Vicarious and learns to do machine-learning research.
-
Before 2021
Code models at OpenAI
Before joining Anthropic, he joins OpenAI's safety team and spends eight months working on code models and understanding how they would progress.
-
December 2021
A general assistant for alignment
In December 2021, he coauthors A General Language Assistant as a Laboratory for Alignment, which studies prompting and ranked preference modeling for an assistant designed to be helpful, honest and harmless.
-
April 2022
Training helpful assistants
He coauthors Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback in April 2022, applying preference modeling and reinforcement learning from human feedback to fine-tune helpful, harmless assistants.
-
July 2022
Models assess their own answers
In July 2022, he coauthors Language Models (Mostly) Know What They Know, which tests whether models can assess their own claims and predict which questions they can answer correctly.
-
December 2022
Constitutional AI from feedback
Constitutional AI: Harmlessness from AI Feedback appears in December 2022 with Joseph as a coauthor; the method trains a harmless assistant through self-improvement using principles and AI feedback.
-
May 2024
Leading Anthropic's training team
By May 2024, he leads Anthropic's model-training group, managing more than 40 people focused on its large language models, including Claude.
-
May 2026
Pre-training at Anthropic
Under his leadership, Andrej Karpathy joins Anthropic's pre-training team in May 2026 with plans to build a group that uses Claude to accelerate pre-training research.
Sources and credits
Photo: We have no published photo of Nicholas Joseph yet. Send us a free-licensed photo.
- #197 – Nick Joseph on whether Anthropic’s AI safety policy is up to the task
- A General Language Assistant as a Laboratory for Alignment
- A General Language Assistant as a Laboratory for Alignment
- Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
- Language Models (Mostly) Know What They Know
- Constitutional AI: Harmlessness from AI Feedback
- Constitutional AI: Harmlessness from AI Feedback
- OpenAI co-founder Andrej Karpathy joins Anthropic’s pre-training team
- Karpathy, Who Called Today's AI Agents 'Slop,' Joins Anthropic to Use Claude to Build the Next Claude


