Archit Sharma
Archit Sharma is a machine learning researcher and a co-author of Direct Preference Optimization (DPO), a method for aligning language models with human preferences. After studying electrical engineering at IIT Kanpur, he worked as an AI resident at Google Brain from 2018 to 2020 and was a PhD student at Stanford from 2021 to 2024, advised by Chelsea Finn. His first-author papers on skill discovery (DADS, 2019) and autonomous reinforcement learning (VaPRL, 2021) came before DPO, which appeared in May 2023 and was named an Outstanding Paper Runner-up at NeurIPS 2023. He is a research scientist at Google DeepMind, which he joined in September 2024.
- Now at
- Google DeepMind
Timeline
-
2014–2018
Engineering at IIT Kanpur
He studies electrical engineering at IIT Kanpur from 2014 to 2018, with minors in machine learning and linguistic theory, and works with Piyush Rai. In 2017, he interns with Yoshua Bengio at Mila.
-
2018–2020
AI resident at Google Brain
From July 2018 to December 2020, he is an AI resident at Google Brain in Mountain View.
-
2019
Skill discovery with DADS
In July 2019, he posts Dynamics-Aware Unsupervised Discovery of Skills as first author, with Shixiang Gu, Sergey Levine, Vikash Kumar and Karol Hausman. The DADS algorithm discovers predictable behaviors and learns their dynamics at the same time.
-
2021–2024
Stanford PhD under Chelsea Finn
He is a machine learning PhD student at Stanford University from January 2021 to September 2024, advised by Chelsea Finn. His work centers on autonomous deep reinforcement learning, in which real-world robots learn to deal with unseen situations without human intervention.
-
2021
Subgoal curricula and VaPRL
In July 2021, he posts Autonomous Reinforcement Learning via Subgoal Curricula as first author, with Abhishek Gupta, Sergey Levine, Karol Hausman and Chelsea Finn. Its VaPRL method reduces the interventions required by three orders of magnitude compared to episodic RL.
-
May 2023
Direct Preference Optimization
In May 2023, he coauthors Direct Preference Optimization: Your Language Model is Secretly a Reward Model with Rafael Rafailov, Eric Mitchell, Stefano Ermon, Christopher D. Manning and Chelsea Finn. DPO solves the standard RLHF problem with only a simple classification loss and eliminates the need to sample from the language model during fine-tuning.
-
2023
A NeurIPS runner-up paper award
NeurIPS 2023 names Direct Preference Optimization an Outstanding Paper Runner-up. The award recognizes the DPO paper he wrote with Rafael Rafailov, Eric Mitchell, Christopher D. Manning, Stefano Ermon and Chelsea Finn.
-
Since 2024
Research scientist at Google DeepMind
He joins Google DeepMind as a research scientist in September 2024. In July 2025, he is among the authors of the Gemini 2.5 paper.
Career
- Since 2024Google DeepMindResearch Scientist
- 2018–2020Google BrainAI Resident
- 2017MilaIntern
Education
Sources and credits
Photo: We have no published photo of Archit Sharma yet. Send us a free-licensed photo.
- Archit Sharma
- Archit Sharma | alphaXiv
- Archit Sharma, Stanford: On unsupervised and autonomous reinforcement learning - Imbue
- [1907.01657] Dynamics-Aware Unsupervised Discovery of Skills
- [2107.12931] Autonomous Reinforcement Learning via Subgoal Curricula
- [2305.18290] Direct Preference Optimization: Your Language Model is Secretly a Reward Model
- NeurIPS 2023 Awards
- [2507.06261] Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities


