Ankit Singh Rawat
Ankit Singh Rawat studies methods that make language-model inference more efficient. He earned degrees at IIT Kanpur and UT Austin and held postdoctoral appointments at Carnegie Mellon, MIT and UMass Amherst. His papers explore confidence-based cascades, draft-model distillation and token-level uncertainty for language models. In 2025, his speculative-cascade paper received an ICLR Outstanding Paper Honorable Mention. As of October 2026, he is a Research Scientist at Google Research in New York.
- Now at
- Google Research
- Badges
Timeline
-
2010–2015
Degrees in Kanpur and Austin
He earns a B.Tech. in electrical engineering at IIT Kanpur in 2010 and a Ph.D. in electrical and computer engineering at UT Austin in 2015.
-
2015–2017
Postdocs at CMU, MIT and UMass
He is a postdoctoral fellow in Carnegie Mellon's Computer Science Department in 2015–2016 and a joint postdoc at MIT and UMass Amherst by October 2017.
-
2023
Confidence-based cascade deferral
In 2023, he coauthors When Does Confidence-Based Cascade Deferral Suffice?, which analyzes when confidence-based deferral fails and studies post-hoc rules that can improve accuracy-cost trade-offs.
-
2023
DistillSpec for faster decoding
Through DistillSpec in 2023, he uses knowledge distillation to align a small draft model with a larger target model; the method reports 10–45% speedups over standard speculative decoding on benchmarks.
-
2024
Token-level uncertainty for LMs
In 2024, he coauthors Language Model Cascades: Token-level uncertainty and beyond, a study showing that learned deferral rules using token-level uncertainty can improve cost-quality trade-offs for language-model tasks.
-
2024–2025
Faster Cascades at ICLR
In 2024, he coauthors Faster Cascades via Speculative Decoding, which applies a cascade's deferral rule through speculative execution. In 2025, the paper receives an ICLR Outstanding Paper Honorable Mention.
-
2025
Gating is Weighting at COLM
In 2025, he coauthors Gating is Weighting: Understanding Gated Linear Attention through In-context Learning, a COLM study of gating in linear-attention models. At NeurIPS 2025, he serves as a Senior Area Chair.
-
As of October 2026
Google Research in New York
As of October 2026, he is a Research Scientist at Google Research in New York, with research interests in large-scale machine learning, coding theory and information theory.
Career
- NowGoogle ResearchResearch Scientist
- Until 2017Massachusetts Institute of TechnologyPostdoc
- Until 2017University of Massachusetts AmherstPostdoc
- 2015–2016Carnegie Mellon UniversityPostdoctoral fellow
Education
- 2015University of Texas at AustinPh.D.
- 2010Indian Institute of Technology KanpurB.Tech.
Sources and credits
Photo: We have no published photo of Ankit Singh Rawat yet. Send us a free-licensed photo.
- Fall 2017 SIP Seminars – INSPIRE Lab | Rutgers University
- When Does Confidence-Based Cascade Deferral Suffice?
- DistillSpec: Improving Speculative Decoding via Knowledge Distillation
- Language Model Cascades: Token-level uncertainty and beyond
- Faster Cascades via Speculative Decoding
- Announcing the Outstanding Paper Awards at ICLR 2025
- Publications – Wittawat Jitkrittum
- Ankit Singh Rawat
- Google at NeurIPS 2025
- Ankit Singh Rawat

