Shashank Gupta
Shashank Gupta is a researcher at the Allen Institute for AI (Ai2) in Seattle, where they develop agentic language models that plan, reason and use tools. They studied computer science at the Birla Institute of Technology and Science, Pilani, and the University of Illinois at Urbana-Champaign, then worked as an applied scientist at Microsoft AI from 2018 to 2022. In 2023, they coauthored the Self-Refine method and were first author of 'Bias Runs Deep', a study of reasoning bias in persona-assigned LLMs. Their coauthored benchmarks AppWorld and SUPER won an ACL 2024 Best Resource Paper award and an EMNLP 2024 Outstanding Paper award, and in 2025 they were a core contributor to the fully open Olmo 3 language models.
- Works
- 100
- Citations
- 2,671
- h-index
- 27
Publication numbers from OpenAlex, as of 22 October 2026.
Timeline
-
2008–2017
Studies at BITS Pilani and Illinois
They study for a computer science BE at the Birla Institute of Technology and Science, Pilani, from 2008 to 2012. After a research internship in the Databases and Information Systems group at the Max Planck Institute in 2014 and 2015, they study for a computer science MSc at the University of Illinois at Urbana-Champaign from 2015 to 2017.
-
2018–2022
Applied scientist at Microsoft AI
They work as an applied scientist at Microsoft AI from 2018 to 2022, leading Smart Reply research for Outlook and Teams in the Microsoft Search, Assistant and Intelligence group. Their work there covers model compression and mixture-of-experts architectures.
-
March 2023
Co-developing Self-Refine
They coauthor Self-Refine, posted on arXiv in March 2023. A single language model writes an output, gives feedback on it and refines it, and across the evaluated tasks the outputs improve by about 20% absolute on average.
-
2023
Bias Runs Deep at Ai2
In November 2023, they are first author of 'Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMs' with colleagues at the Allen Institute for AI. The study tests 24 reasoning datasets, 4 LLMs and 19 personas, finds that persona assignment can lower reasoning performance, and appears at ICLR 2024.
-
2024
Two award-winning agent benchmarks
AppWorld, a benchmark of 750 tasks for interactive coding agents in a simulated world of 9 apps, wins a Best Resource Paper award at ACL 2024. SUPER, a benchmark of problems on setting up and executing tasks from research repositories, wins an Outstanding Paper award at EMNLP 2024. They are among the authors of both.
-
2025
LLM-SR as an ICLR oral
They coauthor LLM-SR, a method for discovering scientific equations by programming with large language models, which is presented as an oral paper at ICLR 2025.
-
2025
Core contributor to Olmo 3
In 2025, Ai2 releases Olmo 3, a family of fully open language models at the 7B and 32B parameter scales, and posts the technical report on arXiv in December 2025. They are a core contributor to the project.
-
As of October 2026
Researcher at Ai2
As a researcher at the Allen Institute for AI (Ai2) in Seattle, they develop agentic large language models: systems that plan, reason, use tools and APIs, write code and interact with complex environments.
Career
- Since 2024Allen Institute for AI (Ai2)Researcher
- 2018–2022MicrosoftApplied Scientist, Microsoft Search, Assistant and Intelligence group
- 2014–2015Max Planck Institute for Intelligent SystemsResearch intern
- 2014–2018National Institute of Technology Kurukshetra
- 2003–2025Birla Institute of Technology and Science, Pilani
Education
- 2017University of Illinois Urbana-ChampaignComputer science MSc
- 2012Birla Institute of Technology and Science, PilaniComputer science BE
Most-cited works
- A survey on the role of Internet of Things for adopting and promoting Agriculture 4.0
- Role of emerging technologies in future IoT-driven Healthcare 4.0 technologies: a survey, current challenges and future directions
- Security of Cryptocurrencies in blockchain technology: State-of-art, challenges and future prospects
- Cross-Site Scripting (XSS) attacks and defense mechanisms: classification and state-of-the-art
- Role of machine learning and deep learning in securing 5G-driven industrial IoT applications
Sources and credits
Photo: We have no published photo of Shashank Gupta yet. Send us a free-licensed photo.
- Shashank Gupta | alphaXiv
- [2303.17651] Self-Refine: Iterative Refinement with Self-Feedback
- [2311.04892] Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMs
- Persona-Bias - Allen Institute of AI
- Best Paper Awards - ACL 2024
- Best Papers - EMNLP 2024
- [2407.18901] AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents
- [2409.07440] SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories
- ICLR Oral LLM-SR: Scientific Equation Discovery via Programming with Large Language Models
- [2512.13961] Olmo 3
- Shashank Gupta
- Team Directory | Ai2


