Luyu Gao
Luyu Gao is an AI researcher whose work spans dense information retrieval, language-model reasoning, and scientific coding. He studied computer science at the University of Illinois Urbana-Champaign, completed a six-month internship with NVIDIA's GPU Foundation Profiler team, and earned a Master of Language Technologies at Carnegie Mellon in 2021. His research includes Condenser for dense retrieval, PAL's program-aided reasoning, Self-Refine's feedback loop, RARR's attribution and revision, and the SciCode coding benchmark. In June 2025, he coauthored the Magistral paper on Mistral AI's first reasoning model; as of October 2026, he is a machine learning engineer at OpenAI working on neural information retrieval.
Timeline
-
2021
Condenser for dense retrieval
In 2021, he coauthors Condenser, a pre-training Transformer architecture that improves over standard language models on text retrieval and similarity tasks.
-
By 2022
UIUC, NVIDIA and Carnegie Mellon
He graduates from the University of Illinois Urbana-Champaign with a computer science major. In 2021, he earns a Master of Language Technologies at Carnegie Mellon's Language Technologies Institute, with Jamie Callan as academic advisor. By 2022, he has completed a six-month internship with NVIDIA's GPU Foundation Profiler team.
-
2022–2023
PAL for language model reasoning
In 2022, he and his coauthors post PAL as a preprint; in 2023, the work appears in the Proceedings of Machine Learning Research at ICML. The method has a language model generate programs as intermediate reasoning steps and sends them to a Python interpreter for execution.
-
2023
Self-Refine's feedback loop
In 2023, he coauthors Self-Refine, which uses one language model to generate an output, give feedback on it, and revise it iteratively.
-
2023
RARR for generated text
In 2023, he coauthors RARR, a system that finds attribution for generated text and edits unsupported content while preserving the original output as much as possible.
-
2024
A benchmark for scientific coding
In 2024, he coauthors SciCode, a coding benchmark created with input from scientists and AI researchers across 16 natural-science fields. It evaluates language models on code for real scientific research problems.
-
June 2025
Mistral's first reasoning model
In June 2025, he coauthors the Magistral paper. It introduces Mistral AI's first reasoning model and describes a scalable reinforcement-learning pipeline.
-
As of October 2026
OpenAI machine learning engineer
As of October 2026, he is a machine learning engineer at OpenAI and works on neural information retrieval.
Career
Education
- 2021Carnegie Mellon UniversityMaster of Language Technologies
- University of Illinois Urbana-Champaign
Sources and credits
Photo: We have no published photo of Luyu Gao yet. Send us a free-licensed photo.
- Condenser: a Pre-training Architecture for Dense Retrieval
- Luyu Gao
- Luyu Gao - Language Technologies Institute - School of Computer Science - Carnegie Mellon University
- [2211.10435] PAL: Program-aided Language Models
- PAL: Program-aided Language Models
- Self-Refine: Iterative Refinement with Self-Feedback
- RARR: Researching and Revising What Language Models Say, Using Language Models
- [2407.13168] SciCode: A Research Coding Benchmark Curated by Scientists
- [2506.10910] Magistral
- Jamie Callan's Research Group