Stephen Roller
Stephen Roller is a researcher on large language models and dialogue systems. A computer science PhD from the University of Texas at Austin under Katrin Erk, he worked at Meta's Fundamental AI Research lab (FAIR) from 2017 to 2023. At FAIR he was a joint first author of Wizard of Wikipedia in 2019, first author of a 2020 paper on recipes for open-domain chatbots, and a joint first author of OPT, a suite of open transformers of up to 175 billion parameters, in 2022. After FAIR, he led pretraining and training infrastructure efforts at Character.AI from 2023 to 2024, then worked as a Senior Staff Research Scientist at Google DeepMind from 2024 to 2025 and is a listed author of the 2025 Gemini 2.5 report. At Thinking Machines Lab, where he was named among 29 employees announced in February 2025, he is a Member of the Technical Staff.
- Now at
- Thinking Machines Lab
- Works
- 50
- Citations
- 3,982
- h-index
- 25
Publication numbers from OpenAlex, as of 22 October 2026.
Timeline
-
2010–2017
PhD at UT Austin
He earns a computer science PhD at the University of Texas at Austin under Katrin Erk, working from 2010 to 2017 on distributional semantics, multimodal models and Bayesian methods. His 2017 dissertation is Identifying Lexical Relationships and Entailments with Distributional Semantics.
-
2017–2023
Research engineer at FAIR
He joins Meta's Fundamental AI Research lab (FAIR) in 2017 and stays until 2023. On the Large Language Model and dialogue teams, he works as a Senior Staff Research Engineer, and much of his FAIR work is open source.
-
2019
Wizard of Wikipedia
In 2019, he is a joint first author, with Emily Dinan and Kurt Shuster, of Wizard of Wikipedia, published at ICLR. The paper releases a large dataset of conversations grounded in Wikipedia knowledge and builds dialogue models that look up that knowledge, read it and answer with it.
-
2020
Recipes for an open-domain chatbot
In April 2020, he is first author of Recipes for building an open-domain chatbot, which builds models with 90M, 2.7B and 9.4B parameters and makes the models and code publicly available. Human evaluations rate the best models above existing approaches for engagingness and humanness.
-
2022
The OPT language models
In 2022, he is a joint first author, with Susan Zhang and Naman Goyal, of OPT: Open Pre-trained Transformer Language Models. OPT is a suite of decoder-only transformers from 125M to 175B parameters; OPT-175B is comparable to GPT-3 with 1/7th the carbon footprint, and the team releases a logbook of its infrastructure challenges along with code.
-
2023–2024
Pretraining at Character.AI
He moves to Character.AI as a Member of the Technical Staff in 2023 and leads its pretraining and training infrastructure efforts until 2024.
-
2024–2025
Google DeepMind research scientist
From 2024 to 2025, he is a Senior Staff Research Scientist at Google DeepMind. In July 2025, the Gemini 2.5 report appears on arXiv with him among its authors.
-
Since 2025
Joining Thinking Machines Lab
In February 2025, Thinking Machines Lab announces a team of 29 employees that includes him. He is a Member of the Technical Staff at the lab.
Career
- Since 2025Thinking Machines LabMember of the Technical Staff
- 2024–2025Google DeepMindSenior Staff Research Scientist
- 2023–2024Character.AIMember of the Technical Staff
- 2023–2024New York University
- 2018–2024Meta
- 2017–2023FAIR (Meta)Senior Staff Research Engineer
Education
Sources and credits
Photo: We have no published photo of Stephen Roller yet. Send us a free-licensed photo.
- Stephen Roller
- AI-Lab People - Stephen Roller - UT Austin Computer Science
- Stephen Roller on alphaXiv
- Wizard of Wikipedia: Knowledge-Powered Conversational agents
- Recipes for building an open-domain chatbot
- OPT: Open Pre-trained Transformer Language Models
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- Former OpenAI CTO Mira Murati unveils Thinking Machines Lab details and leadership team stacked with former OpenAI colleagues


