Rylan Schaeffer
Rylan Schaeffer is a machine learning researcher who studies how to measure and predict what large language models can do. After studying computer science and statistics at UC Davis, he earned a research master's in cognitive neuroscience at University College London, worked as a data scientist at Uber, and completed a master's in computer science engineering at Harvard. His 2023 paper "Are Emergent Abilities of Large Language Models a Mirage?", written with Brando Miranda and Sanmi Koyejo, was named an outstanding main-track paper at NeurIPS 2023, and in 2024 he followed it with work on model collapse and on predicting downstream capabilities from scale. He worked on Gemini pretraining at Google from 2024 to 2025 and joined Meta in 2025. He is a Stanford computer science PhD student on leave, advised by Sanmi Koyejo, and says he is creating something new.
Timeline
-
2011–2016
Two degrees at UC Davis
He earns two BS degrees at UC Davis, in computer science engineering and statistics, finishing in 2016. He begins in biomedical engineering, switches to business, and designs a major of his own on persuasion and motivation before settling on computer science and statistics.
-
2017–2018
Metacognition research at UCL
He earns a Master of Research in Cognitive Neuroscience at University College London's Institute of Cognitive Neuroscience, studying metacognition under Stephen Fleming. With Julius Kunze and Louis Kirsch, he starts UCL's Artificial Intelligence Journal Club, which hosts 25 speakers in 9 months.
-
2018–2019
Data scientist at Uber
He works as a data scientist on Uber's Intelligent Decision Systems team. The team specializes in time-series forecasting and anomaly detection.
-
2019–2021
Harvard master's and MIT research
He pursues a Master of Engineering in Computer Science Engineering at Harvard University and conducts research with Ila Fiete at MIT.
-
2023
A NeurIPS outstanding paper
In April 2023, he and Brando Miranda and Sanmi Koyejo post "Are Emergent Abilities of Large Language Models a Mirage?", which argues that apparent emergent abilities appear because of the researcher's choice of metric. NeurIPS lists it among its two Outstanding Main Track Papers in December 2023.
-
2024
Predictable scaling and model collapse
In April 2024, he coauthors "Is Model Collapse Inevitable?", which shows that accumulating synthetic data alongside the original real data avoids model collapse. In June 2024, he is first author of a paper showing that benchmark accuracy, computed from negative log likelihoods through a sequence of transformations, progressively loses its statistical relationship to scale, and the paper works toward scaling-predictable evaluations of frontier AI models.
-
2024–2025
Gemini pretraining at Google
He works as a research scientist on Google Gemini Pretraining & Data, a post that arrives with the Character AI acquihire. He contributes to the development of Gemini 2.5.
-
As of October 2026
Stanford PhD on leave after Meta
He joins Meta in 2025 as an AI research scientist and works in its TBD lab. His profile now lists him as ex-Meta TBD and on leave from Stanford, where he is a computer science PhD student in Sanmi Koyejo's STAIR lab, and says he is creating something new.
Career
- From 2025MetaAI Research Scientist
- 2024–2025GoogleResearch Scientist
- 2021–2026Stanford University
- 2019–2021Massachusetts Institute of TechnologyResearcher
- 2018–2019UberData Scientist
Education
- 2021Harvard UniversityMaster of Engineering in Computer Science Engineering
- 2018University College LondonMaster of Research in Cognitive Neuroscience
- 2016University of California, DavisBS degrees
- Stanford UniversityPhD
Most-cited works
- Are Emergent Abilities of Large Language Models a Mirage?With Sanmi Koyejo
- A brain-wide map of neural activity during complex behaviourWith Peter Dayan
- Brain-wide representations of prior information in mouse decision-makingWith Peter Dayan
- DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT ModelsWith Bo Li and Sanmi Koyejo
- Lightning Pose: improved animal pose estimation via semi-supervised learning, Bayesian ensembling and cloud-native open-source toolsWith Peter Dayan
Sources and credits
Photo: We have no published photo of Rylan Schaeffer yet. Send us a free-licensed photo.
- About | Rylan Schaeffer
- [2304.15004] Are Emergent Abilities of Large Language Models a Mirage?
- Announcing the NeurIPS 2023 Paper Awards – NeurIPS Blog
- [2404.01413] Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data
- [2406.04391] Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive?
- Home | Rylan Schaeffer
- Rylan Schaeffer | alphaXiv
- Rylan Schaeffer | Digg


