Amanda Bertsch
Amanda Bertsch researches language models, long-context reasoning, and inference algorithms. She entered the University of Arizona as a Flinn Scholar in 2017, studied computer science and mathematics, and published research on Wikipedia puffery and minimum Bayes risk decoding. Her long-context learning work won NAACL's 2025 SAC Award for Language Modeling, and she designed and co-taught a language-model inference course before coauthoring OLMo 3. In 2026, two papers she coauthored were accepted to COLM; as of October 2026, she is a final-year PhD candidate at Carnegie Mellon and a student researcher at AI2.
- Works
- 33
- Citations
- 178
- h-index
- 7
Publication numbers from OpenAlex, as of 18 October 2026.
Timeline
-
2017
A Flinn Scholar at Arizona
In 2017, she joins the University of Arizona's College of Engineering as a Flinn Scholar after graduating as valedictorian from Tri-City College Prep in Prescott.
-
2021
A Wikipedia puffery paper
In 2021, she is a senior double-majoring in computer science and mathematics at the University of Arizona. She and Steven Bethard publish a W-NUT paper that uses citation features in a RoBERTa model to identify puffery on Wikipedia.
-
2023
Minimum Bayes risk decoding
In 2023, she and three coauthors show how several modern language-generation methods can be expressed as minimum Bayes risk decoding and report theoretical and empirical results for its variants.
-
2025
Long-context in-context learning
In 2025, she and six coauthors study in-context learning with thousands of demonstrations and show that performance rises for many datasets with large label spaces. The work wins NAACL's 2025 SAC Award for Language Modeling.
-
2025
Teaching language-model inference
In 2025, she designs and co-teaches a new course, Inference Algorithms for Language Modeling.
-
2025
Coauthoring OLMo 3
In 2025, she coauthors OLMo 3, a family of fully open 7B and 32B language models that targets long-context reasoning, function calling, coding, instruction following, general chat, and knowledge recall.
-
2026
Two papers reach COLM
In 2026, COLM accepts two papers she coauthors: Oolong, a benchmark for long-context reasoning and aggregation, and Cracks in the Foundation, a study of transformer choices that affect long-context extension. Oolong asks models to analyze and aggregate individual text chunks; Cracks shows that combinations of architectural choices can limit long-context performance.
-
As of October 2026
A PhD at Carnegie Mellon
As of October 2026, she is a final-year PhD candidate in Carnegie Mellon's Language Technologies Institute and a student researcher at the Allen Institute for AI.
Career
- Since 2025Allen Institute for AI (Ai2)Student researcher
Education
- From 2017University of Arizona
- Carnegie Mellon UniversityPhD
Most-cited works
- Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation
- Unlimiformer: Long-Range Transformers with Unlimited Length Input
- SummQA at MEDIQA-Chat 2023: In-Context Learning with GPT-4 for Medical Summarization
- LLMs as Workers in Human-Computational Algorithms? Replicating Crowdsourcing Pipelines with LLMs
- In-Context Learning with Long-Context Models: An In-Depth Exploration
Sources and credits
Photo: We have no published photo of Amanda Bertsch yet. Send us a free-licensed photo.
- Flinn Scholars lay foundation for engineering careers
- Awards 2020 - 2021 | Computer Science
- Detection of Puffery on the English Wikipedia
- It's MBR All the Way Down: Modern Generation Techniques Through the Lens of Minimum Bayes Risk
- In-Context Learning with Long-Context Models: An In-Depth Exploration
- Amanda Bertsch
- Olmo 3
- Oolong: Evaluating Long Context Reasoning and Aggregation Capabilities
- COLM 2026 Accepted Papers
- Cracks in the Foundation: Seemingly Minor Architectural Choices Impact Long Context Extension



