Researcher

Ari Holtzman

Ari Holtzman is an assistant professor at the University of Chicago whose work spans text generation, language-model behavior, and AI alignment. He studied computer science and philosophy of language at NYU, completed a computer-science PhD at Washington, and helped build the UW team’s 2017 Alexa Prize-winning Sounding Board. He and his collaborators introduced Nucleus Sampling, coauthored QLoRA, and developed MUSE to evaluate language-model unlearning. His 2023 dissertation on interpretation errors in generative models received the William Chan Memorial Dissertation Award. As of October 2026, he is an assistant professor at UChicago; he taught a graduate course on transformers and mechanistic interpretability in Winter 2026.

Works
72
Citations
8,854
h-index
23
Badges

Publication numbers from OpenAlex, as of 18 October 2026.

Timeline

  1. 2015

    An NYU degree and honors

    He completes an interdisciplinary degree at NYU in computer science and philosophy of language. In 2015, he receives Phi Beta Kappa recognition and is named an NYU University honors scholar.

  2. 2017

    Sounding Board wins the Alexa Prize

    As an Allen School doctoral student at the University of Washington, he works on Sounding Board, a conversational agent that wins Amazon’s inaugural Alexa Prize in 2017.

  3. 2019

    Nucleus sampling

    In 2019, he and his coauthors introduce Nucleus Sampling, which truncates the unreliable tail of a language model’s probability distribution to produce more diverse text.

  4. 2023

    QLoRA and a doctorate

    In 2023, he coauthors QLoRA, which reduces memory use enough to fine-tune a 65-billion-parameter model on one 48GB GPU while preserving full 16-bit task performance. He earns a computer-science PhD at the University of Washington and receives the William Chan Memorial Dissertation Award for his work on interpretation errors in generative models.

  5. July 2024

    Joining the University of Chicago

    In July 2024, he joins the University of Chicago as an assistant professor of computer science and data science. His work focuses on generative models of text and how people can understand them.

  6. 2024

    A machine-unlearning benchmark

    In 2024, he coauthors MUSE, a benchmark that evaluates language-model unlearning across six goals, including preventing privacy leakage, preserving utility on unrelated data, and supporting repeated removal requests.

  7. 2025

    Alignment and model reliability

    In 2025, he studies how to align AI systems with human values and ensure reliable, safe behavior. He probes language models through creative prompting, targeted fine-tuning, model surgery, and analysis of their internal mechanisms.

  8. As of October 2026

    Assistant professor at UChicago

    As of October 2026, he is an assistant professor of computer science and data science at UChicago. In Winter 2026, he teaches a graduate course on transformers and mechanistic interpretability.

Career

  1. Since 2024University of ChicagoAssistant Professor
  2. 2018–2022Allen Institute for AI (Ai2)

Education

  1. 2023University of WashingtonPhD
  2. 2015New York University

Most-cited works

  1. QLoRA: Efficient Finetuning of Quantized LLMs2023 · neural information processing systems · 1,739 citationsWith Luke Zettlemoyer
  2. The Curious Case of Neural Text Degeneration2019 · 1,304 citations
  3. CLIPScore: A Reference-free Evaluation Metric for Image Captioning2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 1,212 citations
  4. HellaSwag: Can a Machine Really Finish Your Sentence?2019 · Annual Meeting of the Association for Computational Linguistics (ACL) · 817 citationsWith Ali Farhadi
  5. Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?2022 · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 744 citationsWith Luke Zettlemoyer

Sources and credits

Photo: We have no published photo of Ari Holtzman yet. Send us a free-licensed photo.

  1. Ari Holtzman | DSI datascience.uchicago.edu. Checked 18 October 2026.
  2. Allen School News Archive » UW’s Sounding Board wins inaugural Amazon Alexa Prize news.cs.washington.edu. Checked 18 October 2026.
  3. The Curious Case of Neural Text Degeneration arxiv.org. Checked 18 October 2026.
  4. QLoRA: Efficient Finetuning of Quantized LLMs arxiv.org. Checked 18 October 2026.
  5. Ph.D. Student Recognition - Paul G. Allen School of Computer Science & Engineering cs.washington.edu. Checked 18 October 2026.
  6. Luke Zettlemoyer homes.cs.washington.edu. Checked 18 October 2026.
  7. Ari Holtzman | CDS codas.uchicago.edu. Checked 18 October 2026.
  8. MUSE: Machine Unlearning Six-Way Evaluation for Language Models arxiv.org. Checked 18 October 2026.
  9. Powering Discovery: How Advanced Computing is Transforming Research Across Disciplines | DSI datascience.uchicago.edu. Checked 18 October 2026.
  10. llms-and-mechinterp/README.md at main · ari-holtzman/llms-and-mechinterp · GitHub github.com. Checked 18 October 2026.