Hannah Rose Kirk
Also known as Hannah Kirk
Hannah Rose Kirk is an AI researcher who studies how human feedback aligns language models and how frontier AI shapes the people who use it. After degrees at Cambridge and Peking University, she began a DPhil in Social Data Science at the Oxford Internet Institute in 2021, worked in online safety at The Alan Turing Institute, and was first author of the Hatemoji dataset paper in 2022. In 2024 she was first author of the PRISM Alignment Dataset paper, built from 1,500 participants in 75 countries, which won the Best Paper Award in the NeurIPS 2024 Datasets & Benchmarks track. Since September 2024, she is Workstream Lead for Human Influence at the UK AI Security Institute, investigating the social and psychological capabilities of frontier AI.
- Now at
- UK AI Security Institute
Timeline
-
2018–2020
Cambridge and Peking University degrees
Graduating from Trinity College, University of Cambridge in 2018 with a double first in Economics, she moves to Beijing for two years. There she earns an MA at Yenching Academy, Peking University in 2020 with honours and works at a think-tank on eastern and western philosophical approaches to artificial intelligence.
-
2020–2021
Social Data Science at Oxford
From October 2020 to July 2021 she studies for an MSc in Social Data Science at the Oxford Internet Institute and finishes with Distinction. In September 2021 she begins a DPhil in Social Data Science there, supervised by Scott A. Hale and Bertie Vidgen.
-
2021–2023
Online safety at the Turing Institute
From September 2021 to September 2023 she is a data scientist in online safety at The Alan Turing Institute, where she builds data-centric AI to detect online harms efficiently.
-
2022
The Hatemoji dataset
She is first author of Hatemoji, a test suite and adversarially-generated dataset for benchmarking and detecting emoji-based hate, published at NAACL in 2022.
-
2023
Safety work at OpenAI and Google
In 2023, she is an external student researcher at Google, where she co-hosts an adversarial challenge to identify unsafe failure modes in text2image models. From August 2023 to December 2023 she is also a red-teamer and consultant at OpenAI, improving the safety of DALL-E and GPT-4, and from September 2023 to December 2023 a visiting academic in data science at New York University, collaborating on human-AI coordination and LLM alignment.
-
April 2024
A Nature Machine Intelligence perspective
In April 2024, Nature Machine Intelligence publishes her perspective, written with Bertie Vidgen, Paul Röttger and Scott A. Hale, on the benefits, risks and bounds of personalizing the alignment of large language models to individuals. It sets out a taxonomy of risks and benefits of personalized LLMs for individuals and society.
-
2024
PRISM and a NeurIPS best paper
With supervisors Scott A. Hale and Bertie Vidgen, she launches the PRISM alignment project, and in 2024 she is first author of the PRISM Alignment Dataset paper, which maps the stated preferences of 1,500 participants from 75 countries to their feedback in 8,011 live conversations with 21 LLMs. The paper receives the Best Paper Award in the Datasets & Benchmarks track at NeurIPS 2024. Co-authored work on political bias in AI systems also earns her an Outstanding Paper Award at ACL 2024.
-
Since September 2024
Human Influence at the AI Security Institute
She joins the UK AI Security Institute in September 2024 and is Workstream Lead for Human Influence, investigating the social and psychological capabilities of frontier AI. In December 2025 she is first author of a study with Christopher Summerfield and others that combines longitudinal randomised controlled trials (N=3,534) with neural steering vectors to vary exposure to relationship-seeking AI. In June 2026 she is among the authors of "AI systems out-persuade expert humans", whose four preregistered experiments find AI more persuasive than expert humans.
Career
- Since 2024UK AI Security InstituteWorkstream Lead for Human Influence
- 2023GoogleExternal Student Researcher
- 2023OpenAIRed-teamer and Consultant
- 2023New York UniversityVisiting Academic
- 2021–2023Alan Turing InstituteData Scientist, Online Safety
Education
- 2021University of OxfordMSc in Social Data Science
- From 2021University of OxfordDPhil in Social Data Science
- 2020Peking UniversityMA
- 2018Trinity College, University of Cambridge
Sources and credits
Photo: We have no published photo of Hannah Rose Kirk yet. Send us a free-licensed photo.
- DemTech | Hannah Kirk
- Hannah Rose Kirk - Oxford Sparks
- Hannah Rose Kirk
- OII | Hannah Rose Kirk
- The benefits, risks and bounds of personalizing the alignment of large language models to individuals | Nature Machine Intelligence
- The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models
- Professor He He and PhD Candidate Hannah Rose Kirk Win NeurIPS 2024 Best Paper Award for PRISM Alignment Dataset
- How we can better align Large Language Models with diverse humans
- Neural steering vectors reveal dose and exposure-dependent impacts of human-AI relationships
- AI systems out-persuade expert humans


