Milad Nasr
Milad Nasr is a security and privacy researcher whose attacks and audits show what machine-learning models reveal about their training data. He began an MS/PhD program at the University of Massachusetts Amherst in 2015 and was a research scientist at Google Brain from 2022 to 2023, at Google DeepMind from 2023 to 2025, and at OpenAI from 2025 to 2026. In 2023, his privacy-auditing papers won a USENIX Security Distinguished Paper Award and a NeurIPS Outstanding Paper award, and he was first author of a paper that extracted training data from ChatGPT. Stealing Part of a Production Language Model, a paper he coauthored, won an ICML 2024 Best Paper award. He is a research scientist at Anthropic, where he works at the intersection of computer security and language models.
Timeline
-
2015–2017
Graduate study at UMass Amherst
He starts an MS/PhD program at the University of Massachusetts Amherst in 2015 and finishes the master's degree in 2017. He is a member of the Secure, Private INternet (SPIN) group under Amir Houmansadr.
-
2018–2019
White-box membership inference attacks
In December 2018, he posts a paper with Reza Shokri and Amir Houmansadr that designs white-box inference attacks against centralized and federated deep learning. It appears at the 2019 IEEE Symposium on Security and Privacy.
-
2022–2023
Research scientist at Google Brain
With a PhD in computer science, he works as a research scientist at Google Brain from 2022 to 2023, mostly on the security and privacy of AI.
-
2023
USENIX and NeurIPS paper awards
Tight Auditing of Differentially Private Machine Learning, written with Jamie Hayes, Thomas Steinke, Borja Balle, Florian Tramèr, Matthew Jagielski, Nicholas Carlini and Andreas Terzis, wins a Distinguished Paper Award at USENIX Security 2023. Privacy Auditing with One (1) Training Run, written with Thomas Steinke and Matthew Jagielski, receives a NeurIPS 2023 Outstanding Paper award.
-
2023–2025
Training data pulled from ChatGPT
He is a research scientist at Google DeepMind from 2023 to 2025. In November 2023, he is first author of Scalable Extraction of Training Data from (Production) Language Models, which extracts gigabytes of training data from open-source, semi-open and closed models such as ChatGPT, using a new divergence attack on the aligned chatbot.
-
2024
An ICML 2024 Best Paper
Stealing Part of a Production Language Model, written with Nicholas Carlini, Florian Tramèr and other coauthors, wins a Best Paper award at ICML 2024. Its attack recovers the embedding projection layer of a transformer model through typical API access and extracts the full projection matrix of OpenAI's Ada and Babbage models.
-
2025–2026
Research scientist at OpenAI
He is a research scientist at OpenAI from 2025 to 2026, where he researches AI security and privacy.
-
As of October 2026
Computer security at Anthropic
He is a research scientist at Anthropic, where he works at the intersection of computer security and language models. His research there focuses on how language models affect the future of computer security.
Career
- Since 2026AnthropicResearch scientist
- 2025–2026OpenAIResearch scientist
- 2023–2025Google DeepMindResearch scientist
- 2022–2023Google BrainResearch scientist
- 2022–2025Google
Education
- From 2015University of Massachusetts AmherstMS/PhD student
Most-cited works
- Comprehensive Privacy Analysis of Deep Learning: Passive and Active White-box Inference Attacks against Centralized and Federated Learning
- Gemini: A Family of Highly Capable Multimodal ModelsWith Angeliki Lazaridou, Anja Hauth, Clemens Meyer, David Silver, Emily Pitler and Fabio Viola
- Membership Inference Attacks From First PrinciplesWith Nicholas Carlini
- Machine Learning with Membership Privacy using Adversarial Regularization
- Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextWith George van den Driessche, Paul Barham and Roy Frostig
Sources and credits
Photo: We have no published photo of Milad Nasr yet. Send us a free-licensed photo.
- Milad Nasr
- [1812.00910] Comprehensive Privacy Analysis of Deep Learning: Passive and Active White-box Inference Attacks against Centralized and Federated Learning
- Milad Nasr
- Tight Auditing of Differentially Private Machine Learning | USENIX
- NeurIPS 2023 Awards
- [2311.17035] Scalable Extraction of Training Data from (Production) Language Models
- ICML 2024 Awards
- [2403.06634] Stealing Part of a Production Language Model
- Milad Nasr - MATS Mentor


