Edward J. Hu
Also known as Edward Hu
Edward Hu is an AI researcher whose work spans language-model adaptation, neural-network scaling and probabilistic reasoning. After studying computer science and linguistics in college and researching empirical NLP at Johns Hopkins, he worked as a researcher at Microsoft, where he coauthored the Maximal Update Parametrization (μP) in July 2021 and LoRA and μTransfer in 2022. At Mila in Montreal, he pursued PhD research under Yoshua Bengio, co-writing a March 2023 essay on generative flow networks and receiving an ICLR 2024 Outstanding Paper Honorable Mention for work on amortizing intractable inference in large language models. He also worked on o1 as a researcher at OpenAI, became a founding partner in a Woodside stealth AI company in 2025, and posted the introduction to his computer science PhD thesis, Building a Reasoning Machine, in April 2026. As of October 2026, he leads AI model training and research at Mercor.
- Now at
- Mercor
Timeline
-
2020
An ICLR workshop prize
After studying computer science and linguistics in college, he researches empirical NLP at Johns Hopkins, building systems to understand documents. In July 2020, his coauthored paper “Improved Image Wasserstein Attacks and Defenses” wins the Best Paper award at the ICLR Trustworthy ML Workshop.
-
July 2021
Maximal Update Parametrization at Microsoft
Before graduate school, he works as a researcher at Microsoft. In July 2021, he and Greg Yang introduce the Maximal Update Parametrization (μP), a parametrization for infinitely wide neural networks that exhibit feature learning.
-
2022
LoRA and μTransfer
In March 2022, he, Greg Yang and Jianfeng Gao present μTransfer, a technique for hyperparameter tuning of enormous neural networks such as GPT-3. At ICLR in April 2022, he coauthors Low-Rank Adaptation (LoRA), which freezes pre-trained model weights and injects trainable rank decomposition matrices into each layer of the Transformer architecture.
-
2023
GFlowNets and PhD research at Mila
In March 2023, he and Yoshua Bengio co-write “Scaling in the service of reasoning & model-based ML,” describing GFlowNets as a way to model compositional objects and build an inference machine for reasoning. By August 2023, he is an AI researcher at Mila in Montreal, pursuing his PhD under Bengio.
-
2024
An ICLR 2024 Honorable Mention
At ICLR 2024, his oral paper “Amortizing Intractable Inference in Large Language Models,” coauthored with Moksh Jain, Eric Elmoznino, Younesse Kaddar, Guillaume Lajoie, Yoshua Bengio and Nikolay Malkin, receives an Outstanding Paper Honorable Mention.
-
2025
OpenAI o1 and a Woodside venture
He works as a researcher on o1 at OpenAI, focuses his Mila PhD research on generative models and robust reasoning, and in 2025 is a founding partner in a stealth AI company in Woodside, California. The University of Montreal schedules his PhD defense, “Building a Reasoning Machine,” under research director Yoshua Bengio for November 2025.
-
April 2026
Building a Reasoning Machine
He receives his PhD in computer science under the supervision of Yoshua Bengio. In April 2026, he posts the introduction to his PhD thesis, “Building a Reasoning Machine,” on reasoning and GFlowNets.
-
As of October 2026
AI model training at Mercor
As of October 2026, he leads AI model training and research at Mercor.
Career
- NowMercorAI model training and research lead
- Johns Hopkins UniversityResearcher
- MicrosoftResearcher
- MilaAI Researcher
Education
- From 2025MilaPhD
- From 2025Université de MontréalPhD
Sources and credits
Photo: We have no published photo of Edward J. Hu yet. Send us a free-licensed photo.
- Perspectives in AI: From LLMs to Reasoning with Edward Hu
- Improved Image Wasserstein Attacks and Defenses
- About Edward Hu
- On infinitely wide neural networks that exhibit feature learning
- µTransfer: A technique for hyperparameter tuning of enormous neural networks
- LoRA: Low-Rank Adaptation of Large Language Models
- Scaling in the service of reasoning & model-based ML
- ICLR 2024 Awards
- Edward Hu — Deep Tech Week speaker
- Soutenance de thèse - Edward Hu
- Building a Reasoning Machine - Ph.D. thesis

