Michael Y Hu
Also known as Michael Hu
Michael Y Hu is a doctoral researcher at NYU's Center for Data Science who studies the science of training language models, with a focus on data. As a Princeton undergraduate, Hu worked with Karthik Narasimhan and Tom Griffiths, and in 2022 co-authored a paper on instilling human inductive biases in machines that NeurIPS named an Outstanding Paper. At NYU, they worked with Kyunghyun Cho and Tal Linzen on training dynamics, data mixing and downstream scaling laws, and their 2025 paper on pre-pretraining with formal languages won an Outstanding Paper Award at ACL 2025. In 2026, they introduced OP-Mix, a data mixing algorithm for the whole language model training lifecycle. They are a fifth-year PhD student advised by Cho and Linzen and a member of technical staff at Principia.
- Now at
- New York University and Principia
Timeline
-
2022
A NeurIPS Outstanding Paper
In 2022, Hu is one of ten authors of "Using natural language and program abstractions to instill human inductive biases in machines", a paper on meta-learning agents that includes Karthik Narasimhan and Tom Griffiths, the Princeton researchers Hu works with for two years during a BSE in computer science. NeurIPS names the paper an Outstanding Paper in 2022.
-
2023
Hidden Markov models of training
Hu is first author, in 2023, of "Latent State Models of Training Dynamics", written with Angelica Chen, Naomi Saphra and Kyunghyun Cho and accepted at TMLR 2023. The method fits a hidden Markov model over metrics recorded during neural network training and uses the latent states to study phase transitions and detour states that slow down convergence.
-
2024
BabyLM findings and Aioli
In 2024, Hu is first author of "Findings of the Second BabyLM Challenge", a report on 31 submissions to a competition to train language models on 100 million words or fewer. They also co-author Aioli with Mayee Chen, Nicholas Lourie, Kyunghyun Cho and Christopher Ré, an online data mixing method that estimates mixing law parameters during training.
-
2025
An ACL Outstanding Paper
Hu leads "Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases" in 2025, written with Jackson Petty, Chuan Shi, William Merrill and Tal Linzen. Pre-pretraining on formal languages that capture hierarchical dependencies gives lower loss and better linguistic generalization on natural language, and a 1B-parameter model reaches the same loss with a 33% smaller token budget. ACL 2025 names the paper an Outstanding Paper.
-
2025
A scaling laws reality check
The 2025 paper "Scaling Laws Are Unreliable for Downstream Tasks: A Reality Check", co-authored with Nicholas Lourie and Kyunghyun Cho, appears in EMNLP Findings 2025. Its meta-analysis of existing data finds predictable downstream scaling in 39% of cases.
-
January 2026
Neural Neural Scaling Laws
In January 2026, Hu and four co-authors, Jane Pan, Ayush Rajesh Jhaveri, Nicholas Lourie and Kyunghyun Cho, post "Neural Neural Scaling Laws". Their NeuNeu network, trained on open-source model checkpoints, predicts accuracy on 66 downstream tasks with 1.99% mean absolute error, a 44% reduction against logistic scaling laws.
-
As of October 2026
Technical staff at Principia
Hu is a fifth-year PhD student at NYU's Center for Data Science, advised by Kyunghyun Cho and Tal Linzen, and a member of technical staff at Principia. In May 2026, they are first author of "Always Learning, Always Mixing", which introduces OP-Mix, a data mixing algorithm that simulates candidate mixtures by interpolating low-rank adapters. Their research studies the science of training language models, with a focus on data, and their earlier career includes two years as the first employee of Yobi AI.
Career
- NowNew York UniversityDoctoral Researcher
- NowPrincipiaMember of Technical Staff
- Yobi AIFirst Employee
Education
- Princeton UniversityBSE in computer science
- New York UniversityPhD
Sources and credits
Photo: We have no published photo of Michael Y Hu yet. Send us a free-licensed photo.
- Michael Hu
- [2205.11558] Using Natural Language and Program Abstractions to Instill Human Inductive Biases in Machines
- Announcing the NeurIPS 2022 Awards – NeurIPS Blog
- [2308.09543] Latent State Models of Training Dynamics
- [2412.05149] Findings of the Second BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora
- [2411.05735] Aioli: A Unified Optimization Framework for Language Model Data Mixing
- [2502.19249] Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases
- Awards - ACL 2025
- [2507.00885] Scaling Laws Are Unreliable for Downstream Tasks: A Reality Check
- [2601.19831] Neural Neural Scaling Laws
- [2605.15220] Always Learning, Always Mixing: Efficient and Simple Data Mixing All The Time

