Cody Hao Yu
Also known as Cody Yu
Cody Hao Yu helps make large language models easier to serve through vLLM and its PagedAttention memory system. He earned computer-science degrees at National Tsing Hua University in 2011 and 2013, then completed a UCLA PhD in 2019. At AWS AI, he researched Apache TVM and machine-learning systems from 2019 to April 2023. His work includes the Bring Your Own Codegen compiler framework, SGLang, and engineering roles at BosonAI and Anyscale. Since April 2025, he has been a Member of Technical Staff at OpenAI and has contributed to the GPT-5 System Card released alongside the model in August 2025.
Timeline
-
2011–2019
Degrees in computer science
He earns B.S. and M.S. degrees in computer science at National Tsing Hua University in 2011 and 2013, then completes a PhD at UCLA in 2019.
-
2019–April 2023
Compiler research at AWS
He joins AWS AI as an applied scientist in 2019 and researches Apache TVM and machine-learning systems.
-
2021
Bring Your Own Codegen
He coauthors Bring Your Own Codegen to Deep Learning Compiler in 2021, proposing an open-source framework that reuses compiler components and enables custom code generation.
-
June 2023
PagedAttention and vLLM
He helps build vLLM, an open-source LLM serving engine built around PagedAttention; in 2023, the FastChat-vLLM backend serves Vicuna to millions of Chatbot Arena users.
-
December 2023
SGLang for language programs
In December 2023, he coauthors SGLang, a system with a frontend language and runtime for executing complex language-model programs.
-
2024
Tech lead at Anyscale
In 2024, he serves as a staff software engineer and tech lead at Anyscale, optimizing LLM inference after serving as a founding engineer at BosonAI.
-
Since April 2025
OpenAI post-training work
He joins OpenAI as a Member of Technical Staff in April 2025 and contributes to its GPT-5 System Card, published alongside the model's August 2025 launch.
Career
- Since 2025OpenAIMember of Technical Staff
- From 2024AnyscaleStaff software engineer and tech lead
- 2019–2023AmazonApplied scientist
- BosonAIFounding engineer
Education
- 2019University of California, Los AngelesPhD
- 2013National Tsing Hua UniversityB.S. and M.S. in computer science
Sources and credits
Photo: We have no published photo of Cody Hao Yu yet. Send us a free-licensed photo.
- (Cody) Hao Yu | VAST lab
- Cody (Hao) Yu | alphaXiv
- [2105.03215] Bring Your Own Codegen to Deep Learning Compiler
- vLLM: Easy, Fast, and Cheap LLM Serving with PagedAttention | vLLM Blog
- [2309.06180] Efficient Memory Management for Large Language Model Serving with PagedAttention
- [2312.07104] SGLang: Efficient Execution of Structured Language Model Programs
- Cody Yu | QCon San Francisco 2024
- [2601.03267] OpenAI GPT-5 System Card





