Builder

Costa Huang

Also known as Shengyi Huang

Costa Huang is a machine-learning engineer whose work spans deep reinforcement learning and open language models. He created CleanRL, a library for game-playing agents, and coauthored a 2022 paper on its single-file algorithms. He completed a computer-science PhD at Drexel University in 2023 with a dissertation on deep reinforcement learning. He was a researcher and machine-learning engineer at Ai2 in 2024; he coauthored Olmo 3, a family of fully open 7B and 32B language models, in 2025. As of October 2026, he is a team member at Periodic Labs.

Works
67

Publication numbers from OpenAlex, as of 19 October 2026. Citations and h-index are hidden because this OpenAlex record may be incomplete or mix in other authors.

Timeline

  1. 2019

    Developing CleanRL

    In 2019, he develops CleanRL, a deep-reinforcement-learning library for training game-playing agents.

  2. 2022

    A CleanRL journal paper

    In 2022, he coauthors a Journal of Machine Learning Research paper describing CleanRL's single-file deep reinforcement-learning algorithms.

  3. 2023

    A Drexel doctorate

    In 2023, he completes a computer-science PhD at Drexel University with a dissertation titled Reproducible and Efficient Deep Reinforcement Learning.

  4. 2024

    Research engineering at Ai2

    In 2024, he is a researcher and machine-learning engineer at Ai2.

  5. 2025

    Coauthoring Olmo 3

    In 2025, he coauthors Olmo 3, a family of fully open language models at the 7B and 32B parameter scales.

  6. As of October 2026

    On Periodic Labs' team

    As of October 2026, he is a member of Periodic Labs' team.

Career

  1. NowPeriodic LabsTeam Member
  2. From 2024Allen Institute for AI (Ai2)Researcher and Machine-Learning Engineer

Education

  1. 2023Drexel UniversityPhD

Sources and credits

Photo: We have no published photo of Costa Huang yet. Send us a free-licensed photo.

  1. Costa Huang's Website costa.sh. Checked 19 October 2026.
  2. CleanRL: High-quality Single-file Implementations of Deep Reinforcement Learning Algorithms jmlr.org. Checked 19 October 2026.
  3. Santiago Ontañón Villar sites.google.com. Checked 19 October 2026.
  4. 2022-23 Doctoral Defenses | Office of Graduate Studies | Drexel University drexel.edu. Checked 19 October 2026.
  5. 'Reasoning' AI models have become a trend, for better or worse techcrunch.com. Checked 19 October 2026.
  6. Olmo 3 arxiv.org. Checked 19 October 2026.
  7. Periodic Labs periodic.com. Checked 19 October 2026.