Aurelia Guy
Aurelia Guy is an AI researcher whose work spans reinforcement learning, interactive agents, and language models. In 2018, she co-authored a random-search method for continuous control, and in 2020 she co-authored Google DeepMind's Imitating Interactive Intelligence on a simulated Playroom for interactive agents. Her 2021 and 2022 papers studied Gopher, retrieval-enhanced models, routed scaling laws, and speech-based task learning. The compute-optimal training paper she co-authored earned a NeurIPS 2022 Outstanding Paper award. By 2024, she contributed to OpenAI's ChatGPT and Whisper API release.
Timeline
-
2018
Random search for reinforcement learning
In 2018, she co-authors a random-search method for training static linear policies for continuous control, matching state-of-the-art sample efficiency on MuJoCo locomotion tasks.
-
2020
Interactive agents in the Playroom
In 2020, she co-authors Google DeepMind's Imitating Interactive Intelligence, which introduces a simulated Playroom where agents move objects, speak, follow instructions, and answer questions.
-
2021
Training Gopher at scale
In 2021, she co-authors Scaling Language Models: Methods, Analysis & Insights from Training Gopher, which evaluates Transformer models up to 280 billion parameters on 152 tasks.
-
2022
Retrieval-Enhanced Transformer
In 2022, she co-authors Improving Language Models by Retrieving from Trillions of Tokens, which introduces RETRO and conditions language models on retrieved text from a large corpus.
-
2022
Scaling laws for routed models
In 2022, she co-authors Unified Scaling Laws for Routed Language Models, which derives scaling laws for routing networks that conditionally use a subset of their parameters to process an input.
-
2022
Speech for zero-shot task learning
In 2022, she co-authors Intra-agent speech permits zero-shot task acquisition, a study that teaches embodied agents to caption images and manipulate new objects with little labeled language data.
-
2022
A NeurIPS Outstanding Paper
In 2022, she co-authors An empirical analysis of compute-optimal large language model training, which earns a NeurIPS Outstanding Paper award. Its Chinchilla model uses the same compute budget as Gopher with 70 billion parameters.
-
By 2024
OpenAI API contributions
By April 2024, she contributes to OpenAI's launch of the ChatGPT and Whisper APIs.
Sources and credits
Photo: We have no published photo of Aurelia Guy yet. Send us a free-licensed photo.
- Simple random search provides a competitive approach to reinforcement learning
- Imitating Interactive Intelligence
- Scaling Language Models: Methods, Analysis & Insights from Training Gopher
- Improving Language Models by Retrieving from Trillions of Tokens
- Unified Scaling Laws for Routed Language Models
- Intra-agent speech permits zero-shot task acquisition
- Announcing the NeurIPS 2022 Awards
- An empirical analysis of compute-optimal large language model training
- Introducing ChatGPT and Whisper APIs