William Dally
Also known as Bill Dally
William Dally is a computer architect whose career links parallel-computing systems with the GPUs used for neural-network learning. He studied electrical engineering at Virginia Tech and Stanford, then earned a computer-science PhD at Caltech before building parallel machines at MIT and Stanford. At NVIDIA, he recognized that GPUs could perform neural-network image recognition faster with a fraction of the processors; he is now chief scientist and senior vice president of research. He coauthored a paper on a deep-learning inference accelerator and shared the 2025 Queen Elizabeth Prize for Engineering for contributions to modern machine learning. In 2026, he described using reinforcement learning to adapt chip cell libraries to new fabrication processes.
- Now at
- NVIDIA and Stanford University
- Works
- 486
- Citations
- 51,667
- h-index
- 91
Publication numbers from OpenAlex, as of 14 October 2026.
Timeline
-
1970s–1983
A computer in junior high
As a junior-high student in the Washington, D.C., region, he encountered his first computer in the early 1970s. He studied electrical engineering at Virginia Tech and Stanford before entering Caltech's computer-science PhD program in 1983.
-
1983–1986
Designing parallel hardware
At Caltech, he completed a computer-science PhD and designed the MOSSIM Simulation Engine and Torus Routing chip. The chip pioneered wormhole routing and virtual-channel flow control.
-
1986–1997
Building parallel machines
His MIT group built the J-Machine and M-Machine, experimental parallel computers with low-overhead synchronization and communication. The J-Machine used wormhole routing to speed messages between nodes.
-
1997–2009
A lab and a desert drive
At Stanford, he chaired computer science while his team developed architecture, networking, signaling, routing, and synchronization technologies used in large parallel computers. During the 2005 DARPA Grand Challenge, a team collected road data to train a statistical machine-learning model.
-
Since 2009
GPUs for visual learning
He joined NVIDIA as chief scientist in January 2009. After hearing about Andrew Ng's Google neural network for recognizing cats, he saw that NVIDIA GPUs could perform similar image-recognition work faster with a fraction of the processors.
-
2023–2025
A prize and an inference chip
He coauthored a 2023 paper on a 95.6-TOPS/W deep-learning inference accelerator. In 2025, he shared the Queen Elizabeth Prize for Engineering with six other engineers for contributions to modern machine learning.
-
As of October 2026
Leading NVIDIA research
In April 2026, he described NVCell, a reinforcement-learning program for porting standard-cell libraries to a new process; the task runs overnight on one GPU. As of October 2026, he is NVIDIA's chief scientist and senior vice president of research.
Sources and credits
Photo: The White House, via Wikimedia Commons. License: Public domain. Source: commons.wikimedia.org. Cropped to a square and resized. Ask us to remove or replace this photo.
- William Dally | Research
- “This Is Going to Be Really Big”: How Nvidia’s Bill Dally Shaped the AI Era
- 2025 Queen Elizabeth Prize for Engineering awarded for Modern Machine Learning
- Not that we should be at all surprised, but Nvidia leans on AI pretty hard for speeding up how it plans and designs its next generation of GPUs
- The engine behind the AI revolution: NVIDIA’s chief scientist William Dally on what really drives computing forward