PeopleofSuperintelligence

Researcher

Steve Omohundro

Also known as Stephen Omohundro, Stephen M. Omohundro

Steve Omohundro is a researcher whose work on AI safety spans arguments about advanced AI drives and proposals for verifiable AGI. He earned physics and mathematics degrees at Stanford and a physics Ph.D. at UC Berkeley, then taught at Illinois, helped develop Mathematica and led Sather at ICSI. His 2008 “The Basic AI Drives” paper described self-improvement, self-protection and resource acquisition; his 2023 and 2024 papers set out ways to prove AI systems safe. He shared the 2024 Future of Life Award, proposed mathematically provable contracts for AGI regulation in July 2025, and is Founder and CEO of Beneficial AI Research as of October 2026, after research roles at Meta and AIBrain.

Now at
Beneficial AI Research
Born
1959
Works
14
Citations
408
h-index
9
Badges

Years link to their sources. Publication numbers from OpenAlex, as of 22 October 2026.

Timeline

  1. By 1988

    Degrees and an Illinois post

    At Stanford, he earns degrees in physics and mathematics, then completes a Ph.D. in physics at UC Berkeley in 1985; his dissertation, “Geometric Perturbation Theory and Plasma Physics,” lists Allan N. Kaufman and Alan David Weinstein as advisors. From 1986 to 1988, he serves as an assistant professor of computer science at the University of Illinois at Urbana-Champaign and co-founds the Center for Complex Systems Research with Stephen Wolfram and Norman Packard. As one of Mathematica’s seven original developers, he writes its three-dimensional graphics portion.

  2. 1990s

    The Sather language

    Around 1990, he designs Sather, an object-oriented language developed at ICSI in Berkeley by an international team he leads.

  3. 2008

    The Basic AI Drives

    In February 2008, “The Basic AI Drives” appears in the Proceedings of the First AGI Conference. The paper argues that sufficiently advanced AI systems of any design develop drives to improve themselves, protect themselves and acquire resources, unless designers explicitly counteract them.

  4. September 2023

    Provably safe systems

    In September 2023, he and Max Tegmark submit “Provably safe systems: the only path to controllable AGI.” They describe a path to building AGIs that provably satisfy human-specified requirements, using formal verification and mechanistic interpretability.

  5. May 2024

    Towards Guaranteed Safe AI

    In May 2024, he is one of 17 authors of “Towards Guaranteed Safe AI,” alongside Yoshua Bengio, Stuart Russell and Max Tegmark. The paper builds quantitative safety guarantees from a world model, a safety specification and a verifier that provides an auditable proof certificate.

  6. 2024

    A Future of Life Award

    In December 2024, he shares the Future of Life Award with James H. Moor and Batya Friedman for laying the foundations of modern computer ethics and AI safety.

  7. July 2025

    Provable contracts for AGI regulation

    In July 2025, he publishes “Regulating AGI: From Liability to Provable Contracts,” proposing mathematically provable contracts as a basis for AGI regulation.

  8. As of October 2026

    Founder and CEO of Beneficial AI

    As of October 2026, he is Founder and CEO of Beneficial AI Research, which works to ensure that AI is safe and beneficial. His earlier roles include research scientist at Meta, where he works on generative models and AI-based simulation, chief scientist at AIBrain, and research scientist at the NEC Research Institute and ICSI.

Career

  1. NowBeneficial AI ResearchFounder and CEO
  2. 1986–1988University of Illinois Urbana-ChampaignAssistant Professor of Computer Science, Co-founder
  3. MetaResearch Scientist
  4. AIBrainChief Scientist
  5. International Computer Science InstituteResearch Scientist
  6. NEC Research InstituteResearch Scientist

Education

  1. 1985University of California, BerkeleyPhD in Physics
  2. Stanford UniversityDegrees in physics and mathematics

From the biography and OpenAlex affiliations (the years of papers that list the organization), so some years are approximate.

  1. The Massachusetts Institute of Technology trained or employed 44 of the 187 AI major-prize winners, more than any other universityIncludes University of Illinois Urbana-Champaign. The Massachusetts Institute of Technology trained or employed 44 of the 187 AI major-prize winners, more than any other university. We compare doctorate and 5+ year employment links, career timing and current workplaces for 187 major-prize and 1,111 best-paper winners.
  2. 84% of people shaping AI with recorded undergraduate and doctoral schools changed institutions for their doctorateIncludes University of Illinois Urbana-Champaign. 84% of people shaping AI with recorded undergraduate and doctoral schools changed institutions for their doctorate. Across 2,116 people with both an undergraduate degree and a doctorate recorded, we trace which undergraduate schools feed which doctoral programs, how often students stay at the same school, and how paths differ by birth-country region.
  3. The company share of AI researchers’ top papers was 31% in 2020–2024 and 8% in 1970–1974Includes Meta. We estimate where the people shaping AI worked when their most-cited papers appeared: the company share was 31% in 2020–2024 and 8% in 1970–1974, and Google led all organizations in 2020–2024.
  4. Companies supply the most prior-work hires at 7 of the 9 frontier AI labsIncludes Meta. Our estimates of the organizations where 550 people worked directly before joining 9 frontier AI labs across 620 career transitions, comparing the main feeder organizations per lab.

Colleagues

People named in this biography, and people with dated positions at the same organization in the same years.

Sources and credits

Photo: We have no published photo of Steve Omohundro yet. Send us a free-licensed photo.

  1. Stephen Omohundro - The Mathematics Genealogy Project mathgenealogy.org. Checked 21 October 2026.
  2. Steve Omohundro steveomohundro.com. Checked 21 October 2026.
  3. Steve Omohundro - Wikipedia en.wikipedia.org. Checked 21 October 2026.
  4. Scientific Contributions | Steve Omohundro steveomohundro.com. Checked 21 October 2026.
  5. Sather - Wikipedia en.wikipedia.org. Checked 21 October 2026.
  6. The Basic AI Drives | Self-Aware Systems selfawaresystems.com. Checked 21 October 2026.
  7. Provably safe systems: the only path to controllable AGI arxiv.org. Checked 21 October 2026.
  8. Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems arxiv.org. Checked 21 October 2026.
  9. Future Of Life Award 2024 - Future of Life Institute futureoflife.org. Checked 21 October 2026.
  10. Regulating AGI: From Liability to Provable Contracts windfalltrust.substack.com. Checked 21 October 2026.