James Whittington
Also known as James C. R. Whittington
James Whittington is a computational neuroscientist at the University of Oxford whose models of the hippocampal formation connect brain research with machine learning. Educated at Oxford in physics, medicine and neuroscience, he did his PhD with Rafal Bogacz and Tim Behrens, and in 2020 he introduced the Tolman-Eichenbaum machine in Cell. In 2021, he showed that transformers with recurrent position encodings replicate hippocampal place and grid representations, and his 2023 ICLR paper on disentanglement with biological constraints earned an Honorable Mention. He coauthored the Zamba language model in 2024 and won a European Research Council Starting Grant in 2025. He is a Principal Investigator in the Department of Experimental Psychology at Oxford and a co-founder of the nonprofit Thinking About Thinking.
- Now at
- University of Oxford and Thinking About Thinking
- Badges
Timeline
-
2017–2019
Backpropagation in the brain
He studies physics, medicine and neuroscience at Oxford and does his PhD there with Rafal Bogacz and Tim Behrens. His 2017 paper with Bogacz in Neural Computation approximates the error backpropagation algorithm in a predictive coding network with local Hebbian synaptic plasticity, and a 2019 paper in Trends in Cognitive Sciences covers theories of error back-propagation in the brain.
-
2018–2020
The Tolman-Eichenbaum machine
In 2018, he presents "Generalisation of structural knowledge in the hippocampal-entorhinal system" as an oral paper at NeurIPS. In 2020, he is first author of the Cell paper "The Tolman-Eichenbaum Machine: Unifying space and relational memory through generalisation in the hippocampal formation", written with six coauthors including Timothy Behrens.
-
2021–2022
Transformers and cognitive maps
In December 2021, he posts a paper with Joseph Warren and Timothy Behrens showing that transformers with recurrent position encodings replicate the place and grid representations of the hippocampal formation. In September 2022, he and three coauthors, including Behrens, publish the Nature Neuroscience review "How to build a cognitive map", which organizes models of the hippocampus and other brain areas into a clear ontology.
-
By 2023
Wellcome Scholar at Stanford
In January 2023, he is a Sir Henry Wellcome Scholar split between Stanford and Oxford, and gives the Wu Tsai Neuro MBCT seminar "Organizing knowledge for flexible behavior" at Stanford.
-
2023
Honorable mention at ICLR
His ICLR 2023 paper with Will Dorrell, Surya Ganguli and Timothy Behrens, "Disentanglement with Biological Constraints: A Theory of Functional Cell Types", earns an Honorable Mention. The paper proves that nonnegativity and energy efficiency in activity and weights promote disentangled representations, and uses the result to explain why the brain partitions cells into types such as grid and object-vector cells.
-
2024
The Zamba language model
In 2024, he is a coauthor of the Zamba technical report, which presents a 7B model that combines a Mamba backbone with a single shared attention module and trains on 1T tokens from openly available datasets. He also coauthors Zyda, a 1.3 T dataset for open language modeling.
-
September 2025
An ERC Starting Grant
In September 2025, he is one of eleven Oxford early-career researchers awarded a European Research Council Starting Grant, valued at €1.5 million over five years. His project studies how brain networks support flexible behaviour, using neural network models and collaboration with experimental neuroscientists.
-
As of October 2026
Principal Investigator at Oxford
He is a Principal Investigator in the Department of Experimental Psychology at the University of Oxford, where he leads a group researching fundamentals in artificial intelligence and neuroscience. He is also a co-founder and director of the nonprofit Thinking About Thinking and consults for AI technology companies.
Career
- NowUniversity of OxfordPrincipal Investigator
- NowThinking About ThinkingCo-founder, Director
- From 2023Stanford UniversitySir Henry Wellcome Scholar
Education
Sources and credits
Photo: We have no published photo of James Whittington yet. Send us a free-licensed photo.
- James Whittington - Organizing knowledge for flexible behavior | Wu Tsai Neurosciences Institute
- James Whittington | The Transmitter: Neuroscience News and Perspectives
- James Whittington
- [2112.04035] Relating transformers to models and neural representations of the hippocampal formation
- How to build a cognitive map | Nature Neuroscience
- ICLR 2023 Awards
- [2405.16712] Zamba: A Compact 7B SSM Hybrid Model
- Oxford researchers win ERC Starting Grants to tackle global challenges
- Professor James Whittington BMBCh (Oxon), DPhil (Oxon) | Thinking About Thinking


