José Hernández-Orallo
José Hernández-Orallo studies how to evaluate AI capabilities, progress and risks. He studied computer science at UPV, earned a logic doctorate at Valencia and joined the DMIP team before coauthoring a 2004 data-mining textbook. His 2017 book The Measure of All Minds won the 2018 PROSE Award; he coauthored the 2023 Science article Rethink reporting of evaluation results in AI and researched psychometric evaluation in health care in 2025. In 2026, he was appointed to the EU AI Act Scientific Panel and received the Aritmel Award; as of October 2026, he directs research at Cambridge's Leverhulme Centre for the Future of Intelligence and is a professor on partial leave at TU Valencia.
Years link to their sources.
Timeline
-
1996–2000
Joining UPV's DMIP team
He studies computer science at UPV, partly at France's École Nationale Supérieure de l'Électronique et de ses Applications, and joins UPV's Department of Information Systems and Computation in 1996. In 1999, he completes a logic doctorate at the University of Valencia; in 2000, he becomes a member of the DMIP team.
-
2004
A data-mining textbook
In 2004, he coauthors the Spanish textbook Introducción a la minería de datos with María José Ramírez Quintana and César Ferri Ramírez. The book uses practical examples and software such as SPSS, Clementine and WEKA to explain data-mining methods.
-
2018
The Measure of All Minds
In 2017, he publishes The Measure of All Minds, applying algorithmic information theory to the evaluation of cognition. The book wins the 2018 PROSE Award for Computing and Information Sciences.
-
2023
Rethink AI evaluation reporting
In 2023, he coauthors the Science article Rethink reporting of evaluation results in AI. It argues that aggregate metrics and limited access to results make AI evaluation harder to understand.
-
October 2025
Psychometrics for medical AI
In October 2025, he is a Senior Research Fellow at Cambridge's Leverhulme Centre for the Future of Intelligence and coauthors research on psychometric evaluation in health care. The study finds that exam benchmarks can miss system weaknesses and performance outside tested tasks.
-
June 2026
The EU AI Act panel
In June 2026, he is appointed to the European Union's AI Act Scientific Panel with CFI colleagues Seán Ó hÉigeartaigh and Lorenzo Pacchiardi. The panel advises the AI Office and national authorities on implementing the AI Act and assessing impacts and risks from general-purpose AI models.
-
2026
The Aritmel Award
The Spanish Computer Science Scientific Society and Fundación BBVA award him the 2026 Aritmel National Computer Science Award for work evaluating AI capabilities, limits and risks.
-
As of October 2026
Director of Research at CFI
In August 2026, he coauthors the Science Policy Forum article The next Turing tests: Reimagining conceptions and measures of AI, which proposes measuring AI progress through diversity, partnership and systemicity. He is Director of Research at the Leverhulme Centre for the Future of Intelligence at Cambridge and a professor on partial leave at TU Valencia; his research focuses on AI capabilities, generality, progress, impact and risks.
Career
- Since 2025University of CambridgeSenior Research Fellow, Director of Research
- Since 1996Polytechnic University of ValenciaProfessor
- From 2026European UnionMember
- From 2000Department of Information Systems and ComputationMember
Education
Sources and credits
Photo: We have no published photo of José Hernández-Orallo yet. Send us a free-licensed photo.
- José Hernández-Orallo | edX
- Doctoral Dissertation
- Introducción a la minería de datos - Google Libros
- The Measure of All Minds
- Jose Hernandez-Orallo's Home Page
- How psychometrics can enhance AI healthcare evaluation
- Cambridge experts appointed to the European Union's AI Act Scientific Panel
- Fallados los Premios de Investigación Sociedad Científica Informática de España (SCIE)–Fundación BBVA 2026
- New paper: Beyond the Turing Test
- José Hernández-Orallo - CHIA



