Ellen M Voorhees
Also known as Ellen M. Voorhees, E. Voorhees, E.M Voorhees, E.M. Voorhees, Ellen M Voorhes, Ellen Voorhees
Ellen M Voorhees is a computer scientist whose work built shared ways to measure search and language systems. She studied computer science at Penn State and Cornell, worked on information-access agents at Siemens, then spent decades shaping NIST’s TREC evaluation program. ACM named her a Fellow in 2018; her TREC-COVID work earned Commerce awards in 2021, and SIGIR gave her the Gerard Salton Award in 2024. In 2025 she coauthored LARA, a method that combines human assessments with language-model predictions; she is also a scientist emeritus at NIST and studies evaluation for trustworthy AI.
Timeline
-
1979–1996
From computing to search
She earned a B.S. in computer science at Penn State in 1979, followed by an M.S. and Ph.D. at Cornell in 1982 and 1985. After teaching at Cornell, she worked on intelligent agents for information access at Siemens, where her work resulted in three patents.
-
1996–2023
Building TREC’s evaluation program
At NIST, she managed the Text REtrieval Conference (TREC) for most of her tenure; the project developed infrastructure for large-scale evaluation of search engines and information-access technology. Her 2001 paper on the TREC-9 web track found that evaluation could be unstable when assessors judged only highly relevant pages and disagreed on the best page. Her Information Technology Laboratory service ran from 1996 to 2023.
-
2018
A fellowship for evaluation
ACM named her a Fellow for contributions to evaluation in information retrieval, question answering, and other language technologies.
-
2021
Searching through a pandemic
She led the NIST TREC-COVID Challenge, which evaluated information retrieval for COVID-19 research. The work earned her the U.S. Department of Commerce Gold Medal and Ron Brown Excellence in Innovation Award.
-
2023
An honorary science doctorate
The University of Glasgow awarded her an honorary Doctor of Science for her achievements in evaluating information retrieval, question answering, and other language technologies.
-
2024
Recognition for search evaluation
SIGIR gave her the Gerard Salton Award for systematic evaluation of retrieval systems, benchmarks, forums, and metrics. NIST inducted her into its Portrait Gallery for her impact on information retrieval, access, and search technology.
-
July 2025
Pairing LLMs with assessors
With Rikiya Takehi, Tetsuya Sakai, and Ian Soboroff, she published LLM-Assisted Relevance Assessments (LARA), a method that combines human annotations with language-model predictions to build test collections.
-
Since 2025
Evaluation for trustworthy AI
She is a scientist emeritus at NIST’s Information Technology Laboratory, where she studies how large-scale community evaluations can support trustworthy AI.
Sources and credits
Photo: We have no published photo of Ellen M Voorhees yet. Send us a free-licensed photo.
- Ellen M. Voorhees | NIST
- 2024 NIST Portrait Gallery Induction Ceremony | NIST
- Text REtrieval Conference (TREC) Contact Information
- Evaluation by Highly Relevant Documents | NIST
- Ellen Voorhees Named ACM Fellow | NIST
- 2021 Gold Medal Award—Ellen Voorhees | NIST
- 2021 Ron Brown Excellence in Innovation Award—Ellen Voorhees | NIST
- Ellen Voorhees Receives Honorary Doctor of Science Degree from the University of Glasgow | NIST
- Ellen Voorhees receives Gerald Salton Award | NIST
- Gerard Salton Awards | SIGIR
- LLM-Assisted Relevance Assessments | NIST
- NLM Ada Lovelace Computational Health Lecture