João F. Henriques
Also known as João Henriques, Joao Henriques, Joao F. Henriques
João Henriques is a computer vision researcher at the University of Oxford whose KCF and SiameseFC trackers run in consumer hardware, from Facebook apps to commercial drones. After a master's degree in electrical engineering at the University of Coimbra in 2009, he coauthored the first tracker based on circulant matrices in 2012, and the Kernelized Correlation Filter followed in 2014 while he was a doctoral student at Coimbra's Institute of Systems and Robotics. In 2016 he coauthored the SiamFC tracker with Luca Bertinetto, Jack Valmadre, Andrea Vedaldi and Philip Torr, and in 2018 and 2019 he presented MapNet and CurveBall. The Royal Academy of Engineering announced his Research Fellowship for the one-shot learning project MEMO in August 2019, and in 2021 he helped organize the NeurIPS pre-registration workshop. He is a Research Fellow of the Royal Academy of Engineering in Oxford's Visual Geometry Group, where his research also covers robot mapping, multi-agent cooperation and "friendly" AI.
- Now at
- University of Oxford
Timeline
-
2009
Electrical engineering at Coimbra
He earns a master's degree in electrical engineering from the University of Coimbra in 2009. He goes on to doctoral studies at the university's Institute of Systems and Robotics, with research on Fourier analysis and machine learning for detection and tracking.
-
2012–2014
From circulant trackers to KCF
In 2012, he coauthors "Exploiting the Circulant Structure of Tracking-by-Detection with Kernels" at ECCV with Rui Caseiro, Pedro Martins and Jorge Batista, the first tracker based on circulant matrices. Its successor, the Kernelized Correlation Filter (KCF), appears on arXiv in 2014 and outperforms trackers such as Struck and TLD on a 50-video benchmark while running at hundreds of frames per second.
-
2016
The SiamFC tracker
In 2016, he coauthors "Fully-Convolutional Siamese Networks for Object Tracking" with Luca Bertinetto, Jack Valmadre, Andrea Vedaldi and Philip H. S. Torr. The SiamFC tracker uses a fully-convolutional Siamese network trained end-to-end on the ILSVRC15 video detection data and operates at frame-rates beyond real-time.
-
2018–2019
MapNet and CurveBall
At CVPR in 2018, he and Andrea Vedaldi present MapNet, an end-to-end learnable deep network that solves the full SLAM problem with a spatial memory. In 2019 at ICCV, he and coauthors introduce CurveBall, a second-order optimizer for deep networks that needs no hyper-parameter tuning.
-
2019
Royal Academy of Engineering fellowship
In August 2019, the Royal Academy of Engineering announces 18 new Research Fellowships, including one for Dr Joao Henriques of the University of Oxford for the project MEMO, Meta-learning Enhanced Memorization in One-shot. Each awardee receives five years of funding and mentorship.
-
2021
A pre-registration workshop
In 2021, he helps organize the NeurIPS pre-registration workshop with Samuel Albanie, Luca Bertinetto, Alex Hernandez-Garcia, Hazel Doughty and Gul Varol. Papers in this publication model go to peer review without experimental results, and the experimental protocol is followed after acceptance.
-
2024
A talk on safe agents
In 2024, he gives the first invited talk at the NeurIPS workshop Towards Safe & Trustworthy Agents.
-
As of October 2026
Research Fellow at Oxford's VGG
He is a Research Fellow of the Royal Academy of Engineering in the Visual Geometry Group at the University of Oxford, an associate member of faculty in Engineering Science and a principal investigator. His research spans computer vision, deep learning, robot mapping and navigation, and multi-agent cooperation and "friendly" AI. The KCF and SiameseFC trackers he created won the VOT Challenge twice and are widely deployed in consumer hardware, from Facebook apps to commercial drones.
Career
- NowUniversity of OxfordResearch Fellow and Principal Investigator
Education
- 2009University of CoimbraMaster's degree in electrical engineering
Sources and credits
Photo: We have no published photo of João F. Henriques yet. Send us a free-licensed photo.
- High-Speed Tracking with Kernelized Correlation Filters (ar5iv HTML version)
- João F. Henriques
- High-Speed Tracking with Kernelized Correlation Filters
- Fully-Convolutional Siamese Networks for Object Tracking
- Academy supports engineering excellence with 18 new Research Fellowships
- The pre-registration workshop: an alternative publication model for machine learning research
- Invited talk 1: João F. Henriques (Research Fellow, Royal Academy of Engineering)
- João Henriques - People - Department of Engineering Science
- People - Visual Geometry Group - University of Oxford
