Roei Herzig
Also known as Roi Herzig
Roei Herzig is a computer vision and robotics researcher who develops models and learning algorithms for Physical AI, with robots as the main testbed. He studied computer science and physics at Tel Aviv University, earned a PhD there under Amir Globerson in 2023, and won the 2023 IAAI Best PhD Thesis Award. His papers include the SKU-110K dataset in 2019, Object-Region Video Transformers in 2022, LLARVA in 2024 and ARM4R in 2025, and he was a core contributor to the Granite Vision model in 2025. As of October 2026, he is an incoming assistant professor in the School of Computing Science at Simon Fraser University, following a postdoc at UC Berkeley with Trevor Darrell.
- Badges
Timeline
-
2015–2019
Degrees at Tel Aviv University
He earns a double-major BSc in computer science and physics at Tel Aviv University in 2015. A master's degree in computer science follows there in 2019, awarded magna cum laude.
-
2019
The SKU-110K dataset
In 2019, he coauthors Precise Detection in Densely Packed Scenes with Eran Goldman, Aviv Eisenschtat and colleagues, published at CVPR. The paper releases SKU-110K, an annotated dataset of packed retail environments for training and testing precise object detection.
-
2022
Object-Region Video Transformers
In 2022, he is first author of Object-Region Video Transformers (ORViT), published at CVPR with Elad Ben-Avraham, Amir Globerson, Trevor Darrell and others. ORViT extends video transformer layers with a block that feeds object representations through appearance and dynamics streams. He is also a winner of the Ego4D Point of No Return Temporal Localization Challenge at CVPR 2022.
-
2023
PhD and the IAAI award
He completes his PhD at Tel Aviv University in 2023 under Amir Globerson, with the thesis Towards Compositionality in Computer Vision. The thesis wins the 2023 IAAI Best PhD Thesis Award of the Israeli Association for Artificial Intelligence, given for the best AI thesis in Israel, and he is one of three selected for the Israeli Excellence in Data Science Postdoctoral Fellowship in 2023.
-
2024
LLARVA for robot learning
In 2024, he coauthors LLARVA with Dantong Niu, Yuvan Sharma, Trevor Darrell and others, published at CoRL. The model is pre-trained on 8.5M image-visual trace pairs from the Open X-Embodiment dataset and evaluated on 12 RLBench tasks and a physical Franka Emika Panda robot.
-
2025
ARM4R and 4D representations
In 2025, he coauthors ARM4R, published at ICML, an auto-regressive robotic model that learns low-level 4D representations from human video data. The 4D representations are 3D point tracks lifted from video with monocular depth estimation, and they transfer to robot control across several robot environments.
-
2025
Core contributor to Granite Vision
Also in 2025, he is a core contributor to Granite Vision, a lightweight, open-source multimodal model for enterprise use. Its 2-billion-parameter Granite language model is aligned with visual inputs for visual document understanding, and the model is released under the Apache-2 license.
-
As of October 2026
Incoming professor at SFU
In February 2026, he gives the seminar Towards Structured Physical AI Models at UT Austin as a postdoctoral scholar at UC Berkeley, advised by Trevor Darrell, and a research scientist at the MIT-IBM Watson AI Lab. He is an incoming Assistant Professor at the School of Computing Science at Simon Fraser University. His research develops models and learning algorithms for Physical AI, using robots as the primary testbed.
Career
- Until 2026University of California, BerkeleyPostdoctoral Scholar
- Until 2026IBM ResearchResearch Scientist
- Simon Fraser UniversityAssistant Professor
Education
- 2023Tel Aviv UniversityPhD
- 2019Tel Aviv UniversityMaster's degree in Computer Science
- 2015Tel Aviv UniversityBSc in Computer Science and Physics
Sources and credits
Photo: We have no published photo of Roei Herzig yet. Send us a free-licensed photo.
- Roi Herzig - School of Computing Science - Simon Fraser University
- Roei Herzig - Vector Institute for Artificial Intelligence
- Precise Detection in Densely Packed Scenes
- Roei Herzig
- Object-Region Video Transformers
- Prizes of IAAI
- LLARVA: Vision-Action Instruction Tuning Enhances Robot Learning
- Pre-training Auto-regressive Robotic Models with 4D Representations
- Granite Vision: a lightweight, open-source multimodal model for enterprise Intelligence
- Towards Structured Physical AI Models | Texas ECE - Electrical & Computer Engineering at UT Austin

