Ryo Hachiuma
Ryo Hachiuma is a computer vision researcher whose work spans real-time SLAM, action recognition, and multimodal models for images, video, and autonomous driving. He coauthored DetectFusion and earned a Ph.D. in Engineering at Keio University under Hideo Saito; he also coauthored a method for estimating 3D human-object interactions from a wearable camera. His papers address image-caption bias, region-level image and video understanding, and cooperative driving with multimodal language models. As of October 2026, he is a Senior Research Scientist at NVIDIA Research Taiwan; his interests include video understanding and vision-language models, and five of his papers were accepted at CVPR 2026.
Timeline
-
2019
DetectFusion at BMVC
In 2019, he coauthors DetectFusion with Christian Pirchheim, Dieter Schmalstieg and Hideo Saito, a real-time RGB-D SLAM system for semantically known and unknown moving objects. BMVC selects the paper for its 2019 spotlight session.
-
2019
An APMAR Best Paper Award
He wins the Best Paper Award at the Asia Pacific Workshop on Mixed and Augmented Reality in 2019.
-
2020
A MICCAI foot-ulcer win
In 2020, he takes first place in MICCAI’s Diabetic Foot Ulcer Challenge. He coauthors Deep Learning in Diabetic Foot Ulcers Detection: A Comprehensive Evaluation, which compares the winning teams’ methods, including Faster R-CNN variants, YOLOv5 and EfficientDet.
-
2021
A Keio Ph.D. and pose policy
He earns a Ph.D. in Engineering at Keio University under Hideo Saito in 2021 and also works as a visiting researcher at TU Graz and Carnegie Mellon University. At NeurIPS 2021, he coauthors Dynamics-Regulated Kinematic Policy with Zhengyi Luo, Ye Yuan and Kris Kitani, a method for estimating physically plausible 3D human-object interactions from a single wearable camera.
-
2023
Action recognition at Konica Minolta
Before joining NVIDIA Research, he works as a computer vision engineer at Konica Minolta in Japan on human action recognition. At CVPR 2023, he coauthors the paper Unified Keypoint-Based Action Recognition Framework via Structured Keypoint Pooling with Fumiaki Sato and Taiki Sekii. The framework treats time-series human skeletons and nonhuman object contours as an input 3D point cloud through a tracking-free architecture.
-
2024
NVIDIA Research Taiwan
NVIDIA Research Taiwan is the APAC research team founded in 2022, where he works as a Research Scientist on multi-modal AI. His interests include video understanding and vision-language models. At EMNLP 2024, he coauthors From Descriptive Richness to Bias, which finds that generative image-caption enrichment increases gender bias and hallucination.
-
2025
Omni-RGPT and V2V-LLM
In 2025, he coauthors Omni-RGPT with Miran Heo, Min-Hung Chen, Yu-Chiang Frank Wang and others, a multimodal large language model for region-level understanding of images and videos. He is the second author of V2V-LLM, which fuses perception information from multiple connected autonomous vehicles in a multimodal large language model to answer driving questions about grounding, notable-object identification and planning.
-
As of October 2026
Senior Research Scientist at NVIDIA
As of October 2026, he is a Senior Research Scientist at NVIDIA Research Taiwan, working on multi-modal AI. CVPR 2026 accepts five of his papers.
Career
- Since 2024NVIDIASenior Research Scientist
- 2023Konica MinoltaComputer Vision Engineer
- 2021Graz University of TechnologyVisiting Researcher
- 2021Carnegie Mellon UniversityVisiting Researcher
Education
- 2021Keio UniversityPh.D. in Engineering
Most-cited works
- Deep Learning in Diabetic Foot Ulcers Detection: A Comprehensive EvaluationWith Eibe Frank
- Unified Keypoint-Based Action Recognition Framework via Structured Keypoint Pooling
- Prompt-Guided Zero-Shot Anomaly Action Recognition using Pretrained Deep Skeleton Features
- Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimation
- Toward Unsupervised 3d Point Cloud Anomaly Detection Using Variational Autoencoder
Sources and credits
Photo: We have no published photo of Ryo Hachiuma yet. Send us a free-licensed photo.
- DetectFusion: Detecting and Segmenting Both Known and Unknown Dynamic Objects in Real-time SLAM
- Ryo Hachiuma
- Deep Learning in Diabetic Foot Ulcers Detection: A Comprehensive Evaluation
- Dynamics-Regulated Kinematic Policy for Egocentric Pose Estimation
- Ryo Hachiuma | NVIDIA Research Taiwan
- Unified Keypoint-Based Action Recognition Framework via Structured Keypoint Pooling (CVPR 2023 Open Access Repository)
- NVIDIA Research Taiwan
- From Descriptive Richness to Bias: Unveiling the Dark Side of Generative Image Caption Enrichment | NVIDIA Research Taiwan
- Omni-RGPT: Unifying Image and Video Region-level Understanding via Token Marks
- V2V-LLM: Vehicle-to-Vehicle Cooperative Autonomous Driving with Multimodal Large Language Models



