Hsuan-I Ho
Also known as Sean Ho
Hsuan-I Ho is a research scientist at NVIDIA Research and a member of NVIDIA Research Taiwan, working on human-centric computer vision and machine perception powered by generative AI. They earned a BSc in electrical engineering at National Taiwan University and a master's degree in computer science at ETH Zurich in 2021, and an early paper on summarizing first-person videos appeared at ECCV 2018. As first author, they built locally editable virtual humans and the CustomHumans dataset in 2023, the diffusion-based single-image reconstruction method SiTH in 2024, and the PHD body-fitting method in 2025. Supervised by Otmar Hilliges and Marc Pollefeys in ETH Zurich's Advanced Interactive Technologies lab, they defended a doctoral thesis on digital humans in February 2026.
Timeline
-
2017–2018
First-person video summarization
With Wei-Chen Chiu and Yu-Chiang Frank Wang, Ho coauthors a deep network that summarizes first-person videos, trained on annotated third-person videos plus a small set of annotated first-person ones. The paper goes to arXiv in November 2017 and appears at ECCV 2018.
-
2021
A master's degree at ETH Zurich
After a BSc in electrical engineering at National Taiwan University, Ho completes a master's degree in computer science at ETH Zurich in 2021. In November 2021, they release Render In-between with Xu Chen, Jie Song and Otmar Hilliges, a BMVC 2021 method that predicts skeletal motion between frames and renders high-frame-rate human video from low-frame-rate footage.
-
2023
Locally editable virtual humans
As first author with Lixin Xue, Jie Song and Otmar Hilliges, Ho presents Learning Locally Editable Virtual Humans at CVPR 2023, a generative model of neural avatars that stores geometry and texture features on the vertices of a body model so local parts can be swapped between avatars. The team also contributes CustomHumans, a new high-quality dataset for avatar creation and editing.
-
2024
SiTH and 4D-DRESS
SiTH, a CVPR 2024 pipeline first-authored by Ho with Jie Song and Otmar Hilliges, uses an image-conditioned diffusion model to hallucinate a person's unseen back view and then recovers a full-body textured 3D mesh from the input image and the generated view. With Wenbo Wang as joint first author, they also introduce 4D-DRESS, a real-world 4D clothing dataset of 64 outfits in 520 motion sequences, accepted as a CVPR 2024 highlight.
-
2024–2026
A Taiwan study-abroad scholarship
From 2024 to 2026, Ho holds the Taiwan Government Scholarship for Studying Abroad, worth USD 32,000. In spring 2025, they serve as a teaching assistant for Machine Perception at ETH Zurich, a course on deep-learning methods for human-centric signals.
-
2025
Personalized body fitting with PHD
At ICCV 2025, Ho presents PHD as first author, a method that calibrates a user's body shape and then fits 3D poses from video with a shape-conditioned Point Diffusion Transformer prior trained only on synthetic data. With Onat Vuran, a master's thesis student in 2024, they publish ReMu at BMVC 2025, which reconstructs multi-layer 3D clothed humans from images.
-
2026
A doctorate on digital humans
In February 2026, Ho defends the doctoral thesis "Advancing Digital Humans Toward Personalized Human-Centric AI" in the Advanced Interactive Technologies lab of ETH Zurich's Institute for Intelligent Interactive Systems, supervised by Otmar Hilliges and Marc Pollefeys. Siyu Tang, Ming-Hsuan Yang and Lingjie Liu join Pollefeys on the doctoral committee. In March 2026, they post Gaussian Wardrobe with Zhiyi Chen and colleagues, a 3DV 2026 framework that builds 3D Gaussian avatars from layers of free-form garments for virtual try-on.
-
As of October 2026
Research scientist at NVIDIA
Ho is a research scientist at NVIDIA Research and a member of NVIDIA Research Taiwan, the APAC team of NVIDIA Research, founded in 2022 and led by Frank Wang, which focuses on generative AI, multimodal learning and 3D vision. Their research centers on human-centric computer vision and machine perception powered by generative AI. Earlier, they intern as a research scientist at Meta Reality Labs in Redmond and Google XR in Zurich, working on diffusion models for human pose estimation and 3D human generation.
Sources and credits
Photo: We have no published photo of Hsuan-I Ho yet. Send us a free-licensed photo.
- [1711.08922] Summarizing First-Person Videos from Third Persons' Points of Views
- Hsuan-I Ho | NVIDIA Research Taiwan
- Dr. Hsuan-I Ho | AIT Lab
- [2111.01029] Render In-between: Motion Guided Video Synthesis for Action Interpolation
- Learning Locally Editable Virtual Humans – CVPR 2023 Open Access Repository
- [2311.15855] SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion
- 4D-DRESS: A 4D Dataset of Real-World Human Clothing With Semantic Annotations – CVPR 2024 Open Access Repository
- Machine Perception, Spring 2025 | AIT Lab
- [2508.21257] PHD: Personalized 3D Human Body Fitting with Point Diffusion
- Hsuan-I (Sean) Ho | Personal Webpage
- [2603.04290] Gaussian Wardrobe: Compositional 3D Gaussian Avatars for Free-Form Virtual Try-On
- NVIDIA Research Taiwan



