Yusuke Hirota
Yusuke Hirota is a researcher in AI fairness whose work identifies and reduces societal biases in vision-language datasets and models. At Osaka University, he earned a B.S. in engineering, an M.S. in information science and a Ph.D. in computer science. His research examined bias in visual question answering and image captioning, and developed mitigation methods including LIBRA and SANER. Since April 2025, he is a research scientist at NVIDIA Research Taiwan, where he focuses on fairness in multimodal tasks.
Timeline
-
2016–2022
Degrees at Osaka University
He studies at Osaka University from 2016 to 2020 for a B.S. in the School of Engineering, then from 2020 to 2022 for an M.S. in the School of Information Science and Technology.
-
2021
A visual question-answering paper
In 2021, he is first author of “Visual Question Answering with Textual Representations for Images” at ICCV CLVL 2021.
-
2022
A PhD and two bias papers
In April 2022, he begins a Ph.D. in Osaka University’s Graduate School of Information Science and Technology under Noa Garcia and Yuta Nakashima. His paper “Quantifying Societal Bias Amplification in Image Captioning” is an oral at CVPR 2022, and he coauthors “Gender and Racial Bias in Visual Question Answering Datasets” at ACM FAccT 2022.
-
2023
LIBRA and Sony AI
His CVPR 2023 paper with Yuta Nakashima and Noa Garcia introduces LIBRA, which learns from synthetically biased samples to reduce gender misclassification and replace stereotypical words in captions. He also coauthors “Uncurated Image-Text Datasets: Shedding Light on Demographic Bias,” selected as a CVPR 2023 highlight, and starts an internship at Sony AI in April 2023.
-
2023–2024
NVIDIA internship and EMNLP papers
In December 2023, he starts an internship at NVIDIA Research. He coauthors the CVPR 2024 paper “Would Deep Generative Models Amplify Bias in Future Models?” and two main-track EMNLP 2024 papers. “From Descriptive Richness to Bias: Unveiling the Dark Side of Generative Image Caption Enrichment” finds that enriched captions carry more gender bias and hallucination, and that models trained on them amplify gender bias by an average of 30.9%; “Resampled Datasets Are Not Enough: Mitigating Societal Bias Beyond Single Attributes” uses text-guided inpainting to make protected groups independent of all image attributes.
-
2025
A doctorate and SANER
His ICLR 2025 paper SANER, coauthored with Min-Hung Chen, Chien-Yi Wang, Yuta Nakashima, Yu-Chiang Frank Wang and Ryo Hachiuma, removes attribute information from CLIP text features of attribute-neutral descriptions without requiring attribute annotations. In March 2025, he completes a Ph.D. in computer science at Osaka University.
-
2025
LOTUS and bias benchmarks
In 2025, he is first author of LOTUS, an ACL industry-track leaderboard for detailed image captions that evaluates quality, hallucination and societal bias. His ICCV 2025 study finds that masking 10% of objects or weakly blurring backgrounds can shift gender-bias scores by up to 175% in generative vision-language models. In May 2025, he is selected as an outstanding reviewer for CVPR.
-
Since April 2025
Research scientist at NVIDIA
In April 2025, he becomes a research scientist at NVIDIA Research Taiwan. In 2026, his papers are accepted at CVPR, ACL, ECCV and EMNLP, including “Guardrail-Agnostic Societal Bias Evaluation in Large Vision-Language Models” at ECCV 2026. At NVIDIA Research Taiwan, he focuses on fairness in multimodal tasks by identifying societal biases in datasets and models and developing mitigation strategies.
Career
Education
- 2025Osaka UniversityPhD
- 2022Osaka UniversityMaster of Science
- 2020Osaka UniversityBachelor of Science
Sources and credits
Photo: We have no published photo of Yusuke Hirota yet. Send us a free-licensed photo.
- Yusuke Hirota
- Yusuke Hirota | NVIDIA Research Taiwan
- Yusuke Hirota | ISLab, Osaka University
- Model-agnostic gender debiased image captioning | ISLab, the University of Osaka
- [2406.13912] From Descriptive Richness to Bias: Unveiling the Dark Side of Generative Image Caption Enrichment
- [2407.03623] Resampled Datasets Are Not Enough: Mitigating Societal Bias Beyond Single Attributes
- [2408.10202] SANER: Annotation-free Societal Attribute Neutralizer for Debiasing CLIP
- [2507.19362] LOTUS: A Leaderboard for Detailed Image Captioning from Quality to Societal Bias and User Preferences
- [2509.07596] Bias in Gender Bias Benchmarks: How Spurious Features Distort Evaluation


