Matthias Minderer
Matthias Minderer is a computer-vision researcher whose work spans visual neuroscience, video modeling, image recognition, and open-vocabulary detection. He studied neuroscience at ETH Zürich and biochemistry at Cambridge before completing a Harvard PhD with Christopher Harvey. He coauthored papers on object dynamics and Vision Transformers, and contributed to PaliGemma's spatial understanding. Since 2025, he works at Microsoft AI in Zürich on multimodal large language models focused on spatial understanding and localization.
Timeline
-
2019
Harvard PhD and video dynamics
At Harvard, he earns a PhD while working with Christopher Harvey; his thesis focuses on visual and action-related information in the mammalian cerebral cortex. Earlier, he studies neuroscience at ETH Zürich and biochemistry at the University of Cambridge. In 2019, he coauthors a NeurIPS paper on object structure and dynamics from videos.
-
2020
Removing shortcuts in self-supervised learning
In 2020, he coauthors a paper on removing shortcuts from self-supervised representation learning. It trains a lens network to make small image changes that reduce performance on a pretext task.
-
2021
Vision Transformers for image recognition
In 2021, he coauthors a Vision Transformer paper for image recognition. It applies a pure transformer directly to image-patch sequences for image classification.
-
2022–2023
OWL-ViT and OWLv2
In 2022, he coauthors OWL-ViT, which uses a Vision Transformer with contrastive image-text pretraining for open-vocabulary object detection. In 2023, he coauthors OWLv2, which scales detection data with self-training and uses an existing detector to generate pseudo-box annotations on image-text pairs.
-
2024
PaliGemma spatial understanding
In 2024, he coauthors PaliGemma, an open 3B vision-language model based on the SigLIP-So400m vision encoder and Gemma-2B language model. He contributes to its spatial-understanding capabilities.
-
Since 2025
Microsoft AI in Zürich
In February 2025, he joins Microsoft AI as a founding member of its new Zürich office. Before the move, he works as a research scientist at Google Brain and later Google DeepMind. He is a Member of Technical Staff focused on multimodal large language models, spatial understanding, and localization.
Career
- Since 2025MicrosoftMember of Technical Staff
- Google BrainResearch Scientist
- Google DeepMindResearch Scientist
Education
Sources and credits
Photo: We have no published photo of Matthias Minderer yet. Send us a free-licensed photo.
- Matthias Minderer
- Unsupervised learning of object structure and dynamics from videos
- Automatic Shortcut Removal for Self-Supervised Representation Learning
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- Simple Open-Vocabulary Object Detection with Vision Transformers
- Scaling Open-Vocabulary Object Detection
- PaliGemma: A versatile 3B VLM for transfer
- Microsoft eröffnet KI-Labor in Zürich

