Nicolas Carion
Nicolas Carion is a computer vision researcher whose work spans cooperative reinforcement learning, object detection and visual segmentation. He coauthored DETR, which frames object detection as direct set prediction, and SAM 2 and SAM 3, models for promptable segmentation in images and video. After completing a PhD at Paris Dauphine University and Facebook AI Research in Paris, he held a postdoctoral position at NYU Courant under Yann LeCun and later coauthored FlowWM, a stochastic world model that uses flow matching in pretrained feature space. By June 2026, he is at a stealth startup with no public name.
Timeline
-
2019
Agent coordination through assignment
In 2019, he coauthors a structured-prediction approach that assigns agents to tasks in cooperative multi-agent reinforcement learning.
-
2020
DETR for object detection
In 2020, computer vision researcher Nicolas Carion coauthors DETR, which treats object detection as direct set prediction.
-
By 2022
A PhD and NYU postdoc
He completes a PhD at Paris Dauphine University and Facebook AI Research in Paris. He works as a postdoctoral researcher at NYU Courant under Yann LeCun from 2020 to 2022.
-
2024
SAM 2 for video segmentation
In 2024, he coauthors SAM 2, a foundation model for promptable segmentation in images and videos.
-
2025
An ICLR honorable mention
In 2025, ICLR gives SAM 2 an Outstanding Paper Honorable Mention.
-
2025
Concept prompts in SAM 3
In 2025, he coauthors SAM 3, which detects, segments and tracks objects in images and videos from noun-phrase or image-exemplar prompts.
-
June 2026
World modeling in feature space
In June 2026, he coauthors Flow Matching in Feature Space for Stochastic World Modeling, which proposes FlowWM, a stochastic model that performs flow matching in pretrained feature space.
-
June 2026
A stealth startup
By June 2026, he is at a stealth startup with no public name, after years as a research scientist at Meta’s FAIR lab.
Career
- 2021–2023New York University
- 2020–2022Courant Institute of Mathematical SciencesPostdoctoral researcher
- 2018–2022Meta
- 2016–2018ETH Zurich
- FAIR (Meta)Research scientist
Education
Most-cited works
- End-to-End Object Detection with Transformers
- MDETR - Modulated Detection for End-to-End Multi-Modal UnderstandingWith Yann LeCun
- SAM 2: Segment Anything in Images and VideosWith Christoph Feichtenhofer, Piotr Dollár and Ross Girshick
- Constrained Bayesian Optimization with Particle Swarms for Safe Adaptive Controller TuningWith Andreas Krause and Angela Schoellig
- GeneCIS: A Benchmark for General Conditional Image SimilarityWith Sagar Vaze
Sources and credits
Photo: We have no published photo of Nicolas Carion yet. Send us a free-licensed photo.
- A Structured Prediction Approach for Generalization in Cooperative Multi-Agent Reinforcement Learning
- End-to-End Object Detection with Transformers
- About me - Nicolas Carion
- Yann LeCun's Home Page
- SAM 2: Segment Anything in Images and Videos
- Announcing the Outstanding Paper Awards at ICLR 2025 – ICLR Blog
- SAM 3: Segment Anything with Concepts
- Flow Matching in Feature Space for Stochastic World Modeling
- Investor Day (004)




