Mirco Mutti
Mirco Mutti is a reinforcement-learning researcher whose work studies reward-free exploration and how agents adapt across tasks. He coauthored IDE³AL, a model-based algorithm for reward-free exploration, and his 2022 paper on non-Markovian policies received an ICML Outstanding Paper Award. He completed a 2023 doctoral thesis in Data Science and Computation at the University of Bologna, supervised by Marcello Restelli, and joined the Technion as a postdoctoral researcher in September 2023. His later work examined test-time regret, exploration with parallel agents, and confidence calibration for vision-language-action models. As of October 2026, he is a postdoctoral researcher at the Technion, working with Aviv Tamar in the Robots Learning Lab.
- Now at
- Technion
Timeline
-
2020
IDE³AL for reward-free exploration
In 2020, he and Marcello Restelli publish “An Intrinsically-Motivated Approach for Learning Highly Exploring and Fast Mixing Policies.” The paper introduces IDE³AL, a model-based reinforcement-learning algorithm for policies that explore widely and mix quickly.
-
2022
An ICML Outstanding Paper
In 2022, he, Riccardo De Santi, and Marcello Restelli argue that non-Markovian policies matter for maximum state-entropy exploration in finite samples. ICML gives their paper an Outstanding Paper Award.
-
2023
A doctoral thesis on state entropy
In 2023, he completes a doctoral thesis in Data Science and Computation at the University of Bologna titled “Unsupervised reinforcement learning via state entropy maximization.” Marcello Restelli supervises the thesis. In September 2023, he joins the Technion as a postdoctoral researcher.
-
2024
Test-time regret in meta-learning
In 2024, he and Aviv Tamar analyze test-time regret in meta-reinforcement learning. They derive a lower bound that makes the regret rate nearly optimal under a task-separation condition.
-
2025
Exploration with parallel agents
In 2025, with Vincenzo De Paola, Riccardo Zamboni, and Marcello Restelli, he publishes “Enhancing Diversity In Parallel Agents: A Maximum State Entropy Exploration Story.” The method balances entropy within agents with diversity across agents.
-
2026
Temporal-difference calibration for VLA
In 2026, with Shelly Francis-Meretzki, Yaniv Romano, and Aviv Tamar, he introduces a sequential Brier-score method for calibration in vision-language-action models. For binary outcomes, its risk minimizer matches the policy’s value function.
-
As of October 2026
Postdoctoral researcher at Technion
As of October 2026, he is a postdoctoral researcher at the Technion, working with Aviv Tamar in the Robots Learning Lab.
Career
- Since 2023TechnionPostdoctoral researcher
Education
- 2023University of BolognaDoctoral degree in Data Science and Computation
Sources and credits
Photo: We have no published photo of Mirco Mutti yet. Send us a free-licensed photo.
- Vol. 34 No. 04: AAAI-20 Technical Tracks 4 Archives - AAAI
- [1907.04662] An Intrinsically-Motivated Approach for Learning Highly Exploring and Fast Mixing Policies
- The Importance of Non-Markovianity in Maximum State Entropy Exploration
- ICML 2022 Awards
- Unsupervised reinforcement learning via state entropy maximization
- Test-Time Regret Minimization in Meta Reinforcement Learning
- Enhancing Diversity In Parallel Agents: A Maximum State Entropy Exploration Story
- Temporal Difference Calibration in Sequential Tasks: Application to Vision-Language-Action Models
- Mirco Mutti
- Reinforcement Learning Generalization by Dr Mirco Mutti | College of Computing and Data Science | NTU Singapore


