Szymon Antoniak
Szymon Antoniak is an AI scientist at Mistral AI in Warsaw and an author on papers behind the company's Mixtral, Pixtral and Magistral models. He studied at the University of Warsaw, and in 2023 he coauthored Magnushammer, a transformer-based method for premise selection in automated theorem proving, as a student researcher at IDEAS NCBR. In October 2023, he was first author of Mixture of Tokens, a continuous mixture-of-experts architecture. After joining Mistral AI in January 2024, he took part in Mixtral of Experts, Pixtral 12B in 2024 and Magistral, Mistral's first reasoning model, in 2025. Voxtral, Ministral 3 and Shieldstral followed in 2025 and 2026.
- Now at
- Mistral AI
- Works
- 14
- Citations
- 177
- h-index
- 4
Publication numbers from OpenAlex, as of 22 October 2026.
Timeline
-
2017–2023
Student at the University of Warsaw
He studies at the University of Warsaw, as an undergraduate from 2017 to 2020 and as a master's student from 2021 to 2023.
-
2023
Magnushammer for premise selection
As a student researcher at IDEAS NCBR in 2023, he coauthors Magnushammer, a transformer-based method for premise selection in automated theorem proving. Magnushammer beats the Sledgehammer tool, reaching 59.5% against 38.3% on the PISA benchmark, and appears at ICLR 2024.
-
October 2023
Mixture of Tokens
In October 2023, he and nine coauthors post Mixture of Tokens, a continuous mixture-of-experts architecture, with him as first author. The best models train 3x faster than dense Transformers in language pretraining and match state-of-the-art MoE architectures.
-
January 2024
Joining Mistral AI
In January 2024, he becomes an AI scientist at Mistral AI in Warsaw. He is among the authors of Mixtral of Experts, whose Mixtral 8x7B model gives each token access to 47B parameters while using 13B active parameters, and of MoE-Mamba, which reaches the performance of Mamba in 2.35 times fewer training steps.
-
February–October 2024
Fine-grained MoE and Pixtral
In February 2024, he coauthors Scaling Laws for Fine-Grained Mixture of Experts, which introduces granularity, a hyperparameter that controls the size of the experts. In October 2024, he is among the authors of Pixtral 12B, a 12-billion-parameter multimodal language model released under Apache 2.0.
-
June 2025
Magistral reasoning model
In June 2025, he is among the authors of Magistral, Mistral's first reasoning model, built with the company's own scalable reinforcement learning pipeline. Mistral open-sources Magistral Small under Apache 2.0.
-
July 2025–January 2026
Voxtral and Ministral 3
In July 2025, he is among the authors of Voxtral, a pair of multimodal audio chat models released under Apache 2.0. In January 2026, he is among the authors of Ministral 3, a family of dense language models in 3B, 8B and 14B sizes.
-
As of October 2026
AI scientist at Mistral
He is an AI scientist at Mistral AI in Warsaw. In July 2026, he is among the authors of Shieldstral, a 3B-parameter multimodal safety classifier.
Career
- Since 2024Mistral AIAI scientist
- 2023IDEAS NCBRStudent Researcher
Education
- 2023University of WarsawMaster's student
- 2020University of WarsawUndergraduate student
Sources and credits
Photo: We have no published photo of Szymon Antoniak yet. Send us a free-licensed photo.
- Szymon Antoniak (Mistral AI) — Lacuna
- Magnushammer: A Transformer-Based Approach to Premise Selection (arXiv)
- Mixture of Tokens: Continuous MoE through Cross-Example Aggregation (arXiv)
- Szymon Antoniak | alphaXiv
- Szymon Antoniak - AI Scientist at Mistral AI | The Org
- Mixtral of Experts (arXiv)
- MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts (arXiv)
- Scaling Laws for Fine-Grained Mixture of Experts (arXiv)
- Pixtral 12B (arXiv)
- Magistral (arXiv)
- Voxtral (arXiv)
- Ministral 3 (arXiv)
- Shieldstral (arXiv)


