Xuanyu Zhang
Xuanyu Zhang is a software engineer at Mistral AI whose work spans language model inference, reasoning, coding agents and multimodal audio. While at Apple in 2024, he coauthored Recurrent Drafter (ReDrafter) for speculative decoding and contributed to integrating it into NVIDIA TensorRT-LLM in December 2024. In 2025, he coauthored the Magistral reasoning models, the Voxtral multimodal audio chat models and the Devstral-Small model for coding agents. At a Munich vLLM meetup in February 2026, he presented on Mistral AI and vLLM, and in July 2026 he contributed a FlashInfer monolithic MoE routing replay change to vLLM.
- Now at
- Mistral AI
Timeline
-
2024
Recurrent Drafter at Apple
While at Apple in 2024, he coauthors Recurrent Drafter (ReDrafter), a speculative decoding method for large language model inference. The approach pairs a recurrent neural network draft model conditioned on hidden states with dynamic tree attention over beam search results.
-
December 2024
ReDrafter in TensorRT-LLM
In December 2024, he contributes to Apple's collaboration with NVIDIA to integrate ReDrafter speculative decoding into the NVIDIA TensorRT-LLM inference acceleration framework.
-
June 2025
Magistral reasoning models
He coauthors the June 2025 Magistral paper on Mistral's first reasoning model, which presents Magistral Medium trained on top of Mistral Medium 3 with reinforcement learning alone and open-sources Magistral Small under Apache 2.0.
-
July 2025
Voxtral audio chat models
The July 2025 Voxtral report, which he coauthors, presents Voxtral Mini and Voxtral Small as multimodal audio chat models trained to comprehend spoken audio and text documents.
-
2025
Devstral for coding agents
Zhang coauthors the 2025 Devstral paper, which introduces Devstral-Small, a lightweight open-source language model fine-tuned for coding agent applications.
-
February 2026
Software engineer at Mistral AI
At a Munich vLLM meetup in February 2026, he is a Software Engineer at Mistral AI and presents a talk titled 'Mistral AI & vLLM' alongside Patryk Saffer.
-
July 2026
FlashInfer MoE routing in vLLM
In July 2026, he contributes a merged vLLM change that adds routing_replay_out support to the FlashInfer monolithic MoE backend so RoutedExpertsCapturer can capture expert routing decisions.
Career
- From 2026Mistral AISoftware Engineer
- 2024Apple
Sources and credits
Photo: We have no published photo of Xuanyu Zhang yet. Send us a free-licensed photo.
- Recurrent Drafter for Fast Speculative Decoding in Large Language Models
- Accelerating LLM Inference on NVIDIA GPUs with ReDrafter
- Magistral
- Voxtral
- Devstral: Fine-tuning Language Models for Coding Agent Applications
- Munich vLLM Meetup · Luma
- Enable router replay output from FlashInfer monolithic MoE kernel · #44214

