Magistral
Mistral-AI: Abhinav Rastogi, Albert Q. Jiang, Andy Lo, Gabrielle Berrada, Guillaume Lample, Jason Rute, Joep Barmentlo, Karmesh Yadav, Kartik Khandelwal, Khyathi Raghavi Chandu, L\'eonard Blier, Lucile Saulnier, Matthieu Dinot, Maxime Darrin, Neha Gupta, Roman Soletskyi

TL;DR
Magistral introduces a new reasoning model and RL training pipeline for large language models, demonstrating that pure RL on text can enhance reasoning, instruction following, and multimodal understanding without relying on prior RL traces.
Contribution
The paper presents Magistral, a scalable RL pipeline built from scratch, and shows how pure RL on text data can improve LLM reasoning and multimodal capabilities.
Findings
RL on text data maintains or improves model capabilities
Pure RL training enhances reasoning and instruction following
Open-source Magistral Small for broader research use
Abstract
We introduce Magistral, Mistral's first reasoning model and our own scalable reinforcement learning (RL) pipeline. Instead of relying on existing implementations and RL traces distilled from prior models, we follow a ground up approach, relying solely on our own models and infrastructure. Notably, we demonstrate a stack that enabled us to explore the limits of pure RL training of LLMs, present a simple method to force the reasoning language of the model, and show that RL on text data alone maintains most of the initial checkpoint's capabilities. We find that RL on text maintains or improves multimodal understanding, instruction following and function calling. We present Magistral Medium, trained for reasoning on top of Mistral Medium 3 with RL alone, and we open-source Magistral Small (Apache 2.0) which further includes cold-start data from Magistral Medium.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
- 🤗mistralai/Magistral-Small-2509model· 22k dl· ♡ 29522k dl♡ 295
- 🤗mistralai/Magistral-Small-2506model· 39k dl· ♡ 60939k dl♡ 609
- 🤗EnlistedGhost/Magistral-Small-2509-Vision-GGUFmodel· 232 dl· ♡ 1232 dl♡ 1
- 🤗mistralai/Magistral-Small-2507model· 663 dl· ♡ 104663 dl♡ 104
- 🤗gabriellarson/Magistral-Small-2507-GGUFmodel· 195 dl· ♡ 2195 dl♡ 2
- 🤗unsloth/Magistral-Small-2507-GGUFmodel· 1.5k dl· ♡ 201.5k dl♡ 20
- 🤗unsloth/Magistral-Small-2507model· 7 dl· ♡ 27 dl♡ 2
- 🤗cyankiwi/Magistral-Small-2507-AWQ-4bitmodel· 83 dl83 dl
- 🤗m-polignano/ANITA-NEXT-24B-Dolphin-Mistral-UNCENSORED-ITAmodel· 65 dl· ♡ 865 dl♡ 8
- 🤗unsloth/Magistral-Small-2507-unsloth-bnb-4bitmodel· 2 dl· ♡ 22 dl♡ 2
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsReinforcement Learning in Robotics · Multimodal Machine Learning Applications · Topic Modeling
