Pixtral 12B
Pravesh Agrawal, Szymon Antoniak, Emma Bou Hanna, Baptiste Bout,, Devendra Chaplot, Jessica Chudnovsky, Diogo Costa, Baudouin De Monicault,, Saurabh Garg, Theophile Gervet, Soham Ghosh, Am\'elie H\'eliou, Paul Jacob,, Albert Q. Jiang, Kartik Khandelwal, Timoth\'ee Lacroix

TL;DR
Pixtral-12B is a versatile 12-billion-parameter multimodal language model that excels in understanding images and documents, outperforming larger models and maintaining strong natural language capabilities.
Contribution
Introduces Pixtral-12B with a new vision encoder, long context processing, and an open-source benchmark for multimodal evaluation, advancing open-source multimodal LLMs.
Findings
Outperforms similar-sized open models like Llama-3.2 11B and Qwen-2-VL 7B
Surpasses larger models such as Llama-3.2 90B in multimodal tasks
Supports processing images at natural resolution and arbitrary number of images in long contexts
Abstract
We introduce Pixtral-12B, a 12--billion-parameter multimodal language model. Pixtral-12B is trained to understand both natural images and documents, achieving leading performance on various multimodal benchmarks, surpassing a number of larger models. Unlike many open-source models, Pixtral is also a cutting-edge text model for its size, and does not compromise on natural language performance to excel in multimodal tasks. Pixtral uses a new vision encoder trained from scratch, which allows it to ingest images at their natural resolution and aspect ratio. This gives users flexibility on the number of tokens used to process an image. Pixtral is also able to process any number of images in its long context window of 128K tokens. Pixtral 12B substanially outperforms other open models of similar sizes (Llama-3.2 11B \& Qwen-2-VL 7B). It also outperforms much larger open models like Llama-3.2…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTransport Systems and Technology
