TAU2
Measured May 14, 2026Source
Score
0.28
Models15 0 
Mistral
Devstral Small (Jul '25)
MistralMistralFrance
Devstral Small is a lightweight, fast model from Mistral optimized for software engineering tasks like code generation, debugging, and understanding. It is designed for rapid iteration and cost-effective deployment in development workflows.
CodingFastCheapLong context
Input / 1M tokens
$0.10Output / 1M tokens
$0.30Output tokens/s
219.13First-token seconds
0.4sSupported plans
0Benchmark history
Evaluations
Terminalbench Hard
Measured May 14, 2026Source
Score
0.06
Lcr
Measured May 14, 2026Source
Score
0.17
Ifbench
Measured May 14, 2026Source
Score
0.35
Aime 25
Measured May 14, 2026Source
Score
0.29
Aime
Measured May 14, 2026Source
Score
0
Math 500
Measured May 14, 2026Source
Score
0.63
Scicode
Measured May 14, 2026Source
Score
0.24
Livecodebench
Measured May 14, 2026Source
Score
0.25
Hle
Measured May 14, 2026Source
Score
0.04
Gpqa
Measured May 14, 2026Source
Score
0.41
Mmlu Pro
Measured May 14, 2026Source
Score
0.62
Artificial Analysis Math Index
Measured May 14, 2026Source
Score
29.3
Artificial Analysis Coding Index
Measured May 14, 2026Source
Score
12.1
Artificial Analysis Intelligence Index
Measured May 14, 2026Source
Score
15.2
Plan availability
Products and plans that support this model
No products or plans have been linked to this model yet.
Discussion
Thinking... Make sure you are connected to GitHub server