TAU2
Measured Jul 10, 2026Source
Score
0.15
Models17 1 
Llama 3.1 Instruct 70B
MetaMetaUnited States
Llama 3.1 Instruct 70B is a 70-billion parameter, instruction-tuned large language model from Meta. It features a 128K token context window and is optimized for high-performance, open-source deployment across a wide range of tasks.
ReasoningLong contextCheapCoding
Input / 1M tokens
$0.56Output / 1M tokens
$0.56Output tokens/s
33.46First-token seconds
0.59sSupported plans
2Benchmark history
Evaluations
Terminalbench Hard
Measured Jul 10, 2026Source
Score
0.03
Lcr
Measured Jul 10, 2026Source
Score
0.06
Ifbench
Measured Jul 10, 2026Source
Score
0.34
Aime 25
Measured Jul 10, 2026Source
Score
0.04
Aime
Measured Jul 10, 2026Source
Score
0.17
Math 500
Measured Jul 10, 2026Source
Score
0.65
Scicode
Measured Jul 10, 2026Source
Score
0.27
Livecodebench
Measured Jul 10, 2026Source
Score
0.23
Hle
Measured Jul 10, 2026Source
Score
0.05
Gpqa
Measured Jul 10, 2026Source
Score
0.41
Mmlu Pro
Measured Jul 10, 2026Source
Score
0.68
Artificial Analysis Math Index
Measured Jul 10, 2026Source
Score
4
Artificial Analysis Intelligence Index
Measured Jul 10, 2026Source
Score
6.8
Tau Banking
Measured Jul 10, 2026Source
Score
0.02
Terminalbench V2 1
Measured Jul 10, 2026Source
Score
0.02
Artificial Analysis Coding Index
Measured Jul 10, 2026Source
Score
5.4
Plan availability
Products and plans that support this model
Synthetic
Synthetic
Synthetic is a platform that runs open-source AI models in private, secure datacenters. It offers subscription and usage-based pricing for accessing models like DeepSeek, Llama, MiniMax, Kimi, and others, with OpenAI-compatible API access for use in coding agents and tools.
User ratings
Loading ratings...
Discussion
Thinking... Make sure you are connected to GitHub server