TAU2
Measured May 14, 2026Source
Score
0.16
Models15 1 
Meta
Llama 3.1 Instruct 8B
MetaMetaUnited States
A lightweight, open-source large language model developed by Meta, supporting a 128K long context window. It is instruction-tuned for dialogue and instruction-following tasks.
FastCheapLong context
Input / 1M tokens
$0.10Output / 1M tokens
$0.10Output tokens/s
223.81First-token seconds
0.48sSupported plans
2Benchmark history
Evaluations
Terminalbench Hard
Measured May 14, 2026Source
Score
0.01
Lcr
Measured May 14, 2026Source
Score
0.16
Ifbench
Measured May 14, 2026Source
Score
0.29
Aime 25
Measured May 14, 2026Source
Score
0.04
Aime
Measured May 14, 2026Source
Score
0.08
Math 500
Measured May 14, 2026Source
Score
0.52
Scicode
Measured May 14, 2026Source
Score
0.13
Livecodebench
Measured May 14, 2026Source
Score
0.12
Hle
Measured May 14, 2026Source
Score
0.05
Gpqa
Measured May 14, 2026Source
Score
0.26
Mmlu Pro
Measured May 14, 2026Source
Score
0.48
Artificial Analysis Math Index
Measured May 14, 2026Source
Score
4.3
Artificial Analysis Coding Index
Measured May 14, 2026Source
Score
4.9
Artificial Analysis Intelligence Index
Measured May 14, 2026Source
Score
11.8
Plan availability
Products and plans that support this model
Synthetic
Synthetic
Synthetic is a platform that runs open-source AI models in private, secure datacenters. It offers subscription and usage-based pricing for accessing models like DeepSeek, Llama, MiniMax, Kimi, and others, with OpenAI-compatible API access for use in coding agents and tools.
Discussion
Thinking... Make sure you are connected to GitHub server