Leaderboards

Benchmarks

Every score carries its origin.

Reasoning374Coding337Math221Agentic375Chat636Speech778
Arena Agent55Arena Agent · Recovery55Arena Agent · Steerability55Arena Agent · Task outcome55Arena Agent · Tool use55LiveBench Agentic Coding58SWE-bench Verified42

Arena Agent · Task outcome

Inverse-propensity score for finishing the task the session set out to do — higher is better
Provenance55 modelsscores Aug 11, 2026 – Sep 25, 2026
1Claude Fable 5.1AnthropicScore0.173ScoredSep 25, 20262GPT-6 AstraOpenAIScore0.137ScoredSep 25, 20263DeepSeek V4.1 FlashDeepSeek763BScore0.131ScoredSep 25, 20264GPT-6 SolOpenAIScore0.114ScoredSep 25, 20265Claude Opus 5AnthropicScore0.106ScoredSep 25, 20266Gemini 3.8 FlashGoogleScore0.102ScoredSep 25, 20267Kimi K3Moonshot AI2.8TScore0.1ScoredSep 25, 20268Grok 4.7xAIScore0.098ScoredSep 25, 20269Muse Spark 1.3MetaScore0.085ScoredSep 25, 202610Hy4 previewTencent780BScore0.077ScoredSep 25, 202611GLM 5.3 FlashZ.ai321BScore0.07ScoredSep 25, 202612Qwen3.8 FlashQwenScore0.065ScoredSep 25, 202613GLM 5.3Z.aiScore0.061ScoredSep 25, 202614Claude Opus 4.8AnthropicScore0.059ScoredSep 5, 202615Qwen3.8 MaxQwenScore0.056ScoredSep 25, 202616GLM 5.2Z.ai753BScore0.039ScoredSep 25, 202617Claude Fable 5AnthropicScore0.036ScoredSep 25, 202618DeepSeek V4 FlashDeepSeek291BScore0.033ScoredSep 15, 202619GPT-5.6 SolOpenAIScore0.029ScoredSep 25, 202620Qwen3.8 27BQwen27.8BScore0.028ScoredSep 25, 202621Claude Opus 4.7AnthropicScore0.026ScoredSep 5, 202622Claude Opus 4.6AnthropicScore0.025ScoredSep 5, 202623Kimi K2.7 CodeMoonshot AI1.1TScore0.012ScoredSep 5, 202624Claude Sonnet 5AnthropicScore0.005ScoredSep 25, 202625Gemini 3.7 FlashGoogleScore0.003ScoredSep 25, 202626GLM 5.1Z.ai754BScore0.002ScoredSep 5, 202627Grok 4.5xAIScore−0.006ScoredSep 25, 202628Gemini 3.6 FlashGoogleScore−0.008ScoredAug 11, 202629Gemini 3.5 FlashGoogleScore−0.016ScoredSep 5, 202630Muse Spark 1.1MetaScore−0.019ScoredSep 25, 202631Grok 4.6xAIScore−0.033ScoredSep 25, 202632Gemma 4 31BGoogle31.3BScore−0.034ScoredSep 5, 202633DeepSeek V4 ProDeepSeek1.6TScore−0.034ScoredSep 25, 202634GPT-5.4OpenAIScore−0.035ScoredSep 25, 202635GPT-5.5OpenAIScore−0.04ScoredSep 25, 202636GPT-5.6 LunaOpenAIScore−0.044ScoredSep 25, 202637Muse Spark 1.2MetaScore−0.045ScoredSep 25, 202638Kimi K2.6Moonshot AI1.1TScore−0.054ScoredSep 5, 202639Claude Sonnet 4.6AnthropicScore−0.058ScoredSep 15, 202640GPT-5.6 TerraOpenAIScore−0.059ScoredSep 25, 202641Grok Build 0.1xAIScore−0.074ScoredSep 5, 202642Gemini 3.1 Pro Preview Custom ToolsGoogleScore−0.075ScoredSep 25, 202643Qwen3.7 MaxQwenScore−0.087ScoredSep 25, 202644Qwen3.7 PlusQwenScore−0.091ScoredSep 25, 202645MiMo-V2.5-ProXiaomi1TScore−0.108ScoredSep 25, 202646Hy3Tencent299BScore−0.109ScoredSep 25, 202647Grok 4.3xAIScore−0.131ScoredSep 5, 202648MiniMax M3MiniMax427BScore−0.138ScoredSep 25, 202649Nemotron 3 UltraNVIDIA561BScore−0.157ScoredSep 5, 202650Mistral Medium 3.5Mistral AI128BScore−0.161ScoredSep 25, 202651Gemini 3.5 Flash LiteGoogleScore−0.176ScoredSep 15, 202652MiniMax M2.7MiniMax229BScore−0.18ScoredSep 15, 202653Inkling SmallThinking Machines266BScore−0.212ScoredSep 25, 202654InklingThinking Machines952BScore−0.214ScoredSep 25, 202655Solar Pro 4UpstageScore−0.231ScoredSep 25, 2026