Leaderboards
Benchmarks
Every score carries its origin.
Arena Creative Writing168Arena Instruction Following168Arena Text (overall)168IFEval16LiveBench Instruction Following58LiveBench Language58
IFEval
% instruction-following accuracyProvenance16 modelsscores Jun 12, 2024 – Jan 22, 2025
1Llama 3.3 70B InstructMeta70.6BScore90Score / $281Score / GB VRAM~2ScoredDec 3, 20242Llama 3.1 70B InstructMeta70.6BScore86.7Score / $217Score / GB VRAM~1.9ScoredAug 15, 20243Qwen2.5 72B InstructQwen72.7BScore86.4Score / $216Score / GB VRAM~1.9ScoredOct 16, 20244Mistral LargeMistral AIScore84Score / $14ScoredNov 19, 20245Gemma 2 27BGoogle27.2BScore79.8Score / $123Score / GB VRAM~4.7ScoredAug 7, 20246Command R7B (12-2024)CohereScore77.1Score / $514ScoredDec 20, 20247Hermes 3 70B InstructNous Research70.6BScore76.6Score / $109Score / GB VRAM~1.7ScoredAug 28, 20248Qwen2.5 7B InstructQwen7.6BScore75.9Score / $1084Score / GB VRAM~16ScoredSep 18, 20249Llama 3.2 3B InstructMeta3.2BScore73.9Score / $1478Score / GB VRAM~37ScoredSep 27, 202410Qwen2.5 Coder 32B InstructQwen32.8BScore72.7Score / $73Score / GB VRAM~3.5ScoredDec 10, 202411Mixtral 8x22B InstructMistral AI141BScore71.8Score / $12Score / GB VRAM~0.81ScoredJun 12, 202412Mistral NemoMistral AI12.2BScore63.8Score / $2127Score / GB VRAM~8.3ScoredAug 29, 202413Ministral 8BMistral AIScore59Score / $536ScoredDec 1, 202414Llama 3.2 1B InstructMeta1.2BScore57Score / $2850Score / GB VRAM~75ScoredSep 23, 202415R1 Distill Llama 70BDeepSeek70.6BScore43.4Score / $54Score / GB VRAM~0.98ScoredJan 22, 202516Phi 4Microsoft14.7BScore5.9Score / $42Score / GB VRAM1ScoredJan 8, 2025
