Models /Mixtral 8x22B Instruct /Can I run it?
Compatibility check

Can I run Mixtral 8x22B Instruct on NVIDIA DGX Spark (GB10)?

Yes — it runs.best quant: Q4_K_M
Decode speed
8 tok/sest
Usable context
66K
Memory
128 GB
Q4_K_MFits in memory8 tok/sest · 66K ctx
Q5_K_MFits in memory7 tok/sest · 66K ctx
Q8_0Spills to system RAM
Mixtral 8x22B Instruct
141B / 39B · full specs & benchmarks →
NVIDIA DGX Spark (GB10)
128 GB · everything it runs →