Compatibility check
Can I run Mixtral 8x22B Instruct on B200 (SXM 192GB)?
Yes — it runs.best quant:
Decode speed
230 tok/sest
Usable context
66K
Memory
192 GB
Fits in memory230 tok/sest · 66K ctx
Fits in memory196 tok/sest · 66K ctx
Fits in memory131 tok/sest · 66K ctx
