Compatibility check
Can I run Mixtral 8x22B Instruct on H100 80GB SXM?
Partially — with CPU offload.best quant:
Decode speed
—
Usable context
—
Memory
80 GB
Spills to system RAM
Spills to system RAMest
Too large
Plan B — rent it
Mixtral 8x22B Instruct is hosted by 2 providers from $6.00 per 1M output tokens (Mistral AI).Compare providers →
