Models /GLM 4.6 /Can I run it?
Compatibility check

Can I run GLM 4.6 on Instinct MI300X?

Partially — with CPU offload.best quant:
Decode speed
—
Usable context
—
Memory
192 GB
Spills to system RAM
Spills to system RAMest
Too large
What is quantisation? →
Plan B — rent it

GLM 4.6 is hosted by 5 providers from $1.75 per 1M output tokens (OpenRouter).Compare providers →

GLM 4.6
357B · full specs & benchmarks →
Instinct MI300X
192 GB · everything it runs →