Compatibility check
Can I run Mistral Small 3.1 24B on GeForce RTX 5080?
Partially — with CPU offload.best quant:
15.1 GB of weights, plus 2 GB for the software that runs it and the smallest conversation it can hold, comes to 17.1 GB against the 14.8 GB this 16 GB device leaves free.
Decode speed
—
Usable context
—
Memory
16 GB
Spills to system RAM
Spills to system RAM
Too large
Plan B — rent it
Mistral Small 3.1 24B is hosted by 2 providers from $0.56 per 1M output tokens (Cloudflare Workers AI).Compare providers →
