Models /Mistral Small 3.1 24B /Can I run it?
Compatibility check

Can I run Mistral Small 3.1 24B on Apple M1 (8-core GPU)?

Probably partially, with CPU offload.best quant:

This one is close. The answer rests on a file size we calculated from the parameter count rather than measured. A 10% error in that size changes the verdict, so treat it as a maybe and test before you buy.

15.1 GB of weights, plus 2 GB for the software that runs it and the smallest conversation it can hold, comes to 17.1 GB against the 12 GB this 16 GB device leaves free.

Decode speed
—
Usable context
—
Memory
16 GB
Spills to system RAMest
Too largeest
Too large
What is quantisation? →
Plan B — rent it

Mistral Small 3.1 24B is hosted by 2 providers from $0.56 per 1M output tokens (Cloudflare Workers AI).Compare providers →

Mistral Small 3.1 24B
24B · full specs & benchmarks →
Apple M1 (8-core GPU)
16 GB · everything it runs →