Compatibility check
Can I run Voxtral Small 24B 2507 on Apple M1 (8-core GPU)?
Probably partially, with CPU offload.best quant:
This one is close. The answer rests on a file size we calculated from the parameter count rather than measured. A 10% error in that size changes the verdict, so treat it as a maybe and test before you buy.
15.3 GB of weights, plus 2 GB for the software that runs it and the smallest conversation it can hold, comes to 17.3 GB against the 12 GB this 16 GB device leaves free.
Decode speed
—
Usable context
—
Memory
16 GB
Spills to system RAMest
Too large
Too large
Plan B — rent it
Voxtral Small 24B 2507 is hosted by 2 providers from $0.30 per 1M output tokens (Mistral AI).Compare providers →