Compatibility check
Can I run Voxtral Mini 3B 2507 on Apple M3 Pro (18-core GPU)?
Yes — it runs.best quant:
Decode speed
37 tok/sest
Usable context
131K
Memory
36 GB
Fits in memory37 tok/sest · 131K ctx
Fits in memory31 tok/sest · 131K ctx
Fits in memory21 tok/sest · 131K ctx
