Models /Devstral 2 2512 /Can I run it?
Compatibility check

Can I run Devstral 2 2512 on Apple M2 Max (38-core GPU)?

Partially — with CPU offload.best quant:

78.8 GB of weights, plus 4.3 GB for the software that runs it and the smallest conversation it can hold, comes to 83.1 GB against the 72 GB this 96 GB device leaves free.

Decode speed
—
Usable context
—
Memory
96 GB
Spills to system RAM
Spills to system RAM
Too large
What is quantisation? →
Plan B — rent it

Devstral 2 2512 is hosted by 2 providers from $2.00 per 1M output tokens (Mistral AI).Compare providers →

Devstral 2 2512
125B · full specs & benchmarks →
Apple M2 Max (38-core GPU)
96 GB · everything it runs →