Compatibility check
Can I run Hy-MT2-30B-A3B on Apple M2 (10-core GPU)?
Partially — with CPU offload.best quant:
19 GB of weights, plus 2 GB for the software that runs it and the smallest conversation it can hold, comes to 21 GB against the 18 GB this 24 GB device leaves free.
Decode speed
—
Usable context
—
Memory
24 GB
Spills to system RAM
Spills to system RAM
Too large
Plan B — rent it
Hy-MT2-30B-A3B is hosted by 2 providers from $0.29 per 1M output tokens (OpenRouter).Compare providers →
