Compatibility check
Can I run Muse Glimmer 30B on Apple M3 (10-core GPU)?
Partially — with CPU offload.best quant:
18.8 GB of weights, plus 1.9 GB for the software that runs it and the smallest conversation it can hold, comes to 20.7 GB against the 18 GB this 24 GB device leaves free.
Decode speed
—
Usable context
—
Memory
24 GB
Spills to system RAM
Spills to system RAM
Too large
Plan B — rent it
Muse Glimmer 30B is hosted by 4 providers from $1.10 per 1M output tokens (Phala).Compare providers →
