Compatibility check
Can I run VibeVoice ASR HF on Apple M2 (8-core GPU, 8GB unified)?
Partially — with CPU offload.best quant:
5.2 GB of weights, plus 1.5 GB for the software that runs it and the smallest conversation it can hold, comes to 6.7 GB against the 6 GB this 8 GB device leaves free.
Decode speed
—
Usable context
—
Memory
8 GB
Spills to system RAM
Spills to system RAM
Too large
