Compatibility check
Can I run Voxtral Mini 4B Realtime 2602 on Radeon RX 7900 XT?
Yes — it runs.best quant:
Decode speed
195 tok/sest
Usable context
131K
Memory
20 GB
Fits in memory195 tok/sest · 131K ctx
Fits in memory166 tok/sest · 131K ctx
Fits in memory111 tok/sest · 66K ctx
