Compatibility check
Can I run Voxtral Mini 4B Realtime 2602 on GeForce RTX 3080 10GB?
Yes — it runs.best quant:
Decode speed
228 tok/sest
Usable context
33K
Memory
10 GB
Fits in memory228 tok/sest · 33K ctx
Fits in memory194 tok/sest · 33K ctx
Fits in memory130 tok/sest · 16K ctx
