Compatibility check
Can I run Olmo 3 32B Think on RTX 6000 Ada?
Yes — it runs.best quant:
Decode speed
39 tok/sest
Usable context
66K
Memory
48 GB
Fits in memory39 tok/sest · 66K ctx
Fits in memory34 tok/sest · 66K ctx
Fits in memory22 tok/sest · 33K ctx
