Compatibility check
Can I run Phi 4 on A100 80GB SXM?
Yes — it runs.best quant:
Decode speed
183 tok/sest
Usable context
16K
Memory
80 GB
Fits in memory183 tok/sest · 16K ctx
Fits in memory156 tok/sest · 16K ctx
Fits in memory104 tok/sest · 16K ctx
Fits in memory56 tok/sest · 16K ctx
Fits in memory · 16K ctx
