Compatibility check
Can I run Phi 4 on L40S?
Yes — it runs.best quant:
Decode speed
78 tok/sest
Usable context
16K
Memory
48 GB
Fits in memory78 tok/sest · 16K ctx
Fits in memory66 tok/sest · 16K ctx
Fits in memory44 tok/sest · 16K ctx
Fits in memory24 tok/sest · 16K ctx
Fits in memory · 16K ctx
