Compatibility check
Can I run Phi 4 Multimodal Instruct on L40S?
Yes — it runs.best quant:
Decode speed
204 tok/sest
Usable context
131K
Memory
48 GB
Fits in memory204 tok/sest · 131K ctx
Fits in memory174 tok/sest · 131K ctx
Fits in memory116 tok/sest · 131K ctx
