Can I run MMS 1b All on L40S?

Yes. MMS 1b All runs on L40S (48 GB) at Q4_K_M — estimated 1140 tok/s with 262K usable context.

Yes — it runs.best quant:

Decode speed

1140 tok/sest

Usable context

262K

Memory

48 GB

Fits in memory1140 tok/sest · 262K ctx

Fits in memory972 tok/sest · 262K ctx

Fits in memory651 tok/sest · 262K ctx