Can I run Hojo ASR V1 on L40S?

Yes. Hojo ASR V1 runs on L40S (48 GB) at Q4_K_M — estimated 220 tok/s with 262K usable context.

Yes — it runs.best quant:

Decode speed

220 tok/sest

Usable context

262K

Memory

48 GB

Fits in memory220 tok/sest · 262K ctx

Fits in memory188 tok/sest · 262K ctx

Fits in memory126 tok/sest · 262K ctx