Compatibility check
Can I run Llama 3.1 8B Instruct on Arc B580?
Yes — it runs.best quant:
Decode speed
66 tok/sest
Usable context
66K
Memory
12 GB
Fits in memory66 tok/sest · 66K ctx
Fits in memory56 tok/sest · 66K ctx
Fits in memoryest38 tok/sest · 8K ctx
