Models /STT 2.6b en /Can I run it?

Compatibility check

Can I run STT 2.6b en on GeForce GTX 1660 SUPER?

Yes — it runs.best quant:

Decode speed

171 tok/sest

Usable context

66K

Memory

6 GB

Fits in memory171 tok/sest · 66K ctx

Fits in memory145 tok/sest · 66K ctx

Fits in memory97 tok/sest · 33K ctx

What is quantisation? →

2.6B · full specs & benchmarks →

GeForce GTX 1660 SUPER

6 GB · everything it runs →