Compatibility check
Can I run Nemotron 3.5 Lightning on Radeon RX 7900 XT?
Partially — with CPU offload.best quant:
19.9 GB of weights, plus 1.9 GB for the software that runs it and the smallest conversation it can hold, comes to 21.8 GB against the 18.8 GB this 20 GB device leaves free.
Decode speed
—
Usable context
—
Memory
20 GB
Spills to system RAM
Spills to system RAM
Too large
Plan B — rent it
Nemotron 3.5 Lightning is hosted by 6 providers from $0.17 per 1M output tokens (Io Net).Compare providers →
