Compatibility Check
Can I Run Hermes 3 Llama 3.1 8B on NVIDIA GeForce GTX 1660 Super?
Mostly — NVIDIA GeForce GTX 1660 Super runs Hermes 3 Llama 3.1 8B (Q4_K_M) with partial GPU offload. Expect slower speeds than a fully fitting card.
Estimated ~38.4 tokens/sec on the Q4_K_M quantization.
Partial GPU
Best variant: Q4_K_M
Partial GPU offload — 6 GB VRAM is above the 5.5 GB minimum but below the 8 GB recommendation. Some layers will spill to RAM.
- GPU VRAM
- 6 GB
- Min VRAM (best fit)
- 5.5 GB
- Recommended VRAM
- 8 GB
- Estimated tok/s
- ~38.4
Share this matchup
Send this page so a friend can see if NVIDIA GeForce GTX 1660 Super fits Hermes 3 Llama 3.1 8B.
Every Hermes 3 Llama 3.1 8B quantization on NVIDIA GeForce GTX 1660 Super
Each row runs the compatibility engine against your VRAM, RAM, and the model's requirements.
| Quantization | File Size | Min VRAM | Rec VRAM | Context | Verdict | Estimated tok/s |
|---|---|---|---|---|---|---|
| Q4_K_MBest fit | 4.9 GB | 5.5 GB | 8 GB | 8K / 128K | Partial GPU | ~38.4 |
NVIDIA GeForce GTX 1660 Super is solid pick for Hermes 3 Llama 3.1 8B
Need second card or fresh build? These links help support site at no extra cost.