Q2_K
240 GBMin VRAM: 245 GB
Recommended VRAM: 260 GB
Min RAM: 260 GB
Context: 4K / 128K
Loading model details...
Fetching variants, compatibility details, and metadata.
Loading model details...
Fetching variants, compatibility details, and metadata.
New to local models? Smaller quantization variants are easier to run, while larger ones can improve quality at the cost of more memory.
Q2_K
240 GBMin VRAM: 245 GB
Recommended VRAM: 260 GB
Min RAM: 260 GB
Context: 4K / 128K
Q4_K_M
380 GBMin VRAM: 385 GB
Recommended VRAM: 400 GB
Min RAM: 400 GB
Context: 4K / 128K
| Quantization | File Size | Min VRAM | Recommended VRAM | Min RAM | Context |
|---|---|---|---|---|---|
| Q2_K | 240 GB | 245 GB | 260 GB | 260 GB | 4K / 128K |
| Q4_K_M | 380 GB | 385 GB | 400 GB | 400 GB | 4K / 128K |