Skip to main content
Full GPU

Best variant: FP16

Full GPU inference — 24 GB VRAM meets the 7.8 GB recommendation.

GPU VRAM
24 GB
Min VRAM (best fit)
6.9 GB
Recommended VRAM
7.8 GB
Estimated tok/s
~156

Share this matchup

Send this page so a friend can see if NVIDIA GeForce RTX 3090 fits SmolLM3 3B.

Every SmolLM3 3B quantization on NVIDIA GeForce RTX 3090

Each row runs the compatibility engine against your VRAM, RAM, and the model's requirements.

QuantizationFile SizeMin VRAMRec VRAMContextVerdictEstimated tok/s
Q4_K_M1.5 GB1.7 GB2 GB8K / 8KFull GPU~499.2
Q5_K_M1.9 GB2.2 GB2.5 GB8K / 8KFull GPU~428.4
Q8_03 GB3.5 GB3.9 GB8K / 8KFull GPU~297.1
FP16Best fit6 GB6.9 GB7.8 GB8K / 8KFull GPU~156

NVIDIA GeForce RTX 3090 is solid pick for SmolLM3 3B

Need second card or fresh build? These links help support site at no extra cost.

All hardware for SmolLM3 3BBest GPU for SmolLM3 3BModels that fit NVIDIA GeForce RTX 3090Full model detailsBrowse all models