A gaming PC with an RTX 4060 8GB and 32GB DDR5 runs a 17.5GB Qwen 3.8 27B by splitting it between VRAM and system RAM and adding speculative decoding, then drives it as a remote coding agent; the same machine also runs Qwen3-VL for invoice extraction.
GPU model
Capacity range
Total VRAM
Practice
Model
Quantization
Context length
Reported speed
Runtime
Tools / workflow
Record origin
EXPLORE BY CAPACITY
Start with your machine.
Capacity is the reported total for this setup. Multi-GPU and unified-memory layouts can behave differently.
8 GB or lessLaptops, iGPUs and modest cards9–12 GBEntry-level local inference13–16 GBCurrent mid-range cards17–20 GBRX 7900 XT and compact pro cards21–24 GB3090, 4090 and 7900 XTX class25–32 GB5090 and workstation cards33–48 GBWorkstation and multi-GPU setups49–96 GBLarge multi-GPU and datacenter setups97 GB+Unified memory, servers and clusters
2 resultsEvery record keeps its origin visible.
CodingGenesis archive2026-10
Qwen 3.8 27B at ~6 tok/s on an 8GB RTX 4060 via RAM offload and MTPMediaGenesis archive2026-09
Describing security camera events on an 8GB cardA vision model on a modest 3070 turns raw detection events from a home-built surveillance system into plain-language descriptions.