Aerospace work with a legal requirement to keep data in-house led to a custom Qwen document parser and RAG, after a stock model struggled with an 785-page federal regulation.
GPU model
Capacity range
Total VRAM
Practice
Model
Quantization
Context length
Reported speed
Runtime
Tools / workflow
Record origin
EXPLORE BY CAPACITY
Start with your machine.
Capacity is the reported total for this setup. Multi-GPU and unified-memory layouts can behave differently.
8 GB or lessLaptops, iGPUs and modest cards9–12 GBEntry-level local inference13–16 GBCurrent mid-range cards17–20 GBRX 7900 XT and compact pro cards21–24 GB3090, 4090 and 7900 XTX class25–32 GB5090 and workstation cards33–48 GBWorkstation and multi-GPU setups49–96 GBLarge multi-GPU and datacenter setups97 GB+Unified memory, servers and clusters
2 resultsEvery record keeps its origin visible.
Regulated workGenesis archive2026-09
A local parser and RAG for ITAR-constrained federal documentsBusiness automationGenesis archive2026-09
A job-matching agent that splits work between a local model and a cloud APIA Hermes agent searches job listings, does the easy keyword and summarisation work locally with Qwen 35B, then sends only the final analysis to a cloud model, cutting token use by about half.