Freelancing is this person's only income, and a lot of the projects they work on contractually forbid sending data to a third party — personal financial information adds another reason to keep things local. Their main workstation, an EPYC 7763 with 1TB of RAM and four RTX 3090s, runs Kimi K3 at a Q2_K_XL quant; a second PC with 32GB total VRAM and 128GB RAM runs DeepSeek V4 Flash; a third, lighter system with 64GB of RAM can run Qwen 3.6 35B-A3B. The four GPUs also serve near-real-time Blender Cycles previews and other memory-heavy work.
Reported anonymously by an r/LocalLLM contributor · 5 upvotes at capture
Leave a comment