Back to directory
Business automation · 2026-10-01

A 4x RTX 5090 (128GB) office rig serving a 50-person company: local RAG, chat, diffusion and agentic coding

A custom 4x RTX 5090 build with 128GB of VRAM, an Intel Xeon w5-3423 and 192GB of ECC DDR5 runs DeepSeek V4 Flash, Qwen 3.8 and Gemma 4 32B locally for a 50-person company that wants its data off grid.

The client is a 50-person company across HR, marketing and finance. The rig runs local RAG over internal documents, lightweight LLM chat, localized diffusion for visual assets and agentic coding, with bursty peaks of 3-5 concurrent requests, not 50 simultaneous streams.

Hardware

  • 4x RTX 5090 (128GB total)
  • ASUS W790E-SAGE SE, Intel Xeon w5-3423, 192GB ECC DDR5, 2TB NVMe
  • Each card on its own PCIe 5.0 x16 riser, cooled by 18 server fans

Models

DeepSeek V4 Flash, Qwen 3.8 and Gemma 4 32B.

Caveat on the numbers

The published throughput figures (24 concurrent at 52 tok/s, ~2.4s to first token in short context, 15.3 tok/s at 25k-50k context, 4.3 tok/s at 100k for 8 concurrent) were measured on their 2x RTX 5090 box with Qwen 3.6 27B, not on this 4-card machine, which was not benchmarked after its models were updated.

VERIFIABLE SOURCE

Reported anonymously by an r/LocalLLM contributor · 315 upvotes at capture

View source
SETUP HISTORY

Snapshots over time

2 versions
CURRENT2026-10-01A 4x RTX 5090 (128GB) office rig serving a 50-person company: local RAG, chat, diffusion and agentic coding

A custom 4x RTX 5090 build with 128GB of VRAM, an Intel Xeon w5-3423 and 192GB of ECC DDR5 runs DeepSeek V4 Flash, Qwen 3.8 and Gemma 4 32B locally for a 50-person company that wants its data off grid.

Business automation1 machineDeepSeek V4 Flash, Qwen 3.8, Gemma 4 32BRuntime unspecified
ChangedDescription
Compare with revision 1
DescriptionPreviousThe client is a 50-person company across departments including HR, marketing and finance, and the rig is used for local RAG over internal documents, lightweight LLM chat, localized diffusion runs for visual assets and agentic coding, with bursty peaks of 3 to 5 concurrent requests rather than 50 simultaneous streams. The machine holds 4x RTX 5090 (128GB total) on an ASUS W790E-SAGE SE with an Intel Xeon w5-3423, 192GB of ECC DDR5 and 2TB NVMe, each card on its own PCIe 5.0 x16 riser and cooled by 18 server fans. The lab runs DeepSeek V4 Flash, Qwen 3.8 and Gemma 4 32B. The published throughput numbers (24 concurrent at 52 tok/s and about 2.4s to first token in short context, 15.3 tok/s at 25k to 50k context, and 4.3 tok/s at 100k for 8 concurrent) were measured on their 2x RTX 5090 box with Qwen 3.6 27B, not on this 4-card machine, which was not benchmarked after its models were updated.This snapshotThe client is a 50-person company across HR, marketing and finance. The rig runs local RAG over internal documents, lightweight LLM chat, localized diffusion for visual assets and agentic coding, with bursty peaks of **3-5 concurrent requests**, not 50 simultaneous streams. ## Hardware - **4x RTX 5090** (128GB total) - ASUS W790E-SAGE SE, Intel Xeon w5-3423, **192GB ECC DDR5**, 2TB NVMe - Each card on its own PCIe 5.0 x16 riser, cooled by 18 server fans ## Models DeepSeek V4 Flash, Qwen 3.8 and Gemma 4 32B. ## Caveat on the numbers The published throughput figures (24 concurrent at 52 tok/s, ~2.4s to first token in short context, 15.3 tok/s at 25k-50k context, 4.3 tok/s at 100k for 8 concurrent) were measured on their **2x RTX 5090 box with Qwen 3.6 27B**, not on this 4-card machine, which was not benchmarked after its models were updated.

This is the currently published snapshot.

REVISION 12026-10-01A 4x RTX 5090 (128GB) office rig serving a 50-person company: local RAG, chat, diffusion and agentic coding

A custom 4x RTX 5090 build with 128GB of VRAM, an Intel Xeon w5-3423 and 192GB of ECC DDR5 runs DeepSeek V4 Flash, Qwen 3.8 and Gemma 4 32B locally for a 50-person company that wants its data off grid.

Business automation1 machineDeepSeek V4 Flash, Qwen 3.8, Gemma 4 32BRuntime unspecified

Archived published snapshot — kept for context and comparison.

Discussion

0 comments

No comments yet. Questions and corrections on this setup are welcome.

Leave a comment

Comments are reviewed before they appear. Keep it civil, cite your sources, and stay on topic.