Release benchmark of an ExLlamaV3-based ROCm engine running two 300B-class MoE models, each on a single 128 GB Ryzen AI Max+ 395 mini PC.
Start with your machine.
Capacity is the reported total for this setup. Multi-GPU and unified-memory layouts can behave differently.
A sales professional dropped every frontier subscription and runs work agents on two DGX Sparks, averaging about 200 million tokens per week.
A weekend vibe-coded web app plus a Hermes agent tracks family finances, with an MCP for adding expenses and inputs arriving from forwarded emails, Telegram or Discord.
A 512GB M3 Ultra Mac Studio running models through oMLX handles most agentic coding work, with measured speeds across several models listed by the owner.