This person reports a budget-friendly AMD configuration: two Radeon RX 9070 XT cards for 32GB of total VRAM, running Qwen 3.8 27B in MXFP4 at 50-60 tok/s with a 200K context. Elsewhere in the thread they note that going well above 40K context is entirely possible on 32GB.
VERIFIABLE SOURCE
View source Reported anonymously by an r/LocalLLM contributor · score 6