The author benchmarks two Radeon Instinct MI50 cards (16GB HBM2 each, 32GB total), each power-limited to 145W (TDP lowered), likely still without a good cooling solution. HBM2 is clocked at 1000MHz, overclockable to 1200MHz at 1.02 TB/s of bandwidth. One card's firmware was changed to activate the miniDP port, with an xrandr mode added for 1920x1080 output.
Command
RADV_PERFTEST=nogttspill GGML_VK_VISIBLE_DEVICES=0,1 time llama-bench -fa on -ngl 99 -m /model.gguf
Using a pre-built Ubuntu Vulkan build of llama.cpp (b11325).
Combined benchmark table
| Model | Quant | Size | Params | pp512 (t/s) | tg128 (t/s) |
|---|---|---|---|---|---|
| Swift-Qwen3.8-27B-Uncensored-MTP | Q6_K | 20.88 GiB | 27.32 B | 141.97 | 17.49 |
| Swift-1.5-Qwen3.8-27B | Q6_K | 22.21 GiB | 27.32 B | 167.38 | 17.97 |
| Gemma-4-MoonGem-31B | i1-Q6_K | 23.46 GiB | 30.70 B | 122.00 | 15.20 |
| gemma-4-31B-it-UD | Q6_K_XL | 25.62 GiB | 30.70 B | 135.99 | 12.05 |
| Nemotron-3.5-30B-A3B-Antislop-FTPO | i1-Q5_K_M | 25.18 GiB | 32.91 B | 863.92 | 60.57 |
| Laguna-XS-2.1-APEX-I-Balanced | - | 22.64 GiB | 33.44 B | 738.57 | 52.88 |
| Qwen3.6-35B-A3B-UD | Q4_K_XL | 19.70 GiB | 34.66 B | 983.26 | 46.88 |
| Qwen3.6-35B-A3B-UD | Q5_K_XL | 24.76 GiB | 34.66 B | 937.47 | 49.19 |
| Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive | Q6_K_P | 28.53 GiB | 34.66 B | 783.24 | 46.85 |
Dense models run slowly (27B/31B at ~12-18 tok/s decode) while MoE models are much faster (up to ~60 tok/s), which is the point of the test: a mix of dense and MoE GGUFs sized between 16GB and 32GB total.
Cost
As of the post, the average price for a 16GB MI50 is **under 300. A third MI50 sits beside a Radeon RX 7900 GRE rather than in this dual-card benchmark.
Reported anonymously by an r/LocalLLM contributor · 1 upvotes at capture
Leave a comment