Back to directory
Research & analysis · 2026-10-03

Dual Radeon Instinct MI50 benchmarks: dense models at 12 to 18 tok/s, MoE models at 47 to 61 tok/s

Two Radeon Instinct MI50 cards limited to 145W each are benchmarked with llama.cpp Vulkan across dense and MoE models, with MoE models far ahead of dense ones.

The author benchmarks two Radeon Instinct MI50 cards (16GB HBM2 each, 32GB total), each power-limited to 145W (TDP lowered), likely still without a good cooling solution. HBM2 is clocked at 1000MHz, overclockable to 1200MHz at 1.02 TB/s of bandwidth. One card's firmware was changed to activate the miniDP port, with an xrandr mode added for 1920x1080 output.

Command

RADV_PERFTEST=nogttspill GGML_VK_VISIBLE_DEVICES=0,1 time llama-bench -fa on -ngl 99 -m /model.gguf

Using a pre-built Ubuntu Vulkan build of llama.cpp (b11325).

Combined benchmark table

ModelQuantSizeParamspp512 (t/s)tg128 (t/s)
Swift-Qwen3.8-27B-Uncensored-MTPQ6_K20.88 GiB27.32 B141.9717.49
Swift-1.5-Qwen3.8-27BQ6_K22.21 GiB27.32 B167.3817.97
Gemma-4-MoonGem-31Bi1-Q6_K23.46 GiB30.70 B122.0015.20
gemma-4-31B-it-UDQ6_K_XL25.62 GiB30.70 B135.9912.05
Nemotron-3.5-30B-A3B-Antislop-FTPOi1-Q5_K_M25.18 GiB32.91 B863.9260.57
Laguna-XS-2.1-APEX-I-Balanced-22.64 GiB33.44 B738.5752.88
Qwen3.6-35B-A3B-UDQ4_K_XL19.70 GiB34.66 B983.2646.88
Qwen3.6-35B-A3B-UDQ5_K_XL24.76 GiB34.66 B937.4749.19
Qwen3.6-35B-A3B-Uncensored-HauhauCS-AggressiveQ6_K_P28.53 GiB34.66 B783.2446.85

Dense models run slowly (27B/31B at ~12-18 tok/s decode) while MoE models are much faster (up to ~60 tok/s), which is the point of the test: a mix of dense and MoE GGUFs sized between 16GB and 32GB total.

Cost

As of the post, the average price for a 16GB MI50 is **under 150∗∗;theauthornotesthereisnoeasy32GB−VRAMcardwiththisperformanceforunder150**; the author notes there is no easy 32GB-VRAM card with this performance for under 300. A third MI50 sits beside a Radeon RX 7900 GRE rather than in this dual-card benchmark.

VERIFIABLE SOURCE

Reported anonymously by an r/LocalLLM contributor · 1 upvotes at capture

View source
SETUP HISTORY

Snapshots over time

3 versions
CURRENT2026-10-03Dual Radeon Instinct MI50 benchmarks: dense models at 12 to 18 tok/s, MoE models at 47 to 61 tok/s

Two Radeon Instinct MI50 cards limited to 145W each are benchmarked with llama.cpp Vulkan across dense and MoE models, with MoE models far ahead of dense ones.

Research & analysis1 machineQwen 3.8 27B, Gemma 4 31B, Qwen 3.6 35B-A3B, Nemotron 3.5 30B-A3B, Laguna-XS-2.1, Agents-A1llama.cpp
ChangedModels
Compare with revision 2
ModelsPreviousQwen 3.8 27B, Gemma 4 31B, Qwen 3.6 35B-A3B, Nemotron-3.5-30B-A3B, Laguna-XS-2.1, Agents-A1This snapshotQwen 3.8 27B, Gemma 4 31B, Qwen 3.6 35B-A3B, Nemotron 3.5 30B-A3B, Laguna-XS-2.1, Agents-A1

This is the currently published snapshot.

REVISION 22026-10-03Dual Radeon Instinct MI50 benchmarks: dense models at 12 to 18 tok/s, MoE models at 47 to 61 tok/s

Two Radeon Instinct MI50 cards limited to 145W each are benchmarked with llama.cpp Vulkan across dense and MoE models, with MoE models far ahead of dense ones.

Research & analysis1 machineQwen 3.8 27B, Gemma 4 31B, Qwen 3.6 35B-A3B, Nemotron-3.5-30B-A3B, Laguna-XS-2.1, Agents-A1llama.cpp
ChangedDescription
Compare with revision 1
DescriptionPreviousTwo Radeon Instinct MI50 cards (16GB HBM2 each, 32GB total) are power-limited to 145W each and benchmarked with a pre-built Ubuntu Vulkan build of llama.cpp (b11325), with HBM2 clocked at 1000MHz and overclockable to 1200MHz at 1.02 TB/s of bandwidth. Dense models ran slowly (Qwen 3.8 27B at Q6_K around 17.5 to 18 tok/s decode, Gemma 4 31B around 12 to 15.2 tok/s) while MoE models were much faster (Nemotron-3.5-30B-A3B at 60.6 tok/s, Qwen 3.6 35B-A3B around 46.9 to 49.2 tok/s), with prefill from 122 to 983 tok/s. The author uses a mix of dense and MoE GGUF models between 16GB and 32GB total and had no good cooling solution yet, and notes the third MI50 sits beside a Radeon RX 7900 GRE rather than in this dual-card benchmark.This snapshotThe author benchmarks two Radeon Instinct MI50 cards (16GB HBM2 each, 32GB total), each **power-limited to 145W** (TDP lowered), likely still without a good cooling solution. HBM2 is clocked at 1000MHz, overclockable to 1200MHz at **1.02 TB/s** of bandwidth. One card's firmware was changed to activate the miniDP port, with an xrandr mode added for 1920x1080 output. ## Command ```shell RADV_PERFTEST=nogttspill GGML_VK_VISIBLE_DEVICES=0,1 time llama-bench -fa on -ngl 99 -m /model.gguf ``` Using a pre-built Ubuntu Vulkan build of llama.cpp (b11325). ## Combined benchmark table | Model | Quant | Size | Params | pp512 (t/s) | tg128 (t/s) | | --- | --- | --- | --- | --- | --- | | Swift-Qwen3.8-27B-Uncensored-MTP | Q6_K | 20.88 GiB | 27.32 B | 141.97 | 17.49 | | Swift-1.5-Qwen3.8-27B | Q6_K | 22.21 GiB | 27.32 B | 167.38 | 17.97 | | Gemma-4-MoonGem-31B | i1-Q6_K | 23.46 GiB | 30.70 B | 122.00 | 15.20 | | gemma-4-31B-it-UD | Q6_K_XL | 25.62 GiB | 30.70 B | 135.99 | 12.05 | | Nemotron-3.5-30B-A3B-Antislop-FTPO | i1-Q5_K_M | 25.18 GiB | 32.91 B | 863.92 | 60.57 | | Laguna-XS-2.1-APEX-I-Balanced | - | 22.64 GiB | 33.44 B | 738.57 | 52.88 | | Qwen3.6-35B-A3B-UD | Q4_K_XL | 19.70 GiB | 34.66 B | 983.26 | 46.88 | | Qwen3.6-35B-A3B-UD | Q5_K_XL | 24.76 GiB | 34.66 B | 937.47 | 49.19 | | Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive | Q6_K_P | 28.53 GiB | 34.66 B | 783.24 | 46.85 | Dense models run slowly (27B/31B at ~12-18 tok/s decode) while MoE models are much faster (up to ~60 tok/s), which is the point of the test: a mix of dense and MoE GGUFs sized between 16GB and 32GB total. ## Cost As of the post, the average price for a 16GB MI50 is **under $150**; the author notes there is no easy 32GB-VRAM card with this performance for under $300. A third MI50 sits beside a Radeon RX 7900 GRE rather than in this dual-card benchmark.

Archived published snapshot — kept for context and comparison.

REVISION 12026-10-03Dual Radeon Instinct MI50 benchmarks: dense models at 12 to 18 tok/s, MoE models at 47 to 61 tok/s

Two Radeon Instinct MI50 cards limited to 145W each are benchmarked with llama.cpp Vulkan across dense and MoE models, with MoE models far ahead of dense ones.

Research & analysis1 machineQwen 3.8 27B, Gemma 4 31B, Qwen 3.6 35B-A3B, Nemotron-3.5-30B-A3B, Laguna-XS-2.1, Agents-A1llama.cpp

Archived published snapshot — kept for context and comparison.

Discussion

0 comments

No comments yet. Questions and corrections on this setup are welcome.

Leave a comment

Comments are reviewed before they appear. Keep it civil, cite your sources, and stay on topic.