Back to directory
Coding · 2026-10-03

Qwen 3.8 Flash Next on a 2021 M1 Max: 44 tok/s and 35 tok/s at 398K context with Splash

Long-context decode benchmark of Qwen 3.8 Flash Next on an M1 Max 64 GB through an unofficial Splash/ds4 fork in real OpenCode agent sessions.

Ran Qwen 3.8 Flash Next on a 2021 M1 Max laptop (32 GPU cores, 64 GB unified memory) through a Splash/ds4 fork (built on antirez's DwarfStar), for real OpenCode agent sessions.

Long-context behaviour (Q2_0, 35 GiB, MTP on)

  • One chat grown to its full context: 44 tok/s at 4K, 38.8 at 256K, 35.4 at 398K; prefill 328 to 292 tok/s
  • Five prompts on a loop for five minutes: 43.2 tok/s at the start, 43.1 at the end, GPU 73-75 C, no throttling, 0.70 J per token
  • Real OpenCode sessions: 162 requests, context up to 371K; median decode 44 tok/s under 64K, 38 at 128-256K
  • IQ3_XXS (44 GiB, better answers): 35.2 tok/s at 4K, 31.7 at 259K

Comparisons

  • Against the author's Splash port of Qwen 3.8 27B: at 128K+ in OpenCode, 14 tok/s vs 38, and prefill 4-7x faster
  • For scale, a DGX Spark with the popular vLLM NVFP4 + MTP recipe does 36.8 tok/s on prose, 45.8 on code
  • Bonus: DeepSeek V4 Flash (81 GiB) on the same 64 GB Mac, streamed from the SSD, does 12 tok/s at 4K and 9 at 127K

Limits

The fork is unofficial; Q2_0 loses about 6 points on code versus BF16 in ISTA's evals (81.1 vs 87.4 LiveCodeBench v6, 89.1 vs 93.1 overall), and Flash Next still needs a 64 GB Mac.

VERIFIABLE SOURCE

Reported anonymously by an r/LocalLLM contributor · 1 upvotes at capture

View source
SETUP HISTORY

Snapshots over time

2 versions
CURRENT2026-10-03Qwen 3.8 Flash Next on a 2021 M1 Max: 44 tok/s and 35 tok/s at 398K context with Splash

Long-context decode benchmark of Qwen 3.8 Flash Next on an M1 Max 64 GB through an unofficial Splash/ds4 fork in real OpenCode agent sessions.

Coding1 machineQwen 3.8 Flash Next, Qwen 3.8 27BSplash
ChangedDescription
Compare with revision 1
DescriptionPreviousRan Qwen 3.8 Flash Next on a 2021 M1 Max laptop (32 GPU cores, 64 GB unified memory) through a Splash/ds4 fork for real OpenCode agent sessions. With the GSQ-RCO Q2_0 quant (35 GiB) and MTP, decode held 44 tok/s at 4K, 38.8 at 256K and 35.4 at 398K, with prefill falling from 328 to 292 tok/s, while IQ3_XXS (44 GiB) managed 35.2 tok/s at 4K and 31.7 at 259K. Sustained load stayed flat at 43.2/43.1 tok/s over five minutes at 73-75 C with no throttling and 0.70 J per token. Limits: the fork is unofficial, Q2_0 loses about 6 points on code versus BF16 in ISTA's evals (81.1 vs 87.4 LiveCodeBench v6, 89.1 vs 93.1 overall), and Flash Next still needs a 64 GB Mac.This snapshotRan Qwen 3.8 Flash Next on a 2021 M1 Max laptop (32 GPU cores, 64 GB unified memory) through a Splash/ds4 fork (built on antirez's DwarfStar), for real OpenCode agent sessions. ## Long-context behaviour (Q2_0, 35 GiB, MTP on) - One chat grown to its full context: **44 tok/s at 4K, 38.8 at 256K, 35.4 at 398K**; prefill 328 to 292 tok/s - Five prompts on a loop for five minutes: **43.2 tok/s at the start, 43.1 at the end**, GPU 73-75 C, no throttling, 0.70 J per token - Real OpenCode sessions: 162 requests, context up to 371K; median decode **44 tok/s under 64K, 38 at 128-256K** - IQ3_XXS (44 GiB, better answers): 35.2 tok/s at 4K, 31.7 at 259K ## Comparisons - Against the author's Splash port of Qwen 3.8 27B: at 128K+ in OpenCode, **14 tok/s vs 38**, and prefill 4-7x faster - For scale, a DGX Spark with the popular vLLM NVFP4 + MTP recipe does 36.8 tok/s on prose, 45.8 on code - Bonus: DeepSeek V4 Flash (81 GiB) on the same 64 GB Mac, streamed from the SSD, does 12 tok/s at 4K and 9 at 127K ## Limits The fork is unofficial; Q2_0 loses about 6 points on code versus BF16 in ISTA's evals (81.1 vs 87.4 LiveCodeBench v6, 89.1 vs 93.1 overall), and Flash Next still needs a 64 GB Mac.

This is the currently published snapshot.

REVISION 12026-10-03Qwen 3.8 Flash Next on a 2021 M1 Max: 44 tok/s and 35 tok/s at 398K context with Splash

Long-context decode benchmark of Qwen 3.8 Flash Next on an M1 Max 64 GB through an unofficial Splash/ds4 fork in real OpenCode agent sessions.

Coding1 machineQwen 3.8 Flash Next, Qwen 3.8 27BSplash

Archived published snapshot — kept for context and comparison.

Discussion

0 comments

No comments yet. Questions and corrections on this setup are welcome.

Leave a comment

Comments are reviewed before they appear. Keep it civil, cite your sources, and stay on topic.