This person has a single Radeon Pro AI R9700 and set it up for coding with Lucebox and a 4-bit quant recommended for that card. The appeal is the card-specific, optimized kernels, which they describe as delivering very good performance. The card cost $1699 a couple of weeks before the post.
VERIFIABLE SOURCE
View source Reported anonymously by an r/LocalLLM contributor · score 1