This person has a single Radeon Pro AI R9700 and set it up for coding with Lucebox and a 4-bit quant recommended for that card. The appeal is the card-specific, optimized kernels, which they describe as delivering very good performance. The card cost $1699 a couple of weeks before the post.
Reported anonymously by an r/LocalLLM contributor · 1 upvotes at capture
Leave a comment