Why It Matters
Well, I finally had time to do some optimizations for 1xR9700 owners and performance has doubled across the board.
Overview
People kept commenting and asking about single AMD 1xR9700 cards in the comments and discord. Well, I finally had time to do some optimizations for 1xR9700 owners and performance has doubled across the board. You can see the results in BetterBench above if you like visuals or below if you're more into text.
Why It Matters
Well, I finally had time to do some optimizations for 1xR9700 owners and performance has doubled across the board.
Key Details
These results were measured running Unsloth's Qwen3.8 27b NVFP4 .
Decode ┌───────────────┬───────────────┬──────────────────┐ │ category │ update p50 ms │ decode t/s (med) │ ├───────────────┼───────────────┼──────────────────┤ │ chat │ 42.3 │ 67.1 │ ├───────────────┼───────────────┼──────────────────┤ │ code │ 42.5 │ 120.5 │ ├───────────────┼───────────────┼──────────────────┤ │ file_edit │ 42.5 │ 138.0 │ ├───────────────┼───────────────┼──────────────────┤ │ json │ 42.4 │ 153.1 │ ├───────────────┼───────────────┼──────────────────┤ │ math │ 42.5 │ 140.0 │ ├───────────────┼───────────────┼──────────────────┤ │ prose │ 42.3 │ 69.2 │ ├───────────────┼───────────────┼──────────────────┤ │ reasoning │ 34.3 │ 123.9 │ ├───────────────┼───────────────┼──────────────────┤ │ summarization │ 34.2 │ 141.7 │ └───────────────┴───────────────┴──────────────────┘ Prefill ┌───────────────┬───────────────┐ │ prefill depth │ pp tok/s │ ├───────────────┼───────────────| │ 2000 │ 3552 │ ├───────────────┼───────────────| │ 8000 │ 3536 │ ├───────────────┼───────────────| │ 16000 │ 3619 │ ├───────────────┼───────────────| │ 32000 │ 3437 │ ├───────────────┼───────────────| │ 64000 │ 3192 │ ├───────────────┼───────────────| Concurrency ┌───────────────┬───────────────┐ │ level │ tok/s │ ├───────────────┼───────────────| │ 1 │ 120 │ ├───────────────┼───────────────| │ 2 │ 215 │ ├───────────────┼───────────────| │ 4 │ 322 │ ├───────────────┼───────────────| │ 8 │ 471 │ ├───────────────┼───────────────| Links (Both repo's updated as some users wanted Github) https://codeberg.org/ggz14/radiance-vllm-mxfp4 https://github.com/GGZ14/vllm-mxfp4 https://x.com/bkuyper I hope you single R9700 card owners enjoy this release!
submitted by /u/whodoneit1 [link] [comments]
--- *Original report published by [Reddit LocalLLaMA (Model Leaks & Local AI)](https://www.reddit.com/r/LocalLLaMA/comments/1wiws8e/153_toks_on_1x_amd_radeon_r9700_running_qwen38/).*
