What 117 real local-LLM rigs tell us about tok/s per euro in 2026

"Which GPU should I buy for local LLMs?" usually gets answered with spec sheets. I wanted an answer from measured numbers, so I took the open RigBase dataset (117 home AI builds, 298 measured results, every row linked to its public source) and divided tokens/sec by what the card costs today.

Short version:

• A used RTX 3090 gives about 3× more generation speed per euro than an RTX 5090 on every current model measured on both. The 5090 is 1.76-1.86× faster, but costs ~5.7× as much.
• For gpt-oss 20B, 16 GB cards win on value. RTX 5070 Ti and 5060 Ti both deliver ~150 tok/s per €1,000.
• Speculative decoding (MTP and friends) gave a median 1.76× speedup in ten same-hardware before/after pairs. That's a free upgrade.

The dataset in one paragraph

117 builds, 298 results, 48 models. 26 of those models are what people currently run (Qwen3.8, Qwen3.6, Gemma 4, gpt-oss, Nemotron 3.5…), and they account for 211 of the results.

• Sources: 33 different sites. GitHub repos/issues are the biggest (47 builds), then Reddit (12), llm-speed.com (10) and llamabench.ai (7).
• Engines: llama.cpp or Ollama (198 results), vLLM (37), MLX (29), other engines (34).
• 53 results use speculative decoding and are flagged as such, because they are not comparable 1:1 with plain decode.
• Hardware: 72 NVIDIA builds, 24 Apple, 16 AMD, 3 Intel, 2 CPU-only.

It's free under CC BY 4.0: builds.csv and builds.json.

Method (so you can disagree with it)

• Speed = decode (generation) tokens/sec as reported by the source. Plain decode only unless stated, single card, no CPU offload. Where a source gives a range, I use the low end.
• Price = lowest new listing on billiger.de (Germany, incl. VAT), checked 16-24 Oct 2026. The exception is the RTX 3090, which is out of production. For it I use the used eBay sold median of €1,248 (237 sales, PCPrice.Watch, 24 Oct 2026).
• Value = tok/s ÷ GPU price × 1000, i.e. tok/s per €1,000 of GPU. GPU only: no CPU, RAM, PSU or case.
• Different sources use different quants and builds. I group comparisons by source wherever possible, and you should treat gaps under ~10% as noise.

1. gpt-oss 20B: one source, six cards

All of these are llama-bench runs in native MXFP4 from the same llama.cpp thread (discussion #15396), so this is the cleanest comparison in the set.

The 5090 is only 1.49× faster than a 5070 Ti here (282.51 vs 189.45), yet it costs 5.7× as much. A 20B MoE in MXFP4 fits comfortably in 16 GB, so the extra VRAM buys you nothing on this model.

Same test rig, with power. Jeff Geerling's ai-benchmarks swaps cards in one Core Ultra 265K system and records peak whole-system power:

Sources: #40, #36, #35, #43. The quant isn't stated in his summary table.

The cheap card wins on value and the fast card wins on efficiency. The €429 RTX 3060 has the best tok/s per euro in the dataset for this model.

One caveat: gpt-oss 20B's weights are about 13 GB, more than the card's 12 GB, so part of the model may have run from system RAM. The 4090 draws more than twice the power, but gets the most tokens per watt.

2. Current 24-32 GB models: used 3090 vs 4090 vs 5090

Here are single-card results on current models, without speculative decoding. Each cell shows measured tok/s → tok/s per €1k.

Sources per row:

• Qwen3.6: 3090 llamabench (low end of 146-153), 4090 llm-speed, 5090 llamabench.
• Gemma 4 31B: 3090, 4090, 5090.
• Nemotron Bolt: llm-speed post for the 3090 and 5090, llamabench for the 4090.
• Qwen3.8 27B: 3090 OpenJet README (llama.cpp, no speculation), 5090 llm-speed.

On all four models the used 3090 gives 3.1-3.2× more tok/s per euro than the 5090. The 5090 is consistently ~1.8× faster, which tracks its memory bandwidth (1,792 vs 936 GB/s). It also has 8 GB more VRAM, which matters for long context.

If raw speed is the goal, buy the 5090. If value is the goal, the used 3090 remains the card to beat in late 2026.

3. The cheapest upgrade: speculative decoding

Here are ten before/after pairs where the same build ran the same model with the same engine and quant, and the only change was turning on a draft method (MTP, DSpark):

Sources: OpenJet, Sleeping Robots, howquant.dev, Cristian Tala, bnk.

The speedups range from 1.26× to 2.45×, with a median of 1.76×. That's roughly the gap between a 3090 and a 5090, and it costs nothing.

Two patterns show up:

• Small-active-parameter MoEs gain least. The dense Qwen3.8 27B gained 1.70-2.45× in every pair except one reasoning-prompt run, and Gemma 4 26B-A4B gained 1.83×. The ~3B-active MoE models (Qwen3.6 35B-A3B, Nemotron Lightning) gained only 1.31-1.34×.
• The prompt matters. On the same 3090, MTP gave 1.79× on a code prompt but 1.26× on a reasoning prompt. Predictable text gets more drafts accepted.

The catch is that drafting numbers are not comparable with plain decode across sources. That's why RigBase flags them ⚡ and lets you hide them.

4. Big models: where there's no good per-euro answer yet

For ~100B+ models, the hardware is mostly unified-memory boxes (Mac Studio, Strix Halo, DGX Spark), and I don't have comparable price data for them yet. So here are the raw measured speeds for gpt-oss 120B:

• RTX Pro 6000 Blackwell (96 GB) - 196.31 tok/s - llama.cpp MXFP4
• Apple M2 Ultra 76-core (192 GB) - 79.68 tok/s - llama.cpp MXFP4
• Ryzen AI Max+ PRO 495 (Radeon 8065S) - 55.8 tok/s - llama.cpp Vulkan MXFP4
• Ryzen AI Max+ PRO 395 (Radeon 8060S) - 44.7 tok/s - llama.cpp Vulkan MXFP4
• DGX Spark (GB10) - 44.4 tok/s - vLLM, 128K ctx

A €16,885 card is 2.5× faster than a 2023 Mac Studio, and the Strix Halo boxes match the DGX Spark. If you know reliable current prices for these systems, I'd like to add them.

Takeaways

• Up to ~20B MoE (gpt-oss 20B, Qwen3.5 9B, Gemma 4 12B): buy a 16 GB card. The RTX 5060 Ti and 5070 Ti tie on value at ~150 tok/s per €1k.
• 27-35B (Qwen3.8 27B, Qwen3.6 35B-A3B, Gemma 4 31B): a used RTX 3090 gives ~3× the value of a 5090. The 5090 is ~1.8× faster.
• Before buying anything, turn on speculative decoding. In this data it was worth a median 1.76×.
• Don't buy a halo card for value. The RTX Pro 6000 is at 17 tok/s per €1k on gpt-oss 20B, versus 152 for a 5070 Ti.

Get the data, add yours. Browse by GPU, by VRAM size, or check if a model fits your card. Download everything: getrigbase.com/data (CSV + JSON, CC BY 4.0, attribution "RigBase"). Ran llama-bench on a current model? Submit it. It needs a public proof link, and that's the only way a number gets in.

Data snapshot: RigBase builds.json, 24 Oct 2026. Prices: billiger.de 16-24 Oct 2026; used RTX 3090 from PCPrice.Watch, 24 Oct 2026. All ratios are arithmetic on the sourced numbers. Corrections welcome.