Find edge AI hardware
Task LLM generation · model-size class by model · batch per group · 15 platforms · edge hardware only · model_key "deepseekr114b"
Results are compared only within the same model. 1 model have results for this task.
How to read power: results are compared only within the same model. By efficiency ranks only results whose source publishes a power figure; By speed ranks every result. Measured = measured for this workload. Vendor-measured (typical/avg) = the vendor’s own measurement at typical or average load, not an independent test and not a maximum, so fps/W looks better than at max TDP. Chip, Module or Board TDP = the vendor’s published maximum, not measured. Typical power, not max TDP = only a typical figure is published, so fps/W looks better than at full load. Scope says what the watts cover: Accelerator only (host not included), Module, or Whole system. Max of range = top of a published range, so fps/W is a floor (≥). “— not published” = the source gives no power; we never estimate one.
DeepSeek R1 14b 15 platforms · 0 with published power
| Rank | Platform | tok/s/W | tok/s | Power | Model · precision · batch | Grade · date | Source |
|---|---|---|---|---|---|---|---|
| – | Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) | 0.139● Measured · Whole system | 64.58 tok/s | 465 WWhole system Measured | deepseek-r1:14bOllama default tag (4-bit unless tag says otherwise) · batch 1 | C 2025-05-06 (page last edited) | Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19 |
| – | Mac Studio (M3 Ultra 512GB) (as tested by Jeff Geerling) | 0.228● Measured · Whole system | 51.85 tok/s | 227 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| – | M1 Ultra (64 GPU Core) 128GB (as tested by Jeff Geerling) | 41.51 tok/s | — not published | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 | |
| – | M1 Ultra (48 GPU Core) 64GB (as tested by Jeff Geerling) | 35.89 tok/s | — not published | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | D 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 | |
| – | Dell Pro Max with GB10 | 0.173● Measured · Whole system | 23.92 tok/s | 138 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| – | AMD Ryzen AI Max+ 395 / PRO 395 (Strix Halo, Radeon 8060S) | 0.0812● Measured · Whole system | 11.37 tok/s | 140 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| – | Pi CM5 - 16GB (AMD AI Pro R9700) (as tested by Jeff Geerling) | 0.0285● Measured · Whole system | 7.98 tok/s | 280 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| – | Framework 13 (Ryzen AI 5 340 16GB) (as tested by Jeff Geerling) | 0.116● Measured · Whole system | 5.83 tok/s | 50.40 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| – | Framework 13 (Ryzen AI 5 340) (as tested by Jeff Geerling) | 0.116● Measured · Whole system | 5.83 tok/s | 50.40 WWhole system Measured | deepseek-r1:14bOllama default tag (4-bit unless tag says otherwise) · batch 1 | C 2025-11-12 (page last edited) | Jeff Geerling sbc-reviews (AI / LLM inference tables)ai-benchmarks README @ 2f56f19 |
| – | Radxa Orion O6 - 16GB (as tested by Jeff Geerling) | 0.125● Measured · Whole system | 4.33 tok/s | 34.70 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| – | Minisforum MS-R1 (as tested by Jeff Geerling) | 0.0883● Measured · Whole system | 3.39 tok/s | 38.40 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| – | MetaComputing AI PC Framework 13 Mainboard (as tested by Jeff Geerling) | 0.102● Measured · Whole system | 3.25 tok/s | 32.00 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| – | GMKtek G3 Plus (Intel N150) - 16GB (as tested by Jeff Geerling) | 0.0703● Measured · Whole system | 2.13 tok/s | 30.30 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| – | Intel N150 Mini PC (GMKTek G3 Plus) (as tested by Jeff Geerling) | 0.0703● Measured · Whole system | 2.13 tok/s | 30.30 WWhole system Measured | deepseek-r1:14bOllama default tag (4-bit unless tag says otherwise) · batch 1 | C 2025-02-04 (page last edited) | Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19 |
| – | Raspberry Pi 5 (CPU only) | 0.0923● Measured · Whole system | 1.20 tok/s | 13.00 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| Rank | Platform | tok/s/W | tok/s | Power | Model · precision · batch | Grade · date | Source |
|---|---|---|---|---|---|---|---|
| 1 | Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) | 0.139● Measured · Whole system | 64.58 tok/s | 465 WWhole system Measured | deepseek-r1:14bOllama default tag (4-bit unless tag says otherwise) · batch 1 | C 2025-05-06 (page last edited) | Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19 |
| 2 | Mac Studio (M3 Ultra 512GB) (as tested by Jeff Geerling) | 0.228● Measured · Whole system | 51.85 tok/s | 227 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| 3 | M1 Ultra (64 GPU Core) 128GB (as tested by Jeff Geerling) | 41.51 tok/s | — not published | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 | |
| 4 | M1 Ultra (48 GPU Core) 64GB (as tested by Jeff Geerling) | 35.89 tok/s | — not published | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | D 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 | |
| 5 | Dell Pro Max with GB10 | 0.173● Measured · Whole system | 23.92 tok/s | 138 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| 6 | AMD Ryzen AI Max+ 395 / PRO 395 (Strix Halo, Radeon 8060S) | 0.0812● Measured · Whole system | 11.37 tok/s | 140 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| 7 | Pi CM5 - 16GB (AMD AI Pro R9700) (as tested by Jeff Geerling) | 0.0285● Measured · Whole system | 7.98 tok/s | 280 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| 8 | Framework 13 (Ryzen AI 5 340 16GB) (as tested by Jeff Geerling) | 0.116● Measured · Whole system | 5.83 tok/s | 50.40 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| 9 | Framework 13 (Ryzen AI 5 340) (as tested by Jeff Geerling) | 0.116● Measured · Whole system | 5.83 tok/s | 50.40 WWhole system Measured | deepseek-r1:14bOllama default tag (4-bit unless tag says otherwise) · batch 1 | C 2025-11-12 (page last edited) | Jeff Geerling sbc-reviews (AI / LLM inference tables)ai-benchmarks README @ 2f56f19 |
| 10 | Radxa Orion O6 - 16GB (as tested by Jeff Geerling) | 0.125● Measured · Whole system | 4.33 tok/s | 34.70 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| 11 | Minisforum MS-R1 (as tested by Jeff Geerling) | 0.0883● Measured · Whole system | 3.39 tok/s | 38.40 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| 12 | MetaComputing AI PC Framework 13 Mainboard (as tested by Jeff Geerling) | 0.102● Measured · Whole system | 3.25 tok/s | 32.00 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| 13 | GMKtek G3 Plus (Intel N150) - 16GB (as tested by Jeff Geerling) | 0.0703● Measured · Whole system | 2.13 tok/s | 30.30 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| 14 | Intel N150 Mini PC (GMKTek G3 Plus) (as tested by Jeff Geerling) | 0.0703● Measured · Whole system | 2.13 tok/s | 30.30 WWhole system Measured | deepseek-r1:14bOllama default tag (4-bit unless tag says otherwise) · batch 1 | C 2025-02-04 (page last edited) | Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19 |
| 15 | Raspberry Pi 5 (CPU only) | 0.0923● Measured · Whole system | 1.20 tok/s | 13.00 WWhole system Measured | DeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1 | C 2026-09-22 (page last edited) | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
Excluded from ranking (13)
Partial or suspected partial models, fps/W outliers and rows HWBench Data flags (rank_note) are kept out of the rankings. Rows with a published power figure that Data does not mark for the default fps/W ranking still appear under By speed. Every row stays in /find.json.
| Platform | Model | Result | Power | Left out of | Why | Source |
|---|---|---|---|---|---|---|
| Mac Studio (M3 Ultra 512GB) (as tested by Jeff Geerling) | DeepSeek R1 14b | 51.85 tok/s | 227 WWhole system Measured | Efficiency ranking | HWBench Data has not verified tok/s/W rows for ranking yet | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| Dell Pro Max with GB10 | DeepSeek R1 14b | 23.92 tok/s | 138 WWhole system Measured | Efficiency ranking | HWBench Data has not verified tok/s/W rows for ranking yet | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) | deepseek-r1:14b | 64.58 tok/s | 465 WWhole system Measured | Efficiency ranking | HWBench Data has not verified tok/s/W rows for ranking yet | Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19 |
| Radxa Orion O6 - 16GB (as tested by Jeff Geerling) | DeepSeek R1 14b | 4.33 tok/s | 34.70 WWhole system Measured | Efficiency ranking | HWBench Data has not verified tok/s/W rows for ranking yet | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| Framework 13 (Ryzen AI 5 340 16GB) (as tested by Jeff Geerling) | DeepSeek R1 14b | 5.83 tok/s | 50.40 WWhole system Measured | Efficiency ranking | HWBench Data has not verified tok/s/W rows for ranking yet | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| Framework 13 (Ryzen AI 5 340) (as tested by Jeff Geerling) | deepseek-r1:14b | 5.83 tok/s | 50.40 WWhole system Measured | Efficiency ranking | HWBench Data has not verified tok/s/W rows for ranking yet | Jeff Geerling sbc-reviews (AI / LLM inference tables)ai-benchmarks README @ 2f56f19 |
| MetaComputing AI PC Framework 13 Mainboard (as tested by Jeff Geerling) | DeepSeek R1 14b | 3.25 tok/s | 32.00 WWhole system Measured | Efficiency ranking | HWBench Data has not verified tok/s/W rows for ranking yet | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| Raspberry Pi 5 (CPU only) | DeepSeek R1 14b | 1.20 tok/s | 13.00 WWhole system Measured | Efficiency ranking | HWBench Data has not verified tok/s/W rows for ranking yet | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| Minisforum MS-R1 (as tested by Jeff Geerling) | DeepSeek R1 14b | 3.39 tok/s | 38.40 WWhole system Measured | Efficiency ranking | HWBench Data has not verified tok/s/W rows for ranking yet | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| AMD Ryzen AI Max+ 395 / PRO 395 (Strix Halo, Radeon 8060S) | DeepSeek R1 14b | 11.37 tok/s | 140 WWhole system Measured | Efficiency ranking | HWBench Data has not verified tok/s/W rows for ranking yet | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| GMKtek G3 Plus (Intel N150) - 16GB (as tested by Jeff Geerling) | DeepSeek R1 14b | 2.13 tok/s | 30.30 WWhole system Measured | Efficiency ranking | HWBench Data has not verified tok/s/W rows for ranking yet | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |
| Intel N150 Mini PC (GMKTek G3 Plus) (as tested by Jeff Geerling) | deepseek-r1:14b | 2.13 tok/s | 30.30 WWhole system Measured | Efficiency ranking | HWBench Data has not verified tok/s/W rows for ranking yet | Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19 |
| Pi CM5 - 16GB (AMD AI Pro R9700) (as tested by Jeff Geerling) | DeepSeek R1 14b | 7.98 tok/s | 280 WWhole system Measured | Efficiency ranking | HWBench Data has not verified tok/s/W rows for ranking yet | Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19 |