HWBench

Find edge AI hardware

JSON

Task LLM generation · model-size class by model · batch per group · 15 platforms · edge hardware only · model_key "deepseekr114b"

Results are compared only within the same model. 1 model have results for this task.

How to read power: results are compared only within the same model. By efficiency ranks only results whose source publishes a power figure; By speed ranks every result. Measured = measured for this workload. Vendor-measured (typical/avg) = the vendor’s own measurement at typical or average load, not an independent test and not a maximum, so fps/W looks better than at max TDP. Chip, Module or Board TDP = the vendor’s published maximum, not measured. Typical power, not max TDP = only a typical figure is published, so fps/W looks better than at full load. Scope says what the watts cover: Accelerator only (host not included), Module, or Whole system. Max of range = top of a published range, so fps/W is a floor (≥). “— not published” = the source gives no power; we never estimate one.

DeepSeek R1 14b 15 platforms · 0 with published power

DeepSeek R1 14b: 0 results with published power, ranked by tok/s per watt; 15 not ranked by efficiency listed below
RankPlatformtok/s/Wtok/sPowerModel · precision · batchGrade · dateSource
–Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)0.139● Measured · Whole system64.58 tok/s465 WWhole system Measureddeepseek-r1:14bOllama default tag (4-bit unless tag says otherwise) · batch 1C 2025-05-06 (page last edited)Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19
–Mac Studio (M3 Ultra 512GB) (as tested by Jeff Geerling)0.228● Measured · Whole system51.85 tok/s227 WWhole system MeasuredDeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1C 2026-09-22 (page last edited)Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
–M1 Ultra (64 GPU Core) 128GB (as tested by Jeff Geerling)41.51 tok/s— not publishedDeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1C 2026-09-22 (page last edited)Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
–M1 Ultra (48 GPU Core) 64GB (as tested by Jeff Geerling)35.89 tok/s— not publishedDeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1D 2026-09-22 (page last edited)Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
–Dell Pro Max with GB100.173● Measured · Whole system23.92 tok/s138 WWhole system MeasuredDeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1C 2026-09-22 (page last edited)Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
–AMD Ryzen AI Max+ 395 / PRO 395 (Strix Halo, Radeon 8060S)0.0812● Measured · Whole system11.37 tok/s140 WWhole system MeasuredDeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1C 2026-09-22 (page last edited)Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
–Pi CM5 - 16GB (AMD AI Pro R9700) (as tested by Jeff Geerling)0.0285● Measured · Whole system7.98 tok/s280 WWhole system MeasuredDeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1C 2026-09-22 (page last edited)Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
–Framework 13 (Ryzen AI 5 340 16GB) (as tested by Jeff Geerling)0.116● Measured · Whole system5.83 tok/s50.40 WWhole system MeasuredDeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1C 2026-09-22 (page last edited)Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
–Framework 13 (Ryzen AI 5 340) (as tested by Jeff Geerling)0.116● Measured · Whole system5.83 tok/s50.40 WWhole system Measureddeepseek-r1:14bOllama default tag (4-bit unless tag says otherwise) · batch 1C 2025-11-12 (page last edited)Jeff Geerling sbc-reviews (AI / LLM inference tables)ai-benchmarks README @ 2f56f19
–Radxa Orion O6 - 16GB (as tested by Jeff Geerling)0.125● Measured · Whole system4.33 tok/s34.70 WWhole system MeasuredDeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1C 2026-09-22 (page last edited)Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
–Minisforum MS-R1 (as tested by Jeff Geerling)0.0883● Measured · Whole system3.39 tok/s38.40 WWhole system MeasuredDeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1C 2026-09-22 (page last edited)Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
–MetaComputing AI PC Framework 13 Mainboard (as tested by Jeff Geerling)0.102● Measured · Whole system3.25 tok/s32.00 WWhole system MeasuredDeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1C 2026-09-22 (page last edited)Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
–GMKtek G3 Plus (Intel N150) - 16GB (as tested by Jeff Geerling)0.0703● Measured · Whole system2.13 tok/s30.30 WWhole system MeasuredDeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1C 2026-09-22 (page last edited)Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
–Intel N150 Mini PC (GMKTek G3 Plus) (as tested by Jeff Geerling)0.0703● Measured · Whole system2.13 tok/s30.30 WWhole system Measureddeepseek-r1:14bOllama default tag (4-bit unless tag says otherwise) · batch 1C 2025-02-04 (page last edited)Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19
–Raspberry Pi 5 (CPU only)0.0923● Measured · Whole system1.20 tok/s13.00 WWhole system MeasuredDeepSeek R1 14bas in linked issue (Ollama default tags are 4-bit) · batch 1C 2026-09-22 (page last edited)Jeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
Excluded from ranking (13)

Partial or suspected partial models, fps/W outliers and rows HWBench Data flags (rank_note) are kept out of the rankings. Rows with a published power figure that Data does not mark for the default fps/W ranking still appear under By speed. Every row stays in /find.json.

Excluded from ranking
PlatformModelResultPowerLeft out ofWhySource
Mac Studio (M3 Ultra 512GB) (as tested by Jeff Geerling)DeepSeek R1 14b51.85 tok/s227 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
Dell Pro Max with GB10DeepSeek R1 14b23.92 tok/s138 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)deepseek-r1:14b64.58 tok/s465 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19
Radxa Orion O6 - 16GB (as tested by Jeff Geerling)DeepSeek R1 14b4.33 tok/s34.70 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
Framework 13 (Ryzen AI 5 340 16GB) (as tested by Jeff Geerling)DeepSeek R1 14b5.83 tok/s50.40 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
Framework 13 (Ryzen AI 5 340) (as tested by Jeff Geerling)deepseek-r1:14b5.83 tok/s50.40 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling sbc-reviews (AI / LLM inference tables)ai-benchmarks README @ 2f56f19
MetaComputing AI PC Framework 13 Mainboard (as tested by Jeff Geerling)DeepSeek R1 14b3.25 tok/s32.00 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
Raspberry Pi 5 (CPU only)DeepSeek R1 14b1.20 tok/s13.00 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
Minisforum MS-R1 (as tested by Jeff Geerling)DeepSeek R1 14b3.39 tok/s38.40 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
AMD Ryzen AI Max+ 395 / PRO 395 (Strix Halo, Radeon 8060S)DeepSeek R1 14b11.37 tok/s140 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
GMKtek G3 Plus (Intel N150) - 16GB (as tested by Jeff Geerling)DeepSeek R1 14b2.13 tok/s30.30 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19
Intel N150 Mini PC (GMKTek G3 Plus) (as tested by Jeff Geerling)deepseek-r1:14b2.13 tok/s30.30 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19
Pi CM5 - 16GB (AMD AI Pro R9700) (as tested by Jeff Geerling)DeepSeek R1 14b7.98 tok/s280 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling ai-benchmarks README (Findings tables)ai-benchmarks README @ 2f56f19