HWBench

Find edge AI hardware

JSON

Task LLM generation · model-size class by model · batch per group · 5 platforms · edge hardware only · model_key "deepseekr115b"

Results are compared only within the same model. 1 model have results for this task.

How to read power: results are compared only within the same model. By efficiency ranks only results whose source publishes a power figure; By speed ranks every result. Measured = measured for this workload. Vendor-measured (typical/avg) = the vendor’s own measurement at typical or average load, not an independent test and not a maximum, so fps/W looks better than at max TDP. Chip, Module or Board TDP = the vendor’s published maximum, not measured. Typical power, not max TDP = only a typical figure is published, so fps/W looks better than at full load. Scope says what the watts cover: Accelerator only (host not included), Module, or Whole system. Max of range = top of a published range, so fps/W is a floor (≥). “— not published” = the source gives no power; we never estimate one.

deepseek-r1:1.5b 5 platforms · 0 with published power

deepseek-r1:1.5b: 0 results with published power, ranked by tok/s per watt; 5 not ranked by efficiency listed below
RankPlatformtok/s/Wtok/sPowerModel · precision · batchGrade · dateSource
–Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)0.669● Measured · Whole system214 tok/s320 WWhole system Measureddeepseek-r1:1.5bOllama default tag (4-bit unless tag says otherwise) · batch 1C 2025-05-06 (page last edited)Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19
–Intel N150 Mini PC (GMKTek G3 Plus) (as tested by Jeff Geerling)0.602● Measured · Whole system17.99 tok/s29.90 WWhole system Measureddeepseek-r1:1.5bOllama default tag (4-bit unless tag says otherwise) · batch 1C 2025-02-04 (page last edited)Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19
–Dell Optiplex 780 (Intel Core 2 Quad Q8400) (as tested by Jeff Geerling)2.30 tok/s— not publisheddeepseek-r1:1.5bOllama default tag (4-bit unless tag says otherwise) · batch 1C 2025-11-05 (page last edited)Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19
–DC-ROMA RISC-V Mainboard II (as tested by Jeff Geerling)0.590 tok/s— not publisheddeepseek-r1:1.5bOllama default tag (4-bit unless tag says otherwise) · batch 1C 2025-10-17 (page last edited)Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19
–HiFive Premier P550 (as tested by Jeff Geerling)0.0363● Measured · Whole system0.490 tok/s13.50 WWhole system Measureddeepseek-r1:1.5bOllama default tag (4-bit unless tag says otherwise) · batch 1C 2025-02-06 (page last edited)Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19
Excluded from ranking (3)

Partial or suspected partial models, fps/W outliers and rows HWBench Data flags (rank_note) are kept out of the rankings. Rows with a published power figure that Data does not mark for the default fps/W ranking still appear under By speed. Every row stays in /find.json.

Excluded from ranking
PlatformModelResultPowerLeft out ofWhySource
Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)deepseek-r1:1.5b214 tok/s320 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19
Intel N150 Mini PC (GMKTek G3 Plus) (as tested by Jeff Geerling)deepseek-r1:1.5b17.99 tok/s29.90 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19
HiFive Premier P550 (as tested by Jeff Geerling)deepseek-r1:1.5b0.490 tok/s13.50 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetJeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19