HWBench

Find edge AI hardware

JSON

Task LLM generation · model-size class by model · batch per group · 3 platforms · edge hardware only · model_key "qwen2515bq4"

Results are compared only within the same model. 1 model have results for this task.

How to read power: results are compared only within the same model. By efficiency ranks only results whose source publishes a power figure; By speed ranks every result. Measured = measured for this workload. Vendor-measured (typical/avg) = the vendor’s own measurement at typical or average load, not an independent test and not a maximum, so fps/W looks better than at max TDP. Chip, Module or Board TDP = the vendor’s published maximum, not measured. Typical power, not max TDP = only a typical figure is published, so fps/W looks better than at full load. Scope says what the watts cover: Accelerator only (host not included), Module, or Whole system. Max of range = top of a published range, so fps/W is a floor (≥). “— not published” = the source gives no power; we never estimate one.

Qwen2.5 1.5B (Q4) 3 platforms · 0 with published power

Qwen2.5 1.5B (Q4): 0 results with published power, ranked by tok/s per watt; 3 not ranked by efficiency listed below
RankPlatformtok/s/Wtok/sPowerModel · precision · batchGrade · dateSource
–Apple iPhone 16 Pro (A18 Pro)25.89 tok/s— not publishedQwen2.5 1.5B (Q4)4-bit · batch 1C 2026-06-07 (published)arXiv 2603.23640 authors (manual extraction)arXiv:2603.23640v2
–Samsung Galaxy S24 Ultra (Snapdragon 8 Gen 3)10.83 tok/s— not publishedQwen2.5 1.5B (Q4)4-bit · batch 1C 2026-06-07 (published)arXiv 2603.23640 authors (manual extraction)arXiv:2603.23640v2
–Raspberry Pi 5 + Hailo-10H (AI HAT+ 2 class, PCIe Gen3)3.70● Measured · Whole system6.91 tok/s1.87 WWhole system MeasuredQwen2.5 1.5B (Q4)4-bit · batch 1C 2026-06-07 (published)arXiv 2603.23640 authors (manual extraction)arXiv:2603.23640v2
Excluded from ranking (1)

Partial or suspected partial models, fps/W outliers and rows HWBench Data flags (rank_note) are kept out of the rankings. Rows with a published power figure that Data does not mark for the default fps/W ranking still appear under By speed. Every row stays in /find.json.

Excluded from ranking
PlatformModelResultPowerLeft out ofWhySource
Raspberry Pi 5 + Hailo-10H (AI HAT+ 2 class, PCIe Gen3)Qwen2.5 1.5B (Q4)6.91 tok/s1.87 WWhole system MeasuredEfficiency rankingHWBench Data has not verified tok/s/W rows for ranking yetarXiv 2603.23640 authors (manual extraction)arXiv:2603.23640v2