HiFive Premier P550 (as tested by Jeff Geerling): edge AI benchmarks
- Independent test Jeff Geerling
Key results
How to read power: results are compared only within the same model. By efficiency ranks only results whose source publishes a power figure; By speed ranks every result. Measured = measured for this workload. Vendor-measured (typical/avg) = the vendor’s own measurement at typical or average load, not an independent test and not a maximum, so fps/W looks better than at max TDP. Chip, Module or Board TDP = the vendor’s published maximum, not measured. Typical power, not max TDP = only a typical figure is published, so fps/W looks better than at full load. Scope says what the watts cover: Accelerator only (host not included), Module, or Whole system. Max of range = top of a published range, so fps/W is a floor (≥). “— not published” = the source gives no power; we never estimate one.
| Workload | Model · precision | Result | Power | Perf/W | Rank on this model | Grade · date | Source |
|---|---|---|---|---|---|---|---|
| LLM generation | deepseek-r1:1.5bOllama default tag (4-bit unless tag says otherwise) · batch 1 | 0.490 tok/s | 13.50 WWhole system Measured | 0.0363● Measured · Whole system | not in the default fps/W ranking #5 of 5 by speed | C 2025-02-06 (page last edited) | Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19 |
| llama2:13bOllama default tag (4-bit unless tag says otherwise) · batch 1 | 0.110 tok/s | 13.60 WWhole system Measured | 0.00809● Measured · Whole system | not in the default fps/W ranking #6 of 6 by speed | C 2025-02-06 (page last edited) | Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19 | |
| llama3.1:8bOllama default tag (4-bit unless tag says otherwise) · batch 1 | 0.100 tok/s | 13.60 WWhole system Measured | 0.00735● Measured · Whole system | not in the default fps/W ranking #8 of 8 by speed | C 2025-02-06 (page last edited) | Jeff Geerling ai-benchmarks issue results (comments)ai-benchmarks README @ 2f56f19 |
Ranks compare this board only with boards running the same model. Up to three models per workload; open a rank to see the full same-model table.
Show data — per-workload tables
object detection
No published object detection results for HiFive Premier P550 (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
instance segmentation
No published instance segmentation results for HiFive Premier P550 (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
pose estimation
No published pose estimation results for HiFive Premier P550 (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
image classification
No published image classification results for HiFive Premier P550 (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
semantic segmentation
No published semantic segmentation results for HiFive Premier P550 (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
speech-to-text
No published speech-to-text results for HiFive Premier P550 (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
LLM generation
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| LLM ≤4B · b=1 | 0.490 tok/s | deepseek-r1:1.5b Ollama default tag (4-bit unless tag says otherwise) · Ollama (geerlingguy/ollama-benchmark) | C | 13.50 W ● Measured, Whole system | Jeff Geerling ai-benchmarks issue results (comments) Older data (2025) | 79 of 81 |
| LLM 5–14B · b=1 | 0.110 tok/s | llama2:13b Ollama default tag (4-bit unless tag says otherwise) · Ollama (geerlingguy/ollama-benchmark) | C | 13.60 W ● Measured, Whole system | Jeff Geerling ai-benchmarks issue results (comments) Older data (2025) | 66 of 66 |
Grades: A audited MLPerf · B third-party · C community · D vendor. How we rank · JSON