HWBenchedge-AI hardware data, cited & graded

Hailo-8L (M.2/PCIe, x86 host): edge AI benchmarks

HailoAI accelerator (M.2) · no photo yet
No licensed photo available — placeholder drawing.
Vendor HailoForm factor AI accelerator (M.2)Compute NPUIndicative price unknownPower envelope 1.5 W
chip typical (vendor); host not included
Published rows 88
object detection437 FPSD 291 FPS/W specundated
instance segmentation338 FPSD 225 FPS/W specundated
pose estimation202 FPSD 135 FPS/W specundated
image classification1738 FPSD 1159 FPS/W specundated

Best published result per workload, across model sizes — open “Show data” for like-for-like groups.

Show data — per-workload tables

object detection

Like-for-like groupBest resultModel · precision · stackGradePowerSource · dateRank in group
nano (YOLO-n) · b=1201 FPSyolov8n
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
12 of 16
nano (YOLO-n) · b=8437 FPSyolov8n
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
2 of 3
small (YOLO-s) · b=1137 FPSyolov5s_wo_spp
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
6 of 8
small (YOLO-s) · b=8275 FPSyolov5s_wo_spp
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 3
medium (YOLO-m) · b=162.90 FPSyolov5m_wo_spp
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
7 of 8
medium (YOLO-m) · b=8105 FPSyolov5m
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 4

instance segmentation

Like-for-like groupBest resultModel · precision · stackGradePowerSource · dateRank in group
medium (YOLO-m) · b=152.90 FPSyolov5m_seg
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 3
medium (YOLO-m) · b=883.60 FPSyolov5m_seg
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 3
nano (YOLO-n) · b=1168 FPSyolov8n_seg
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
4 of 5
nano (YOLO-n) · b=8338 FPSyolov8n_seg
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
2 of 3
small (YOLO-s) · b=1101 FPSyolov5s_seg
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 3
small (YOLO-s) · b=8160 FPSyolov5s_seg
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 3

pose estimation

Like-for-like groupBest resultModel · precision · stackGradePowerSource · dateRank in group
medium (YOLO-m) · b=148.50 FPSyolov8m_pose
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 3
medium (YOLO-m) · b=881.90 FPSyolov8m_pose
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 3
small (YOLO-s) · b=1107 FPSyolov8s_pose
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 3
small (YOLO-s) · b=8202 FPSyolov8s_pose
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 3
unknown · b=185.00 FPScenterpose_regnetx_800mf
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 3
unknown · b=8133 FPScenterpose_regnetx_800mf
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 3

image classification

Like-for-like groupBest resultModel · precision · stackGradePowerSource · dateRank in group
mobile-class CNN · b=11738 FPSmobilenet_v2_1.0
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
6 of 16
mobile-class CNN · b=81738 FPSmobilenet_v2_1.0
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 3
mid-size CNN · b=1138 FPSresnet_v1_50
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
10 of 13
mid-size CNN · b=8502 FPSresnet_v1_50
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 3

semantic segmentation

Like-for-like groupBest resultModel · precision · stackGradePowerSource · dateRank in group
mid-size CNN · b=119.60 FPSfcn8_resnet_v1_18
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
6 of 7
mid-size CNN · b=822.50 FPSfcn8_resnet_v1_18
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 3
mobile-class CNN · b=199.10 FPSunet_mobilenet_v2
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
6 of 7
mobile-class CNN · b=8191 FPSunet_mobilenet_v2
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
3 of 3

speech-to-text

Like-for-like groupBest resultModel · precision · stackGradePowerSource · dateRank in group
Whisper base · b=141.80 FPSwhisper_base_5s_no_kqs_decoder
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
5 of 5
Whisper base · b=8138 FPSwhisper_base_5s_no_kqs_decoder
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
2 of 2
Whisper tiny · b=155.20 FPSwhisper_tiny_10s_encoder
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
5 of 5
Whisper tiny · b=8136 FPSwhisper_tiny_10s_encoder
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo)
D1.50 W specHailo Model Zoo public models (Hailo-8L)
undated
2 of 2

LLM generation

◌

No published LLM generation results for Hailo-8L (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

Compare with another platform (99)

8xMI355X_2xEPYC_9575F (8x AMD Instinct MI355X 288GB HBM3e) · AMD Alveo V70 (Versal AI Core, XDNA AIE-ML) · AMD Kria KV260 Vision AI Starter Kit (K26 SOM) · AMD Ryzen AI Max+ (Strix Halo) iGPU · AMD Ryzen AI Max+ 395 / PRO 395 (Strix Halo, Radeon 8060S) · AMD Ryzen AI processor (SKU not stated) · AMD Versal AI Core VCK190 (VC1902) · AMD Versal AI Edge VEK280 (VE2802) · AMD Zynq UltraScale+ ZCU102 (ZU9EG) · AMD Zynq UltraScale+ ZCU104 (ZU7EV) · Altera Agilex 5 FPGA E-Series 065B Modular Development Kit (FPGA AI Suite, OFS PCIe) · Altera Agilex 7 FPGA I-Series Development Kit (FPGA AI Suite) · Apple M4 (10-core GPU, 120 GB/s) · Apple Mac mini M4 Pro 64GB · Cisco UCS C880A M8 (8x NVIDIA B300-SXM-270GB) · Coral Dev Board CPU (quad Cortex-A53 @1.5 GHz, CPU only) · CoreWeave GB200 NVL72 (4x NVIDIA GB200) · CoreWeave GB300 NVL72 (4x NVIDIA GB300) · Dell Pro Max with GB10 · G8825Z5 (8x AMD Instinct MI350X 288GB HBM3e) · G894-AD3-AAX7 (8x NVIDIA B300-SXM-270GB) · G894-SD3-AAX7 (8x NVIDIA B300-SXM-270GB) · G894-ZD3-AAX7 (8x NVIDIA B300-SXM-270GB) · Google Coral Dev Board (Edge TPU) · Google Coral USB Accelerator (Edge TPU) on Xeon Gold 6154 host, USB 3.0 · HPE ProLiant Compute DL380a Gen12 (10x NVIDIA RTX PRO 6000 Blackwell Server Edition) · HPE ProLiant Compute DL380a Gen12 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition) · HPE ProLiant Compute XD685 (8x AMD Instinct MI355X 288GB HBM3e) · HPE ProLiant DL385 Gen11 (4x NVIDIA RTX PRO 6000 Blackwell Server Edition) · Hailo-10H (M.2/PCIe, x86 host) · Hailo-8 (M.2/PCIe, x86 host) · Intel Arc A-Series Graphics · Intel Arc B-Series Graphics · Intel Atom X6425E · Intel Atom x7425E · Intel Celeron 6305E · Intel Core 5 330 · Intel Core Ultra 7 155H · Intel Core Ultra 7 155H (Meteor Lake) · Intel Core Ultra 7 255H · Intel Core Ultra 7 258V (Lunar Lake) · Intel Core Ultra 7 265H · Intel Core Ultra 7 368H · Intel Core Ultra 9 288V · Intel Core Ultra X7 358H (Panther Lake) · Intel Core i5-1235U · Intel Core i5-1335U · Intel Core i5-13600K · Intel Core i7-1185G7 · Intel Core i7-1185GRE · Intel Core i7-12700H · Intel Core i7-1355U · Intel Data Center GPU Flex 170 · Intel N100 · Intel Xeon Gold 5218T · Intel Xeon Gold 6154 desktop (CPU only, TFLite) · Intel Xeon Gold 6338N · Intel Xeon Platinum 6972P · Intel Xeon Platinum 8280 · Intel Xeon Platinum 8380 · Intel Xeon Platinum 8480+ · Intel Xeon Platinum 8580 · Lattice Avant-E Evaluation Board (sensAI) · Lattice CertusPro-NX Voice and Vision ML Board (sensAI) · Lattice CrossLink-NX-33 Voice and Vision ML Board (sensAI) · Lattice iCE40 UltraPlus Mobile Development Platform (sensAI) · Microchip PolarFire SoC Video Kit (VectorBlox CoreVectorBlox) · NVIDIA DGX B200 (8x NVIDIA B200-SXM-180GB) · NVIDIA DGX B300 (8x NVIDIA B300-SXM-270GB) · NVIDIA DGX Spark · NVIDIA GB200 NVL72 (4x NVIDIA GB200) · NVIDIA GB300 NVL72 (4x NVIDIA GB300) · NVIDIA Jetson AGX Orin 64GB · NVIDIA Jetson AGX Thor · NVIDIA Jetson Orin NX 16GB · NVIDIA Jetson Orin Nano Super · NVIDIA Jetson Thor T4000 · Nebius B300 n1 (8x NVIDIA B300-SXM-270GB) · Nebius GB300 NVL72 (4x NVIDIA GB300) · Qualcomm Dragonwing IQ-9075 EVK · Qualcomm Dragonwing RB3 Gen 2 (QCS6490) · Qualcomm Snapdragon X Elite (CRD) · Qualcomm Snapdragon X2 Elite (CRD) · QuantaGrid D75H-10U (8x NVIDIA B300-SXM-270GB) · Raspberry Pi 5 (CPU only) · Raspberry Pi 5 + AI HAT+ (Hailo-8) · Rockchip RK1808 (NPU) · Rockchip RK3562 (NPU) · Rockchip RK3566/RK3568 (NPU) · Rockchip RK3576 (NPU, single core of 2) · Rockchip RK3588 (NPU, single core of 3) · Rockchip RV1109 (NPU) · Rockchip RV1126 (NPU) · Rockchip RV1126B (NPU) · TI AM68A (8 TOPS) · TRIGKEY Mini PC (AMD Ryzen 5 5560U, CPU) · Terasic DE10-Agilex Development Board (Agilex 7, FPGA AI Suite) · XA NB3I-E12 (8x NVIDIA B300-SXM-270GB) · XE7745_8xMI350P_2xEPYC_9455 (8x AMD Instinct MI350P)

How to read these numbers
Every number is labelled. Confidence: A MLPerf closed, audited · B documented third-party method · C community / review · D vendor-published, not independently verified · E estimate. Power basis: measured with the result · spec vendor spec/envelope · power n/a not published.

Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.