HWBench

Hailo-8L (M.2/PCIe, x86 host) vs NVIDIA Jetson Orin NX 16GB

Hailo-8L M.2 module from the Raspberry Pi AI Kit, mounted on the Raspberry Pi M.2 HAT+
Hailo-8L M.2 AI accelerator module (from the Raspberry Pi AI Kit). Photo: SparkFun Electronics, CC BY 2.0, via Wikimedia Commons.
NVIDIA Jetson Orin NX module seated on a carrier motherboard, close-up at Computex 2025
NVIDIA Jetson Orin NX module on a carrier board. Photo: 4300streetcar, CC BY 4.0, via Wikimedia Commons.

NVIDIA Jetson Orin NX 16GB is faster in the only like-for-like comparison (largest gap: object detection, 1.43×).

Hailo-8L (M.2/PCIe, x86 host)NVIDIA Jetson Orin NX 16GB
Best object detection437 FPS D
2026-10-15 (page last edited)
287 FPS B
2026-10-13 (page last edited)
Power1.50 W specn/a
Perf / W291 FPS/W specn/a
Pricen/an/a
Workloads with data6 of 74 of 7

Best published object detection result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

✓ Like-for-like: model-size class nano (YOLO-n), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB287 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
Bunknown power n/a
no power published
Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)
Hailo-8L (M.2/PCIe, x86 host)201 FPS
throughput · b=1
yolov8n
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · nano (YOLO-n)
D1.50 W spec
reported in result source — spec
Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)

instance segmentation

Only Hailo-8L (M.2/PCIe, x86 host) has published instance segmentation results.

PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)52.90 FPS
throughput · b=1
yolov5m_seg
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · medium (YOLO-m)
D1.50 W spec
reported in result source — spec
Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)

NVIDIA Jetson Orin NX 16GB:

◌

No published instance segmentation results for NVIDIA Jetson Orin NX 16GB or Hailo-8L (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

Only Hailo-8L (M.2/PCIe, x86 host) has published pose estimation results.

PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)795 FPS
throughput · b=1
mspn_regnetx_800mf
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · mid-size CNN
D1.50 W spec
reported in result source — spec
Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)

NVIDIA Jetson Orin NX 16GB:

◌

No published pose estimation results for NVIDIA Jetson Orin NX 16GB or Hailo-8L (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

⚠ MIXED COMPARISON — not like-for-like. Baseline mobile-class CNN at batch 1. Differs: model-size class mid-size CNN vs mobile-class CNN; batch unknown vs 1.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)1738 FPS
throughput · b=1
mobilenet_v2_1.0
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · mobile-class CNN
D1.50 W spec
reported in result source — spec
Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)
NVIDIA Jetson Orin NX 16GB
MIXED: model-size class mid-size CNN vs mobile-class CNN; batch unknown vs 1
2641 FPS
throughput_offline · b=unknown
MLPerf ResNet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN
Dunknown power n/a
no power published
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

No shared like-for-like group exists for this pair.

semantic segmentation

Only Hailo-8L (M.2/PCIe, x86 host) has published semantic segmentation results.

PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)19.60 FPS
throughput · b=1
fcn8_resnet_v1_18
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · mid-size CNN
D1.50 W spec
reported in result source — spec
Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)

NVIDIA Jetson Orin NX 16GB:

◌

No published semantic segmentation results for NVIDIA Jetson Orin NX 16GB or Hailo-8L (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

⚠ MIXED COMPARISON — not like-for-like. Baseline Whisper base at batch 1. Differs: model-size class RNN-T vs Whisper base; batch unknown vs 1.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)41.80 FPS
throughput · b=1
whisper_base_5s_no_kqs_decoder
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · Whisper base
D1.50 W spec
reported in result source — spec
Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)
NVIDIA Jetson Orin NX 16GB
MIXED: model-size class RNN-T vs Whisper base; batch unknown vs 1
432 FPS
throughput_offline · b=unknown
MLPerf RNN-T
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · RNN-T
Dunknown power n/a
no power published
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

No shared like-for-like group exists for this pair.

LLM generation

Only NVIDIA Jetson Orin NX 16GB has published LLM generation results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB11.00 tok/s
generation_throughput · b=1
Nemotron Nano 9B V2
W4A16 · vLLM · LLM 5–14B
Cunknown power n/a
no power published
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)

Hailo-8L (M.2/PCIe, x86 host):

◌

No published LLM generation results for Hailo-8L (M.2/PCIe, x86 host) or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

How to read these numbers
Every number is labelled. Confidence: A MLPerf closed, audited · B documented third-party method · C community / review · D vendor-published, not independently verified · E estimate. Power basis: measured with the result · spec vendor spec/envelope · power n/a not published.

Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.