HWBench

Hailo-8L (M.2/PCIe, x86 host) vs NVIDIA Jetson AGX Orin 64GB

Hailo-8L M.2 module from the Raspberry Pi AI Kit, mounted on the Raspberry Pi M.2 HAT+
Hailo-8L M.2 AI accelerator module (from the Raspberry Pi AI Kit). Photo: SparkFun Electronics, CC BY 2.0, via Wikimedia Commons.
NVIDIA Jetson AGX Orin developer kit with its retail box, on a black background
NVIDIA Jetson AGX Orin developer kit. Photo: Auledas, CC BY 4.0, via Wikimedia Commons.
Showing the newest results per platform and source. 12 superseded older results are hidden.Showing all results, including 12 superseded by newer results from the same source.

Split result: Hailo-8L (M.2/PCIe, x86 host) is faster in 1 and NVIDIA Jetson AGX Orin 64GB in 1 of 2 like-for-like comparisons.

Hailo-8L (M.2/PCIe, x86 host)NVIDIA Jetson AGX Orin 64GB
Best object detection437 FPS D
2026-10-15 (page last edited)		435 FPS B
2026-10-13 (page last edited)
Power1.50 W spec65.00 W spec
Perf / W291 FPS/W spec6.69 FPS/W spec
Pricen/a$3499 list
Workloads with data6 of 73 of 7

Best published object detection result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

✓ Like-for-like: model-size class nano (YOLO-n), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB435 FPS
inference_time · b=1		YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)		B65.00 W spec
platform spec envelope (not measured with this result)		Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)
Hailo-8L (M.2/PCIe, x86 host)201 FPS
throughput · b=1		yolov8n
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · nano (YOLO-n)		D1.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)
✓ Like-for-like: model-size class small (YOLO-s), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)137 FPS
throughput · b=1		yolov5s_wo_spp
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · small (YOLO-s)		D1.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)
NVIDIA Jetson AGX Orin 64GB80.90 FPS
throughput · b=1		YOLO11s (640x640)
INT8 · TensorRT (ONNX export) · small (YOLO-s)		C65.00 W spec
platform spec envelope (not measured with this result)		arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

instance segmentation

Only Hailo-8L (M.2/PCIe, x86 host) has published instance segmentation results.

PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)52.90 FPS
throughput · b=1		yolov5m_seg
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · medium (YOLO-m)		D1.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)

NVIDIA Jetson AGX Orin 64GB:

◌

No published instance segmentation results for NVIDIA Jetson AGX Orin 64GB or Hailo-8L (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

Only Hailo-8L (M.2/PCIe, x86 host) has published pose estimation results.

PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)795 FPS
throughput · b=1		mspn_regnetx_800mf
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · mid-size CNN		D1.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)

NVIDIA Jetson AGX Orin 64GB:

◌

No published pose estimation results for NVIDIA Jetson AGX Orin 64GB or Hailo-8L (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

Only Hailo-8L (M.2/PCIe, x86 host) has published image classification results.

PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)1738 FPS
throughput · b=1		mobilenet_v2_1.0
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · mobile-class CNN		D1.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)

NVIDIA Jetson AGX Orin 64GB:

◌

No published image classification results for NVIDIA Jetson AGX Orin 64GB or Hailo-8L (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

semantic segmentation

⚠ MIXED COMPARISON — not like-for-like. Baseline mid-size CNN at batch 1. Differs: model-size class unknown vs mid-size CNN.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)19.60 FPS
throughput · b=1		fcn8_resnet_v1_18
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · mid-size CNN		D1.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)
NVIDIA Jetson AGX Orin 64GB
MIXED: model-size class unknown vs mid-size CNN		104 FPS
throughput · b=1		SegFormer-B0 (640x640)
FP16 · TensorRT (ONNX export) · unknown		C65.00 W spec
platform spec envelope (not measured with this result)		arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

No shared like-for-like group exists for this pair.

speech-to-text

Only Hailo-8L (M.2/PCIe, x86 host) has published speech-to-text results.

PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)41.80 FPS
throughput · b=1		whisper_base_5s_no_kqs_decoder
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · Whisper base		D1.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)

NVIDIA Jetson AGX Orin 64GB:

◌

No published speech-to-text results for NVIDIA Jetson AGX Orin 64GB or Hailo-8L (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

Only NVIDIA Jetson AGX Orin 64GB has published LLM generation results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB30.00 tok/s
generation_throughput · b=1		Qwen 3 8B
W4A16 · vLLM · LLM 5–14B		C65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)

Hailo-8L (M.2/PCIe, x86 host):

◌

No published LLM generation results for Hailo-8L (M.2/PCIe, x86 host) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

Split result: Hailo-8L (M.2/PCIe, x86 host) is faster in 1 and NVIDIA Jetson AGX Orin 64GB in 1 of 2 like-for-like comparisons.

Hailo-8L (M.2/PCIe, x86 host)NVIDIA Jetson AGX Orin 64GB
Best object detection437 FPS D
2026-10-15 (page last edited)		435 FPS B
2026-10-13 (page last edited)
Power1.50 W spec65.00 W spec
Perf / W291 FPS/W spec6.69 FPS/W spec
Pricen/a$3499 list
Workloads with data6 of 75 of 7

Best published object detection result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

✓ Like-for-like: model-size class nano (YOLO-n), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB435 FPS
inference_time · b=1		YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)		B65.00 W spec
platform spec envelope (not measured with this result)		Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)
Hailo-8L (M.2/PCIe, x86 host)201 FPS
throughput · b=1		yolov8n
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · nano (YOLO-n)		D1.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)
✓ Like-for-like: model-size class small (YOLO-s), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)137 FPS
throughput · b=1		yolov5s_wo_spp
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · small (YOLO-s)		D1.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)
NVIDIA Jetson AGX Orin 64GB80.90 FPS
throughput · b=1		YOLO11s (640x640)
INT8 · TensorRT (ONNX export) · small (YOLO-s)		C65.00 W spec
platform spec envelope (not measured with this result)		arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

instance segmentation

Only Hailo-8L (M.2/PCIe, x86 host) has published instance segmentation results.

PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)52.90 FPS
throughput · b=1		yolov5m_seg
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · medium (YOLO-m)		D1.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)

NVIDIA Jetson AGX Orin 64GB:

◌

No published instance segmentation results for NVIDIA Jetson AGX Orin 64GB or Hailo-8L (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

Only Hailo-8L (M.2/PCIe, x86 host) has published pose estimation results.

PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)795 FPS
throughput · b=1		mspn_regnetx_800mf
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · mid-size CNN		D1.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)

NVIDIA Jetson AGX Orin 64GB:

◌

No published pose estimation results for NVIDIA Jetson AGX Orin 64GB or Hailo-8L (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

⚠ MIXED COMPARISON — not like-for-like. Baseline mobile-class CNN at batch 1. Differs: model-size class mid-size CNN vs mobile-class CNN; batch unknown vs 1.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)1738 FPS
throughput · b=1		mobilenet_v2_1.0
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · mobile-class CNN		D1.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)
NVIDIA Jetson AGX Orin 64GB
MIXED: model-size class mid-size CNN vs mobile-class CNN; batch unknown vs 1		6424 FPS
throughput_offline · b=unknown		MLPerf ResNet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN		D65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

No shared like-for-like group exists for this pair.

semantic segmentation

⚠ MIXED COMPARISON — not like-for-like. Baseline mid-size CNN at batch 1. Differs: model-size class unknown vs mid-size CNN.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)19.60 FPS
throughput · b=1		fcn8_resnet_v1_18
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · mid-size CNN		D1.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)
NVIDIA Jetson AGX Orin 64GB
MIXED: model-size class unknown vs mid-size CNN		104 FPS
throughput · b=1		SegFormer-B0 (640x640)
FP16 · TensorRT (ONNX export) · unknown		C65.00 W spec
platform spec envelope (not measured with this result)		arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

No shared like-for-like group exists for this pair.

speech-to-text

⚠ MIXED COMPARISON — not like-for-like. Baseline Whisper base at batch 1. Differs: model-size class RNN-T vs Whisper base; batch unknown vs 1.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8L (M.2/PCIe, x86 host)41.80 FPS
throughput · b=1		whisper_base_5s_no_kqs_decoder
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · Whisper base		D1.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8L)
2026-10-15 (page last edited)
NVIDIA Jetson AGX Orin 64GB
MIXED: model-size class RNN-T vs Whisper base; batch unknown vs 1		1170 FPS
throughput_offline · b=unknown		MLPerf RNN-T
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · RNN-T		D65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

No shared like-for-like group exists for this pair.

LLM generation

Only NVIDIA Jetson AGX Orin 64GB has published LLM generation results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB30.00 tok/s
generation_throughput · b=1		Qwen 3 8B
W4A16 · vLLM · LLM 5–14B		C65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)

Hailo-8L (M.2/PCIe, x86 host):

◌

No published LLM generation results for Hailo-8L (M.2/PCIe, x86 host) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

How to read these numbers
Every number is labelled. Confidence: A MLPerf closed, audited · B documented third-party method · C community / review · D vendor-published, not independently verified · E estimate. Power basis: measured with the result · spec vendor spec/envelope · power n/a not published.

Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.