HWBench

Hailo-8 (M.2/PCIe, x86 host) vs NVIDIA Jetson AGX Orin 64GB

NVIDIA Jetson AGX Orin developer kit with its retail box, on a black background
NVIDIA Jetson AGX Orin developer kit. Photo: Auledas, CC BY 4.0, via Wikimedia Commons.
Showing the newest results per platform and source. 12 superseded older results are hidden.Showing all results, including 12 superseded by newer results from the same source.

Hailo-8 (M.2/PCIe, x86 host) is faster in all 2 like-for-like comparisons (largest gap: object detection, 7.82×).

Hailo-8 (M.2/PCIe, x86 host)NVIDIA Jetson AGX Orin 64GB
Best object detection1036 FPS D
2026-10-15 (page last edited)		435 FPS B
2026-10-13 (page last edited)
Power2.50 W spec65.00 W spec
Perf / W414 FPS/W spec6.69 FPS/W spec
Pricen/a$3499 list
Workloads with data6 of 73 of 7

Best published object detection result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

✓ Like-for-like: model-size class nano (YOLO-n), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8 (M.2/PCIe, x86 host)1036 FPS
throughput · b=1		yolov8n
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · nano (YOLO-n)		D2.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8)
2026-10-15 (page last edited)
NVIDIA Jetson AGX Orin 64GB435 FPS
inference_time · b=1		YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)		B65.00 W spec
platform spec envelope (not measured with this result)		Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)
✓ Like-for-like: model-size class small (YOLO-s), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8 (M.2/PCIe, x86 host)633 FPS
throughput · b=1		yolov5s_wo_spp
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · small (YOLO-s)		D2.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8)
2026-10-15 (page last edited)
NVIDIA Jetson AGX Orin 64GB80.90 FPS
throughput · b=1		YOLO11s (640x640)
INT8 · TensorRT (ONNX export) · small (YOLO-s)		C65.00 W spec
platform spec envelope (not measured with this result)		arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

instance segmentation

Only Hailo-8 (M.2/PCIe, x86 host) has published instance segmentation results.

PlatformResultModel · precision · stackGradePowerSource
Hailo-8 (M.2/PCIe, x86 host)68.70 FPS
throughput · b=1		yolov5m_seg
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · medium (YOLO-m)		D2.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8)
2026-10-15 (page last edited)

NVIDIA Jetson AGX Orin 64GB:

◌

No published instance segmentation results for NVIDIA Jetson AGX Orin 64GB or Hailo-8 (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

Only Hailo-8 (M.2/PCIe, x86 host) has published pose estimation results.

PlatformResultModel · precision · stackGradePowerSource
Hailo-8 (M.2/PCIe, x86 host)2126 FPS
throughput · b=1		mspn_regnetx_800mf
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · mid-size CNN		D2.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8)
2026-10-15 (page last edited)

NVIDIA Jetson AGX Orin 64GB:

◌

No published pose estimation results for NVIDIA Jetson AGX Orin 64GB or Hailo-8 (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

Only Hailo-8 (M.2/PCIe, x86 host) has published image classification results.

PlatformResultModel · precision · stackGradePowerSource
Hailo-8 (M.2/PCIe, x86 host)2597 FPS
throughput · b=1		mobilenet_v2_1.0
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · mobile-class CNN		D2.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8)
2026-10-15 (page last edited)

NVIDIA Jetson AGX Orin 64GB:

◌

No published image classification results for NVIDIA Jetson AGX Orin 64GB or Hailo-8 (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

semantic segmentation

⚠ MIXED COMPARISON — not like-for-like. Baseline mid-size CNN at batch 1. Differs: model-size class unknown vs mid-size CNN.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8 (M.2/PCIe, x86 host)42.60 FPS
throughput · b=1		fcn8_resnet_v1_18
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · mid-size CNN		D2.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8)
2026-10-15 (page last edited)
NVIDIA Jetson AGX Orin 64GB
MIXED: model-size class unknown vs mid-size CNN		104 FPS
throughput · b=1		SegFormer-B0 (640x640)
FP16 · TensorRT (ONNX export) · unknown		C65.00 W spec
platform spec envelope (not measured with this result)		arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

No shared like-for-like group exists for this pair.

speech-to-text

Only Hailo-8 (M.2/PCIe, x86 host) has published speech-to-text results.

PlatformResultModel · precision · stackGradePowerSource
Hailo-8 (M.2/PCIe, x86 host)51.40 FPS
throughput · b=1		whisper_base_5s_encoder
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · Whisper base		D2.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8)
2026-10-15 (page last edited)

NVIDIA Jetson AGX Orin 64GB:

◌

No published speech-to-text results for NVIDIA Jetson AGX Orin 64GB or Hailo-8 (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

Only NVIDIA Jetson AGX Orin 64GB has published LLM generation results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB30.00 tok/s
generation_throughput · b=1		Qwen 3 8B
W4A16 · vLLM · LLM 5–14B		C65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)

Hailo-8 (M.2/PCIe, x86 host):

◌

No published LLM generation results for Hailo-8 (M.2/PCIe, x86 host) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

Hailo-8 (M.2/PCIe, x86 host) is faster in all 2 like-for-like comparisons (largest gap: object detection, 7.82×).

Hailo-8 (M.2/PCIe, x86 host)NVIDIA Jetson AGX Orin 64GB
Best object detection1036 FPS D
2026-10-15 (page last edited)		435 FPS B
2026-10-13 (page last edited)
Power2.50 W spec65.00 W spec
Perf / W414 FPS/W spec6.69 FPS/W spec
Pricen/a$3499 list
Workloads with data6 of 75 of 7

Best published object detection result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

✓ Like-for-like: model-size class nano (YOLO-n), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8 (M.2/PCIe, x86 host)1036 FPS
throughput · b=1		yolov8n
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · nano (YOLO-n)		D2.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8)
2026-10-15 (page last edited)
NVIDIA Jetson AGX Orin 64GB435 FPS
inference_time · b=1		YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)		B65.00 W spec
platform spec envelope (not measured with this result)		Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)
✓ Like-for-like: model-size class small (YOLO-s), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8 (M.2/PCIe, x86 host)633 FPS
throughput · b=1		yolov5s_wo_spp
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · small (YOLO-s)		D2.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8)
2026-10-15 (page last edited)
NVIDIA Jetson AGX Orin 64GB80.90 FPS
throughput · b=1		YOLO11s (640x640)
INT8 · TensorRT (ONNX export) · small (YOLO-s)		C65.00 W spec
platform spec envelope (not measured with this result)		arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

instance segmentation

Only Hailo-8 (M.2/PCIe, x86 host) has published instance segmentation results.

PlatformResultModel · precision · stackGradePowerSource
Hailo-8 (M.2/PCIe, x86 host)68.70 FPS
throughput · b=1		yolov5m_seg
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · medium (YOLO-m)		D2.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8)
2026-10-15 (page last edited)

NVIDIA Jetson AGX Orin 64GB:

◌

No published instance segmentation results for NVIDIA Jetson AGX Orin 64GB or Hailo-8 (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

Only Hailo-8 (M.2/PCIe, x86 host) has published pose estimation results.

PlatformResultModel · precision · stackGradePowerSource
Hailo-8 (M.2/PCIe, x86 host)2126 FPS
throughput · b=1		mspn_regnetx_800mf
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · mid-size CNN		D2.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8)
2026-10-15 (page last edited)

NVIDIA Jetson AGX Orin 64GB:

◌

No published pose estimation results for NVIDIA Jetson AGX Orin 64GB or Hailo-8 (M.2/PCIe, x86 host) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

⚠ MIXED COMPARISON — not like-for-like. Baseline mobile-class CNN at batch 1. Differs: model-size class mid-size CNN vs mobile-class CNN; batch unknown vs 1.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8 (M.2/PCIe, x86 host)2597 FPS
throughput · b=1		mobilenet_v2_1.0
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · mobile-class CNN		D2.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8)
2026-10-15 (page last edited)
NVIDIA Jetson AGX Orin 64GB
MIXED: model-size class mid-size CNN vs mobile-class CNN; batch unknown vs 1		6424 FPS
throughput_offline · b=unknown		MLPerf ResNet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN		D65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

No shared like-for-like group exists for this pair.

semantic segmentation

⚠ MIXED COMPARISON — not like-for-like. Baseline mid-size CNN at batch 1. Differs: model-size class unknown vs mid-size CNN.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8 (M.2/PCIe, x86 host)42.60 FPS
throughput · b=1		fcn8_resnet_v1_18
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · mid-size CNN		D2.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8)
2026-10-15 (page last edited)
NVIDIA Jetson AGX Orin 64GB
MIXED: model-size class unknown vs mid-size CNN		104 FPS
throughput · b=1		SegFormer-B0 (640x640)
FP16 · TensorRT (ONNX export) · unknown		C65.00 W spec
platform spec envelope (not measured with this result)		arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

No shared like-for-like group exists for this pair.

speech-to-text

⚠ MIXED COMPARISON — not like-for-like. Baseline Whisper base at batch 1. Differs: model-size class RNN-T vs Whisper base; batch unknown vs 1.
PlatformResultModel · precision · stackGradePowerSource
Hailo-8 (M.2/PCIe, x86 host)51.40 FPS
throughput · b=1		whisper_base_5s_encoder
INT8 (Hailo quantized) · Hailo DFC v2.20.0 / HailoRT (model zoo) · Whisper base		D2.50 W spec
reported in result source — spec		Hailo Model Zoo public models (Hailo-8)
2026-10-15 (page last edited)
NVIDIA Jetson AGX Orin 64GB
MIXED: model-size class RNN-T vs Whisper base; batch unknown vs 1		1170 FPS
throughput_offline · b=unknown		MLPerf RNN-T
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · RNN-T		D65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

No shared like-for-like group exists for this pair.

LLM generation

Only NVIDIA Jetson AGX Orin 64GB has published LLM generation results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB30.00 tok/s
generation_throughput · b=1		Qwen 3 8B
W4A16 · vLLM · LLM 5–14B		C65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)

Hailo-8 (M.2/PCIe, x86 host):

◌

No published LLM generation results for Hailo-8 (M.2/PCIe, x86 host) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

How to read these numbers
Every number is labelled. Confidence: A MLPerf closed, audited · B documented third-party method · C community / review · D vendor-published, not independently verified · E estimate. Power basis: measured with the result · spec vendor spec/envelope · power n/a not published.

Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.