HWBench

NVIDIA Jetson AGX Orin 64GB vs Raspberry Pi 5 (CPU only)

NVIDIA Jetson AGX Orin developer kit with its retail box, on a black background
NVIDIA Jetson AGX Orin developer kit. Photo: Auledas, CC BY 4.0, via Wikimedia Commons.
Raspberry Pi 5 single-board computer, top view, showing the Broadcom SoC, RAM, USB and Ethernet ports
Raspberry Pi 5. Photo: SimonWaldherr, CC BY 4.0, via Wikimedia Commons.
Showing the newest results per platform and source. 12 superseded older results are hidden.Showing all results, including 12 superseded by newer results from the same source.

NVIDIA Jetson AGX Orin 64GB is faster in all 3 like-for-like comparisons (largest gap: object detection, 29.14×).

NVIDIA Jetson AGX Orin 64GBRaspberry Pi 5 (CPU only)
Best object detection435 FPS B
2026-10-13 (page last edited)
14.92 FPS B
2026-10-03 (page last edited)
Power65.00 W specn/a
Perf / W6.69 FPS/W specn/a
Price$3499 listn/a
Workloads with data3 of 74 of 7

Best published object detection result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

✓ Like-for-like: model-size class nano (YOLO-n), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB435 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
B65.00 W spec
platform spec envelope (not measured with this result)
Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)
Raspberry Pi 5 (CPU only) CPU-only14.92 FPS
inference_time · b=1
YOLO26n
FP32/default · Ultralytics NCNN · nano (YOLO-n)
Bunknown power n/a
no power published
Ultralytics documentation (benchmark table)
2026-10-03 (page last edited)

instance segmentation

◌

No published instance segmentation results for NVIDIA Jetson AGX Orin 64GB or Raspberry Pi 5 (CPU only) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for NVIDIA Jetson AGX Orin 64GB or Raspberry Pi 5 (CPU only) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

Only Raspberry Pi 5 (CPU only) has published image classification results.

PlatformResultModel · precision · stackGradePowerSource
Raspberry Pi 5 (CPU only) CPU-only29.59 FPS
inference_time · b=1
YOLO26n-cls
FP32 · Ultralytics PyTorch (CPU) · nano (YOLO-n)
Bunknown power n/a
no power published
Ultralytics documentation: Hailo integration benchmark
2026-10-11 (page last edited)

NVIDIA Jetson AGX Orin 64GB:

◌

No published image classification results for NVIDIA Jetson AGX Orin 64GB or Raspberry Pi 5 (CPU only) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

semantic segmentation

⚠ MIXED COMPARISON — not like-for-like. Baseline nano (YOLO-n) at batch 1. Differs: model-size class unknown vs nano (YOLO-n).
PlatformResultModel · precision · stackGradePowerSource
Raspberry Pi 5 (CPU only) CPU-only1.20 FPS
inference_time · b=1
YOLO26n-sem
FP32 · Ultralytics PyTorch (CPU) · nano (YOLO-n)
Bunknown power n/a
no power published
Ultralytics documentation: Hailo integration benchmark
2026-10-11 (page last edited)
NVIDIA Jetson AGX Orin 64GB
MIXED: model-size class unknown vs nano (YOLO-n)
104 FPS
throughput · b=1
SegFormer-B0 (640x640)
FP16 · TensorRT (ONNX export) · unknown
C65.00 W spec
platform spec envelope (not measured with this result)
arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

No shared like-for-like group exists for this pair.

speech-to-text

◌

No published speech-to-text results for NVIDIA Jetson AGX Orin 64GB or Raspberry Pi 5 (CPU only) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

✓ Like-for-like: model-size class LLM 5–14B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB30.00 tok/s
generation_throughput · b=1
Qwen 3 8B
W4A16 · vLLM · LLM 5–14B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
Raspberry Pi 5 (CPU only) CPU-only1.20 tok/s
generation_throughput · b=1
DeepSeek R1 14b
as in linked issue (Ollama default tags are 4-bit) · Ollama / llama.cpp (see linked issue) · LLM 5–14B
C13.00 W measured
reported in result source — measured
Jeff Geerling ai-benchmarks README (Findings tables)
2026-09-22 (page last edited)
✓ Like-for-like: model-size class LLM ≤4B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB60.00 tok/s
generation_throughput · b=1
Qwen3-VL-2B
W4A16 · vLLM · LLM ≤4B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
Raspberry Pi 5 (CPU only) CPU-only4.88 tok/s
generation_throughput · b=1
Llama 3.2:3b
as in linked issue (Ollama default tags are 4-bit) · Ollama / llama.cpp (see linked issue) · LLM ≤4B
C11.90 W measured
reported in result source — measured
Jeff Geerling ai-benchmarks README (Findings tables)
2026-09-22 (page last edited)

NVIDIA Jetson AGX Orin 64GB is faster in all 3 like-for-like comparisons (largest gap: object detection, 29.14×).

NVIDIA Jetson AGX Orin 64GBRaspberry Pi 5 (CPU only)
Best object detection435 FPS B
2026-10-13 (page last edited)
14.92 FPS B
2026-10-03 (page last edited)
Power65.00 W specn/a
Perf / W6.69 FPS/W specn/a
Price$3499 listn/a
Workloads with data5 of 74 of 7

Best published object detection result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

✓ Like-for-like: model-size class nano (YOLO-n), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB435 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
B65.00 W spec
platform spec envelope (not measured with this result)
Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)
Raspberry Pi 5 (CPU only) CPU-only14.92 FPS
inference_time · b=1
YOLO26n
FP32/default · Ultralytics NCNN · nano (YOLO-n)
Bunknown power n/a
no power published
Ultralytics documentation (benchmark table)
2026-10-03 (page last edited)

instance segmentation

◌

No published instance segmentation results for NVIDIA Jetson AGX Orin 64GB or Raspberry Pi 5 (CPU only) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for NVIDIA Jetson AGX Orin 64GB or Raspberry Pi 5 (CPU only) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

⚠ MIXED COMPARISON — not like-for-like. Baseline nano (YOLO-n) at batch 1. Differs: model-size class mid-size CNN vs nano (YOLO-n); batch unknown vs 1.
PlatformResultModel · precision · stackGradePowerSource
Raspberry Pi 5 (CPU only) CPU-only29.59 FPS
inference_time · b=1
YOLO26n-cls
FP32 · Ultralytics PyTorch (CPU) · nano (YOLO-n)
Bunknown power n/a
no power published
Ultralytics documentation: Hailo integration benchmark
2026-10-11 (page last edited)
NVIDIA Jetson AGX Orin 64GB
MIXED: model-size class mid-size CNN vs nano (YOLO-n); batch unknown vs 1
6424 FPS
throughput_offline · b=unknown
MLPerf ResNet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN
D65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

No shared like-for-like group exists for this pair.

semantic segmentation

⚠ MIXED COMPARISON — not like-for-like. Baseline nano (YOLO-n) at batch 1. Differs: model-size class unknown vs nano (YOLO-n).
PlatformResultModel · precision · stackGradePowerSource
Raspberry Pi 5 (CPU only) CPU-only1.20 FPS
inference_time · b=1
YOLO26n-sem
FP32 · Ultralytics PyTorch (CPU) · nano (YOLO-n)
Bunknown power n/a
no power published
Ultralytics documentation: Hailo integration benchmark
2026-10-11 (page last edited)
NVIDIA Jetson AGX Orin 64GB
MIXED: model-size class unknown vs nano (YOLO-n)
104 FPS
throughput · b=1
SegFormer-B0 (640x640)
FP16 · TensorRT (ONNX export) · unknown
C65.00 W spec
platform spec envelope (not measured with this result)
arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

No shared like-for-like group exists for this pair.

speech-to-text

Only NVIDIA Jetson AGX Orin 64GB has published speech-to-text results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB1170 FPS
throughput_offline · b=unknown
MLPerf RNN-T
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · RNN-T
D65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

Raspberry Pi 5 (CPU only):

◌

No published speech-to-text results for Raspberry Pi 5 (CPU only) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

✓ Like-for-like: model-size class LLM 5–14B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB30.00 tok/s
generation_throughput · b=1
Qwen 3 8B
W4A16 · vLLM · LLM 5–14B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
Raspberry Pi 5 (CPU only) CPU-only1.20 tok/s
generation_throughput · b=1
DeepSeek R1 14b
as in linked issue (Ollama default tags are 4-bit) · Ollama / llama.cpp (see linked issue) · LLM 5–14B
C13.00 W measured
reported in result source — measured
Jeff Geerling ai-benchmarks README (Findings tables)
2026-09-22 (page last edited)
✓ Like-for-like: model-size class LLM ≤4B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB60.00 tok/s
generation_throughput · b=1
Qwen3-VL-2B
W4A16 · vLLM · LLM ≤4B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
Raspberry Pi 5 (CPU only) CPU-only4.88 tok/s
generation_throughput · b=1
Llama 3.2:3b
as in linked issue (Ollama default tags are 4-bit) · Ollama / llama.cpp (see linked issue) · LLM ≤4B
C11.90 W measured
reported in result source — measured
Jeff Geerling ai-benchmarks README (Findings tables)
2026-09-22 (page last edited)
How to read these numbers
Every number is labelled. Confidence: A MLPerf closed, audited · B documented third-party method · C community / review · D vendor-published, not independently verified · E estimate. Power basis: measured with the result · spec vendor spec/envelope · power n/a not published.

Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.