HWBench

NVIDIA Jetson Orin NX 16GB vs Raspberry Pi 5 (CPU only)

NVIDIA Jetson Orin NX module seated on a carrier motherboard, close-up at Computex 2025
NVIDIA Jetson Orin NX module on a carrier board. Photo: 4300streetcar, CC BY 4.0, via Wikimedia Commons.
Raspberry Pi 5 single-board computer, top view, showing the Broadcom SoC, RAM, USB and Ethernet ports
Raspberry Pi 5. Photo: SimonWaldherr, CC BY 4.0, via Wikimedia Commons.

NVIDIA Jetson Orin NX 16GB is faster in all 3 like-for-like comparisons (largest gap: object detection, 19.20×).

NVIDIA Jetson Orin NX 16GBRaspberry Pi 5 (CPU only)
Best object detection287 FPS B
2026-10-13 (page last edited)
14.92 FPS B
2026-10-03 (page last edited)
Powern/an/a
Perf / Wn/an/a
Pricen/an/a
Workloads with data4 of 74 of 7

Best published object detection result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

✓ Like-for-like: model-size class nano (YOLO-n), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB287 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
Bunknown power n/a
no power published
Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)
Raspberry Pi 5 (CPU only) CPU-only14.92 FPS
inference_time · b=1
YOLO26n
FP32/default · Ultralytics NCNN · nano (YOLO-n)
Bunknown power n/a
no power published
Ultralytics documentation (benchmark table)
2026-10-03 (page last edited)

instance segmentation

◌

No published instance segmentation results for NVIDIA Jetson Orin NX 16GB or Raspberry Pi 5 (CPU only) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for NVIDIA Jetson Orin NX 16GB or Raspberry Pi 5 (CPU only) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

⚠ MIXED COMPARISON — not like-for-like. Baseline nano (YOLO-n) at batch 1. Differs: model-size class mid-size CNN vs nano (YOLO-n); batch unknown vs 1.
PlatformResultModel · precision · stackGradePowerSource
Raspberry Pi 5 (CPU only) CPU-only29.59 FPS
inference_time · b=1
YOLO26n-cls
FP32 · Ultralytics PyTorch (CPU) · nano (YOLO-n)
Bunknown power n/a
no power published
Ultralytics documentation: Hailo integration benchmark
2026-10-11 (page last edited)
NVIDIA Jetson Orin NX 16GB
MIXED: model-size class mid-size CNN vs nano (YOLO-n); batch unknown vs 1
2641 FPS
throughput_offline · b=unknown
MLPerf ResNet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN
Dunknown power n/a
no power published
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

No shared like-for-like group exists for this pair.

semantic segmentation

Only Raspberry Pi 5 (CPU only) has published semantic segmentation results.

PlatformResultModel · precision · stackGradePowerSource
Raspberry Pi 5 (CPU only) CPU-only1.20 FPS
inference_time · b=1
YOLO26n-sem
FP32 · Ultralytics PyTorch (CPU) · nano (YOLO-n)
Bunknown power n/a
no power published
Ultralytics documentation: Hailo integration benchmark
2026-10-11 (page last edited)

NVIDIA Jetson Orin NX 16GB:

◌

No published semantic segmentation results for NVIDIA Jetson Orin NX 16GB or Raspberry Pi 5 (CPU only) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

Only NVIDIA Jetson Orin NX 16GB has published speech-to-text results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB432 FPS
throughput_offline · b=unknown
MLPerf RNN-T
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · RNN-T
Dunknown power n/a
no power published
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

Raspberry Pi 5 (CPU only):

◌

No published speech-to-text results for Raspberry Pi 5 (CPU only) or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

✓ Like-for-like: model-size class LLM 5–14B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB11.00 tok/s
generation_throughput · b=1
Nemotron Nano 9B V2
W4A16 · vLLM · LLM 5–14B
Cunknown power n/a
no power published
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
Raspberry Pi 5 (CPU only) CPU-only1.20 tok/s
generation_throughput · b=1
DeepSeek R1 14b
as in linked issue (Ollama default tags are 4-bit) · Ollama / llama.cpp (see linked issue) · LLM 5–14B
C13.00 W measured
reported in result source — measured
Jeff Geerling ai-benchmarks README (Findings tables)
2026-09-22 (page last edited)
✓ Like-for-like: model-size class LLM ≤4B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB25.00 tok/s
generation_throughput · b=1
Cosmos Reasoning 2 2B
W4A16 · vLLM · LLM ≤4B
Cunknown power n/a
no power published
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
Raspberry Pi 5 (CPU only) CPU-only4.88 tok/s
generation_throughput · b=1
Llama 3.2:3b
as in linked issue (Ollama default tags are 4-bit) · Ollama / llama.cpp (see linked issue) · LLM ≤4B
C11.90 W measured
reported in result source — measured
Jeff Geerling ai-benchmarks README (Findings tables)
2026-09-22 (page last edited)
How to read these numbers
Every number is labelled. Confidence: A MLPerf closed, audited · B documented third-party method · C community / review · D vendor-published, not independently verified · E estimate. Power basis: measured with the result · spec vendor spec/envelope · power n/a not published.

Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.