HWBench

NVIDIA Jetson Orin NX 16GB vs Rockchip RK3588 (NPU, single core of 3)

NVIDIA Jetson Orin NX module seated on a carrier motherboard, close-up at Computex 2025
NVIDIA Jetson Orin NX module on a carrier board. Photo: 4300streetcar, CC BY 4.0, via Wikimedia Commons.
Close-up of a Rockchip RK3588 system-on-chip package on a circuit board
Rockchip RK3588 SoC package. Photo: Popolon (Commons uploader; CC0, attribution not required), CC0, via Wikimedia Commons.

NVIDIA Jetson Orin NX 16GB is faster in the only like-for-like comparison (largest gap: object detection, 2.63×).

NVIDIA Jetson Orin NX 16GBRockchip RK3588 (NPU, single core of 3)
Best object detection287 FPS B
2026-10-13 (page last edited)
109 FPS C
2026-10-13 (page last edited)
Powern/an/a
Perf / Wn/an/a
Pricen/an/a
Workloads with data4 of 75 of 7

Best published object detection result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

✓ Like-for-like: model-size class nano (YOLO-n), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB287 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
Bunknown power n/a
no power published
Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)
Rockchip RK3588 (NPU, single core of 3)109 FPS
throughput · b=1
yolov6n
INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) · nano (YOLO-n)
Cunknown power n/a
no power published
Rockchip rknn_model_zoo README benchmark table
2026-10-13 (page last edited)

instance segmentation

Only Rockchip RK3588 (NPU, single core of 3) has published instance segmentation results.

PlatformResultModel · precision · stackGradePowerSource
Rockchip RK3588 (NPU, single core of 3)71.50 FPS
throughput · b=1
yolov5n-seg
INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) · nano (YOLO-n)
Cunknown power n/a
no power published
Rockchip rknn_model_zoo README benchmark table
2026-10-13 (page last edited)

NVIDIA Jetson Orin NX 16GB:

◌

No published instance segmentation results for NVIDIA Jetson Orin NX 16GB or Rockchip RK3588 (NPU, single core of 3) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

Only Rockchip RK3588 (NPU, single core of 3) has published pose estimation results.

PlatformResultModel · precision · stackGradePowerSource
Rockchip RK3588 (NPU, single core of 3)58.30 FPS
throughput · b=1
yolov8n-pose
INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) · nano (YOLO-n)
Cunknown power n/a
no power published
Rockchip rknn_model_zoo README benchmark table
2026-10-13 (page last edited)

NVIDIA Jetson Orin NX 16GB:

◌

No published pose estimation results for NVIDIA Jetson Orin NX 16GB or Rockchip RK3588 (NPU, single core of 3) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

⚠ MIXED COMPARISON — not like-for-like. Baseline mobile-class CNN at batch 1. Differs: model-size class mid-size CNN vs mobile-class CNN; batch unknown vs 1.
PlatformResultModel · precision · stackGradePowerSource
Rockchip RK3588 (NPU, single core of 3)459 FPS
throughput · b=1
mobilenetv2-12
INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) · mobile-class CNN
Cunknown power n/a
no power published
Rockchip rknn_model_zoo README benchmark table
2026-10-13 (page last edited)
NVIDIA Jetson Orin NX 16GB
MIXED: model-size class mid-size CNN vs mobile-class CNN; batch unknown vs 1
2641 FPS
throughput_offline · b=unknown
MLPerf ResNet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN
Dunknown power n/a
no power published
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

No shared like-for-like group exists for this pair.

semantic segmentation

Only Rockchip RK3588 (NPU, single core of 3) has published semantic segmentation results.

PlatformResultModel · precision · stackGradePowerSource
Rockchip RK3588 (NPU, single core of 3)34.70 FPS
throughput · b=1
deeplab-v3-plus-mobilenet-v2
INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) · mobile-class CNN
Cunknown power n/a
no power published
Rockchip rknn_model_zoo README benchmark table
2026-10-13 (page last edited)

NVIDIA Jetson Orin NX 16GB:

◌

No published semantic segmentation results for NVIDIA Jetson Orin NX 16GB or Rockchip RK3588 (NPU, single core of 3) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

Only NVIDIA Jetson Orin NX 16GB has published speech-to-text results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB432 FPS
throughput_offline · b=unknown
MLPerf RNN-T
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · RNN-T
Dunknown power n/a
no power published
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

Rockchip RK3588 (NPU, single core of 3):

◌

No published speech-to-text results for Rockchip RK3588 (NPU, single core of 3) or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

Only NVIDIA Jetson Orin NX 16GB has published LLM generation results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB11.00 tok/s
generation_throughput · b=1
Nemotron Nano 9B V2
W4A16 · vLLM · LLM 5–14B
Cunknown power n/a
no power published
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)

Rockchip RK3588 (NPU, single core of 3):

◌

No published LLM generation results for Rockchip RK3588 (NPU, single core of 3) or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

How to read these numbers
Every number is labelled. Confidence: A MLPerf closed, audited · B documented third-party method · C community / review · D vendor-published, not independently verified · E estimate. Power basis: measured with the result · spec vendor spec/envelope · power n/a not published.

Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.