HWBench

NVIDIA Jetson AGX Orin 64GB vs NVIDIA Jetson Orin NX 16GB

NVIDIA Jetson AGX Orin developer kit with its retail box, on a black background
NVIDIA Jetson AGX Orin developer kit. Photo: Auledas, CC BY 4.0, via Wikimedia Commons.
NVIDIA Jetson Orin NX module seated on a carrier motherboard, close-up at Computex 2025
NVIDIA Jetson Orin NX module on a carrier board. Photo: 4300streetcar, CC BY 4.0, via Wikimedia Commons.
Showing the newest results per platform and source. 12 superseded older results are hidden.Showing all results, including 12 superseded by newer results from the same source.

NVIDIA Jetson AGX Orin 64GB is faster in all 5 like-for-like comparisons (largest gap: LLM generation, 4.20×).

NVIDIA Jetson AGX Orin 64GBNVIDIA Jetson Orin NX 16GB
Best object detection435 FPS B
2026-10-13 (page last edited)
287 FPS B
2026-10-13 (page last edited)
Power65.00 W specn/a
Perf / W6.69 FPS/W specn/a
Price$3499 listn/a
Workloads with data3 of 74 of 7

Best published object detection result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

✓ Like-for-like: model-size class nano (YOLO-n), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB435 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
B65.00 W spec
platform spec envelope (not measured with this result)
Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)
NVIDIA Jetson Orin NX 16GB287 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
Bunknown power n/a
no power published
Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)

instance segmentation

◌

No published instance segmentation results for NVIDIA Jetson AGX Orin 64GB or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for NVIDIA Jetson AGX Orin 64GB or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

Only NVIDIA Jetson Orin NX 16GB has published image classification results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB2641 FPS
throughput_offline · b=unknown
MLPerf ResNet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN
Dunknown power n/a
no power published
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

NVIDIA Jetson AGX Orin 64GB:

◌

No published image classification results for NVIDIA Jetson AGX Orin 64GB or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

semantic segmentation

Only NVIDIA Jetson AGX Orin 64GB has published semantic segmentation results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB104 FPS
throughput · b=1
SegFormer-B0 (640x640)
FP16 · TensorRT (ONNX export) · unknown
C65.00 W spec
platform spec envelope (not measured with this result)
arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

NVIDIA Jetson Orin NX 16GB:

◌

No published semantic segmentation results for NVIDIA Jetson Orin NX 16GB or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

Only NVIDIA Jetson Orin NX 16GB has published speech-to-text results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB432 FPS
throughput_offline · b=unknown
MLPerf RNN-T
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · RNN-T
Dunknown power n/a
no power published
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

NVIDIA Jetson AGX Orin 64GB:

◌

No published speech-to-text results for NVIDIA Jetson AGX Orin 64GB or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

✓ Like-for-like: model-size class LLM 5–14B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB30.00 tok/s
generation_throughput · b=1
Qwen 3 8B
W4A16 · vLLM · LLM 5–14B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
NVIDIA Jetson Orin NX 16GB11.00 tok/s
generation_throughput · b=1
Nemotron Nano 9B V2
W4A16 · vLLM · LLM 5–14B
Cunknown power n/a
no power published
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
✓ Like-for-like: model-size class LLM 5–14B, batch 8. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB157 tok/s
generation_throughput · b=8
Qwen 3 8B
W4A16 · vLLM · LLM 5–14B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
NVIDIA Jetson Orin NX 16GB60.00 tok/s
generation_throughput · b=8
Nemotron Nano 9B V2
W4A16 · vLLM · LLM 5–14B
Cunknown power n/a
no power published
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
✓ Like-for-like: model-size class LLM ≤4B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB60.00 tok/s
generation_throughput · b=1
Qwen3-VL-2B
W4A16 · vLLM · LLM ≤4B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
NVIDIA Jetson Orin NX 16GB25.00 tok/s
generation_throughput · b=1
Cosmos Reasoning 2 2B
W4A16 · vLLM · LLM ≤4B
Cunknown power n/a
no power published
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
✓ Like-for-like: model-size class LLM ≤4B, batch 8. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB273 tok/s
generation_throughput · b=8
Cosmos Reasoning 2 2B
W4A16 · vLLM · LLM ≤4B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
NVIDIA Jetson Orin NX 16GB65.00 tok/s
generation_throughput · b=8
Cosmos Reasoning 2 2B
W4A16 · vLLM · LLM ≤4B
Cunknown power n/a
no power published
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)

NVIDIA Jetson AGX Orin 64GB is faster in all 8 like-for-like comparisons (largest gap: LLM generation, 4.20×).

NVIDIA Jetson AGX Orin 64GBNVIDIA Jetson Orin NX 16GB
Best object detection435 FPS B
2026-10-13 (page last edited)
287 FPS B
2026-10-13 (page last edited)
Power65.00 W specn/a
Perf / W6.69 FPS/W specn/a
Price$3499 listn/a
Workloads with data5 of 74 of 7

Best published object detection result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

✓ Like-for-like: model-size class nano (YOLO-n), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB435 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
B65.00 W spec
platform spec envelope (not measured with this result)
Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)
NVIDIA Jetson Orin NX 16GB287 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
Bunknown power n/a
no power published
Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)
✓ Like-for-like: model-size class mid-size CNN, batch unknown (size or batch not stated by source — unverified). Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB149 FPS
throughput_offline · b=unknown
MLPerf Retinanet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN
D65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)
NVIDIA Jetson Orin NX 16GB66.50 FPS
throughput_offline · b=unknown
MLPerf Retinanet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN
Dunknown power n/a
no power published
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

instance segmentation

◌

No published instance segmentation results for NVIDIA Jetson AGX Orin 64GB or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for NVIDIA Jetson AGX Orin 64GB or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

✓ Like-for-like: model-size class mid-size CNN, batch unknown (size or batch not stated by source — unverified). Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB6424 FPS
throughput_offline · b=unknown
MLPerf ResNet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN
D65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)
NVIDIA Jetson Orin NX 16GB2641 FPS
throughput_offline · b=unknown
MLPerf ResNet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN
Dunknown power n/a
no power published
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

semantic segmentation

Only NVIDIA Jetson AGX Orin 64GB has published semantic segmentation results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB104 FPS
throughput · b=1
SegFormer-B0 (640x640)
FP16 · TensorRT (ONNX export) · unknown
C65.00 W spec
platform spec envelope (not measured with this result)
arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

NVIDIA Jetson Orin NX 16GB:

◌

No published semantic segmentation results for NVIDIA Jetson Orin NX 16GB or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

✓ Like-for-like: model-size class RNN-T, batch unknown (size or batch not stated by source — unverified). Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB1170 FPS
throughput_offline · b=unknown
MLPerf RNN-T
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · RNN-T
D65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)
NVIDIA Jetson Orin NX 16GB432 FPS
throughput_offline · b=unknown
MLPerf RNN-T
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · RNN-T
Dunknown power n/a
no power published
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

LLM generation

✓ Like-for-like: model-size class LLM 5–14B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB30.00 tok/s
generation_throughput · b=1
Qwen 3 8B
W4A16 · vLLM · LLM 5–14B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
NVIDIA Jetson Orin NX 16GB11.00 tok/s
generation_throughput · b=1
Nemotron Nano 9B V2
W4A16 · vLLM · LLM 5–14B
Cunknown power n/a
no power published
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
✓ Like-for-like: model-size class LLM 5–14B, batch 8. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB157 tok/s
generation_throughput · b=8
Qwen 3 8B
W4A16 · vLLM · LLM 5–14B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
NVIDIA Jetson Orin NX 16GB60.00 tok/s
generation_throughput · b=8
Nemotron Nano 9B V2
W4A16 · vLLM · LLM 5–14B
Cunknown power n/a
no power published
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
✓ Like-for-like: model-size class LLM ≤4B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB60.00 tok/s
generation_throughput · b=1
Qwen3-VL-2B
W4A16 · vLLM · LLM ≤4B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
NVIDIA Jetson Orin NX 16GB25.00 tok/s
generation_throughput · b=1
Cosmos Reasoning 2 2B
W4A16 · vLLM · LLM ≤4B
Cunknown power n/a
no power published
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
✓ Like-for-like: model-size class LLM ≤4B, batch 8. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB273 tok/s
generation_throughput · b=8
Cosmos Reasoning 2 2B
W4A16 · vLLM · LLM ≤4B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
NVIDIA Jetson Orin NX 16GB65.00 tok/s
generation_throughput · b=8
Cosmos Reasoning 2 2B
W4A16 · vLLM · LLM ≤4B
Cunknown power n/a
no power published
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
How to read these numbers
Every number is labelled. Confidence: A MLPerf closed, audited · B documented third-party method · C community / review · D vendor-published, not independently verified · E estimate. Power basis: measured with the result · spec vendor spec/envelope · power n/a not published.

Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.