HWBenchedge-AI hardware data, cited & graded

NVIDIA Jetson AGX Orin 64GB vs NVIDIA Jetson AGX Thor

NVIDIA Jetson AGX Orin developer kit with its retail box, on a black background
NVIDIA Jetson AGX Orin developer kit. Photo: Auledas, CC BY 4.0, via Wikimedia Commons.
NVIDIAedge reference · no photo yet
No licensed photo available — placeholder drawing.

NVIDIA Jetson AGX Thor is faster in all 9 like-for-like comparisons (largest gap: LLM generation, 2.66×).

NVIDIA Jetson AGX Orin 64GBNVIDIA Jetson AGX Thor
Best object detection435 FPS B
undated
719 FPS B
undated
Power65.00 W spec130 W spec
Perf / W6.69 FPS/W spec5.53 FPS/W spec
Price$1999 list$3499 list
Workloads with data4 of 72 of 7

Best published object detection result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

✓ Like-for-like: model-size class nano (YOLO-n), batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Thor719 FPS
inference_time · b=1
YOLO26n
FP16 · Ultralytics TensorRT · nano (YOLO-n)
B130 W spec
platform spec envelope (not measured with this result)
Ultralytics docs benchmark table
undated
NVIDIA Jetson AGX Orin 64GB435 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
B65.00 W spec
platform spec envelope (not measured with this result)
Ultralytics docs benchmark table
undated

instance segmentation

◌

No published instance segmentation results for NVIDIA Jetson AGX Orin 64GB or NVIDIA Jetson AGX Thor yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for NVIDIA Jetson AGX Orin 64GB or NVIDIA Jetson AGX Thor yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

Only NVIDIA Jetson AGX Orin 64GB has published image classification results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB6424 FPS
throughput_offline · b=unknown
MLPerf ResNet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN
D65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
2026-10

NVIDIA Jetson AGX Thor:

◌

No published image classification results for NVIDIA Jetson AGX Thor or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

semantic segmentation

◌

No published semantic segmentation results for NVIDIA Jetson AGX Orin 64GB or NVIDIA Jetson AGX Thor yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

Only NVIDIA Jetson AGX Orin 64GB has published speech-to-text results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB1170 FPS
throughput_offline · b=unknown
MLPerf RNN-T
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · RNN-T
D65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
2026-10

NVIDIA Jetson AGX Thor:

◌

No published speech-to-text results for NVIDIA Jetson AGX Thor or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

✓ Like-for-like: model-size class LLM 5–14B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Thor45.00 tok/s
tok/s gen, concurrency 1 · b=1
Qwen2.5-VL 7B
n/s on page · NVIDIA (vLLM/TensorRT-LLM per page) · LLM 5–14B
D130 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson Benchmarks
undated
NVIDIA Jetson AGX Orin 64GB30.00 tok/s
generation_throughput · b=1
Qwen 3 8B
W4A16 · vLLM · LLM 5–14B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
undated
✓ Like-for-like: model-size class LLM 5–14B, batch 8. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Thor305 tok/s
tok/s gen, concurrency 8 · b=8
Deepseek R1 7B
n/s on page · NVIDIA (vLLM/TensorRT-LLM per page) · LLM 5–14B
D130 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson Benchmarks
undated
NVIDIA Jetson AGX Orin 64GB157 tok/s
generation_throughput · b=8
Qwen 3 8B
W4A16 · vLLM · LLM 5–14B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
undated
✓ Like-for-like: model-size class LLM 15–40B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Thor72.60 tok/s
generation_throughput · b=1
Qwen3-30B-A3B
INT4 GPTQ · Edge-LLM · LLM 15–40B
C130 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
undated
NVIDIA Jetson AGX Orin 64GB55.00 tok/s
generation_throughput · b=1
Qwen3-30B-A3B
W4A16 · vLLM · LLM 15–40B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
undated
✓ Like-for-like: model-size class LLM 15–40B, batch 8. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Thor242 tok/s
generation_throughput · b=8
Qwen3-30B-A3B
NVFP4 · vLLM · LLM 15–40B
C130 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
undated
NVIDIA Jetson AGX Orin 64GB174 tok/s
generation_throughput · b=8
Qwen3-30B-A3B
W4A16 · vLLM · LLM 15–40B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
undated
✓ Like-for-like: model-size class LLM ≤4B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Thor122 tok/s
generation_throughput · b=1
Qwen3-VL-2B
NVFP4 · vLLM · LLM ≤4B
C130 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
undated
NVIDIA Jetson AGX Orin 64GB60.00 tok/s
generation_throughput · b=1
Qwen3-VL-2B
W4A16 · vLLM · LLM ≤4B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
undated
✓ Like-for-like: model-size class LLM ≤4B, batch 8. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Thor523 tok/s
generation_throughput · b=8
Gemma 4 E2B
NVFP4 · vLLM · LLM ≤4B
C130 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
undated
NVIDIA Jetson AGX Orin 64GB273 tok/s
generation_throughput · b=8
Cosmos Reasoning 2 2B
W4A16 · vLLM · LLM ≤4B
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
undated
✓ Like-for-like: model-size class unknown, batch 1 (size or batch not stated by source — unverified). Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Thor117 tok/s
generation_throughput · b=1
Pi 0.5
NVFP4 + FP8 · TRT · unknown
C130 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
undated
NVIDIA Jetson AGX Orin 64GB44.00 tok/s
generation_throughput · b=1
Cosmos3 Edge (Reasoner)
BF16 · vLLM · unknown
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
undated
✓ Like-for-like: model-size class unknown, batch 8 (size or batch not stated by source — unverified). Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Thor293 tok/s
generation_throughput · b=8
Cosmos3 Edge (Reasoner)
BF16 · vLLM · unknown
C130 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
undated
NVIDIA Jetson AGX Orin 64GB171 tok/s
generation_throughput · b=8
Cosmos3 Edge (Reasoner)
BF16 · vLLM · unknown
C65.00 W spec
platform spec envelope (not measured with this result)
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
undated
How to read these numbers
Every number is labelled. Confidence: A MLPerf closed, audited · B documented third-party method · C community / review · D vendor-published, not independently verified · E estimate. Power basis: measured with the result · spec vendor spec/envelope · power n/a not published.

Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.