NVIDIA Jetson AGX Thor vs NVIDIA Jetson Thor T4000
NVIDIA Jetson AGX Thor is faster in all 8 like-for-like comparisons (largest gap: LLM generation, 1.52×).
| NVIDIA Jetson AGX Thor | NVIDIA Jetson Thor T4000 | |
|---|---|---|
| Best LLM generation | 523 tok/s C undated | 423 tok/s C undated |
| Power | 130 W spec | n/a |
| Perf / W | 4.02 tok/s/W spec | n/a |
| Price | $3499 list | n/a |
| Workloads with data | 2 of 7 | 1 of 7 |
Best published LLM generation result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.
Show data — all workloads, sources and like-for-like groups
object detection
Only NVIDIA Jetson AGX Thor has published object detection results.
| Platform | Result | Model · precision · stack | Grade | Power | Source |
|---|---|---|---|---|---|
| NVIDIA Jetson AGX Thor | 719 FPS inference_time · b=1 | YOLO26n FP16 · Ultralytics TensorRT · nano (YOLO-n) | B | 130 W spec platform spec envelope (not measured with this result) | Ultralytics docs benchmark table undated |
NVIDIA Jetson Thor T4000:
No published object detection results for NVIDIA Jetson Thor T4000 or NVIDIA Jetson AGX Thor yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
instance segmentation
No published instance segmentation results for NVIDIA Jetson AGX Thor or NVIDIA Jetson Thor T4000 yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
pose estimation
No published pose estimation results for NVIDIA Jetson AGX Thor or NVIDIA Jetson Thor T4000 yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
image classification
No published image classification results for NVIDIA Jetson AGX Thor or NVIDIA Jetson Thor T4000 yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
semantic segmentation
No published semantic segmentation results for NVIDIA Jetson AGX Thor or NVIDIA Jetson Thor T4000 yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
speech-to-text
No published speech-to-text results for NVIDIA Jetson AGX Thor or NVIDIA Jetson Thor T4000 yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
LLM generation
| Platform | Result | Model · precision · stack | Grade | Power | Source |
|---|---|---|---|---|---|
| NVIDIA Jetson AGX Thor | 45.00 tok/s tok/s gen, concurrency 1 · b=1 | Qwen2.5-VL 7B n/s on page · NVIDIA (vLLM/TensorRT-LLM per page) · LLM 5–14B | D | 130 W spec platform spec envelope (not measured with this result) | NVIDIA Jetson Benchmarks undated |
| NVIDIA Jetson Thor T4000 | 35.00 tok/s generation_throughput · b=1 | Qwen 3 8B NVFP4 · vLLM · LLM 5–14B | C | unknown power n/a no power published | NVIDIA Jetson AI Lab benchmarks (benchmarks.json) undated |
| Platform | Result | Model · precision · stack | Grade | Power | Source |
|---|---|---|---|---|---|
| NVIDIA Jetson AGX Thor | 305 tok/s tok/s gen, concurrency 8 · b=8 | Deepseek R1 7B n/s on page · NVIDIA (vLLM/TensorRT-LLM per page) · LLM 5–14B | D | 130 W spec platform spec envelope (not measured with this result) | NVIDIA Jetson Benchmarks undated |
| NVIDIA Jetson Thor T4000 | 200 tok/s generation_throughput · b=8 | Qwen 3 8B NVFP4 · vLLM · LLM 5–14B | C | unknown power n/a no power published | NVIDIA Jetson AI Lab benchmarks (benchmarks.json) undated |
| Platform | Result | Model · precision · stack | Grade | Power | Source |
|---|---|---|---|---|---|
| NVIDIA Jetson AGX Thor | 72.60 tok/s generation_throughput · b=1 | Qwen3-30B-A3B INT4 GPTQ · Edge-LLM · LLM 15–40B | C | 130 W spec platform spec envelope (not measured with this result) | NVIDIA Jetson AI Lab benchmarks (benchmarks.json) undated |
| NVIDIA Jetson Thor T4000 | 57.00 tok/s generation_throughput · b=1 | Qwen3-30B-A3B NVFP4 · vLLM · LLM 15–40B | C | unknown power n/a no power published | NVIDIA Jetson AI Lab benchmarks (benchmarks.json) undated |
| Platform | Result | Model · precision · stack | Grade | Power | Source |
|---|---|---|---|---|---|
| NVIDIA Jetson AGX Thor | 242 tok/s generation_throughput · b=8 | Qwen3-30B-A3B NVFP4 · vLLM · LLM 15–40B | C | 130 W spec platform spec envelope (not measured with this result) | NVIDIA Jetson AI Lab benchmarks (benchmarks.json) undated |
| NVIDIA Jetson Thor T4000 | 184 tok/s generation_throughput · b=8 | Qwen3-30B-A3B NVFP4 · vLLM · LLM 15–40B | C | unknown power n/a no power published | NVIDIA Jetson AI Lab benchmarks (benchmarks.json) undated |
| Platform | Result | Model · precision · stack | Grade | Power | Source |
|---|---|---|---|---|---|
| NVIDIA Jetson AGX Thor | 122 tok/s generation_throughput · b=1 | Qwen3-VL-2B NVFP4 · vLLM · LLM ≤4B | C | 130 W spec platform spec envelope (not measured with this result) | NVIDIA Jetson AI Lab benchmarks (benchmarks.json) undated |
| NVIDIA Jetson Thor T4000 | 95.00 tok/s generation_throughput · b=1 | Qwen3-VL-2B NVFP4 · vLLM · LLM ≤4B | C | unknown power n/a no power published | NVIDIA Jetson AI Lab benchmarks (benchmarks.json) undated |
| Platform | Result | Model · precision · stack | Grade | Power | Source |
|---|---|---|---|---|---|
| NVIDIA Jetson AGX Thor | 523 tok/s generation_throughput · b=8 | Gemma 4 E2B NVFP4 · vLLM · LLM ≤4B | C | 130 W spec platform spec envelope (not measured with this result) | NVIDIA Jetson AI Lab benchmarks (benchmarks.json) undated |
| NVIDIA Jetson Thor T4000 | 423 tok/s generation_throughput · b=8 | Qwen3-VL-2B NVFP4 · vLLM · LLM ≤4B | C | unknown power n/a no power published | NVIDIA Jetson AI Lab benchmarks (benchmarks.json) undated |
| Platform | Result | Model · precision · stack | Grade | Power | Source |
|---|---|---|---|---|---|
| NVIDIA Jetson AGX Thor | 117 tok/s generation_throughput · b=1 | Pi 0.5 NVFP4 + FP8 · TRT · unknown | C | 130 W spec platform spec envelope (not measured with this result) | NVIDIA Jetson AI Lab benchmarks (benchmarks.json) undated |
| NVIDIA Jetson Thor T4000 | 94.00 tok/s generation_throughput · b=1 | Pi 0.5 NVFP4 + FP8 · TRT · unknown | C | unknown power n/a no power published | NVIDIA Jetson AI Lab benchmarks (benchmarks.json) undated |
| Platform | Result | Model · precision · stack | Grade | Power | Source |
|---|---|---|---|---|---|
| NVIDIA Jetson AGX Thor | 293 tok/s generation_throughput · b=8 | Cosmos3 Edge (Reasoner) BF16 · vLLM · unknown | C | 130 W spec platform spec envelope (not measured with this result) | NVIDIA Jetson AI Lab benchmarks (benchmarks.json) undated |
| NVIDIA Jetson Thor T4000 | 284 tok/s generation_throughput · b=8 | Cosmos3 Edge (Reasoner) BF16 · vLLM · unknown | C | unknown power n/a no power published | NVIDIA Jetson AI Lab benchmarks (benchmarks.json) undated |
How to read these numbers
Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.