HWBench

Dell Pro Max with GB10 vs NVIDIA Jetson AGX Orin 64GB

NVIDIA Jetson AGX Orin developer kit with its retail box, on a black background
NVIDIA Jetson AGX Orin developer kit. Photo: Auledas, CC BY 4.0, via Wikimedia Commons.
Showing the newest results per platform and source. 12 superseded older results are hidden.Showing all results, including 12 superseded by newer results from the same source.

Split result: Dell Pro Max with GB10 is faster in 2 and NVIDIA Jetson AGX Orin 64GB in 1 of 3 like-for-like comparisons.

Dell Pro Max with GB10NVIDIA Jetson AGX Orin 64GB
Best LLM generation97.93 tok/s C
2026-09-22 (page last edited)		273 tok/s C
2026-07-21 (page last edited)
Power129 W measured65.00 W spec
Perf / W0.762 tok/s/W measured4.20 tok/s/W spec
Pricen/a$3499 list
Workloads with data2 of 73 of 7

Best published LLM generation result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

⚠ MIXED COMPARISON — not like-for-like. Baseline nano (YOLO-n) at batch 1. Differs: model-size class unknown vs nano (YOLO-n); batch unknown vs 1.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB435 FPS
inference_time · b=1		YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)		B65.00 W spec
platform spec envelope (not measured with this result)		Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)
Dell Pro Max with GB10
MIXED: model-size class unknown vs nano (YOLO-n); batch unknown vs 1		78.73 FPS
throughput_offline · b=unknown		MLPerf yolo-95
fp4 · CUDA 13.0 · unknown		Aunknown power n/a
no power published		MLPerf Inference v6.1, closed division, edge suite
2026-09-16 (published)

No shared like-for-like group exists for this pair.

instance segmentation

◌

No published instance segmentation results for Dell Pro Max with GB10 or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for Dell Pro Max with GB10 or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

◌

No published image classification results for Dell Pro Max with GB10 or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

semantic segmentation

Only NVIDIA Jetson AGX Orin 64GB has published semantic segmentation results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB104 FPS
throughput · b=1		SegFormer-B0 (640x640)
FP16 · TensorRT (ONNX export) · unknown		C65.00 W spec
platform spec envelope (not measured with this result)		arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

Dell Pro Max with GB10:

◌

No published semantic segmentation results for Dell Pro Max with GB10 or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

◌

No published speech-to-text results for Dell Pro Max with GB10 or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

✓ Like-for-like: model-size class LLM 5–14B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB30.00 tok/s
generation_throughput · b=1		Qwen 3 8B
W4A16 · vLLM · LLM 5–14B		C65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
Dell Pro Max with GB1023.92 tok/s
generation_throughput · b=1		DeepSeek R1 14b
as in linked issue (Ollama default tags are 4-bit) · Ollama / llama.cpp (see linked issue) · LLM 5–14B		C138 W measured
reported in result source — measured		Jeff Geerling ai-benchmarks README (Findings tables)
2026-09-22 (page last edited)
✓ Like-for-like: model-size class LLM 15–40B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Dell Pro Max with GB1087.97 tok/s
generation_throughput · b=1		gpt-oss 20b
as in linked issue (Ollama default tags are 4-bit) · Ollama / llama.cpp (see linked issue) · LLM 15–40B		C123 W measured
reported in result source — measured		Jeff Geerling ai-benchmarks README (Findings tables)
2026-09-22 (page last edited)
NVIDIA Jetson AGX Orin 64GB55.00 tok/s
generation_throughput · b=1		Qwen3-30B-A3B
W4A16 · vLLM · LLM 15–40B		C65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
✓ Like-for-like: model-size class LLM ≤4B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Dell Pro Max with GB1097.93 tok/s
generation_throughput · b=1		Llama 3.2:3b
as in linked issue (Ollama default tags are 4-bit) · Ollama / llama.cpp (see linked issue) · LLM ≤4B		C129 W measured
reported in result source — measured		Jeff Geerling ai-benchmarks README (Findings tables)
2026-09-22 (page last edited)
NVIDIA Jetson AGX Orin 64GB60.00 tok/s
generation_throughput · b=1		Qwen3-VL-2B
W4A16 · vLLM · LLM ≤4B		C65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)

Split result: Dell Pro Max with GB10 is faster in 2 and NVIDIA Jetson AGX Orin 64GB in 1 of 3 like-for-like comparisons.

Dell Pro Max with GB10NVIDIA Jetson AGX Orin 64GB
Best LLM generation97.93 tok/s C
2026-09-22 (page last edited)		273 tok/s C
2026-07-21 (page last edited)
Power129 W measured65.00 W spec
Perf / W0.762 tok/s/W measured4.20 tok/s/W spec
Pricen/a$3499 list
Workloads with data2 of 75 of 7

Best published LLM generation result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

⚠ MIXED COMPARISON — not like-for-like. Baseline nano (YOLO-n) at batch 1. Differs: model-size class unknown vs nano (YOLO-n); batch unknown vs 1.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB435 FPS
inference_time · b=1		YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)		B65.00 W spec
platform spec envelope (not measured with this result)		Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)
Dell Pro Max with GB10
MIXED: model-size class unknown vs nano (YOLO-n); batch unknown vs 1		78.73 FPS
throughput_offline · b=unknown		MLPerf yolo-95
fp4 · CUDA 13.0 · unknown		Aunknown power n/a
no power published		MLPerf Inference v6.1, closed division, edge suite
2026-09-16 (published)

No shared like-for-like group exists for this pair.

instance segmentation

◌

No published instance segmentation results for Dell Pro Max with GB10 or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for Dell Pro Max with GB10 or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

Only NVIDIA Jetson AGX Orin 64GB has published image classification results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB6424 FPS
throughput_offline · b=unknown		MLPerf ResNet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN		D65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

Dell Pro Max with GB10:

◌

No published image classification results for Dell Pro Max with GB10 or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

semantic segmentation

Only NVIDIA Jetson AGX Orin 64GB has published semantic segmentation results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB104 FPS
throughput · b=1		SegFormer-B0 (640x640)
FP16 · TensorRT (ONNX export) · unknown		C65.00 W spec
platform spec envelope (not measured with this result)		arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

Dell Pro Max with GB10:

◌

No published semantic segmentation results for Dell Pro Max with GB10 or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

Only NVIDIA Jetson AGX Orin 64GB has published speech-to-text results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB1170 FPS
throughput_offline · b=unknown		MLPerf RNN-T
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · RNN-T		D65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

Dell Pro Max with GB10:

◌

No published speech-to-text results for Dell Pro Max with GB10 or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

✓ Like-for-like: model-size class LLM 5–14B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB30.00 tok/s
generation_throughput · b=1		Qwen 3 8B
W4A16 · vLLM · LLM 5–14B		C65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
Dell Pro Max with GB1023.92 tok/s
generation_throughput · b=1		DeepSeek R1 14b
as in linked issue (Ollama default tags are 4-bit) · Ollama / llama.cpp (see linked issue) · LLM 5–14B		C138 W measured
reported in result source — measured		Jeff Geerling ai-benchmarks README (Findings tables)
2026-09-22 (page last edited)
✓ Like-for-like: model-size class LLM 15–40B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Dell Pro Max with GB1087.97 tok/s
generation_throughput · b=1		gpt-oss 20b
as in linked issue (Ollama default tags are 4-bit) · Ollama / llama.cpp (see linked issue) · LLM 15–40B		C123 W measured
reported in result source — measured		Jeff Geerling ai-benchmarks README (Findings tables)
2026-09-22 (page last edited)
NVIDIA Jetson AGX Orin 64GB55.00 tok/s
generation_throughput · b=1		Qwen3-30B-A3B
W4A16 · vLLM · LLM 15–40B		C65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
✓ Like-for-like: model-size class LLM ≤4B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Dell Pro Max with GB1097.93 tok/s
generation_throughput · b=1		Llama 3.2:3b
as in linked issue (Ollama default tags are 4-bit) · Ollama / llama.cpp (see linked issue) · LLM ≤4B		C129 W measured
reported in result source — measured		Jeff Geerling ai-benchmarks README (Findings tables)
2026-09-22 (page last edited)
NVIDIA Jetson AGX Orin 64GB60.00 tok/s
generation_throughput · b=1		Qwen3-VL-2B
W4A16 · vLLM · LLM ≤4B		C65.00 W spec
platform spec envelope (not measured with this result)		NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
How to read these numbers
Every number is labelled. Confidence: A MLPerf closed, audited · B documented third-party method · C community / review · D vendor-published, not independently verified · E estimate. Power basis: measured with the result · spec vendor spec/envelope · power n/a not published.

Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.