HWBench

NVIDIA Jetson AGX Orin 64GB vs Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)

NVIDIA Jetson AGX Orin developer kit with its retail box, on a black background
NVIDIA Jetson AGX Orin developer kit. Photo: Auledas, CC BY 4.0, via Wikimedia Commons.
Showing the newest results per platform and source. 23 superseded older results are hidden.Showing all results, including 23 superseded by newer results from the same source.

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) is faster in all 2 like-for-like comparisons (largest gap: LLM generation, 3.76×).

NVIDIA Jetson AGX Orin 64GBRadxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)
Best LLM generation273 tok/s C
2026-07-21 (page last edited)
214 tok/s C
2025-05-06 (page last edited)
Power60.00 W Module TDP, Module, max of range 15-60 W320 W ● Measured, Whole system
Perf / W4.55 tok/s/W Module TDP, Module, max of range 15-60 W0.669 tok/s/W ● Measured, Whole system
Price$3499 listn/a
Workloads with data3 of 71 of 7

Best published LLM generation result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

Only NVIDIA Jetson AGX Orin 64GB has published object detection results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB435 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
B60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling):

◌

No published object detection results for Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

instance segmentation

◌

No published instance segmentation results for NVIDIA Jetson AGX Orin 64GB or Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for NVIDIA Jetson AGX Orin 64GB or Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

◌

No published image classification results for NVIDIA Jetson AGX Orin 64GB or Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

semantic segmentation

Only NVIDIA Jetson AGX Orin 64GB has published semantic segmentation results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB104 FPS
throughput · b=1
SegFormer-B0 (640x640)
FP16 · TensorRT (ONNX export) · unknown
C60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling):

◌

No published semantic segmentation results for Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

◌

No published speech-to-text results for NVIDIA Jetson AGX Orin 64GB or Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

✓ Like-for-like: model-size class LLM 5–14B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)113 tok/s
generation_throughput · b=1
llama3.1:8b
Ollama default tag (4-bit unless tag says otherwise) · Ollama (geerlingguy/ollama-benchmark) · LLM 5–14B
C471 W ● Measured, Whole system
reported in result source — Measured, Whole system
Jeff Geerling ai-benchmarks issue results (comments)
2025-05-06 (page last edited)
NVIDIA Jetson AGX Orin 64GB30.00 tok/s
generation_throughput · b=1
Qwen 3 8B
W4A16 · vLLM · LLM 5–14B
C60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
✓ Like-for-like: model-size class LLM ≤4B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)214 tok/s
generation_throughput · b=1
deepseek-r1:1.5b
Ollama default tag (4-bit unless tag says otherwise) · Ollama (geerlingguy/ollama-benchmark) · LLM ≤4B
C320 W ● Measured, Whole system
reported in result source — Measured, Whole system
Jeff Geerling ai-benchmarks issue results (comments)
2025-05-06 (page last edited)
NVIDIA Jetson AGX Orin 64GB60.00 tok/s
generation_throughput · b=1
Qwen3-VL-2B
W4A16 · vLLM · LLM ≤4B
C60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) is faster in all 2 like-for-like comparisons (largest gap: LLM generation, 3.76×).

NVIDIA Jetson AGX Orin 64GBRadxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)
Best LLM generation273 tok/s C
2026-07-21 (page last edited)
214 tok/s C
2025-05-06 (page last edited)
Power60.00 W Module TDP, Module, max of range 15-60 W320 W ● Measured, Whole system
Perf / W4.55 tok/s/W Module TDP, Module, max of range 15-60 W0.669 tok/s/W ● Measured, Whole system
Price$3499 listn/a
Workloads with data5 of 71 of 7

Best published LLM generation result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

Only NVIDIA Jetson AGX Orin 64GB has published object detection results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB435 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
B60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling):

◌

No published object detection results for Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

instance segmentation

◌

No published instance segmentation results for NVIDIA Jetson AGX Orin 64GB or Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for NVIDIA Jetson AGX Orin 64GB or Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

Only NVIDIA Jetson AGX Orin 64GB has published image classification results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB6424 FPS
throughput_offline · b=unknown
MLPerf ResNet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN
Dunknown power not published
not published
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling):

◌

No published image classification results for Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

semantic segmentation

Only NVIDIA Jetson AGX Orin 64GB has published semantic segmentation results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB104 FPS
throughput · b=1
SegFormer-B0 (640x640)
FP16 · TensorRT (ONNX export) · unknown
C60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling):

◌

No published semantic segmentation results for Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

Only NVIDIA Jetson AGX Orin 64GB has published speech-to-text results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB1170 FPS
throughput_offline · b=unknown
MLPerf RNN-T
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · RNN-T
Dunknown power not published
not published
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling):

◌

No published speech-to-text results for Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

✓ Like-for-like: model-size class LLM 5–14B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)113 tok/s
generation_throughput · b=1
llama3.1:8b
Ollama default tag (4-bit unless tag says otherwise) · Ollama (geerlingguy/ollama-benchmark) · LLM 5–14B
C471 W ● Measured, Whole system
reported in result source — Measured, Whole system
Jeff Geerling ai-benchmarks issue results (comments)
2025-05-06 (page last edited)
NVIDIA Jetson AGX Orin 64GB30.00 tok/s
generation_throughput · b=1
Qwen 3 8B
W4A16 · vLLM · LLM 5–14B
C60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
✓ Like-for-like: model-size class LLM ≤4B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)214 tok/s
generation_throughput · b=1
deepseek-r1:1.5b
Ollama default tag (4-bit unless tag says otherwise) · Ollama (geerlingguy/ollama-benchmark) · LLM ≤4B
C320 W ● Measured, Whole system
reported in result source — Measured, Whole system
Jeff Geerling ai-benchmarks issue results (comments)
2025-05-06 (page last edited)
NVIDIA Jetson AGX Orin 64GB60.00 tok/s
generation_throughput · b=1
Qwen3-VL-2B
W4A16 · vLLM · LLM ≤4B
C60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)

Grades: A audited MLPerf · B third-party · C community · D vendor. How we rank · JSON