HWBench

NVIDIA Jetson Orin NX 16GB vs Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)

NVIDIA Jetson Orin NX module seated on a carrier motherboard, close-up at Computex 2025
NVIDIA Jetson Orin NX module on a carrier board. Photo: 4300streetcar, CC BY 4.0, via Wikimedia Commons.
Showing the newest results per platform and source. 11 superseded older results are hidden.Showing all results, including 11 superseded by newer results from the same source.

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) is faster in all 2 like-for-like comparisons (largest gap: LLM generation, 10.25×).

NVIDIA Jetson Orin NX 16GBRadxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)
Best LLM generation65.00 tok/s C
2026-07-21 (page last edited)
214 tok/s C
2025-05-06 (page last edited)
Power40.00 W Module TDP, Module, max of range 10-40 W320 W ● Measured, Whole system
Perf / W1.63 tok/s/W Module TDP, Module, max of range 10-40 W0.669 tok/s/W ● Measured, Whole system
Pricen/an/a
Workloads with data4 of 71 of 7

Best published LLM generation result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

Only NVIDIA Jetson Orin NX 16GB has published object detection results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB287 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
B40.00 W Module TDP, Module, max of range 10-40 W
reported in result source — Module TDP, Module, max of range 10-40 W
Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling):

◌

No published object detection results for Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

instance segmentation

◌

No published instance segmentation results for NVIDIA Jetson Orin NX 16GB or Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for NVIDIA Jetson Orin NX 16GB or Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

Only NVIDIA Jetson Orin NX 16GB has published image classification results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB2641 FPS
throughput_offline · b=unknown
MLPerf ResNet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN
D40.00 W Module TDP, Module, max of range 10-40 W
reported in result source — Module TDP, Module, max of range 10-40 W
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling):

◌

No published image classification results for Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

semantic segmentation

◌

No published semantic segmentation results for NVIDIA Jetson Orin NX 16GB or Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

Only NVIDIA Jetson Orin NX 16GB has published speech-to-text results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB432 FPS
throughput_offline · b=unknown
MLPerf RNN-T
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · RNN-T
D40.00 W Module TDP, Module, max of range 10-40 W
reported in result source — Module TDP, Module, max of range 10-40 W
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling):

◌

No published speech-to-text results for Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

✓ Like-for-like: model-size class LLM 5–14B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)113 tok/s
generation_throughput · b=1
llama3.1:8b
Ollama default tag (4-bit unless tag says otherwise) · Ollama (geerlingguy/ollama-benchmark) · LLM 5–14B
C471 W ● Measured, Whole system
reported in result source — Measured, Whole system
Jeff Geerling ai-benchmarks issue results (comments)
2025-05-06 (page last edited)
NVIDIA Jetson Orin NX 16GB11.00 tok/s
generation_throughput · b=1
Nemotron Nano 9B V2
W4A16 · vLLM · LLM 5–14B
C40.00 W Module TDP, Module, max of range 10-40 W
reported in result source — Module TDP, Module, max of range 10-40 W
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
✓ Like-for-like: model-size class LLM ≤4B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)214 tok/s
generation_throughput · b=1
deepseek-r1:1.5b
Ollama default tag (4-bit unless tag says otherwise) · Ollama (geerlingguy/ollama-benchmark) · LLM ≤4B
C320 W ● Measured, Whole system
reported in result source — Measured, Whole system
Jeff Geerling ai-benchmarks issue results (comments)
2025-05-06 (page last edited)
NVIDIA Jetson Orin NX 16GB25.00 tok/s
generation_throughput · b=1
Cosmos Reasoning 2 2B
W4A16 · vLLM · LLM ≤4B
C40.00 W Module TDP, Module, max of range 10-40 W
reported in result source — Module TDP, Module, max of range 10-40 W
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) is faster in all 2 like-for-like comparisons (largest gap: LLM generation, 10.25×).

NVIDIA Jetson Orin NX 16GBRadxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)
Best LLM generation65.00 tok/s C
2026-07-21 (page last edited)
214 tok/s C
2025-05-06 (page last edited)
Power40.00 W Module TDP, Module, max of range 10-40 W320 W ● Measured, Whole system
Perf / W1.63 tok/s/W Module TDP, Module, max of range 10-40 W0.669 tok/s/W ● Measured, Whole system
Pricen/an/a
Workloads with data4 of 71 of 7

Best published LLM generation result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

Only NVIDIA Jetson Orin NX 16GB has published object detection results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB287 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
B40.00 W Module TDP, Module, max of range 10-40 W
reported in result source — Module TDP, Module, max of range 10-40 W
Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling):

◌

No published object detection results for Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

instance segmentation

◌

No published instance segmentation results for NVIDIA Jetson Orin NX 16GB or Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for NVIDIA Jetson Orin NX 16GB or Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

Only NVIDIA Jetson Orin NX 16GB has published image classification results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB2641 FPS
throughput_offline · b=unknown
MLPerf ResNet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN
D40.00 W Module TDP, Module, max of range 10-40 W
reported in result source — Module TDP, Module, max of range 10-40 W
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling):

◌

No published image classification results for Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

semantic segmentation

◌

No published semantic segmentation results for NVIDIA Jetson Orin NX 16GB or Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

Only NVIDIA Jetson Orin NX 16GB has published speech-to-text results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson Orin NX 16GB432 FPS
throughput_offline · b=unknown
MLPerf RNN-T
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · RNN-T
D40.00 W Module TDP, Module, max of range 10-40 W
reported in result source — Module TDP, Module, max of range 10-40 W
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling):

◌

No published speech-to-text results for Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling) or NVIDIA Jetson Orin NX 16GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

✓ Like-for-like: model-size class LLM 5–14B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)113 tok/s
generation_throughput · b=1
llama3.1:8b
Ollama default tag (4-bit unless tag says otherwise) · Ollama (geerlingguy/ollama-benchmark) · LLM 5–14B
C471 W ● Measured, Whole system
reported in result source — Measured, Whole system
Jeff Geerling ai-benchmarks issue results (comments)
2025-05-06 (page last edited)
NVIDIA Jetson Orin NX 16GB11.00 tok/s
generation_throughput · b=1
Nemotron Nano 9B V2
W4A16 · vLLM · LLM 5–14B
C40.00 W Module TDP, Module, max of range 10-40 W
reported in result source — Module TDP, Module, max of range 10-40 W
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
✓ Like-for-like: model-size class LLM ≤4B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Radxa Oryon O6 Mini ITX Board (as tested by Jeff Geerling)214 tok/s
generation_throughput · b=1
deepseek-r1:1.5b
Ollama default tag (4-bit unless tag says otherwise) · Ollama (geerlingguy/ollama-benchmark) · LLM ≤4B
C320 W ● Measured, Whole system
reported in result source — Measured, Whole system
Jeff Geerling ai-benchmarks issue results (comments)
2025-05-06 (page last edited)
NVIDIA Jetson Orin NX 16GB25.00 tok/s
generation_throughput · b=1
Cosmos Reasoning 2 2B
W4A16 · vLLM · LLM ≤4B
C40.00 W Module TDP, Module, max of range 10-40 W
reported in result source — Module TDP, Module, max of range 10-40 W
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)

Grades: A audited MLPerf · B third-party · C community · D vendor. How we rank · JSON