HWBench

Minisforum MS-R1 (as tested by Jeff Geerling) vs NVIDIA Jetson AGX Orin 64GB

NVIDIA Jetson AGX Orin developer kit with its retail box, on a black background
NVIDIA Jetson AGX Orin developer kit. Photo: Auledas, CC BY 4.0, via Wikimedia Commons.
Showing the newest results per platform and source. 12 superseded older results are hidden.Showing all results, including 12 superseded by newer results from the same source.

Minisforum MS-R1 (as tested by Jeff Geerling) is faster in all 2 like-for-like comparisons (largest gap: LLM generation, 1.19×).

Minisforum MS-R1 (as tested by Jeff Geerling)NVIDIA Jetson AGX Orin 64GB
Best LLM generation71.36 tok/s C
2025-11-10 (page last edited)
273 tok/s C
2026-07-21 (page last edited)
Powern/a60.00 W Module TDP, Module, max of range 15-60 W
Perf / Wn/a4.55 tok/s/W Module TDP, Module, max of range 15-60 W
Pricen/a$3499 list
Workloads with data1 of 73 of 7

Best published LLM generation result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

Only NVIDIA Jetson AGX Orin 64GB has published object detection results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB435 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
B60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)

Minisforum MS-R1 (as tested by Jeff Geerling):

◌

No published object detection results for Minisforum MS-R1 (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

instance segmentation

◌

No published instance segmentation results for Minisforum MS-R1 (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for Minisforum MS-R1 (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

◌

No published image classification results for Minisforum MS-R1 (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

semantic segmentation

Only NVIDIA Jetson AGX Orin 64GB has published semantic segmentation results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB104 FPS
throughput · b=1
SegFormer-B0 (640x640)
FP16 · TensorRT (ONNX export) · unknown
C60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

Minisforum MS-R1 (as tested by Jeff Geerling):

◌

No published semantic segmentation results for Minisforum MS-R1 (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

◌

No published speech-to-text results for Minisforum MS-R1 (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

✓ Like-for-like: model-size class LLM 5–14B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Minisforum MS-R1 (as tested by Jeff Geerling)34.52 tok/s
generation_throughput · b=1
llama3.1:8b
Ollama default tag (4-bit unless tag says otherwise) · Ollama (geerlingguy/ollama-benchmark) · LLM 5–14B
Cunknown power not published
not published
Jeff Geerling ai-benchmarks issue results (comments)
2025-11-10 (page last edited)
NVIDIA Jetson AGX Orin 64GB30.00 tok/s
generation_throughput · b=1
Qwen 3 8B
W4A16 · vLLM · LLM 5–14B
C60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
✓ Like-for-like: model-size class LLM ≤4B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Minisforum MS-R1 (as tested by Jeff Geerling)71.36 tok/s
generation_throughput · b=1
llama3.2:3b
Ollama default tag (4-bit unless tag says otherwise) · Ollama (geerlingguy/ollama-benchmark) · LLM ≤4B
Cunknown power not published
not published
Jeff Geerling ai-benchmarks issue results (comments)
2025-11-10 (page last edited)
NVIDIA Jetson AGX Orin 64GB60.00 tok/s
generation_throughput · b=1
Qwen3-VL-2B
W4A16 · vLLM · LLM ≤4B
C60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)

Minisforum MS-R1 (as tested by Jeff Geerling) is faster in all 2 like-for-like comparisons (largest gap: LLM generation, 1.19×).

Minisforum MS-R1 (as tested by Jeff Geerling)NVIDIA Jetson AGX Orin 64GB
Best LLM generation71.36 tok/s C
2025-11-10 (page last edited)
273 tok/s C
2026-07-21 (page last edited)
Powern/a60.00 W Module TDP, Module, max of range 15-60 W
Perf / Wn/a4.55 tok/s/W Module TDP, Module, max of range 15-60 W
Pricen/a$3499 list
Workloads with data1 of 75 of 7

Best published LLM generation result per platform (may be from different like-for-like groups — see data). n/a = not published; never estimated.

Show data — all workloads, sources and like-for-like groups

object detection

Only NVIDIA Jetson AGX Orin 64GB has published object detection results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB435 FPS
inference_time · b=1
YOLO26n
INT8 · Ultralytics TensorRT · nano (YOLO-n)
B60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
Ultralytics documentation (benchmark table)
2026-10-13 (page last edited)

Minisforum MS-R1 (as tested by Jeff Geerling):

◌

No published object detection results for Minisforum MS-R1 (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

instance segmentation

◌

No published instance segmentation results for Minisforum MS-R1 (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for Minisforum MS-R1 (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

Only NVIDIA Jetson AGX Orin 64GB has published image classification results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB6424 FPS
throughput_offline · b=unknown
MLPerf ResNet
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · mid-size CNN
Dunknown power not published
not published
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

Minisforum MS-R1 (as tested by Jeff Geerling):

◌

No published image classification results for Minisforum MS-R1 (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

semantic segmentation

Only NVIDIA Jetson AGX Orin 64GB has published semantic segmentation results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB104 FPS
throughput · b=1
SegFormer-B0 (640x640)
FP16 · TensorRT (ONNX export) · unknown
C60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
arXiv 2608.00927 AgriJetsonBench (abstract figures)
2026-08-02 (published)

Minisforum MS-R1 (as tested by Jeff Geerling):

◌

No published semantic segmentation results for Minisforum MS-R1 (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

Only NVIDIA Jetson AGX Orin 64GB has published speech-to-text results.

PlatformResultModel · precision · stackGradePowerSource
NVIDIA Jetson AGX Orin 64GB1170 FPS
throughput_offline · b=unknown
MLPerf RNN-T
INT8/FP16 (MLPerf closed) · TensorRT (MLPerf Inference, older round) · RNN-T
Dunknown power not published
not published
NVIDIA Jetson Benchmarks (MLPerf v3.1 results table)
Older data (2023)

Minisforum MS-R1 (as tested by Jeff Geerling):

◌

No published speech-to-text results for Minisforum MS-R1 (as tested by Jeff Geerling) or NVIDIA Jetson AGX Orin 64GB yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

✓ Like-for-like: model-size class LLM 5–14B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Minisforum MS-R1 (as tested by Jeff Geerling)34.52 tok/s
generation_throughput · b=1
llama3.1:8b
Ollama default tag (4-bit unless tag says otherwise) · Ollama (geerlingguy/ollama-benchmark) · LLM 5–14B
Cunknown power not published
not published
Jeff Geerling ai-benchmarks issue results (comments)
2025-11-10 (page last edited)
NVIDIA Jetson AGX Orin 64GB30.00 tok/s
generation_throughput · b=1
Qwen 3 8B
W4A16 · vLLM · LLM 5–14B
C60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)
✓ Like-for-like: model-size class LLM ≤4B, batch 1. Model, precision and stack may still differ.
PlatformResultModel · precision · stackGradePowerSource
Minisforum MS-R1 (as tested by Jeff Geerling)71.36 tok/s
generation_throughput · b=1
llama3.2:3b
Ollama default tag (4-bit unless tag says otherwise) · Ollama (geerlingguy/ollama-benchmark) · LLM ≤4B
Cunknown power not published
not published
Jeff Geerling ai-benchmarks issue results (comments)
2025-11-10 (page last edited)
NVIDIA Jetson AGX Orin 64GB60.00 tok/s
generation_throughput · b=1
Qwen3-VL-2B
W4A16 · vLLM · LLM ≤4B
C60.00 W Module TDP, Module, max of range 15-60 W
reported in result source — Module TDP, Module, max of range 15-60 W
NVIDIA Jetson AI Lab benchmarks (benchmarks.json)
2026-07-21 (page last edited)

Grades: A audited MLPerf · B third-party · C community · D vendor. How we rank · JSON