Orrick Optimized 6x NVIDIA B200 (6x NVIDIA B200-SXM-180GB): edge AI benchmarks
Key results
| Workload | Best result | Model · precision | Power · perf/W | Grade · date | Source |
|---|---|---|---|---|---|
| LLM serving (MLPerf datacenter) | 274927 tok/s batch unknown | MLPerf llama3.1-8b nvfp4 · TensorRT-LLM 1.3.0rc20 | unknown | B 2026-09-16 (published) | MLPerf Inference v6.1, open division, data-centre suite |
Best published result per workload, across model sizes. For like-for-like groups, open the per-workload tables below.
Show data — per-workload tables
object detection
No published object detection results for Orrick Optimized 6x NVIDIA B200 (6x NVIDIA B200-SXM-180GB) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
instance segmentation
No published instance segmentation results for Orrick Optimized 6x NVIDIA B200 (6x NVIDIA B200-SXM-180GB) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
pose estimation
No published pose estimation results for Orrick Optimized 6x NVIDIA B200 (6x NVIDIA B200-SXM-180GB) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
image classification
No published image classification results for Orrick Optimized 6x NVIDIA B200 (6x NVIDIA B200-SXM-180GB) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
semantic segmentation
No published semantic segmentation results for Orrick Optimized 6x NVIDIA B200 (6x NVIDIA B200-SXM-180GB) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
speech-to-text
No published speech-to-text results for Orrick Optimized 6x NVIDIA B200 (6x NVIDIA B200-SXM-180GB) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
LLM generation
No published LLM generation results for Orrick Optimized 6x NVIDIA B200 (6x NVIDIA B200-SXM-180GB) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
LLM serving (MLPerf datacenter)
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| LLM 5–14B · b=unknown | 274927 tok/s | MLPerf llama3.1-8b nvfp4 · TensorRT-LLM 1.3.0rc20 | B | unknown power n/a | MLPerf Inference v6.1, open division, data-centre suite 2026-09-16 (published) | 1 of 48 |
How to read these numbers
Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.