B300-SXM-270GBx1_TRT (1x NVIDIA B300-SXM-270GB): edge AI benchmarks
Key results
| Workload | Best result | Model · precision | Power · perf/W | Grade · date | Source |
|---|---|---|---|---|---|
| speech-to-text | 7059 FPS batch unknown | MLPerf whisper fp16 · TensorRT 10.14, CUDA 13.1, cuDNN 9.17, TensorRT-LLM feat/1.2-mlpinf, NVIDIA Dynamo mlperf-v6.0-dynamo-v0.8.0, vLLM CentM | unknown | A 2026-09-16 (published) | MLPerf Inference v6.1, closed division, data-centre suite |
| LLM serving (MLPerf datacenter) | 21266 tok/s batch unknown | MLPerf llama3.1-8b fp4 · TensorRT 10.14, CUDA 13.1, cuDNN 9.17, TensorRT-LLM feat/1.2-mlpinf, NVIDIA Dynamo mlperf-v6.0-dynamo-v0.8.0, vLLM CentM | unknown | A 2026-09-16 (published) | MLPerf Inference v6.1, closed division, data-centre suite |
Best published result per workload, across model sizes. For like-for-like groups, open the per-workload tables below.
Show data — per-workload tables
object detection
No published object detection results for B300-SXM-270GBx1_TRT (1x NVIDIA B300-SXM-270GB) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
instance segmentation
No published instance segmentation results for B300-SXM-270GBx1_TRT (1x NVIDIA B300-SXM-270GB) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
pose estimation
No published pose estimation results for B300-SXM-270GBx1_TRT (1x NVIDIA B300-SXM-270GB) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
image classification
No published image classification results for B300-SXM-270GBx1_TRT (1x NVIDIA B300-SXM-270GB) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
semantic segmentation
No published semantic segmentation results for B300-SXM-270GBx1_TRT (1x NVIDIA B300-SXM-270GB) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
speech-to-text
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| unknown · b=unknown | 7059 FPS | MLPerf whisper fp16 · TensorRT 10.14, CUDA 13.1, cuDNN 9.17, TensorRT-LLM feat/1.2-mlpinf, NVIDIA Dynamo mlperf-v6.0-dynamo-v0.8.0, vLLM CentM | A | unknown power n/a | MLPerf Inference v6.1, closed division, data-centre suite 2026-09-16 (published) | 27 of 48 |
LLM generation
No published LLM generation results for B300-SXM-270GBx1_TRT (1x NVIDIA B300-SXM-270GB) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
LLM serving (MLPerf datacenter)
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| LLM >40B · b=unknown | 14637 tok/s | MLPerf llama2-70b-99.9 fp4 · TensorRT 10.14, CUDA 13.1, cuDNN 9.17, TensorRT-LLM feat/1.2-mlpinf, NVIDIA Dynamo mlperf-v6.0-dynamo-v0.8.0, vLLM CentM | A | unknown power n/a | MLPerf Inference v6.1, closed division, data-centre suite 2026-09-16 (published) | 85 of 93 |
| LLM 5–14B · b=unknown | 21266 tok/s | MLPerf llama3.1-8b fp4 · TensorRT 10.14, CUDA 13.1, cuDNN 9.17, TensorRT-LLM feat/1.2-mlpinf, NVIDIA Dynamo mlperf-v6.0-dynamo-v0.8.0, vLLM CentM | A | unknown power n/a | MLPerf Inference v6.1, closed division, data-centre suite 2026-09-16 (published) | 28 of 48 |
How to read these numbers
Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.