ESC8000_E12P_RTX_PRO_6000_PCIE_96GBx8 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition): edge AI benchmarks

Name: ESC8000_E12P_RTX_PRO_6000_PCIE_96GBx8 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition)
Brand: ASUSTeK

ASUSTeKdatacenter serverNo licensed photo yet

Vendor ASUSTeKForm factor datacenter serverCompute GPUIndicative price unknownPower envelope unknownPublished rows 5

Key results

Best published result per workload for ESC8000_E12P_RTX_PRO_6000_PCIE_96GBx8 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition)
Workload	Best result	Model · precision	Power · perf/W	Grade · date	Source
LLM serving (MLPerf datacenter)	48614 tok/s batch unknown	MLPerf llama3.1-8b fp4 · TensorRT 10.14, CUDA 13.1	unknown	A 2026-04-01 (published)	MLPerf Inference v6.0, closed division, data-centre suite

Best published result per workload, across model sizes. For like-for-like groups, open the per-workload tables below.

Show data — per-workload tables

object detection

◌

No published object detection results for ESC8000_E12P_RTX_PRO_6000_PCIE_96GBx8 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

instance segmentation

◌

No published instance segmentation results for ESC8000_E12P_RTX_PRO_6000_PCIE_96GBx8 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for ESC8000_E12P_RTX_PRO_6000_PCIE_96GBx8 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

◌

No published image classification results for ESC8000_E12P_RTX_PRO_6000_PCIE_96GBx8 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

semantic segmentation

◌

No published semantic segmentation results for ESC8000_E12P_RTX_PRO_6000_PCIE_96GBx8 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

◌

No published speech-to-text results for ESC8000_E12P_RTX_PRO_6000_PCIE_96GBx8 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

◌

No published LLM generation results for ESC8000_E12P_RTX_PRO_6000_PCIE_96GBx8 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM serving (MLPerf datacenter)

Like-for-like group	Best result	Model · precision · stack	Grade	Power	Source · date	Rank in group
LLM >40B · b=unknown	27730 tok/s	MLPerf llama2-70b-99 fp4 · TensorRT 10.14, CUDA 13.1	A	unknown power n/a	MLPerf Inference v6.0, closed division, data-centre suite 2026-04-01 (published)	74 of 93
LLM 5–14B · b=unknown	48614 tok/s	MLPerf llama3.1-8b fp4 · TensorRT 10.14, CUDA 13.1	A	unknown power n/a	MLPerf Inference v6.0, closed division, data-centre suite 2026-04-01 (published)	23 of 48

How to read these numbers

Every number is labelled. Confidence: A MLPerf closed, audited · B documented third-party method · C community / review · D vendor-published, not independently verified · E estimate. Power basis: measured with the result · spec vendor spec/envelope · power n/a not published.

Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.