Dell_MangoBoost Heterogeneous Cluster (8x AMD Instinct MI300X 192GB HBM3 (x8) and AMD Instinct MI325X 256GB HBM3e (x8) and AMD Instinct MI355X 288GB HBM3e (x8)): edge AI benchmarks
Key results
| Workload | Best result | Model · precision | Power · perf/W | Grade · date | Source |
|---|---|---|---|---|---|
| LLM serving (MLPerf datacenter) | 151843 tok/s batch unknown | MLPerf llama2-70b-99 fp8 · ROCm | unknown | A 2026-04-01 (published) | MLPerf Inference v6.0, closed division, data-centre suite |
Best published result per workload, across model sizes. For like-for-like groups, open the per-workload tables below.
Show data — per-workload tables
object detection
No published object detection results for Dell_MangoBoost Heterogeneous Cluster (8x AMD Instinct MI300X 192GB HBM3 (x8) and AMD Instinct MI325X 256GB HBM3e (x8) and AMD Instinct MI355X 288GB HBM3e (x8)) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
instance segmentation
No published instance segmentation results for Dell_MangoBoost Heterogeneous Cluster (8x AMD Instinct MI300X 192GB HBM3 (x8) and AMD Instinct MI325X 256GB HBM3e (x8) and AMD Instinct MI355X 288GB HBM3e (x8)) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
pose estimation
No published pose estimation results for Dell_MangoBoost Heterogeneous Cluster (8x AMD Instinct MI300X 192GB HBM3 (x8) and AMD Instinct MI325X 256GB HBM3e (x8) and AMD Instinct MI355X 288GB HBM3e (x8)) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
image classification
No published image classification results for Dell_MangoBoost Heterogeneous Cluster (8x AMD Instinct MI300X 192GB HBM3 (x8) and AMD Instinct MI325X 256GB HBM3e (x8) and AMD Instinct MI355X 288GB HBM3e (x8)) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
semantic segmentation
No published semantic segmentation results for Dell_MangoBoost Heterogeneous Cluster (8x AMD Instinct MI300X 192GB HBM3 (x8) and AMD Instinct MI325X 256GB HBM3e (x8) and AMD Instinct MI355X 288GB HBM3e (x8)) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
speech-to-text
No published speech-to-text results for Dell_MangoBoost Heterogeneous Cluster (8x AMD Instinct MI300X 192GB HBM3 (x8) and AMD Instinct MI325X 256GB HBM3e (x8) and AMD Instinct MI355X 288GB HBM3e (x8)) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
LLM generation
No published LLM generation results for Dell_MangoBoost Heterogeneous Cluster (8x AMD Instinct MI300X 192GB HBM3 (x8) and AMD Instinct MI325X 256GB HBM3e (x8) and AMD Instinct MI355X 288GB HBM3e (x8)) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
LLM serving (MLPerf datacenter)
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| LLM >40B · b=unknown | 151843 tok/s | MLPerf llama2-70b-99 fp8 · ROCm | A | unknown power n/a | MLPerf Inference v6.0, closed division, data-centre suite 2026-04-01 (published) | 14 of 93 |
How to read these numbers
Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.