HWBench

Workloads

Core edge workloads

Used for the home page, answers and edge rankings.

Core edge workloads
WorkloadPublished rowsPlatformsUnit
object detection162781FPS
instance segmentation18120FPS
pose estimation19223FPS
image classification177176FPS
semantic segmentation26435FPS
speech-to-text12162FPS
LLM generation2993106tok/s

More edge workloads

Published edge results in further workloads. Each has its own like-for-like tables.

More edge workloads
WorkloadPublished rowsPlatformsUnit
LLM prefill4122tok/s
vision-language models (VLM)7822tok/s
image/video generation7026FPS
language models (NLP)14133FPS
embeddings (CLIP etc.)155FPS
audio classification116FPS
speech enhancement41FPS
text-to-speech55RTF (lower is better)
depth estimation7312FPS
super-resolution1008FPS
face analysis9411FPS
hand tracking221FPS
text recognition (OCR)2711FPS
oriented object detection3113FPS
keypoint / feature detection166FPS
3D point clouds121FPS
object tracking61FPS
re-identification63FPS
medical segmentation64FPS
recommendation147FPS
video action recognition71FPS
graph neural network75FPS

Tiny (MLPerf Tiny, microcontrollers)

Microcontroller-class results from MLPerf Tiny, with measured energy per inference. Ranked only against each other.

Tiny (MLPerf Tiny, microcontrollers)
WorkloadPublished rowsPlatformsUnit
tiny image classification3919inferences/s
visual wake words3517inferences/s
anomaly detection3416inferences/s
keyword spotting3317inferences/s

Datacenter (not ranked against edge)

MLPerf Inference datacenter results. Kept out of edge rankings.

Datacenter (not ranked against edge)
WorkloadPublished rowsPlatformsUnit
LLM serving (MLPerf datacenter)605118tok/s
How to read these numbers
Every number is labelled. Confidence: A MLPerf closed, audited · B documented third-party method · C community / review · D vendor-published, not independently verified · E estimate. Power basis: measured with the result · spec vendor spec/envelope · power n/a not published.

Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.