Find edge AI hardware
Task face · model-size class mid-size CNN · batch 1 · 11 platforms
Not like-for-like across groups: same model-size class and batch, but 3 different model/precision combinations. Compare within a group; each group is sorted by result.
YuNet · not stated (MX3 activations BF16 / weights 4-8-16 bit per vendor) (1)
| Platform | Result | Model · precision · stack | Grade · date | Power | Price | Source |
|---|---|---|---|---|---|---|
| MemryX MX3 M.2 module | 7221 FPS throughput b=1 | YuNet not stated (MX3 activations BF16 / weights 4-8-16 bit per vendor) · MemryX SDK 2.2 (closed-loop compiled DFP) | C 2026-07-15 (published) | unknown no power published | unknown | MemryX Model Explorer (SDK 2.2) |
FaceNet - InceptionResnetV1 · INT8 (2)
| Platform | Result | Model · precision · stack | Grade · date | Power | Price | Source |
|---|---|---|---|---|---|---|
| Axelera Metis Embedded 113m M.2 card | 1285 FPS throughput b=1 | FaceNet - InceptionResnetV1 INT8 · Voyager SDK (GStreamer pipeline) | C 2026-10-15 (page last edited) | unknown no power published | unknown | Axelera Voyager SDK model zoo (docs/reference/models/model-zoo.md) |
| Axelera Metis Edge 130p PCIe card | 1226 FPS throughput b=1 | FaceNet - InceptionResnetV1 INT8 · Voyager SDK (GStreamer pipeline) | C 2026-10-15 (page last edited) | unknown no power published | unknown | Axelera Voyager SDK model zoo (docs/reference/models/model-zoo.md) |
RetinaFace_resnet50_320 · INT8 (8)
| Platform | Result | Model · precision · stack | Grade · date | Power | Price | Source |
|---|---|---|---|---|---|---|
| Rockchip RK3576 (NPU, single core of 2) | 54.60 FPS throughput b=1 | RetinaFace_resnet50_320 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
| Rockchip RK3588 (NPU, single core of 3) | 50.00 FPS throughput b=1 | RetinaFace_resnet50_320 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
| Rockchip RV1126B (NPU) | 46.50 FPS throughput b=1 | RetinaFace_resnet50_320 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
| Rockchip RK3562 (NPU) | 27.10 FPS throughput b=1 | RetinaFace_resnet50_320 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
| Rockchip RK1808 (NPU) | 24.60 FPS throughput b=1 | RetinaFace_resnet50_320 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
| Rockchip RV1126 (NPU) | 20.80 FPS throughput b=1 | RetinaFace_resnet50_320 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
| Rockchip RK3566/RK3568 (NPU) | 18.40 FPS throughput b=1 | RetinaFace_resnet50_320 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
| Rockchip RV1109 (NPU) | 14.60 FPS throughput b=1 | RetinaFace_resnet50_320 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
Confidence: A audited MLPerf closed, B documented third-party, C community, D vendor-published, E estimate. Unknown is never assumed. Other like-for-like groups: mid-size CNN, batch 1 (11); mobile-class CNN, batch 1 (1); unknown, batch 1 (9)