Find edge AI hardware
Task NLP · model-size class unknown · batch 1 · 8 platforms
Not like-for-like across groups: same model-size class and batch, but 2 different model/precision combinations. Compare within a group; each group is sorted by result.
lite-transformer-encoder-16 · FP16 (5)
| Platform | Result | Model · precision · stack | Grade · date | Power | Price | Source |
|---|---|---|---|---|---|---|
| Rockchip RK3588 (NPU, single core of 3) | 987 FPS throughput b=1 | lite-transformer-encoder-16 FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
| Rockchip RK3576 (NPU, single core of 2) | 981 FPS throughput b=1 | lite-transformer-encoder-16 FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
| Rockchip RK3562 (NPU) | 858 FPS throughput b=1 | lite-transformer-encoder-16 FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
| Rockchip RV1126B (NPU) | 853 FPS throughput b=1 | lite-transformer-encoder-16 FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
| Rockchip RK3566/RK3568 (NPU) | 386 FPS throughput b=1 | lite-transformer-encoder-16 FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
lite-transformer-decoder-16 · FP16 (3)
| Platform | Result | Model · precision · stack | Grade · date | Power | Price | Source |
|---|---|---|---|---|---|---|
| Rockchip RK1808 (NPU) | 110 FPS throughput b=1 | lite-transformer-decoder-16 FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
| Rockchip RV1126 (NPU) | 65.80 FPS throughput b=1 | lite-transformer-decoder-16 FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
| Rockchip RV1109 (NPU) | 48.00 FPS throughput b=1 | lite-transformer-decoder-16 FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C 2026-10-13 (page last edited) | unknown no power published | unknown | Rockchip rknn_model_zoo README benchmark table |
Confidence: A audited MLPerf closed, B documented third-party, C community, D vendor-published, E estimate. Unknown is never assumed. Other like-for-like groups: unknown, batch 1 (8); unknown, batch not stated (25)