Rockchip RK3588 (NPU, single core of 3): edge AI benchmarks
Key results
| Workload | Best result | Model · precision | Power · perf/W | Grade · date | Source |
|---|---|---|---|---|---|
| object detection | 109 FPS batch 1 | yolov6n INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | unknown | C 2026-10-13 (page last edited) | Rockchip rknn_model_zoo README benchmark table |
| instance segmentation | 119 FPS batch 1 | mobilesam_decoder FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | unknown | C 2026-10-13 (page last edited) | Rockchip rknn_model_zoo README benchmark table |
| pose estimation | 58.30 FPS batch 1 | yolov8n-pose INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | unknown | C 2026-10-13 (page last edited) | Rockchip rknn_model_zoo README benchmark table |
| image classification | 459 FPS batch 1 | mobilenetv2-12 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | unknown | C 2026-10-13 (page last edited) | Rockchip rknn_model_zoo README benchmark table |
| semantic segmentation | 42.70 FPS batch 1 | ppseg_lite_1024x512 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | unknown | C 2026-10-13 (page last edited) | Rockchip rknn_model_zoo README benchmark table |
| language models (NLP) | 987 FPS batch 1 | lite-transformer-encoder-16 FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | unknown | C 2026-10-13 (page last edited) | Rockchip rknn_model_zoo README benchmark table |
| embeddings (CLIP etc.) | 96.10 FPS batch 1 | clip_text FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | unknown | C 2026-10-13 (page last edited) | Rockchip rknn_model_zoo README benchmark table |
| face analysis | 229 FPS batch 1 | RetinaFace_mobile320 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | unknown | C 2026-10-13 (page last edited) | Rockchip rknn_model_zoo README benchmark table |
| text recognition (OCR) | 605 FPS batch 1 | lprnet FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | unknown | C 2026-10-13 (page last edited) | Rockchip rknn_model_zoo README benchmark table |
| oriented object detection | 77.10 FPS batch 1 | yolov8n-obb INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | unknown | C 2026-10-13 (page last edited) | Rockchip rknn_model_zoo README benchmark table |
Best published result per workload, across model sizes. For like-for-like groups, open the per-workload tables below.
Show data — per-workload tables
object detection
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| small (YOLO-s) · b=1 | 66.50 FPS | yolov5s_relu INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 12 of 22 |
| nano (YOLO-n) · b=1 | 109 FPS | yolov6n INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 17 of 27 |
| medium (YOLO-m) · b=1 | 20.90 FPS | yolov5m INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 13 of 20 |
| unknown · b=1 | 73.60 FPS | yolov7-tiny INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 12 of 20 |
instance segmentation
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| nano (YOLO-n) · b=1 | 71.50 FPS | yolov5n-seg INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 9 of 15 |
| small (YOLO-s) · b=1 | 37.40 FPS | yolov5s-seg INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 8 of 13 |
| medium (YOLO-m) · b=1 | 16.40 FPS | yolov5m-seg INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 7 of 13 |
| unknown · b=1 | 119 FPS | mobilesam_decoder FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 6 of 10 |
pose estimation
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| nano (YOLO-n) · b=1 | 58.30 FPS | yolov8n-pose INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 7 of 9 |
image classification
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| mobile-class CNN · b=1 | 459 FPS | mobilenetv2-12 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 16 of 29 |
| mid-size CNN · b=1 | 113 FPS | resnet50-v2-7 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 15 of 28 |
semantic segmentation
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| mobile-class CNN · b=1 | 34.70 FPS | deeplab-v3-plus-mobilenet-v2 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 10 of 17 |
| unknown · b=1 | 42.70 FPS | ppseg_lite_1024x512 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 6 of 14 |
speech-to-text
No published speech-to-text results for Rockchip RK3588 (NPU, single core of 3) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
LLM generation
No published LLM generation results for Rockchip RK3588 (NPU, single core of 3) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
language models (NLP)
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| unknown · b=1 | 987 FPS | lite-transformer-encoder-16 FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 1 of 8 |
embeddings (CLIP etc.)
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| unknown · b=1 | 96.10 FPS | clip_text FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 1 of 5 |
face analysis
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| mid-size CNN · b=1 | 50.00 FPS | RetinaFace_resnet50_320 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 5 of 11 |
| unknown · b=1 | 229 FPS | RetinaFace_mobile320 INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 5 of 9 |
text recognition (OCR)
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| unknown · b=1 | 605 FPS | lprnet FP16 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 4 of 11 |
oriented object detection
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| nano (YOLO-n) · b=1 | 77.10 FPS | yolov8n-obb INT8 · RKNN-Toolkit2 / RKNPU (rknn_model_zoo) | C | unknown power n/a | Rockchip rknn_model_zoo README benchmark table 2026-10-13 (page last edited) | 7 of 13 |
Compare with another platform (107)
8xMI355X_2xEPYC_9575F (8x AMD Instinct MI355X 288GB HBM3e) · AMD Alveo V70 (Versal AI Core, XDNA AIE-ML) · AMD Kria KV260 Vision AI Starter Kit (K26 SOM) · AMD Ryzen AI Max+ (Strix Halo) iGPU · AMD Ryzen AI Max+ 395 / PRO 395 (Strix Halo, Radeon 8060S) · AMD Ryzen AI processor (SKU not stated) · AMD Versal AI Core VCK190 (VC1902) · AMD Versal AI Edge Series Gen 2 VEK385 · AMD Versal AI Edge VEK280 (VE2802) · AMD Zynq UltraScale+ ZCU102 (ZU9EG) · AMD Zynq UltraScale+ ZCU104 (ZU7EV) · Altera Agilex 5 FPGA E-Series 065B Modular Development Kit (FPGA AI Suite, OFS PCIe) · Altera Agilex 7 FPGA I-Series Development Kit (FPGA AI Suite) · Apple M4 (10-core GPU, 120 GB/s) · Apple Mac mini M4 Pro 64GB · Axelera Metis Edge 130p PCIe card · Axelera Metis Edge 130p PCIe card (16GB) · Axelera Metis Embedded 113m M.2 card · Cisco UCS C880A M8 (8x NVIDIA B300-SXM-270GB) · Coral Dev Board CPU (quad Cortex-A53 @1.5 GHz, CPU only) · CoreWeave GB200 NVL72 (4x NVIDIA GB200) · CoreWeave GB300 NVL72 (4x NVIDIA GB300) · Dell Pro Max with GB10 · G8825Z5 (8x AMD Instinct MI350X 288GB HBM3e) · G894-AD3-AAX7 (8x NVIDIA B300-SXM-270GB) · G894-SD3-AAX7 (8x NVIDIA B300-SXM-270GB) · G894-ZD3-AAX7 (8x NVIDIA B300-SXM-270GB) · Google Coral Dev Board (Edge TPU) · Google Coral USB Accelerator (Edge TPU) on Xeon Gold 6154 host, USB 3.0 · HPE ProLiant Compute DL380a Gen12 (10x NVIDIA RTX PRO 6000 Blackwell Server Edition) · HPE ProLiant Compute DL380a Gen12 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition) · HPE ProLiant Compute XD685 (8x AMD Instinct MI355X 288GB HBM3e) · HPE ProLiant DL385 Gen11 (4x NVIDIA RTX PRO 6000 Blackwell Server Edition) · Hailo-10H (M.2/PCIe, x86 host) · Hailo-8 (M.2/PCIe, x86 host) · Hailo-8L (M.2/PCIe, x86 host) · Intel Arc A-Series Graphics · Intel Arc B-Series Graphics · Intel Atom X6425E · Intel Atom x7425E · Intel Celeron 6305E · Intel Core 5 330 · Intel Core Ultra 7 155H · Intel Core Ultra 7 155H (Meteor Lake) · Intel Core Ultra 7 255H · Intel Core Ultra 7 258V (Lunar Lake) · Intel Core Ultra 7 265H · Intel Core Ultra 7 368H · Intel Core Ultra 9 288V · Intel Core Ultra X7 358H (Panther Lake) · Intel Core i5-1235U · Intel Core i5-1335U · Intel Core i5-13600K · Intel Core i7-1185G7 · Intel Core i7-1185GRE · Intel Core i7-12700H · Intel Core i7-1355U · Intel Data Center GPU Flex 170 · Intel N100 · Intel Xeon Gold 5218T · Intel Xeon Gold 6154 desktop (CPU only, TFLite) · Intel Xeon Gold 6338N · Intel Xeon Platinum 6972P · Intel Xeon Platinum 8280 · Intel Xeon Platinum 8380 · Intel Xeon Platinum 8480+ · Intel Xeon Platinum 8580 · Lattice Avant-E Evaluation Board (sensAI) · Lattice CertusPro-NX Voice and Vision ML Board (sensAI) · Lattice CrossLink-NX-33 Voice and Vision ML Board (sensAI) · Lattice iCE40 UltraPlus Mobile Development Platform (sensAI) · MemryX MX3 M.2 module · Microchip PolarFire SoC Video Kit (VectorBlox CoreVectorBlox) · NDP9120 (N/A) · NUCLEO-L4R5ZI (STM32L4R5ZIT6U) · NUCLEO-U575ZI-Q (STM32U575ZIT6Q) · NVIDIA DGX B200 (8x NVIDIA B200-SXM-180GB) · NVIDIA DGX B300 (8x NVIDIA B300-SXM-270GB) · NVIDIA DGX Spark · NVIDIA GB200 NVL72 (4x NVIDIA GB200) · NVIDIA GB300 NVL72 (4x NVIDIA GB300) · NVIDIA Jetson AGX Orin 64GB · NVIDIA Jetson AGX Thor · NVIDIA Jetson Orin NX 16GB · NVIDIA Jetson Orin Nano Super · NVIDIA Jetson Thor T4000 · Nebius B300 n1 (8x NVIDIA B300-SXM-270GB) · Nebius GB300 NVL72 (4x NVIDIA GB300) · Qualcomm Dragonwing IQ-9075 EVK · Qualcomm Dragonwing RB3 Gen 2 (QCS6490) · Qualcomm Snapdragon X Elite (CRD) · Qualcomm Snapdragon X2 Elite (CRD) · QuantaGrid D75H-10U (8x NVIDIA B300-SXM-270GB) · Raspberry Pi 5 (CPU only) · Raspberry Pi 5 + AI HAT+ (Hailo-8) · Rockchip RK1808 (NPU) · Rockchip RK3562 (NPU) · Rockchip RK3566/RK3568 (NPU) · Rockchip RK3576 (NPU, single core of 2) · Rockchip RV1109 (NPU) · Rockchip RV1126 (NPU) · Rockchip RV1126B (NPU) · TI AM68A (8 TOPS) · TRIGKEY Mini PC (AMD Ryzen 5 5560U, CPU) · Terasic DE10-Agilex Development Board (Agilex 7, FPGA AI Suite) · XA NB3I-E12 (8x NVIDIA B300-SXM-270GB) · XE7745_8xMI350P_2xEPYC_9455 (8x AMD Instinct MI350P)
How to read these numbers
Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.