tiny image classification benchmarks on edge AI hardware
MLPerf Tiny, microcontroller class. Throughput in inferences per second; measured energy per inference is shown on each platform page. Not ranked against edge GPUs or accelerators.
39 published rows. Each table compares only results with the same model-size class and batch size. Search this workload · JSON.
Fastest in the best-covered like-for-like group (mid-size CNN, batch 1): Next Generation Snapdragon Mobile Platform MTP at 10437 inferences/s A 2025-09-17 (published). 1 groups, 19 platforms.
Show data — 1 like-for-like tables
mid-size CNN · batch 1 (19 platforms)
✓ Like-for-like: model-size class mid-size CNN, batch 1. Model, precision and stack may still differ.
| Platform | Result | Model · precision · stack | Grade | Power | Source |
|---|---|---|---|---|---|
| Next Generation Snapdragon Mobile Platform MTP | 10437 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) PTQ · Qualcomm AI Stack · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| Snapdragon 8 Gen 3 Mobile HDK (Snapdragon 8 Gen 3 Mobile Platform) | 6722 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) PTQ · Qualcomm AI Stack · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| K1_BOARD_V1.0_HIGH_FREQ (K1 Octa-Core RISC-V) | 1023 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) Uniform symmetric quantization · · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| K1_BOARD_V1.0 (K1 Octa-Core RISC-V) | 438 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) Uniform symmetric quantization · · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| NDP9120 (N/A) | 195 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) Uniform scaling from pre-trained weights · N/A · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| EK-RA8D1 (R7FA8D1AHECBD) | 118 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) INT8 · · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| ASUS Tinker V (Renesas RZ/Five) | 29.97 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) ONNC calibrator with PTQ · ONNC · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-H7A3ZI-Q (STM32H7A3ZIT6Q) | 24.48 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) INT8 · X-CUBE-AI v9.0.0 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-H7A3ZI (STM32H7A3ZIT6Q) | 21.81 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-U3C5ZIT6-Q | 19.97 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) INT8 · STEDGE-AI Internal version · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| DISCO-F746NG (STM32F746NG) | 15.99 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| LC236R5E176_BOARD_V2.0 (Octopus B1) | 9.26 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) Uniform symmetric quantization · · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-U575ZI-Q (STM32U575ZIT6Q) | 9.13 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) INT8 · X-CUBE-AI v10.2 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| CY8CPROTO-062-4343W (PSoC 62 MCU) | 6.17 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-L4R5ZI (STM32L4R5ZIT6U) | 6.06 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) INT8 · X-CUBE-AI v9.0 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-L4R5ZI-P (STM32L4R5ZIT6P) | 6.04 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) INT8 · X-CUBE-AI v10.2 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| NUCLEO-U385RG-Q (STM32U385RGT6Q) | 5.48 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) INT8 · X-CUBE-AI v10.2 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| Renesas RH850/F1KM-S4 R7F701649 | 4.50 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-G0B1RE (STM32G0B1RE) | 0.657 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
Fastest in the best-covered like-for-like group (mid-size CNN, batch 1): Next Generation Snapdragon Mobile Platform MTP at 10437 inferences/s A 2025-09-17 (published). 1 groups, 19 platforms.
Show data — 1 like-for-like tables
mid-size CNN · batch 1 (19 platforms)
✓ Like-for-like: model-size class mid-size CNN, batch 1. Model, precision and stack may still differ.
| Platform | Result | Model · precision · stack | Grade | Power | Source |
|---|---|---|---|---|---|
| Next Generation Snapdragon Mobile Platform MTP | 10437 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) PTQ · Qualcomm AI Stack · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| Snapdragon 8 Gen 3 Mobile HDK (Snapdragon 8 Gen 3 Mobile Platform) | 6722 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) PTQ · Qualcomm AI Stack · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| K1_BOARD_V1.0_HIGH_FREQ (K1 Octa-Core RISC-V) | 1023 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) Uniform symmetric quantization · · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| K1_BOARD_V1.0 (K1 Octa-Core RISC-V) | 438 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) Uniform symmetric quantization · · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| NDP9120 (N/A) | 195 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) Uniform scaling from pre-trained weights · N/A · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| EK-RA8D1 (R7FA8D1AHECBD) | 118 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) INT8 · · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| ASUS Tinker V (Renesas RZ/Five) | 29.97 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) ONNC calibrator with PTQ · ONNC · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-H7A3ZI-Q (STM32H7A3ZIT6Q) | 24.48 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) INT8 · X-CUBE-AI v9.0.0 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-H7A3ZI (STM32H7A3ZIT6Q) | 21.81 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-U3C5ZIT6-Q | 19.97 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) INT8 · STEDGE-AI Internal version · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| DISCO-F746NG (STM32F746NG) | 15.99 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| LC236R5E176_BOARD_V2.0 (Octopus B1) | 9.26 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) Uniform symmetric quantization · · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-U575ZI-Q (STM32U575ZIT6Q) | 9.13 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) INT8 · X-CUBE-AI v10.2 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| CY8CPROTO-062-4343W (PSoC 62 MCU) | 6.17 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-L4R5ZI (STM32L4R5ZIT6U) | 6.06 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) INT8 · X-CUBE-AI v9.0 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-L4R5ZI-P (STM32L4R5ZIT6P) | 6.04 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) INT8 · X-CUBE-AI v10.2 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| NUCLEO-U385RG-Q (STM32U385RGT6Q) | 5.48 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) INT8 · X-CUBE-AI v10.2 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| Renesas RH850/F1KM-S4 R7F701649 | 4.50 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-G0B1RE (STM32G0B1RE) | 0.657 inferences/s throughput · b=1 | ResNet-8 (MLPerf Tiny IC) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · mid-size CNN | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
How to read these numbers
Every number is labelled. Confidence: A MLPerf closed, audited · B documented third-party method · C community / review · D vendor-published, not independently verified · E estimate. Power basis: measured with the result · spec vendor spec/envelope · power n/a not published.
Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.