anomaly detection benchmarks on edge AI hardware
MLPerf Tiny, microcontroller class. Throughput in inferences per second; measured energy per inference is shown on each platform page. Not ranked against edge GPUs or accelerators.
34 published rows. Each table compares only results with the same model-size class and batch size. Search this workload · JSON.
Fastest in the best-covered like-for-like group (unknown, batch 1): Next Generation Snapdragon Mobile Platform MTP at 14625 inferences/s A 2025-09-17 (published). 1 groups, 16 platforms.
Show data — 1 like-for-like tables
unknown · batch 1 (16 platforms)
✓ Like-for-like: model-size class unknown, batch 1 (size or batch not stated by source — unverified). Model, precision and stack may still differ.
| Platform | Result | Model · precision · stack | Grade | Power | Source |
|---|---|---|---|---|---|
| Next Generation Snapdragon Mobile Platform MTP | 14625 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) PTQ · Qualcomm AI Stack · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| Snapdragon 8 Gen 3 Mobile HDK (Snapdragon 8 Gen 3 Mobile Platform) | 13541 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) PTQ · Qualcomm AI Stack · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| K1_BOARD_V1.0_HIGH_FREQ (K1 Octa-Core RISC-V) | 3163 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) Uniform symmetric quantization · · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| ASUS Tinker V (Renesas RZ/Five) | 2723 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) ONNC calibrator with PTQ · ONNC · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| EK-RA8D1 (R7FA8D1AHECBD) | 1884 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) INT8 · · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| K1_BOARD_V1.0 (K1 Octa-Core RISC-V) | 1357 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) Uniform symmetric quantization · · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| NUCLEO-H7A3ZI (STM32H7A3ZIT6Q) | 923 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-H7A3ZI-Q (STM32H7A3ZIT6Q) | 816 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) INT8 · X-CUBE-AI v9.0.0 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| DISCO-F746NG (STM32F746NG) | 702 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-U575ZI-Q (STM32U575ZIT6Q) | 312 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) INT8 · X-CUBE-AI v10.2 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| NUCLEO-L4R5ZI (STM32L4R5ZIT6U) | 211 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-L4R5ZI-P (STM32L4R5ZIT6P) | 209 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) INT8 · X-CUBE-AI v10.2 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| CY8CPROTO-062-4343W (PSoC 62 MCU) | 203 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-U385RG-Q (STM32U385RGT6Q) | 185 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) INT8 · X-CUBE-AI v10.2 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| Renesas RH850/F1KM-S4 R7F701649 | 177 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-G0B1RE (STM32G0B1RE) | 24.45 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
Fastest in the best-covered like-for-like group (unknown, batch 1): Next Generation Snapdragon Mobile Platform MTP at 14625 inferences/s A 2025-09-17 (published). 1 groups, 16 platforms.
Show data — 1 like-for-like tables
unknown · batch 1 (16 platforms)
✓ Like-for-like: model-size class unknown, batch 1 (size or batch not stated by source — unverified). Model, precision and stack may still differ.
| Platform | Result | Model · precision · stack | Grade | Power | Source |
|---|---|---|---|---|---|
| Next Generation Snapdragon Mobile Platform MTP | 14625 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) PTQ · Qualcomm AI Stack · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| Snapdragon 8 Gen 3 Mobile HDK (Snapdragon 8 Gen 3 Mobile Platform) | 13541 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) PTQ · Qualcomm AI Stack · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| K1_BOARD_V1.0_HIGH_FREQ (K1 Octa-Core RISC-V) | 3163 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) Uniform symmetric quantization · · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| ASUS Tinker V (Renesas RZ/Five) | 2723 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) ONNC calibrator with PTQ · ONNC · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| EK-RA8D1 (R7FA8D1AHECBD) | 1884 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) INT8 · · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| K1_BOARD_V1.0 (K1 Octa-Core RISC-V) | 1357 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) Uniform symmetric quantization · · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| NUCLEO-H7A3ZI (STM32H7A3ZIT6Q) | 923 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-H7A3ZI-Q (STM32H7A3ZIT6Q) | 816 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) INT8 · X-CUBE-AI v9.0.0 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| DISCO-F746NG (STM32F746NG) | 702 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-U575ZI-Q (STM32U575ZIT6Q) | 324 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-L4R5ZI (STM32L4R5ZIT6U) | 211 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-L4R5ZI-P (STM32L4R5ZIT6P) | 209 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) INT8 · X-CUBE-AI v10.2 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| CY8CPROTO-062-4343W (PSoC 62 MCU) | 203 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-U385RG-Q (STM32U385RGT6Q) | 185 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) INT8 · X-CUBE-AI v10.2 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.3 (closed) 2025-09-17 (published) |
| Renesas RH850/F1KM-S4 R7F701649 | 177 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
| NUCLEO-G0B1RE (STM32G0B1RE) | 24.45 inferences/s throughput · b=1 | FC autoencoder (MLPerf Tiny AD) not stated · Bosch Hardware-Aware Lowering Engine (HALE) version 1.0.175 · unknown | A | unknown power n/a no power published | MLPerf Tiny v1.2 (closed) Older data (2024) |
How to read these numbers
Every number is labelled. Confidence: A MLPerf closed, audited · B documented third-party method · C community / review · D vendor-published, not independently verified · E estimate. Power basis: measured with the result · spec vendor spec/envelope · power n/a not published.
Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.