Pi CM5 - 16GB (Nvidia RTX 4090) (as tested by Jeff Geerling): edge AI benchmarks
Best published result per workload, across model sizes — open “Show data” for like-for-like groups.
Show data — per-workload tables
object detection
No published object detection results for Pi CM5 - 16GB (Nvidia RTX 4090) (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
instance segmentation
No published instance segmentation results for Pi CM5 - 16GB (Nvidia RTX 4090) (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
pose estimation
No published pose estimation results for Pi CM5 - 16GB (Nvidia RTX 4090) (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
image classification
No published image classification results for Pi CM5 - 16GB (Nvidia RTX 4090) (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
semantic segmentation
No published semantic segmentation results for Pi CM5 - 16GB (Nvidia RTX 4090) (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
speech-to-text
No published speech-to-text results for Pi CM5 - 16GB (Nvidia RTX 4090) (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.
LLM generation
| Like-for-like group | Best result | Model · precision · stack | Grade | Power | Source · date | Rank in group |
|---|---|---|---|---|---|---|
| LLM 5–14B · b=1 | 83.31 tok/s | DeepSeek R1 14b as in linked issue (Ollama default tags are 4-bit) · llama.cpp (Vulkan) | C | 398 W measured | Jeff Geerling ai-benchmarks README (Findings tables) undated | 7 of 53 |
| LLM 15–40B · b=1 | 189 tok/s | gpt-oss 20b as in linked issue (Ollama default tags are 4-bit) · llama.cpp (Vulkan) | C | 322 W measured | Jeff Geerling ai-benchmarks README (Findings tables) undated | 2 of 22 |
| LLM ≤4B · b=1 | 236 tok/s | Llama 3.2:3b as in linked issue (Ollama default tags are 4-bit) · llama.cpp (Vulkan) | C | 290 W measured | Jeff Geerling ai-benchmarks README (Findings tables) undated | 6 of 64 |
How to read these numbers
Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.