Framework Mainboard Cluster (512GB) (as tested by Jeff Geerling): edge AI benchmarks

Name: Framework Mainboard Cluster (512GB) (as tested by Jeff Geerling)
Brand: (independent test)

No licensed photo available — placeholder drawing.

Vendor (independent test)Form factor independent test systemCompute GPUIndicative price unknownPower envelope unknownPublished rows 1

LLM generation0.710 tok/sC perf/W n/aundated

Best published result per workload, across model sizes — open “Show data” for like-for-like groups.

Show data — per-workload tables

object detection

◌

No published object detection results for Framework Mainboard Cluster (512GB) (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

instance segmentation

◌

No published instance segmentation results for Framework Mainboard Cluster (512GB) (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

pose estimation

◌

No published pose estimation results for Framework Mainboard Cluster (512GB) (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

image classification

◌

No published image classification results for Framework Mainboard Cluster (512GB) (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

semantic segmentation

◌

No published semantic segmentation results for Framework Mainboard Cluster (512GB) (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

speech-to-text

◌

No published speech-to-text results for Framework Mainboard Cluster (512GB) (as tested by Jeff Geerling) yet.
We only show cited public figures — nothing is estimated to fill gaps. Requests tell us what to source or test next.

LLM generation

Like-for-like group	Best result	Model · precision · stack	Grade	Power	Source · date	Rank in group
LLM >40B · b=1	0.710 tok/s	Llama 3.1:405b as in linked issue (Ollama default tags are 4-bit) · Ollama / llama.cpp (see linked issue)	C	unknown power n/a	Jeff Geerling ai-benchmarks README (Findings tables) undated	11 of 11

How to read these numbers

Every number is labelled. Confidence: A MLPerf closed, audited · B documented third-party method · C community / review · D vendor-published, not independently verified · E estimate. Power basis: measured with the result · spec vendor spec/envelope · power n/a not published.

Machine-readable: /find.json (see llms.txt); full tables are in “Show data”. Confidence grades: A audited MLPerf closed · B documented third-party · C community · D vendor-published · E estimate. Unknown values are shown as unknown, never estimated. Generated 2026-10-16 from public sources.