Benchmark Framework Desktop Mainboard and 4-node cluster

Testing the Framework Desktop - AMD Ryzen AI Max+ 395 with Radeon 8090S. (Four pre-production units were shipped to me for local cluster testing).

Single Node configuration (128 GB RAM):

Cluster configuration (4x Mainboard - 512 GB RAM)

Initial tests (above) were run using 2.5 Gbps Ethernet interconnect.

I later changed to 5 Gbps using a NICGIGA switch, and racked it in a black T1 mini rack shipped by DeskPi, along with four of their currently-in-prototype Framework Desktop mini rack trays. Mini rack build showcase here.

I also tested Thunderbolt node-to-node interconnects, but could only get 10 Gbps over TB4 using thunderbolt0/thunderbolt1 interfaces).

For more benchmarks (focusing on CPU, GPU, disk, net, etc.), see:

• I clustered four Framework Mainboards to test huge LLMs
• sbc-reviews: Framework Desktop.

All my automation for testing is in the Beowulf AI Cluster repo.