News Score: Score the News, Sort the News, Rewrite the Headlines

1.5 TB of VRAM on Mac Studio - RDMA over Thunderbolt 5

Apple gave me access to this Mac Studio cluster to test RDMA over Thunderbolt, a new feature in macOS 26.2. The easiest way to test it is with Exo 1.0, an open source private AI clustering tool. RDMA lets the Macs all act like they have one giant pool of RAM, which speeds up things like massive AI models. The stack of Macs I tested, with 1.5 TB of unified memory, costs just shy of $40,000, and if you're wondering, no I cannot justify spending that much money for this. Apple loaned the Mac Studio...

Read more at jeffgeerling.com

© News Score  score the news, sort the news, rewrite the headlines