HARDWARE % min read

Datacenters turn to shared memory as a potential escape from the DRAM meltdown

Datacenters turn to shared memory as a potential escape from the DRAM meltdown
Photo by Christina @ wocintechchat.com M / Unsplash

The ongoing DRAM shortage is accelerating the rise of so-called memory godboxes, appliances that pool and share system memory across multiple servers using CXL technology. With CXL 3.0 and 3.1, memory can be shared between machines, enabling larger topologies, improved resource utilization, and confidential computing protections. Although latency remains higher than local DDR5, bandwidth improvements from PCIe 6.0 and 7.0 make the approach viable for many workloads. However, AI-driven demand for DRAM and KV cache offloading may consume much of this new capacity, limiting the relief enterprises hope to gain.

Read the full story on The Register →