Dell Technologies And AMD Expand The Generative AI Solutions Portfolio

Dell Technologies and AMD are expanding the generative AI solutions portfolio, with the high-performance Dell PowerEdge XE9680 server, designed to support the AMD Instinct MI300X accelerator.
Learn more:
https://www.dell.com/identity/global/...


The Dell PowerEdge XE9680 server features the AMD Instinct Platform with eight MI300X accelerators making it one of the most powerful AI optimized platforms. This is news enterprises have been waiting for to power their AI and GenAI workloads.
“It features 192 gigs of memory of high band width memory three in each GPU. And that really gives us up to 1.5 terabytes of GPU memory per eight-way system,” says Allen Clingerman, chief technology strategist, server+workloads, NA channels, Dell Technologies
The system also supports up to four terabytes of system memory with 10 front-facing PCIe Gen5 slots, providing balanced IO. While it’s more powerful, it takes up less infrastructure.

Clingerman also adds, “we do all of this while still fitting in a very small, compact 6U form
factor, entered Enterprise 1200-millimeter rack while being fully air cooled.”

The fact that it’s air cooled-allows thee energy efficiency within the data center- to
continue to improve as well.

“There's a lot of customers out there with sustainability goals. There's an equal amount of
customers out there that want to touch AI and be able to commercialize it and put it into their
business to improve and to innovate. And I think this system with our GPU makes that happen,”
says David Melendrez, account manager, AMD processors, AMD.

PowerEdge XE9680 is coupled with the new Dell Validated Design for Generative AI, leveraging
AMD ROCm-powered AI frameworks, making GenAI more accessible for enterprises particularly
in terms of training larger language models.