Ethernet - The Path to Singularity

Presented by Ram Velaga (Broadcom)

As the demand for AI scalability reaches unprecedented levels, the question arises: How can we efficiently scale to hundreds of thousands of nodes to support LLM/generative AI? The answer lies in the innovations and enhancements to Ethernet.

We will unveil technological innovations that span the entire Ethernet ecosystem. At the core of this is the Ultra Ethernet Consortium (UEC). We will discuss UEC initiatives such as multi-pathing, congestion control, and improved RDMA with end-to-end security. UEC will significantly expand the open innovative technologies available to the OCP community and its ecosystem.

Join us and the UEC founding members as we delve into the singular position of Ethernet to enable 100K+ AI accelerators. With a focus on overcoming challenges of power consumption, space utilization, and time efficiency, we will show how Ethernet paves the way for efficient and sustainable AI infrastructure. Broadcom will be making new contributions to OCP, including open system designs, simulation tools, and SAI specs to help advance AI scalability, deployments and new supply chains.