Inside Vera Rubin: How NVIDIA Builds a Rack-Scale Supercomputer

What does it take to make 72 GPUs work together on a single AI problem? Inside NVIDIA’s Vera Rubin NVL72, 36 Vera CPUs share a liquid-cooled rack with 72 Rubin GPUs. The CPUs coordinate the work, the GPUs perform the calculations, and a network called NVLink moves data between them. We look inside the rack to see why those connections matter. When an AI model has a long conversation to keep track of, moving information to the chip that needs it can be as important as the speed of the chip itself. Note: This podcast was AI-generated, and sometimes AI can make mistakes. Please double-check any critical information. Sponsored by Embersilk LLC