Why Dual-Socket Servers Win on Dense AI Models

Adding a second CPU socket offers extra memory channels and PCIe lanes, but non-uniform memory access dramatically shapes real-world performance. A detailed look at Intel Xeon and AMD EPYC platforms reveals why dense neural networks scale up while fine-grained mixture-of-experts architectures stall on cross-socket interconnects. Also covered: BIOS nodes-per-socket settings, the economics of decommissioned server hardware, and how memory placement bugs distort hardware benchmarks. Key sources: • AMD, 2P or not 2P? That is the question, published 2025-02-21, retrieved 2026-11-09. — https://www.amd.com/en/blogs/2025/2p-or-not-2p--that-is-the-question--.html • AMD, The Right CPU can Boost Microsoft SQL Server Performance and Lower Software Costs, 2025-09-03, retrieved 2026-11-09. — https://www.amd.com/en/blogs/2025/the-right-cpu-can-boost-microsoft-sql--server--performance-and-l.html • AMD, EPYC Processor Overview, retrieved 2026-11-09. — https://www.amd.com/en/partner/articles/epyc-processor-overview.html Episode 6513 — myweirdprompts.com/n/6513 (permanent short link: myweirdprompts.com/246789) Listen on Android: MWP FM Player — myweirdprompts.com/apk