Michael Kagan

Nvidia CTO Michael Kagan: Scaling Beyond Moore's Law to Million-GPU Clusters

Michael Kagan, Sonya Huang, Pat Grady

Following NVIDIA's strategic acquisition of Mellanox in 2019, the combined entity transformed the AI landscape by shifting industry reliance from Moore's Law to a "scale-out" architecture that unifies thousands of GPUs through ultra-low latency interconnects. This integration enabled the development of specialized hardware, including Bluefield DPUs and Spectrum X switches, to overcome physical energy constraints and optimize distinct training versus inference workloads across gigawatt-scale data centers. Consequently, the partnership has driven a 45-fold increase in market capitalization while establishing a new philosophy where software-hardware co-design allows AI to function as a foundational utility for simulating complex scientific and historical phenomena.