Mansour Karam

Inside the AI Inference Cluster: Measuring What Matters | Mansour Karam, Aria Networks | RAISE 2026

Mansour Karam, Dylan Patel

The AI infrastructure sector is pivoting from homogeneous general-purpose systems to specialized architectures that optimize distinct model training and serving economics, with high-throughput inference offering potential cost savings of up to 100x. This shift demands deep networking solutions capable of managing dynamic, unpredictable traffic patterns and microsecond-scale latency requirements for complex agent workflows. Leading this transition, ARIA proposes a multi-layered AI agent architecture that integrates full-stack telemetry to dynamically coordinate hardware, software, and network operations across immediate physical reactions and long-term strategic planning.