Latest Interviews
Showing 1–2 of 2 transcripts.
Clear all filters- RAISE Summit19 min
Inside the AI Inference Cluster: Measuring What Matters | Mansour Karam, Aria Networks | RAISE 2026
The AI infrastructure sector is pivoting from homogeneous general-purpose systems to specialized architectures that optimize distinct model training and serving economics, with high-throughput inference offering potential cost savings of up to 100x. This shift demands deep networking solutions capable of managing dynamic, unpredictable traffic patterns and microsecond-scale latency requirements for complex agent workflows. Leading this transition, ARIA proposes a multi-layered AI agent architecture that integrates full-stack telemetry to dynamically coordinate hardware, software, and network operations across immediate physical reactions and long-term strategic planning.
- RAISE Summit18 min
Cheap Tokens, Expensive Mistakes: The Real Economics of AI at Scale | RAISE Summit 2026
Liran Zvibel, Dylan Patel, Karen Kwok
Major AI operators are pivoting from pure pricing power to structural cost efficiency, leveraging advanced KV cache offloading and optimized storage architectures to slash inference expenses. Recent benchmarks reveal that NAND-based memory solutions and strategic hardware combinations, such as high-capacity AMD GPUs, can outperform standard setups by up to 20 times in multi-turn agentic workflows while delivering 7x higher throughput. This shift allows emerging providers and frontier labs to significantly expand gross margins, with companies like Anthropic and OpenAI now projecting substantial operating profits driven by these infrastructure innovations rather than model weights alone.