newsfilter.io

Latest Interviews

Showing 1–4 of 4 transcripts.

Clear all filters
  1. RAISE Summit19 min

    Inside the AI Inference Cluster: Measuring What Matters | Mansour Karam, Aria Networks | RAISE 2026

    Mansour Karam, Dylan Patel

    The AI infrastructure sector is pivoting from homogeneous general-purpose systems to specialized architectures that optimize distinct model training and serving economics, with high-throughput inference offering potential cost savings of up to 100x. This shift demands deep networking solutions capable of managing dynamic, unpredictable traffic patterns and microsecond-scale latency requirements for complex agent workflows. Leading this transition, ARIA proposes a multi-layered AI agent architecture that integrates full-stack telemetry to dynamically coordinate hardware, software, and network operations across immediate physical reactions and long-term strategic planning.

  2. RAISE Summit39 min

    Failing to Understand the Exponential (Again) | Elastic, AWS, Nebius & More | RAISE Summit 2026

    Ashutosh Kulkarni, Pim de Witte, Julien Lépine, Jeremy Fraenkel, Marc Boroditsky, Dylan Patel

    A panel of industry leaders characterizes the current AI landscape as an exponential "first chapter" where rapid adaptation is essential, while noting that AWS maintains a strategic advantage by serving both commoditized and premium workloads through a hybrid CPU-GPU architecture. The discussion highlights a critical shift from indiscriminate token consumption to verifiable value creation, driven by the urgent need for AI engineers and the development of governance frameworks that treat agents as distinct security entities. Ultimately, the consensus is that while domains like software coding see immediate ROI, long-term success depends on enterprises leveraging proprietary context and verifying outputs within complex legacy infrastructure.

  3. Sourcery with Molly O'Shea57 min

    SemiAnalysis, Altimeter, Nebius, Glean.. 12 Hot Takes From Biggest Names in AI

    Dylan Patel, Qasar Younis, Apoorv Agrawal, Arvind Jain, Ariel Cohen, CJ Desai, Gil Feig, Nikhil Benesch, Barak Kaufman, Max Junestrand, Marc Boroditsky, Laura Diorio, Kasser, Mark

    RAISE Paris marked a decisive industry shift from speculative hype to enterprise-grade cost reconciliation, as buyers now demand clear ROI and physical AI adoption outpaces volatile large language model growth. Key figures including Applied Intuition's Kasser and analysts from Altimeter Research warned of an impending market bust driven by unsustainable spending, while companies like Navan and TurboPuffer demonstrated new economic models focused on profitability and reduced inference costs. The event concluded with a consensus that success requires resilient multi-model strategies, robust data layers, and a global expansion mindset to navigate rising hardware prices and geopolitical energy constraints.

  4. RAISE Summit18 min

    Cheap Tokens, Expensive Mistakes: The Real Economics of AI at Scale | RAISE Summit 2026

    Liran Zvibel, Dylan Patel, Karen Kwok

    Major AI operators are pivoting from pure pricing power to structural cost efficiency, leveraging advanced KV cache offloading and optimized storage architectures to slash inference expenses. Recent benchmarks reveal that NAND-based memory solutions and strategic hardware combinations, such as high-capacity AMD GPUs, can outperform standard setups by up to 20 times in multi-turn agentic workflows while delivering 7x higher throughput. This shift allows emerging providers and frontier labs to significantly expand gross margins, with companies like Anthropic and OpenAI now projecting substantial operating profits driven by these infrastructure innovations rather than model weights alone.