Semafor19 min
SambaNova CEO Rodrigo Liang & ElevenLabs CEO Mati Staniszewski at Silicon Valley & The World
Rodrigo Liang, Mati Staniszewski, Liz Rappaport
Conference Presentation, Fireside Chat, Interview
Market Context & Trajectory
- Rodrigo Liang (Samba Nova) characterizes recent market headwinds—specifically outages and financing challenges—as a necessary market strengthening phase that ensures sustainable, scalable growth rather than a long-term slowdown.
- Matty Stanisiewski (ElevenLabs) counters that while infrastructure has faced constraints, the adoption of applied AI in the enterprise sector is accelerating, with clear outcomes and value realization becoming the primary drivers.
- Enterprise investment focus is shifting from cost-saving measures to revenue generation, market share acquisition, and differentiation to avoid competing on a "race to the bottom."
Adoption Curves by Sector
- Neoclouds: Facing critical constraints in capacity, power, and financing due to traffic surges; efficiency is now a primary operational metric.
- Governments (Sovereign AI): Infrastructure build-out is ramping up globally as nations prioritize data and model independence; US election cycles are expected to increase focus on energy efficiency within sovereign projects.
- Enterprise: Early experimentation phases are concluding; organizations are now prioritizing clear ROI and specific use cases over "adoption for adoption's sake."
- Key Adopters: Examples of successful enterprise deployment include Deutsche Telekom, T-Mobile, and Stripe.
Compute Strategy & Constraints
- Short-Term Outlook: Both speakers agree the industry faces an imminent compute constraint, driven by a lack of sufficient chips, data centers, and financing.
- Infrastructure Solutions: The market is moving toward "aggregated inference" to maximize throughput on existing infrastructure by mixing architectures (e.g., Samba Nova with NVIDIA).
- Energy Efficiency: Due to grid limits (e.g., 98% capacity in Singapore and Japan) and permit delays for new gigawatt-scale liquid-cooled centers, the industry is pivoting to reclaiming and repurposing existing, air-cooled data centers.
- Heterogeneous Deployment: There is a growing trend toward repatriating computing to on-premises environments behind corporate firewalls to ensure data sovereignty and security, rather than relying solely on public cloud infrastructure.
Model Orchestration & Economics
- Model Selection Strategy: Organizations are adopting a tiered model strategy, utilizing open-source or fine-tuned models for standard tasks (e.g., product inquiries) while reserving frontier models for high-stakes scenarios (e.g., medical authentication).
- Optimization Goal: The primary operational metric is maximizing outcomes per token spent, necessitating a trade-off between model capability and inference cost.
- Samba Nova Proposition: The SM50 chip is designed to enhance NVIDIA systems, generating significantly higher output with only a 10% increase in power consumption.
Geographic Trends & Regional Dynamics
- Europe: Expected to lead in "applied AI" diffusion within public sectors (healthcare, education, social benefits) but faces challenges regarding risk appetite compared to Silicon Valley.
- UK/EU Collaboration: There is a hope for deeper integration across the UK, EU, and broader European ecosystem to tackle infrastructure and security challenges collectively.
- Global Scale: The energy and infrastructure constraints are identified as a global issue affecting the US, Asia, and Europe, requiring more efficient technologies to scale responsibly.
Safety, Trust, & Government Use Cases
- Transparency Protocols: ElevenLabs emphasizes mandatory disclosure and smart watermarking to ensure users know they are interacting with AI.
- Government Applications:
- Ukraine: Implemented voice agents for crisis information, citizen support, and guidance on travel and healthcare.
- City of Dallas, Texas: Deployed multilingual voice AI to assist immigrants and the elderly, removing language barriers and improving navigation of government services.
- Trust Challenges: Addressing public fears regarding data privacy and surveillance is critical for adoption, particularly for sensitive services like immigration assistance.
Future Outlook & Corporate Strategy
- IPO Plans: ElevenLabs and Samba Nova are deferring IPO discussions, prioritizing the development of solid business fundamentals, real dollar generation, and sustainable growth before considering public exits.
- Industry Collaboration: Samba Nova views NVIDIA as a partner with a massive market share, intending to enhance NVIDIA systems rather than replace them immediately.
- Next Frontier: The immediate challenge for the industry is making intelligence accessible to everyone, focusing on how humans interact with technology in the next phase of development.