Conference Presentation, Panel
Welcome to the New Frontier of Agentic AI | Wiz, Merge, You.com & More | RAISE Summit 2026
Model Selection and Routing Strategies
- Organizations are abandoning single-model reliance in favor of multi-model routing architectures similar to multi-cloud strategies.
- Cost sensitivity is shifting from a secondary concern to a primary decision factor as usage scales and rate limits are reached.
- Studies indicate no correlation between token spending volume and organizational productivity, with cost reduction being the only significant efficiency driver.
- Model selection is increasingly driven by governance, regulatory compliance, and data residency requirements rather than raw performance metrics.
- Blackbox advises against per-step model routing for coding tasks, noting that such over-engineering yields negligible performance gains compared to phased approaches (planning vs. execution).
- Blackbox's internal benchmarks suggest a hybrid approach combining a closed-source reasoning model (e.g., Nvidia Omniverse Ultra) with a high-performance open-source coding model (e.g., Qwen 2.5-High) maximizes output.
- Wiz's "Cyber Model Arena" benchmark demonstrates that model performance varies significantly across specific security tasks, necessitating task-specific model selection.
Security, Privacy, and Infrastructure
- End-to-end encryption at the token level is identified as the highest security standard for agentic inference, surpassing dedicated GPU or air-gap deployments.
- There is a strong market preference for American open-source models and deployments; Chinese models are only favored if fully deployed within a US air-gapped environment with end-to-end encryption.
- Ed (Pincap TieDB) emphasizes that engineering harnesses, tooling quality, and sandbox environments are becoming more critical to success than the underlying model choice itself.
- Viz (Wiz) highlights that the "mode" or intelligence resides in the data graph and architecture, which must remain stable regardless of model volatility.
- Blackbox notes that for code-specific workloads, the market effectively consolidates around five top models, reducing the need for complex routing across hundreds of options.
- Vue.com warns that models are often trained on their own agentic frameworks (e.g., Claude + Code), creating portability issues when switching to open-source frameworks like Ollama.
Evaluation, Variance, and Reliability
- Industry benchmarks relying on single numbers are insufficient; quantifying variance is essential due to non-deterministic agent behavior and inconsistent task difficulty.
- Agent inconsistency stems from multi-turn settings and tool usage rather than model capability alone, leading to reliability risks at scale.
- Vue.com's research indicates that benchmarks often measure agent inconsistency (harness issues) rather than true model capability or task difficulty.
- Wiz employs "context-aware tool selection," filtering available skills to match the specific task to reduce context usage and improve tool selection accuracy for smaller models.
- Strategic tooling partnerships (e.g., access to licensed financial data) can enable standard models to outperform frontier models on specific benchmarks like FinComp without model tuning.
Market Trends and Future Outlook
- The industry is transitioning from a scientific problem to an engineering challenge focused on infrastructure stability and orchestration.
- No single "mythos" event has yet occurred that renders current architectures obsolete; the pace of change is continuous rather than punctuated by one-time shifts.
- Open-source models are rapidly closing the performance gap with closed-source frontier models, particularly in defense and planning scenarios.
- The primary barrier to enterprise automation remains the need to build trust, governance, and compliance layers to safely deploy autonomous workflows.
- User behavior is shifting from short chat interactions to long-horizon agentic workflows requiring extensive tool usage and context management.
- Future differentiation will likely stem from unique tool integrations and data partnerships rather than the base model alone.
Strategic Recommendations for Builders
- Prioritize the quality and integration of tools over the selection of the underlying model for most use cases.
- Build infrastructure that abstracts model choices, allowing for seamless switching between providers to mitigate vendor lock-in and leverage the "best of breed" for specific tasks.
- Focus on developing stable data models and graphs that remain constant despite the volatility of underlying model weights.
- Organizations should deploy their own open-source models on dedicated GPUs for privacy and security, utilizing end-to-end encryption.
- Enterprises must build "bridges" involving governance and guardrails to facilitate the adoption of disruptive agentic technologies.
- Developers should increase attention on open-weight models, as they are becoming capable of handling complex tasks that previously required frontier models.
- The current low cost of development encourages a "build first" mentality, allowing for rapid iteration and risk-taking in agentic applications.