newsfilter.io
Interview, Podcast

Embedded AI: The Questions Every CEO is Asking

  • Market Context & Challenges

    • 2022 is characterized as a breakout year for AI, with ChatGPT identified as the fastest-growing app in history.
    • CEO Zed Inam (Cresta) notes that contact centers suffer from 30–40% annual agent attrition, with some sectors reaching 80% due to low wages, high stress, and seasonal demand.
    • Employee Net Promoter Scores (eNPS) in contact centers frequently fall below zero.
    • Companies face critical decisions regarding data privacy, cost, accuracy, and the speed of AI integration.
  • Strategic AI Implementation Models

    • Lazy AI: Defined as end-to-end automation of existing processes without reimagining the business model.
    • Creative AI: Defined as using AI as a foundational capability to reimagine products, processes, and human-AI collaboration to achieve previously impossible outcomes.
    • Cresta emphasizes the "bi-directional" value of AI: serving the customer while simultaneously feeding product and market insights back to the business.
    • Unstructured customer conversation data is utilized to drive strategic decisions, such as pricing adjustments and new product launches (e.g., telecom pricing bundles).
  • Differentiation Through Context & Data

    • Sourcegraph (Byung Liu): Positions "context as king," arguing that the quality of LLM output depends on the specific data fetched rather than the model itself.
    • Kodi (Sourcegraph): Differentiates from GitHub Copilot by fetching broad, relevant code context (including organization-specific private code) rather than relying solely on local recent files or autocomplete.
    • Sourcegraph differentiates via open-source transparency (Apache 2 license for Kodi) to facilitate a pluggable ecosystem and avoid vendor lock-in.
    • Hex (Barry McCardle): Leverages thousands of historical SQL/Python queries and database schemas to construct personalized prompts and reduce model hallucination.
    • Hex maintains a "human in the loop" policy, generating code for review rather than executing it autonomously to ensure safety and learning.
  • Security, Privacy, & Business Models

    • Transparency: Cresta advocates for disclosing AI interactions to protect brand trust, noting that non-disclosure risks long-term reputation damage (e.g., AI accent masking).
    • Data Moats: Companies are recognizing the value of retaining proprietary datasets longer to train models or provide context, though this introduces retention costs and security risks.
    • Vendor Agnosticism: Sourcegraph enables customers to "bring their own model," supporting options from OpenAI, Anthropic, and Salesforce's Codex to mitigate security and pricing risks.
    • Self-hosting is prioritized for security-sensitive enterprise customers to prevent code leakage.
    • Model pricing volatility (e.g., OpenAI price hikes) necessitates strategies to integrate multiple models to manage cost exposure.
  • Future Outlook (2028 Projections)

    • Contact Center Evolution: Industry experts predict a shift to a "touchless" workflow by 2028 where AI handles data entry, summarization, and system navigation.
    • Role Transformation: Contact center agents will transition from reactive problem solvers to strategic relationship builders and account managers.
    • Efficiency Metrics: Key performance indicators will shift away from "Average Handle Time" toward metrics focused on relationship quality and proactive engagement.
    • Frictionless Digital: Routine inquiries will be handled by advanced bots (potentially with entertainment features), reserving human agents for high-value, strategic interactions.