Interview, Fireside Chat
Bret Taylor: Why Pre-Training is for Morons & Companies Will Build Their Own Software | E1209
Market Assessment & The "Bubble" Thesis
- Brett Taylor characterizes the current AI investment landscape as a bubble, but one that he believes will "rhyme with the dot-com bubble" rather than repeat its worst failures.
- He predicts that, similar to the post-dot-com era which birthed Amazon, Google, and Salesforce, the current AI excess will result in defining, trillion-dollar consumer companies and over 10 enduring enterprise software firms.
- Unlike the 1998 dot-com era where top valuations were not in the billions, Taylor acknowledges current valuations (e.g., xAI's $18B round) are higher due to the sheer volume of available capital and private equity structures, though he remains skeptical that this invalidates the technology's long-term potential.
- He expresses skepticism toward startups engaging in pre-training, labeling it "burning capital" unless the company is an AGI research lab, comparing it to a software startup building its own data center.
Strategic Investment & Business Models
- Taylor advocates for a "solution-first" approach over "model-first," arguing that most companies should lease infrastructure and fine-tune existing open-source or frontier models (e.g., Llama 3.1) rather than pre-training from scratch.
- He predicts a market dynamic similar to cloud computing: a consolidation of "frontier models" (infrastructure) owned by hyperscalers, a layer of "toolmakers" (e.g., Databricks), and a long tail of vertical "Software as a Service" (SaaS) solutions.
- The commercial success of AI services/consulting firms is viewed as a temporary phenomenon reflecting the current lack of mature, out-of-box SaaS solutions, expected to diminish as plug-and-play agents become standard.
- Taylor argues that professional services will remain valuable for "change management" (operational restructuring) even as technical implementation costs drop, as the technology forces fundamental shifts in how departments operate.
Technological Trajectory & Commoditization
- The "foundation model" market (lower-tier models) is already highly commoditized and cheap (e.g., Llama), while the "frontier model" market continues to see incremental improvements punctuated by occasional step-changes in quality.
- Taylor anticipates that the cost of AI inference will follow a trend similar to Moore's Law, driven by hardware improvements, model distillation (creating smaller, cheaper models with similar quality), and efficiency gains.
- He notes that Meta's decision to open-source high-quality models (Llama) is a strategic differentiator for a company without a cloud cash cow, accelerating the open-source ecosystem.
- Progress toward AGI is viewed as a mix of three inputs: better algorithms, increased compute, and new data sources (including synthetic data and multimodal content), making a hard "wall" unlikely in the near term.
The Era of "Conversational Agents"
- Taylor identifies the shift from rule-based websites to "conversational software" as the next paradigm shift, comparing the adoption of AI agents to the transition from BlackBerry keyboards to multi-touch screens in 2007.
- By 2025, he predicts that having a branded AI agent will be as essential for digital existence as a website is today; agents will be the primary interface for customer service, sales, and support across consumer brands.
- The dominant form factor is expected to remain text and voice chat within existing platforms (like WhatsApp or apps) due to low friction, though multimodal inputs (image, voice) will become standard.
- He disputes the imminent replacement of the smartphone as the primary computer, viewing the phone as a durable "hub" for these conversational experiences, similar to how it absorbed other device markets.
Technical Challenges: Determinism vs. Agency
- Building industrial-grade agents requires solving the tension between "agency" (creativity, empathy, and nuance) and "determinism" (reliability, brand safety, and adherence to business rules).
- Taylor describes this as a shift from an "age of rules" to an "age of goals and guardrails," where companies must define high-level objectives and boundaries rather than hard-coding every interaction path.
- He argues against modeling AI reliability on traditional software (5-9s uptime); instead, companies should adopt operational mechanisms to handle AI "hallucinations" and errors, similar to how human call centers manage agent deviations.
Leadership Insights & Personal Anecdotes
- Taylor believes leadership is a learnable skill rather than an innate trait, citing the military's structured approach to leadership training as a model for corporate development.
- He identifies the most critical trait of legendary leaders (Zuckerberg, Benioff, Bezos, Schmidt) as "relentless drive" and the ability to think two times further into the future than their peers or the public.
- He notes that the hardest lesson for board members is finding the balance between strategic involvement and operational interference, requiring a unique operating cadence for each CEO.
- His most significant career moment was Mark Zuckerberg appointing him CTO of Facebook, which shifted his self-conception from engineer to leader; his favorite Facebook story involves the "Appletini" scene from The Social Network becoming a real-life bar phenomenon.
Forward-Looking Statements & Future Risks
- Taylor is confident that AI will solve its own challenges, including misinformation, predicting a "white hat vs. black hat" arms race in content verification similar to cybersecurity.
- He warns against the misconception that AI's value lies solely in hardware or base models; he predicts the next generation of defining companies will be those delivering consumer/business solutions powered by AI, not the model makers themselves.
- He advises entrepreneurs to focus on product-market fit before incurring significant pre-training costs and to prioritize building "branded" agents that solve specific customer problems rather than generic productivity tools.
- He expresses optimism that the AI market will eventually consolidate around a few key infrastructure providers and a long tail of vertical SaaS applications, making it a less risky environment for specialized startups than the current "race to the bottom" implies.