Anthropic rival says companies can (mostly) skip the pricey models
Summary
- Anthropic completed the largest IPO on record with high investor enthusiasm.
- Fireworks AI specializes in open-weight models that allow customers to tune them on their own data for faster and cheaper performance.
- Fireworks customers have included Uber, Shopify, and Notion.
- Co-founder Chenyu Zhao states that open models are at most six months behind frontier models, likely closer to three months.
- Fireworks disclosed two security incidents this fall involving exposed API keys and a breach of its cloud provider.
- Notion reported that AI chat transcripts from fewer than 1% of its workspaces were exposed and has since disconnected from Fireworks.
- Uber stated that hackers stole names, addresses, birth dates, and driver's license numbers of about 150,000 drivers through a vendor identified as Fireworks.
- Fireworks holds a $17.5 billion valuation from summer investors and is reportedly in early talks for another funding round.
- Rival companies Together AI and Baseten have announced massive funding rounds recently.
- Palo Alto Networks agreed to buy Applied Compute for $4.5 billion in stock.
- Chenyu Zhao spent a decade at Google managing a 50-person engineering team on Google Cloud Vertex AI before co-founding Fireworks.
- Zhao describes Fireworks as a specialized intelligence platform using smaller, cheaper, and faster open models.
- Zhao predicts a two-model world where frontier models handle high-level planning while open models handle basic tasks.
- Fireworks maintains a zero data retention promise for inference traffic but acknowledged that batch prediction services store data at rest.
- Fireworks attributes some security attacks to LLM jacking aimed at selling tokens on illicit marketplaces.
- Nvidia has backed Fireworks since 2024 and remains a strong supporter of open source despite Jensen Huang's departure.
On the day Anthropic went public, Fireworks AI’s co-founder made the case for open-source models as a cheaper alternative, and addressed the breaches that have cost the company some customers’ trust.
- Keywords
- TC,Venture