newsfilter
← Latest News
TechCrunch·

Anthropic rival says companies can (mostly) skip the pricey models

Summary

  • Anthropic completed the largest IPO on record with high investor enthusiasm.
  • Fireworks AI specializes in open-weight models that allow customers to tune them on their own data for faster and cheaper performance.
  • Fireworks customers have included Uber, Shopify, and Notion.
  • Co-founder Chenyu Zhao states that open models are at most six months behind frontier models, likely closer to three months.
  • Fireworks disclosed two security incidents this fall involving exposed API keys and a breach of its cloud provider.
  • Notion reported that AI chat transcripts from fewer than 1% of its workspaces were exposed and has since disconnected from Fireworks.
  • Uber stated that hackers stole names, addresses, birth dates, and driver's license numbers of about 150,000 drivers through a vendor identified as Fireworks.
  • Fireworks holds a $17.5 billion valuation from summer investors and is reportedly in early talks for another funding round.
  • Rival companies Together AI and Baseten have announced massive funding rounds recently.
  • Palo Alto Networks agreed to buy Applied Compute for $4.5 billion in stock.
  • Chenyu Zhao spent a decade at Google managing a 50-person engineering team on Google Cloud Vertex AI before co-founding Fireworks.
  • Zhao describes Fireworks as a specialized intelligence platform using smaller, cheaper, and faster open models.
  • Zhao predicts a two-model world where frontier models handle high-level planning while open models handle basic tasks.
  • Fireworks maintains a zero data retention promise for inference traffic but acknowledged that batch prediction services store data at rest.
  • Fireworks attributes some security attacks to LLM jacking aimed at selling tokens on illicit marketplaces.
  • Nvidia has backed Fireworks since 2024 and remains a strong supporter of open source despite Jensen Huang's departure.

On the day Anthropic went public, Fireworks AI’s co-founder made the case for open-source models as a cheaper alternative, and addressed the breaches that have cost the company some customers’ trust.

Keywords
TC,Venture