newsfilter
← Latest News
Lightspeed Venture Partners·

Accelerating Intelligence: Our Investment in Fractile

Summary

  • Fractile is a chip-first frontier AI company building new inference accelerators to remove bottlenecks in compute performance & scale intelligence.
  • The company is co-led by Exponential in its Series C funding round.
  • AI inference is growing exponentially with frontier models processing 10x more tokens annually, driving a market expected to reach hundreds of billions of dollars within five years.
  • Approximately 80% of future AI infrastructure spend will go towards inference due to long-horizon agentic tasks & token-intensive use cases like coding.
  • Current chips face a supply shortage & lack the memory bandwidth capacity needed to serve high-token workloads efficiently.
  • Fractile designs rack-scale systems using stacked dynamic random-access memory (DRAM) to achieve higher bandwidth & capacity than high-bandwidth memory (HBM) or static random-access memory (SRAM).
  • The new accelerators claim to serve advanced AI models at over an order of magnitude faster speeds at a fraction of the cost.
  • Fractile is vertically integrated since 2022 under CEO Walter Goodwin, owning its entire stack from software to supply chain to control costs & performance.
  • The team consists of industry veterans with experience shipping silicon at scale & working across hardware, operations, & software domains.

Every sentence, image, and piece of code generated by an AI model is the result of inference: data passed across billions or trillions of weights and parameters by powerful processors to create the outputs and applications that touch our everyday lives.