Accelerating Intelligence: Our Investment in Fractile
Summary
- Fractile is a chip-first frontier AI company building new inference accelerators to remove bottlenecks in compute performance & scale intelligence.
- The company is co-led by Exponential in its Series C funding round.
- AI inference is growing exponentially with frontier models processing 10x more tokens annually, driving a market expected to reach hundreds of billions of dollars within five years.
- Approximately 80% of future AI infrastructure spend will go towards inference due to long-horizon agentic tasks & token-intensive use cases like coding.
- Current chips face a supply shortage & lack the memory bandwidth capacity needed to serve high-token workloads efficiently.
- Fractile designs rack-scale systems using stacked dynamic random-access memory (DRAM) to achieve higher bandwidth & capacity than high-bandwidth memory (HBM) or static random-access memory (SRAM).
- The new accelerators claim to serve advanced AI models at over an order of magnitude faster speeds at a fraction of the cost.
- Fractile is vertically integrated since 2022 under CEO Walter Goodwin, owning its entire stack from software to supply chain to control costs & performance.
- The team consists of industry veterans with experience shipping silicon at scale & working across hardware, operations, & software domains.
Every sentence, image, and piece of code generated by an AI model is the result of inference: data passed across billions or trillions of weights and parameters by powerful processors to create the outputs and applications that touch our everyday lives.