Partnering with Etched: Building the Inference Machine
Summary
- The inference market is projected to become the largest global market, powering diverse sectors including retail, media, healthcare, gaming, legal, and software development.
- Etched is the only post-ChatGPT-era hardware startup with production-ready custom silicon scheduled for shipment in 2026.
- The company pioneered architectural breakthroughs in low-voltage inference & cluster-scale memory to achieve step-change gains in throughput & latency.
- Etched designs full cluster-scale inference systems capable of handling various model architectures, including large sparse MoEs, dense transformers, & Mamba.
- The team successfully taped out its first-generation chip at TSMC, marking the first post-ChatGPT full-reticle A0 chip tape-out on TSMC's leading-edge nodes.
- Within 40 days of tape-out, the team brought up their first cluster to run inference on frontier AI models, achieving Pareto dominant performance on industry-standard throughput-interactivity curves.
- Etched has established a live lab in San Jose & an office in Taiwan to colocate with suppliers & expedite testing.
- The company is leading its $300 Million Series C funding round at a $10 Billion pre-money valuation.
- Investors joining the round include Jane Street, Andreessen Horowitz, Diffusion, & SK Hynix.
Gavin, Rob, Chris and the Etched team are building frontier clusters for inference, maximizing the intelligence per flop that humanity can consume.