Vipul Vaid-Prakash

Together AI & SemiAnalysis: In Conversation Together AI's Vision For the Future of AI Infrastructure

Vipul Vaid-Prakash, Dylan Patel

Founded in late 2022, Together AI challenges hyperscaler dominance by reengineering the cloud stack to achieve 75% maximum FLOP utilization on H100 GPUs, significantly outpacing the 50% industry standard. Led by chief scientist Tri Dao and the ClusterMax initiative, the firm drives down inference costs for massive models like DeepSeek from $8 to 30 cents per million tokens through architectural innovations and Reinforcement Learning frameworks. These technical advancements enable new MoE-based workloads and position the company to define emerging optimization surfaces before new hardware generations are fully adopted.