newsfilter
← Interviews
a16z51 min

Will LLMs Get Us To AGI?

Vishal Misra, Martin

Fireside Chat, Interview

Martin and Vishal define Artificial General Intelligence as the capacity to generate entirely new scientific paradigms rather than merely interpolating within existing data manifolds, a capability they argue current Large Language Models lack despite their sophisticated Bayesian reasoning. They detail a formal Matrix Abstraction Model explaining how in-context learning functions as evidence-based posterior updates, while simultaneously critiquing the industry's reliance on prompt engineering and empirical scaling as insufficient for achieving recursive self-improvement or true innovation. The discussion concludes that a fundamental architectural leap beyond probability-based transformers is necessary to transition from generating "confident nonsense" to producing outputs that fall completely outside training distributions.