Interview, Fireside Chat
How To Design Better AI Apps
- AI is expected to enable users to build software capable of performing any task through natural language programming, transforming the user experience from a "bicycle for the mind" to a "rocket ship for the mind."
- Developers are currently "far ahead" in using tools with full access to underlying models due to lower liability concerns compared to domains like law or accounting, which are hindered by a "kid glove mentality."
- The majority of people are predicted to be able to write system prompts in the near future, a skill that will become as "unremarkable" as using a computer or file system manager.
- Within five years, 99% of people are forecasted not to manually touch system prompts, which will instead be auto-generated by the AI based on previous work and ongoing feedback.
- A higher level of abstraction is expected to emerge where users can "nudge" or correct AI behavior without directly editing extensive 10- to 50-page system prompt documents.
- Every profession is predicted to experience a "Cursor moment" where industry-specific agents handle repetitive workflows, though coding agents will remain "so far ahead" of general purpose agents in the foreseeable future.
- The industry is anticipated to shift from the "chatbot paradigm" toward software designed for agents that accomplish real-world tasks, moving away from tools that merely produce text.
- Foundational model labs are expected to continue integrating memory into chatbots, though this approach will likely be superseded by more transparent and editable system prompts.
- AI-native versions of tools are expected to be designed from the ground up to offload repetitive work, appearing significantly different from current software rather than simply embedding chatbots into existing interfaces.
- Users will eventually be able to rely on tools capable of chaining multiple MCP servers to allow agents to autonomously handle complex, multi-step workflows without manual intervention.
- The Gmail team is described as likely not using specific draft writing features shipped previously due to the tools being frustrating, while the system prompt is suggested to contain hidden instructions preventing embarrassment for Google.