Interview
Product Tips from Steve Jobs and Elon Musk | Marty Cagan
- Founders should disregard verbal customer feedback regarding future purchase intent, as customers lack the vision to understand what is technologically or functionally possible; this aligns with the Steve Jobs quote that 100 focus groups would never have predicted the iPhone.
- Qualitative feedback should not be used to seek product affirmation or ideas for new features, but rather to identify every specific reason a user would reject the current product.
- The goal of gathering qualitative objections is to accelerate the decision-making process to validate product resonance, though success is not guaranteed and some products may never materialize.
- A key distinction exists between qualitative and quantitative feedback: qualitative data seeks patterns in rejection reasons, while quantitative data requires statistical significance to confirm a need across a broad user cohort.
- Teams must differentiate between needs identified by "super users" and those of the general market to avoid basing decisions on isolated use cases.
- To distinguish between polite refusal and genuine disinterest, teams must employ "value tests" that require users to commit tangible resources:
- Monetary commitment: Asking users to pay with a credit card rather than accepting verbal promises.
- Contractual commitment: Securing non-binding letters of intent (LOIs) to buy.
- Time commitment: Asking users to dedicate time to the product before launch.
- Reputational commitment: Asking users to stake their professional reputation on the product's utility.
- These validation techniques are detailed in the book Inspired, which outlines major protocols for effective product management.
- The "Sean Ellis test" is utilized as a specific metric to measure whether a product has achieved significant user satisfaction.
- Modern product development represents a blend of art and science, where the "art" lies in the judgment required to determine the appropriate balance:
- High-risk, high-reward scenarios: Requiring statistically significant quantitative evidence before committing resources.
- Lower-risk or faster-paced scenarios: Relying on qualitative confidence to avoid moving in the wrong direction without waiting for full statistical proof.
- The ultimate consensus, echoing Scott Belsky, is that intuition drives the initial strategic direction ("to the mountain"), while data facilitates execution ("up the mountain").