Philip Tetlock
Showing 1–2 of 2 transcripts.
- 80,000 Hours2h 12m
More accurately predicting the future | Philip Tetlock
Philip Tetlock investigates counterfactual reasoning through a *Civilization V* forecasting tournament that prohibits machine learning to simulate the constraints faced by real-world intelligence analysts. His research demonstrates that while simple algorithms outperform humans in data-rich domains, "superforecasters" achieve higher accuracy in ambiguous geopolitical scenarios by maintaining a "perpetual beta" mindset and distinguishing between 10 to 15 degrees of uncertainty. Despite these advances, Tetlock notes that predictive advantages diminish beyond five to ten years due to historical chaos, yet the adoption of quantified forecasting methods continues to challenge institutional status hierarchies and improve decision-making accuracy.
- 80,000 Hours1h 24m
#15 - Prof Tetlock on how chimps beat Berkeley undergrads and when it’s wise to defer to the wise
Prof Tetlock, Prof Philip Tetlock, Keiran Harris, Rob Wiblin, Philip Tetlock
Spanning 35 years of research on over tens of thousands of participants, Philip Tetlock's program utilizes Brier scores to demonstrate that while most experts and hedgehogs perform no better than chance, a specific subset of adaptable "superforecasters" consistently outperforms intelligence analysts through rigorous training and cognitive diversity. These findings inform a new IARPA-sponsored hybrid tournament that pits human-machine teams against each other in quantitative and idiosyncratic domains to identify the most effective forecasting methods. Ultimately, the research underscores the necessity of calibration and open-mindedness over ideological certainty, advocating for structured aggregation systems to mitigate the dangers of overconfident punditry in complex macro-political landscapes.