Panel, Conference Presentation
The Art and Science of Polling
Milken InstituteMollyann Brodie, Jon Cohen, Michael Dimock, Alex Lundry, Margie Omero, Molly Ambroti
Election Context and Primary Dynamics
- Democratic primary polls indicate a majority of voters find the ongoing contest energizing rather than harmful to party unity.
- Hillary Clinton holds an insurmountable lead over Bernie Sanders in pledged delegates prior to counting superdelegates.
- Republican primary polls reveal high voter engagement driven by fear and horror, creating a more divisive environment compared to the Democratic side.
- Polling suggests the Republican debate over issues like border walls and religious bans is failing to resonate with establishment Republicans who wish to avoid such topics.
Role of Polling in Campaign Strategy
- Polling in multi-candidate primaries requires non-traditional data and specific questioning to distinguish between candidates within the same ideological lane (e.g., establishment vs. insurgent).
- Donald Trump's explicit focus on his robust polling numbers is an effective strategy that leverages the "viability effect," where voters prefer candidates with a higher perceived probability of winning.
- SurveyMonkey's daily polling data showed Trump gaining 11 points in the two weeks leading up to the panel, reaching 56% support, breaking previous perceived ceilings.
- Campaigns utilize polling to test specific messages and scenarios to adapt strategy, rather than solely to predict election outcomes, which represents only 5% of their polling goals.
Impact of Media and "Black Swan" Events
- Trump's rise was predicted earlier by online metrics (Google search volume and social media share of voice) than by traditional polling, which initially struggled to model such a non-traditional candidate.
- The correlation between Trump's news coverage and polling numbers is extremely high, exceeding a 0.9 correlation coefficient.
- Traditional predictive models relying on historical data failed to anticipate Trump because he represented a "black swan" event with no prior analogue.
- Media outlets often accelerate the impact of candidate statements by testing policy positions (e.g., banning Muslims) that would not have otherwise been included in standard polling menus.
Crisis vs. Revolution in Polling Methodology
- Industry leaders describe the current state as a "crisis" due to the collapse of the 40-year consensus on high-quality survey standards, now rendered a luxury item due to rising costs.
- Michael Demick characterizes the shift as a "revolution," noting increased transparency and the ability to aggregate diverse data sources to better capture public voice.
- Phone response rates have declined significantly, though historical data suggests this has not yet drastically impacted result accuracy.
- Online polling volume has increased by 250% since the previous cycle for the Republican primary, while phone polling numbers remain flat.
Data Science and Modeling Advances
- Modern modeling has shifted from human-determined likely voter screens to machine-driven models using historical voter file data to predict turnout probabilities.
- Campaigns are integrating unstructured data (e.g., social media sentiment analysis) alongside traditional polling to identify individuals and target communications.
- Aggregators face a "garbage in, garbage out" risk when mixing high-quality and low-quality polls, potentially compromising the reliability of consensus numbers.
- The "art" of polling remains essential for determining priors, framing the right questions, and understanding the "why" behind voter preferences through qualitative methods.
Public Trust and Media Interaction
- The panel rejects the feasibility of banning polls before elections, arguing it would leave the public with unverified punditry rather than data.
- Media pressure for immediate, daily results creates a "fever" environment that leads to over-interpretation of minor statistical fluctuations.
- Qualitative focus groups reveal that voters often lack detailed knowledge of political mechanics (e.g., Senate balance), challenging assumptions held by insiders and pundits.
- Polling serves as a critical democratic check to validate a winner's mandate against the broader, non-voting body politic.
Specific Case Study: Jeb Bush Campaign
- Early polling for the Jeb Bush campaign indicated that Trump was not a viable threat based on historical metrics, failing to capture the organic momentum shown in digital engagement.
- By October 2015, traditional polling finally caught up, confirming Trump's status as the frontrunner and highlighting the campaign's loss of viability.
- Campaigns historically rely on logic-based data and evidence, which proved insufficient against a candidate operating primarily on emotional resonance and visual media.