Highlights: Hugo Mercier on why gullibility and misinformation are overrated

Evolutionary Basis of Communication

• Communication requires mutual benefit; senders must gain on average, or the trait evolves away, and receivers must benefit, or they evolve to ignore signals.
• Hugo Mercier challenges the "arms race" theory of persuasion and gullibility, arguing it incorrectly assumes early humans started as gullible and evolved skepticism.
• Comparative data from great apes shows high skepticism (e.g., chimpanzees ignore pointing gestures), suggesting humans evolved from a skeptical baseline rather than a gullible one.
• Human evolution favored high receptivity to information, necessitating the development of "discerningness" to filter truth from fiction, rather than an evolutionary drive to reject signals.

Signals of Honesty in Adversarial Contexts

• Adversarial species engage in reliable signaling when lying is impossible; for example, gazelles perform "stotting" (jumping in place) to signal fitness to predators.
• This signaling is honest because only physically capable gazelles can perform the action, making it a reliable indicator that they will outrun predators.

AI Risks: Information Noise and "Spam"

• The primary risk of AI in the information environment is the generation of vast quantities of low-quality, misleading content that increases "noise" rather than persuading specific outcomes.
• High-volume fake content (papers, blogs, videos) degrades credibility cues, leading users to mistrust all information and opt out of public discourse.
• This strategy mirrors state-level tactics used by governments (e.g., Germany vs. BBC, Russia, China) to discredit reliable institutions and induce public apathy when direct persuasion is impossible.
• Mercier counters that reliance on trusted curators (journalists, trusted colleagues) remains the primary filter for the general public, and LLMs may actually assist rather than hinder this verification process.

Motivated Beliefs and Social Grouping

• Professed beliefs that do not align with behavior often stem from pragmatic self-interest or social bonding rather than deep epistemic gullibility.
• Conspiracy theorists (e.g., Flat Earthers, QAnon followers) often seek social cohesion and status within groups, utilizing "alternative" epistemic environments to fulfill a need for influence they lack in professional settings.
• The motivation to create elaborate theories is comparable to the journalist's drive to uncover stories, even if the conclusions are incorrect; the driver is the desire to contribute to the epistemic environment.

Vaccine Hesitancy and Intuitive Logic

• Vaccine hesitation is a universal phenomenon observed for two centuries across cultures, not solely a result of modern misinformation or specific "quack" doctors.
• The hesitation is driven by the counterintuitive nature of the treatment: injecting material from a sick source into a healthy individual is naturally perceived as illogical without deep biological knowledge.
• Justifications vary by culture (e.g., autism in the West, sterility or AIDS elsewhere), but the underlying intuitive aversion is consistent.

Epistemic Vigilance and Openness

• "Open vigilance" describes a system where openness to new information is enabled by the ability to be vigilant and verify trustworthiness.
• Strong arguments and evidence frequently lead to belief updates; experiments show that while people sometimes cling to intuitions, the vast majority of cases result in belief changes in the direction of the evidence.
• The "backfire effect" (where evidence hardens opposing views) is extremely rare, documented in only a few specific cases like the Iraq War WMD belief or specific vaccine contexts.

Intuitive vs. Reflective Beliefs

• Intuitive beliefs are formed through perception or direct testimony and strongly guide behavior (e.g., not walking through a wall).
• Reflective beliefs are held with equal conviction but are often divorced from behavior, often due to fear of repercussions or lack of actionability.
• Conspiracy theories are predominantly reflective; individuals who intuitively know about corrupt security services (e.g., in Pakistan) do not publicly voice these views due to fear, whereas those without direct evidence (conspiracy theorists) vocalize extreme claims because they face no immediate danger.
• The vocalization of grand conspiracy theories often indicates they are false; if powerful actors were truly orchestrating events, the proponents would likely be silenced.

Dimensions of Trust

• Trust is determined by two dimensions: Competence (expertise, knowledge access, and ability to perceive truth) and Trustworthiness (incentives to share accurate information).
• Short-term incentives (e.g., poker players) undermine trust even among friends, while long-term shared interests (family, long-term partners) align incentives to favor honesty.
• Human judgment regarding who to trust is generally accurate, with a tendency toward under-trusting rather than over-trusting.