Interview, Podcast
Disinformation & synthetic media on the rise | Nina Schick (2021)
- Technology is expected to drive an AI-led paradigm change in human creation and perception, with synthetic media fidelity improving rapidly to become indistinguishable from reality even to advanced forensic tools.
- By the end of the decade, up to 90% of audiovisual content online is predicted to be synthetically generated, enabling creators like YouTubers to produce Hollywood-level quality with accessible smartphones.
- Barriers to creating deepfakes will decrease due to technical limitations being the primary constraint, allowing voice synthesis with as little as five seconds of audio and facilitating the creation of sophisticated video deepfakes.
- Synthetic media is projected to become ubiquitous within the next decade, affecting billions of new users in regions like Africa and India, while transforming industries ranging from corporate training to education.
- The geopolitical balance of state-led disinformation is shifting, with China becoming increasingly aggressive and interested in infiltrating Western information spaces, potentially leading to monolithic control over collective narratives.
- Future risks include widespread denial of authentic footage due to societal polarization, where elections or key events could be dismissed as "completely fake," and increased danger for human rights activists as narratives are twisted to avoid accountability.
- Deepfake pornography is anticipated to persist as a civil liberties issue and effective tool of harm due to ingrained cultural taboos, evolving into a broader crisis regarding non-consensual biometric hijacking.
- Trust is expected to shift away from traditional institutions toward individual influencers, while the challenge of adopting media authentication technologies will depend heavily on engagement from major tech companies.
- Legislative frameworks regarding consent will likely emerge from new industries surrounding synthetic media, though society may struggle to keep pace with the speed of change compared to historical technological shifts.
- Skeptical counter-arguments suggest that deepfakes currently represent a tiny fraction of online media and may lose effectiveness over time as public skepticism grows, or that their impact will eventually prove equally problematic for all regime types.
- The overall pace of disruption is described as unprecedented in human history, driven by near-universal access to information ecosystems and generalized adversarial networks.