Generative Propaganda

Authors: Madeleine I. G. Daepp, Alejandro Cuevas, Robert Osazuwa Ness, Vickie Yu-Ping Wang, Bharat Kumar Nayak, Dibyendu Mishra, Ti-Chung Cheng, Shaily Desai, Joyojeet Pal

Published: 2025-09-23 15:27:00+00:00

Comment: Working Paper

AI Summary

This paper characterizes generative propaganda through interviews with defenders and creators in Taiwan and India, revealing that the term "deepfakes" disproportionately shapes defender expectations. It develops a taxonomy distinguishing obvious from hidden, and promotional from derogatory generative AI use, finding that deception is not the primary driver. Instead, AI offers efficiency gains in multilingual, multimodal communication and evading detection, which are crucial for persuasion and narrative distortion.

Abstract

Generative propaganda is the use of generative artificial intelligence (AI) to shape public opinion. To characterize its use in real-world settings, we conducted interviews with defenders (e.g., factcheckers, journalists, officials) in Taiwan and creators (e.g., influencers, political consultants, advertisers) as well as defenders in India, centering two places characterized by high levels of online propaganda. The term deepfakes, we find, exerts outsized discursive power in shaping defenders' expectations of misuse and, in turn, the interventions that are prioritized. To better characterize the space of generative propaganda, we develop a taxonomy that distinguishes between obvious versus hidden and promotional versus derogatory use. Deception was neither the main driver nor the main impact vector of AI's use; instead, Indian creators sought to persuade rather than to deceive, often making AI's use obvious in order to reduce legal and reputational risks, while Taiwan's defenders saw deception as a subset of broader efforts to distort the prevalence of strategic narratives online. AI was useful and used, however, in producing efficiency gains in communicating across languages and modes, and in evading human and algorithmic detection. Security researchers should reconsider threat models to clearly differentiate deepfakes from promotional and obvious uses, to complement and bolster the social factors that constrain misuse by internal actors, and to counter efficiency gains globally.


Key findings
The term "deepfakes" exerts outsized influence, causing defenders to overemphasize deceptive, adversarial content while overlooking broader uses of generative AI. Generative AI's primary utility lies in efficiency gains—lower detectability, multilingual reach, and multimodal output—for persuasion and distortion, often through obvious or promotional content. Social factors like legal fears, reputational risk, and social context are more significant constraints on misuse by internal actors than technical limitations alone.
Approach
The authors conducted 64 hours of semi-structured interviews with 72 participants (defenders and creators) in Taiwan and India. They analyzed this qualitative data using an abductive coding approach to develop a taxonomy for generative propaganda, differentiating uses based on obviousness and promotional/derogatory intent.
Datasets
55 semi-structured interviews with 72 participants (defenders and creators) across Taiwan and India, totaling 64 hours of qualitative data.
Model(s)
UNKNOWN
Author countries
USA, India, UK