S.M.M.

Stop Manipulating Me · A Field Guide to Psychological Influence

ENTRY No. T25.26
CATEGORY Advanced Influence
CLEARANCE Public / Essential
EDITION 01
Dossier · Manipulation Tactic

AI-Generated Persuasion

AI-Enabled · Synthetic Persuasion · Rapidly Emerging
Critical
How It WorksSEC 01

AI-generated persuasion uses generative models to produce personalized persuasive content — text, audio, images, video — at machine scale and speed. Its significance is economic: it collapses the marginal cost of crafting tailored, fluent, on-message material to nearly zero, so techniques that once required a skilled human per target — spear-phishing, romance fraud, tailored propaganda — can now be run against millions of people individually. As of August 2026 this is a rapidly evolving space; specific model capabilities and detection tools shift quickly, so the durable analysis is about the shape of the threat rather than any particular tool.

The technique is genuinely dual-use — the same capability powers helpful tailored communication, accessibility tools, and disclosed marketing — but its manipulative deployment is what earns a Critical rating: mass-personalized scams, automated disinformation, and synthetic identities that pass casual scrutiny. This entry stays at recognition and provenance altitude and offers no generation guidance. The observable tells are uncanny personalization arriving at superhuman volume, subtle synthetic markers (fabricated citations, too-perfect fluency, audio/image artifacts), an unverifiable identity behind a persuasive message, and a flood of similar-but-varied content with no traceable human origin.

The defense shifts from spotting typos to verifying provenance and identity. Confirming any consequential request through a known independent channel — never the one that delivered it — neutralizes even flawless synthetic content, because the defense no longer depends on detecting the fake. Checking for content-provenance signals (such as C2PA content credentials) and treating their absence on high-stakes media as a caution, raising skepticism specifically for uncanny tailored appeals, and independently confirming that a persuasive correspondent is a real person together form a posture that holds even as the generation technology improves.

Warning SignsSEC 02
  • Uncanny personalization at volume. Content that feels tailored to you specifically, arriving at a scale no human team could produce.
  • Synthetic markers. Subtle tells — odd phrasing, fabricated citations, image or voice artifacts, too-perfect fluency.
  • Unverifiable identity behind the message. A persuasive correspondent, caller, or author you cannot independently confirm exists.
  • Volume without a traceable origin. A flood of similar-but-varied content lacking a checkable human source.
Frequently Paired WithSEC 03
  • Personalized Manipulation · T19.14
    Micro-targeting that AI supercharges
  • Deepfakes · T12.9
    Synthetic audio/video used as the persuasive payload
  • Coordinated Inauthentic Behavior · T25.28
    AI content as fuel for fake-account networks
How the Technique WorksSEC 04
  • Stage 01 · Generate
    Generative models produce fluent, on-message text, audio, images, or video at near-zero marginal cost.
  • Stage 02 · Personalize & scale
    Content is tailored to individuals or segments and deployed at a volume and speed no human operation could match.
  • Stage 03 · Iterate
    Responses are measured and the content is automatically refined, optimizing persuasion in a tight loop.
Counter-ProtocolSEC 05
Defense: Verify provenance and treat unsolicited tailored content skeptically.
  • Verify out-of-band. Confirm any consequential request or claim through a known, independent channel — not the one that delivered it.
  • Check provenance. Look for content credentials / C2PA provenance signals and treat their absence on high-stakes media as a caution.
  • Raise skepticism for tailored appeals. Uncanny personalization at volume is a warning sign, not a sign of genuine attention.
  • Confirm the human. For persuasive correspondents or callers, independently verify the person exists before acting.