Jump to content

AI-generated violent extremist content

From Wikipedia, the free encyclopedia

An example of an AI-generated video glorifying the perpetrator of the 2024 Abundant Life Christian School shooting. The "–2" is a reference to the number of victims killed in the shooting.

The rise of generative artificial intelligence has seen the technology used to create content promoting violence, terrorist attacks, and mass killings. Since 2025, experts observed a trend towards using readily available AI tools to produce video content that normalizes or glorifies violence and targets young audiences on social media platforms.[1][2]

Forms of extremist AI-generated content

[edit]

Use of Viggle AI

[edit]

Viggle AI is a Chinese artificial intelligence-based image-to-video platform. It allows users to place people or fictional characters from images into reference videos and transform static images into animated videos, including an AI Dance Generator.[3] Viggle AI was launched in March 2024 by founder and CEO Chu Hang, a former employee of Google, Nvidia, Facebook, and Autodesk. By February 2026, the platform had surpassed 40 million users.[4][1]

A 2026 article published by the Global Network on Extremism and Technology described a trend involving the use of Viggle AI to create videos of mass murderers dancing at the locations of their attacks, often alongside references to the demographic targeted by the attack and the number of people killed. According to the article, videos such as these, while not outright inciting murder, contribute to the normalization of violence.[1]

Fruit and vegetable gore content

[edit]

One "genre" of AI-generated violent extremist content involves videos of anthropomorphic fruits and vegetables being subjected to violence, torture, and hyper-realistic killings, while using aesthetics that feature bright colors, cartoon characters, and Pixar-style animation to conceal the disturbing nature of the content.[5][6]

Minion AI

[edit]

A trend of violent AI-generated content that got popular on apps like TikTok around December 2024. These are videos where gore and other types of shock content are edited with AI programs like Runway to replace people with minions.[7]

2026 Tumbler Ridge shooting

[edit]

The perpetrator of the 2026 Tumbler Ridge shooting, eighteen-year-old Jesse Van Rootselaar, had extensively described various scenarios involving gun violence to ChatGPT before the shooting.[8][9] The interactions were flagged as "gun violence activity and planning" by OpenAI's automated abuse detection system, and a security team recommended notifying Canadian law enforcement after reviewing the logs, viewing them as indicative of an "imminent risk of serious harm to others."[10]

OpenAI's management rejected the security team's recommendation, suspending Van Rootselaar's account for violating the company's terms of service but choosing to not contact law enforcement because they assessed the conversations to not meet their threshold of a "credible and imminent" threat.[11]

After being blocked, Van Rootselaar created a second account and continued her conversations with ChatGPT; this account was not detected by OpenAI until after the attack took place.[10][11]

See also

[edit]

References

[edit]
  1. 1 2 3 Lucini, Silvano Rizieri (2026-02-26). "An 'Ode to Violence': Extremist Exploitation of Viggle AI". GNET. Retrieved 2026-08-25.
  2. ↑ "AI and Extremist Propaganda: An Assessment".
  3. ↑ Carry, Owen (2026-03-11). "Teens Are Using AI-Fueled 'Slander Pages' to Mock Their Teachers". Wired. ISSN 1059-1028. Retrieved 2026-08-24.
  4. ↑ "What Is Viggle AI And How To Use It? - Dataconomy". 2024-04-18. Retrieved 2026-09-18.
  5. ↑ Pugnana, Alessandra (2026-08-10). "Fruit, Vegetable, and Brain Rot: The Use of Generative AI to Produce Violence-Based Viral Trends". GNET. Retrieved 2026-08-25.
  6. ↑ https://www.the-independent.com/news/uk/home-news/ai-tiktok-vegetables-radicalise-extremism-b3030708.html
  7. ↑ https://www.ischool.berkeley.edu/news/2025/prof-hany-farid-reflects-minion-gore-videos
  8. ↑ Herberhold, Allizandra (2026-05-01). "The 'True Crime Community Stoplight Model': Understanding Digital Pathways and Tumbler Ridge". GNET. Retrieved 2026-08-25.
  9. ↑ Varga, Michael (2026-07-09). "The Counterterrorism Blind Spot: AI as a Radicalisation Environment". GNET. Retrieved 2026-08-25.
  10. 1 2 Duffy, Clare (2026-04-29). "Families of Tumbler Ridge shooting victims sue OpenAI and CEO Sam Altman". CNN. Retrieved 2026-08-25.
  11. 1 2 "OpenAI vows safety policy changes after Tumbler Ridge shooting". BBC. 2026-02-27. Retrieved 2026-08-25.