AI-generated violent extremist content
This article's lead section may need to be rewritten. (August 2026) |
The rise of generative artificial intelligence has seen the technology used to create content promoting violence, terrorist attacks, and mass killings. Since 2025, experts observed a trend towards using readily available AI tools to produce video content that normalizes or glorifies violence and targets young audiences on social media platforms.[1][2]
| Part of a series on |
| Artificial intelligence (AI) |
|---|
| Glossary |
Forms of extremist AI-generated content
[edit]This section needs expansion. You can help by adding missing information. (October 2026) |
Use of Viggle AI
[edit]Viggle AI is a Chinese artificial intelligence-based image-to-video platform. It allows users to place people or fictional characters from images into reference videos and transform static images into animated videos, including an AI Dance Generator.[3] Viggle AI was launched in March 2024 by founder and CEO Chu Hang, a former employee of Google, Nvidia, Facebook, and Autodesk. By February 2026, the platform had surpassed 40 million users.[4][1]
A 2026 article published by the Global Network on Extremism and Technology described a trend involving the use of Viggle AI to create videos of mass murderers dancing at the locations of their attacks, often alongside references to the demographic targeted by the attack and the number of people killed. According to the article, videos such as these, while not outright inciting murder, contribute to the normalization of violence.[1]
Fruit and vegetable gore content
[edit]One "genre" of AI-generated violent extremist content involves videos of anthropomorphic fruits and vegetables being subjected to violence, torture, and hyper-realistic killings, while using aesthetics that feature bright colors, cartoon characters, and Pixar-style animation to conceal the disturbing nature of the content.[5][6]
Minion AI
[edit]A trend of violent AI-generated content that got popular on apps like TikTok around December 2024. These are videos where gore and other types of shock content are edited with AI programs like Runway to replace people with minions.[7]
2026 Tumbler Ridge shooting
[edit]The perpetrator of the 2026 Tumbler Ridge shooting, eighteen-year-old Jesse Van Rootselaar, had extensively described various scenarios involving gun violence to ChatGPT before the shooting.[8][9] The interactions were flagged as "gun violence activity and planning" by OpenAI's automated abuse detection system, and a security team recommended notifying Canadian law enforcement after reviewing the logs, viewing them as indicative of an "imminent risk of serious harm to others."[10]
OpenAI's management rejected the security team's recommendation, suspending Van Rootselaar's account for violating the company's terms of service but choosing to not contact law enforcement because they assessed the conversations to not meet their threshold of a "credible and imminent" threat.[11]
After being blocked, Van Rootselaar created a second account and continued her conversations with ChatGPT; this account was not detected by OpenAI until after the attack took place.[10][11]
See also
[edit]References
[edit]- 1 2 3 Lucini, Silvano Rizieri (2026-02-26). "An 'Ode to Violence': Extremist Exploitation of Viggle AI". GNET. Retrieved 2026-08-25.
- ↑ "AI and Extremist Propaganda: An Assessment".
- ↑ Carry, Owen (2026-03-11). "Teens Are Using AI-Fueled 'Slander Pages' to Mock Their Teachers". Wired. ISSN 1059-1028. Retrieved 2026-08-24.
- ↑ "What Is Viggle AI And How To Use It? - Dataconomy". 2024-04-18. Retrieved 2026-09-18.
- ↑ Pugnana, Alessandra (2026-08-10). "Fruit, Vegetable, and Brain Rot: The Use of Generative AI to Produce Violence-Based Viral Trends". GNET. Retrieved 2026-08-25.
- ↑ https://www.the-independent.com/news/uk/home-news/ai-tiktok-vegetables-radicalise-extremism-b3030708.html
- ↑ https://www.ischool.berkeley.edu/news/2025/prof-hany-farid-reflects-minion-gore-videos
- ↑ Herberhold, Allizandra (2026-05-01). "The 'True Crime Community Stoplight Model': Understanding Digital Pathways and Tumbler Ridge". GNET. Retrieved 2026-08-25.
- ↑ Varga, Michael (2026-07-09). "The Counterterrorism Blind Spot: AI as a Radicalisation Environment". GNET. Retrieved 2026-08-25.
- 1 2 Duffy, Clare (2026-04-29). "Families of Tumbler Ridge shooting victims sue OpenAI and CEO Sam Altman". CNN. Retrieved 2026-08-25.
- 1 2 "OpenAI vows safety policy changes after Tumbler Ridge shooting". BBC. 2026-02-27. Retrieved 2026-08-25.