Reports indicate a massive uptick in AI-generated CSAM throughout the internet

AI-generated child sexual abuse material (CSAM) has been flooding the internet, according to a report by The New York Times. Researchers at organizations like the Internet Watch Foundation and the National Center for Missing & Exploited Children are warning that this new AI-created CSAM is nearly indistinguishable from the real thing.

Let's go over some numbers. The Internet Watch Foundation, a nonprofit that investigates and collects reports of CSAM, has identified 1,286 AI-generated videos so far this year. This is compared with just two videos identified in the first half of 2024. That's an exponential increase.

🔎 Developments in artificial intelligence (AI) come with a range of benefits, including supporting learning and innovation. There is, however, growing concern for how AI can also be misused to create and share child sexual abuse material (CSAM), referred to as AI-CSAM.

In… pic.twitter.com/lgfRQNBk8N

— Internet Watch ...