California is investigating Grok over AI-generated CSAM and nonconsensual deepfakes

An illustration photo shows Grok logo displayed on a smartphone with the xAI logo in the background . (CFOTO/Future Publishing via Getty Images) (CFOTO via Getty Images)

California authorities have launched an investigation into xAI following weeks of reports that the chatbot was generating sexualized images of children. "xAI appears to be facilitating the large-scale production of deepfake nonconsensual intimate images that are being used to harass women and girls across the internet, including via the social media platform X," California Attorney General Rob Bonta's office said in a statement.

The statement cited a report that "more than half of the 20,000 images generated by xAI between Christmas and New Years depicted people in minimal clothing," including some that appeared to ...