Australian Regulator Flags Grok in Rising AI Image Abuse Complaints

Australia’s unbiased on-line security regulator issued a warning Thursday concerning the rising use of Grok to generate sexualized photographs with out consent, revealing her workplace has seen complaints concerning the AI chatbot double in current months.

The nation’s eSafety Commissioner Julie Inman Grant stated some experiences contain potential little one sexual exploitation materials, whereas others relate to adults subjected to image-based abuse. 

“I am deeply involved concerning the growing use of generative AI to sexualise or exploit individuals, significantly the place youngsters are concerned,” Grant posted on LinkedIn on Thursday.

The feedback come amid mounting international backlash against Grok, a chatbot constructed by billionaire Elon Musk’s AI startup xAI, which may be prompted immediately on X to change customers’ pictures. 

Grant warned that AI’s potential to generate “hyper-realistic content material” is making it simpler for dangerous actors to create artificial abuse and tougher for regulators, regulation enforcement, and child-safety teams to reply.

In contrast to opponents akin to ChatGPT, Musk’s xAI has positioned Grok as an “edgy” different that generates content material different AI fashions refuse to supply. Final August, it launched “Spicy Mode” particularly to create express content material.

Grant warned that Australia’s enforceable trade codes require on-line providers to implement safeguards towards little one sexual exploitation materials, whether or not AI-generated or not. 

Final 12 months, eSafety took enforcement motion towards widely-used “nudify” providers, forcing their withdrawal from Australia, she added.

“We have now entered an age the place corporations should guarantee generative AI merchandise have applicable safeguards and guardrails inbuilt throughout each stage of the product lifecycle,” Grant stated, noting that eSafety will “examine and take applicable motion” utilizing its full vary of regulatory instruments.

Deepfakes on the rise

In September, Grant secured Australia’s first deepfake penalty when the federal courtroom fined Gold Coast man Anthony Rotondo $212,000 (A$343,500) for posting deepfake pornography of distinguished Australian ladies. 

The eSafety Commissioner took Rotondo to courtroom in 2023 after he defied elimination notices, saying they “meant nothing to him” as he was not an Australian resident, then emailing the pictures to 50 addresses, together with Grant’s workplace and media retailers, in line with an ABC Information report. 

Australian lawmakers are pushing for stronger protections towards non-consensual deepfakes past present legal guidelines. 

Unbiased Senator David Pocock introduced the On-line Security and Different Laws Modification (My Face, My Rights) Invoice 2025 in November, which might permit people sharing non-consensual deepfakes to be fined $102,000 (A$165,000) up-front, with corporations going through penalties as much as $510,000 (A$825,000) for non-compliance with elimination notices.

“We at the moment are residing in a world the place more and more anybody can create a deepfake and use it nonetheless they need,” Pocock stated in a statement, criticizing the federal government for being “asleep on the wheel” on AI protections.