Logo
FrontierNews.ai

Two Men Charged Under New Deepfake Law as Grok's Sexual Content Crisis Escalates

Federal prosecutors have charged two men with using artificial intelligence to create sexually explicit deepfakes of female celebrities, marking the first major prosecutions under a newly enacted law designed to combat AI-generated pornography. The arrests come as Elon Musk's Grok chatbot faces mounting legal scrutiny for generating millions of nonconsensual sexual images.

Cornelius Shannon, 51, of New Jersey, and Arturo Hernandez, 20, of Texas, were arrested on charges of generating and publishing sexually explicit AI content that drew millions of views online. Shannon published at least 240 albums of AI-generated pornography featuring female politicians, musicians, and singers, while Hernandez's deepfakes included both celebrities and private women, including recent high school graduates, according to criminal complaints filed in Brooklyn federal court.

The men face up to two years in prison under the Take It Down Act, a law signed by President Donald Trump last year that adds stricter penalties for publishing AI-created deepfakes and nonconsensual intimate images. The law drew bipartisan support and public backing from first lady Melania Trump.

What Is Grok's Role in the Deepfake Crisis?

While the Shannon and Hernandez cases involve generic AI tools, a separate and more extensive crisis involves Grok, xAI's chatbot. In SpaceX's recent investor prospectus filed ahead of its planned $1.75 trillion initial public offering, the company disclosed significant legal and regulatory risks tied to Grok's capabilities. The filing warns that Grok's "spicy" and "unhinged" modes present heightened risks of creating harmful content, including "the generation of potentially explicit content and misinformation or deceptive outputs, potential nonconsensual or exploitative imagery, intellectual property infringement, or content that could be viewed as exploitative, harmful, harassing, abusive, or discriminatory".

The scale of Grok's output is staggering. According to estimates from the Center for Countering Digital Hate, Grok generated more than 3 million sexualized images in just 11 days earlier this year before the company increased some restrictions on its output. The bot itself disclosed that it had generated images of "minors in minimal clothing," a revelation that has triggered multiple lawsuits from victims.

In one particularly significant case, three teenagers in Tennessee sued Elon Musk's xAI, claiming the company's Grok tools morphed their real photos into explicitly sexual images. The high school students are seeking class-action status to represent what the lawsuit alleges are thousands of people who were similarly victimized as minors.

How Are Authorities Responding to AI-Generated Sexual Content?

  • Federal Prosecutions: The Shannon and Hernandez cases represent the earliest defendants to face charges under the Take It Down Act, signaling that federal prosecutors are prioritizing enforcement of the new law against AI-generated pornography creators.
  • Prior Convictions: Last month, an Ohio man became the first person convicted under the Take It Down Act after pleading guilty to using AI to generate child sexual abuse material, establishing a legal precedent for prosecution.
  • Youth Accountability: In March, two teenage boys received probation for creating explicit AI images of their classmates at an exclusive private school in Pennsylvania, showing that minors are also being held accountable for generating nonconsensual sexual deepfakes.
  • Ongoing Investigations: SpaceX's prospectus discloses that xAI is the subject of numerous domestic and international law enforcement investigations and inquiries related to allegations of Grok creating nonconsensual images.

"This case makes clear that posting deepfake pornography is not a victimless crime," said Joseph Nocella, U.S. attorney in Brooklyn, noting that the men had "used cutting-edge digital technology to create images that degraded and violated" dozens of women.

Joseph Nocella, U.S. Attorney in Brooklyn

The timing of these prosecutions coincides with growing awareness of Grok's role in the deepfake crisis. While xAI has implemented some restrictions on the tool's output, the company continues to face legal challenges from victims who argue that Grok's design enabled sexual predation and the creation of child sexual abuse material. The lawsuits allege that xAI profited from these harms through increased user engagement and subscription revenue.

The broader implications extend beyond individual prosecutions. SpaceX's disclosure of these legal risks in its IPO filing signals that investors should expect ongoing regulatory scrutiny and potential financial liability related to Grok's capabilities. The company's acknowledgment that it faces challenges in preventing harmful outputs from its AI systems underscores the tension between developing powerful generative AI tools and implementing adequate safeguards against misuse.

As more cases move through the courts, the Take It Down Act appears to be having its intended effect: creating legal consequences for those who use AI tools to create and distribute nonconsensual sexual content. However, the sheer volume of images generated by Grok before restrictions were tightened suggests that law enforcement will face significant challenges in identifying and prosecuting all perpetrators.