OpenAI has uncovered and disrupted two coordinated influence operations originating from China that weaponized ChatGPT to spread misleading content about US AI policy and infrastructure. The company banned hundreds of accounts involved in the campaigns, which generated social media comments and images designed to manipulate public debate around artificial intelligence and technology regulation in the United States.

What Were These Influence Campaigns Targeting?

The two operations had distinct focuses but shared a common goal: to shape how Americans think about AI infrastructure and government policy. One campaign, dubbed "Data Center Bandwagon," generated content claiming that AI data centers were driving up electricity costs for American families. The second operation, called "Tech and Tariffs," created content criticizing US tariffs and technology policies.

Notably, the prompts used by the operators specifically instructed ChatGPT to avoid mentioning Chinese President Xi Jinping and instead focus on US President Donald Trump. The second campaign was also connected to a network of inauthentic social media accounts that spread false claims that ChatGPT user data had been compromised, which OpenAI described as entirely false.

How Did OpenAI Respond to These Operations?

OpenAI said it is working to protect what it calls "democratic AI" by identifying and disrupting such covert interference attempts. The company published its findings publicly on June 10, hoping to help governments, technology companies, and the public identify and stop future influence operations. While OpenAI did not disclose the exact number of accounts removed, it confirmed that the campaigns involved hundreds of ChatGPT accounts that have now been banned.

"Our mission is to ensure that artificial general intelligence benefits all of humanity," OpenAI stated in its report, adding that its mission includes "identifying and disrupting attempts by authoritarian regimes and their proxies to use AI systems to coerce critics, surveil communities or covertly interfere in democratic societies."

OpenAI, in official company report

Steps to Protect Against AI-Powered Influence Operations

• Transparency and Disclosure: Companies should publicly report findings about detected influence campaigns, as OpenAI did, to help governments and the public recognize similar tactics in the future.
• Account Monitoring and Enforcement: Platforms must actively monitor for coordinated inauthentic behavior, including clusters of accounts using AI tools for covert influence, and ban offending accounts swiftly.
• Prompt Instruction Auditing: Organizations should review and flag suspicious prompt patterns that instruct AI systems to avoid mentioning certain political figures or to focus narrowly on divisive narratives.

Did These Campaigns Actually Change Public Opinion?

Interestingly, OpenAI found no evidence that the campaigns significantly influenced public opinion. The company stated that "the targeting of OpenAI and US data center buildouts is significant not because the operation appears to have shifted public opinion, but because it shows PRC-origin influence operators testing narratives against AI infrastructure". The operators appeared to be testing messaging strategies by exploiting existing concerns about energy prices and the impact of data center development, rather than launching a full-scale influence operation with measurable impact.

This discovery underscores a broader concern: even if these particular campaigns did not sway voters or policy, they represent a proof-of-concept for future, more sophisticated attempts. The fact that foreign actors are actively experimenting with AI tools to interfere in American democratic debates signals that governments and technology companies need to remain vigilant about emerging threats to information integrity.

OpenAI's decision to publicize its findings reflects a shift in how AI companies are approaching security and transparency. By sharing details about the tactics, narratives, and account patterns used in these operations, OpenAI is attempting to raise awareness across the industry and help other organizations recognize similar attempts before they gain traction. The company's focus on "democratic AI" suggests that protecting the integrity of public discourse is becoming a core part of how leading AI firms define their responsibility to society.