China's New AI Rules Target the Real Risks: Rogue Agents and Emotional Chatbots
China has introduced three new regulatory frameworks in July 2026 that move beyond broad AI principles to address specific, emerging risks: autonomous AI agents that can act independently, emotional chatbots designed to mimic human connection, and AI ethics guidelines. The regulations reflect a global shift toward more granular, risk-based governance as AI technologies evolve faster than traditional policy frameworks can accommodate.
What Are the New Risks That Triggered These Rules?
The regulatory gap became impossible to ignore as AI capabilities outpaced existing safeguards. Unlike traditional chatbots that simply generate text responses, advanced AI agents can independently plan tasks, access multiple tools, and take actions with minimal human oversight. Since late 2025, open-source AI agent technologies have spread rapidly across China and globally, creating new security vulnerabilities.
Security researchers have documented emerging threats from these autonomous systems, including credential theft, enterprise data leakage, and prompt injection attacks that manipulate AI agents into performing unauthorized actions. Simultaneously, AI companions and emotional chatbots have become increasingly human-like in their interactions, raising concerns about psychological manipulation and emotional dependence, particularly among minors and older adults.
China's earlier regulations, including the Interim Measures for Generative AI Services, focused primarily on content safety, algorithm governance, and data protection. They provided limited guidance on AI ethics, autonomous agents, or anthropomorphic AI interaction services. As these technologies evolved, those regulatory gaps became increasingly apparent.
How Are Global Experts Approaching AI Safety Beyond Regulation?
While regulation is essential, experts emphasize that laws alone cannot solve the deeper challenges posed by AI systems. A webinar hosted by the New York Academy of Sciences on June 30, 2026, brought together leading researchers to discuss both technical and societal dimensions of AI safety.
The conversation revealed a critical insight: many of the most consequential risks are not dramatic scenarios of rogue AI, but slower-moving, diffuse challenges rooted in how humans interact with AI systems. One expert highlighted a concern that resonates across industries: the gradual erosion of critical thinking as people treat AI outputs as an "easy button" without questioning where the information comes from.
"What keeps me up at night, honestly, is us. It's how humans are interacting with AI and this notion of gradual degradation of critical thought. Of using AI as an 'easy button,' accepting the output without questioning where it came from," said Robert Slone, Senior Vice President and Chief Scientist at UL Solutions.
Robert Slone, Senior Vice President and Chief Scientist, UL Solutions
This human-centered concern extends to the alignment problem, which examines whether AI systems can perform ethically and in accordance with human values. Researchers noted that the pace of AI development is unprecedented, with capabilities advancing so rapidly that humans struggle to map all the ways systems can fail or be misused.
What Are the Key Challenges Regulators Face Across Borders?
Regulators face a complex balancing act between intervening too aggressively and not intervening at all. National security concerns add another layer of complexity, particularly because AI development is driven by civilian firms rather than government agencies, yet carries enormous national security implications.
One significant challenge is the dynamic nature of AI systems themselves. What receives certification on one day can be updated on the next, potentially rendering that certification obsolete within hours. Unless regulators have access to lifetime data on system updates from manufacturers, compliance becomes nearly impossible to verify.
Another tension exists between economic competitiveness and safety standards. If one region enforces stricter AI regulations than others, it may place its own technology companies at a disadvantage. This creates a regulatory dilemma: how can governments protect their citizens without handicapping their own industries ?
Steps for Understanding China's Regulatory Approach
- Ethics Guidelines: China's new ethics guidelines establish a baseline for AI development, emphasizing that AI should assist people rather than harm, deceive, or exploit them. This represents a shift from content-focused rules to principle-based governance.
- AI Agent Safeguards: The regulations address autonomous AI agents specifically, targeting security vulnerabilities like credential theft, data leakage, and prompt injection attacks that can force agents to perform unauthorized actions.
- Anthropomorphic AI Controls: New rules govern emotional chatbots and digital avatars designed to mimic human interaction, with particular protections for vulnerable populations including minors and older adults who may be susceptible to manipulation.
The regulatory shift reflects a broader global recognition that one-size-fits-all AI rules are insufficient. As technologies become more specialized and capable, governance must become more granular and risk-specific.
Why Does the Timing of These Rules Matter?
China's July 2026 regulatory developments arrive at a critical moment when AI capabilities are advancing faster than policy frameworks can accommodate. The rapid spread of open-source AI agent technologies since late 2025 created urgent governance challenges that existing regulations could not address.
Experts also noted that there is currently global agreement on certain foundational elements of AI governance, such as data privacy, fairness, and bias mitigation. However, the most difficult challenge remains the dynamic nature of AI systems themselves, which evolve continuously and resist static certification approaches.
"What get certified on day one, could be updated on day three, and be completely different. So unless we have access to lifetime data from those manufacturers, as to what updates they've sent through, you could have an outdated certification within 24 hours or less," explained Robert Slone.
Robert Slone, Senior Vice President and Chief Scientist, UL Solutions
China's approach demonstrates that effective AI governance requires moving beyond broad principles toward operational, risk-based rules tailored to specific technologies. As autonomous agents and emotional chatbots continue to evolve, regulators worldwide will likely follow similar patterns, addressing emerging risks as they materialize rather than attempting to predict all possible harms in advance.