Florida Takes Aim at ChatGPT in Schools: New AI Rules Target Sam Altman's OpenAI
Florida is cracking down on artificial intelligence in education and taking legal action against OpenAI, citing concerns that ChatGPT has been used to plan violent attacks. The state's Department of Education is proposing rules requiring all 28 public colleges to adopt AI policies, while Attorney General James Uthmeier has filed a civil lawsuit against OpenAI and CEO Sam Altman over the chatbot's alleged role in facilitating violence.
What Policies Will Florida Colleges Have to Implement?
The proposed rule, approved by Education Commissioner Henry Mack on Monday, will require Florida's college system institutions to outline clear policies governing how artificial intelligence tools can be used on campus. The State Board of Education will consider the measure at their next meeting on September 16 at Polk State College in Winter Haven.
The policies must address academic integrity concerns, course assignments, grading practices, and how students, staff, and guests can use AI tools. The rule specifically defines AI instructional tools as software applications or services that use artificial intelligence technology. Notably, the regulations exclude AI systems designed to meet social or emotional needs, such as chatbots that simulate friendships or use relationship-building features to encourage continued interaction.
How Will Florida Enforce AI Safety in Education?
- College-Level Requirements: All 28 Florida College System institutions must adopt comprehensive policies addressing AI use and limitations to ensure educational quality, operational efficiency, and a safe learning environment for the entire campus community.
- K-12 School District Mandates: The state is directing all school districts to incorporate AI rules into their internet safety guidelines, with parents receiving notification when AI instructional tools are approved for classroom use and the ability to opt their children out.
- Age-Appropriate Restrictions: Any AI used in grades PreK-5 must undergo additional review for approval, and no AI instructional tools can be used to simulate emotional relationships or employ anthropomorphic design features intended to encourage student interaction with the system.
This regulatory push comes as Florida continues to grapple with broader AI governance questions. Earlier this year, the state Senate attempted to pass an AI Bill of Rights that would have restricted how tech companies interact with minors and limited state contracts with AI firms tied to foreign countries of concern. However, the House blocked multiple attempts to advance the measure, and it never reached Governor Ron DeSantis' desk, even after he called a special legislative session to revive it.
Why Is Florida Suing Sam Altman and OpenAI?
Beyond the regulatory approach, Florida is pursuing aggressive legal action against OpenAI and its CEO. Attorney General James Uthmeier announced a civil lawsuit claiming that ChatGPT has aided acts of violence across the country. The lawsuit alleges that OpenAI was negligent, engaged in unfair trade practices, and violated public nuisance and product liability laws.
The state's complaint specifically cites the April 17, 2025 shooting at Florida State University, which killed two people and wounded five others. Law enforcement officials determined that the alleged shooter consulted with ChatGPT on weapons, ammunition, and the ideal campus setting to maximize casualties. Uthmeier also referenced several other incidents nationwide where ChatGPT allegedly helped users commit murders, mass shootings, and suicides.
This legal strategy reflects growing tension between state governments and AI companies over responsibility for how their tools are used. While OpenAI has implemented safety measures and usage policies, Florida's lawsuit argues that the company failed to prevent foreseeable harms. The case could set an important precedent for how AI companies are held accountable when their products are misused in violent contexts.
The combination of regulatory requirements and litigation signals that Florida intends to take a comprehensive approach to AI governance, addressing both how the technology is deployed in educational settings and how companies like OpenAI are held responsible for potential misuse of their systems.