ChatGPT Is Not a Lawyer, OpenAI Argues in Court. Here's Why That Matters for AI in the Legal System
OpenAI has asked a federal court to dismiss a lawsuit alleging that ChatGPT provided unauthorized legal advice, arguing that the AI platform is not a lawyer and does not practice law. The case, filed by Nippon Life Insurance Company in federal court in Chicago, represents one of the first major legal challenges accusing an AI platform of engaging in the unauthorized practice of law.
What Sparked the Legal Battle Over ChatGPT?
The lawsuit stems from a dispute involving Graciela Dela Torre, a former Nippon employee who had previously sued the company over long-term disability benefits. After settling that case in 2024, Dela Torre filed a new lawsuit and allegedly used ChatGPT to draft dozens of motions and notices that Nippon claims served "no legitimate legal or procedural purpose." Nippon contends that Dela Torre flooded the federal court docket with AI-generated filings designed to harass the company rather than advance legitimate legal arguments.
In its defense filing on Friday, OpenAI pushed back against the accusation directly. The company stated that "ChatGPT is not a person and neither has nor uses any degree of legal knowledge or skill," emphasizing that the tool is simply a research aid that users can access.
How Is ChatGPT Being Used in Courts Today?
The Nippon case arrives as federal judges report a rising trend of self-represented litigants, also known as "pro se" litigants, using generative AI tools to draft and file court papers. This shift reflects a broader pattern of people without legal training turning to AI platforms to navigate the court system.
- Self-Representation Growth: More individuals are representing themselves in court without hiring lawyers, a trend that has accelerated with the availability of AI writing tools.
- AI-Drafted Documents: Generative AI platforms like ChatGPT are being used to draft motions, notices, and other legal filings that would traditionally require attorney expertise.
- Judicial Concerns: Federal judges have flagged this trend as a growing issue, suggesting that courts are seeing an uptick in AI-generated legal documents filed by self-represented litigants.
What Is OpenAI's Defense Strategy?
OpenAI's legal team framed ChatGPT as a tool that actually advances access to justice rather than undermines it. The company argued that Dela Torre was entitled to represent herself and was entitled to use ChatGPT as a tool to do so. OpenAI stated that "Whether she made appropriate arguments is a question of her actions, and was for the district court judge presiding over her cases to decide".
The company also pointed out that users agree not to rely on ChatGPT's content as a substitute for professional legal advice when they accept the platform's terms of service. OpenAI characterized the lawsuit as stemming from "Nippon's apparent frustration with having to defend a pro se lawsuit" rather than any actual wrongdoing by the AI platform.
What Does This Mean for AI and the Legal System?
The case raises fundamental questions about the role of AI in legal proceedings and where responsibility lies when AI-generated documents are filed in court. If Nippon's lawsuit succeeds, it could establish a precedent that AI companies are liable for how their tools are used by litigants, even when those users are acting on their own behalf. Conversely, if OpenAI's motion to dismiss is granted, it would reinforce the principle that AI platforms are neutral tools and that users bear responsibility for how they deploy them.
The broader context matters here: as AI tools become more accessible and capable, more people without legal training will likely attempt to use them for legal purposes. Courts will need to grapple with how to distinguish between legitimate use of AI as a research and drafting aid and abuse of the technology to clog court dockets with frivolous filings. The Nippon case may be just the beginning of a larger conversation about AI accountability in the legal system.