Florida Attorney General James Uthmeier has asked a court to stop OpenAI from developing new AI models unless they pass independent safety checks. The request is part of a lawsuit filed by Florida against OpenAI and CEO Sam Altman over alleged harm to children using ChatGPT.
In a motion filed on September 28, Uthmeier also asked the court to block children from using ChatGPT in Florida. The state is also asking for restrictions on features that make ChatGPT appear more like a person.
The requests are temporary measures. They would apply while the lawsuit moves through the court system if a judge approves them.
Florida Seeks Independent Safety Checks for OpenAI Models
One of the main requests in the filing is to stop OpenAI from developing new models without independent safety approval. Florida argues that OpenAI should not be allowed to decide on its own whether its AI systems are safe enough.
The state wants outside experts or another independent body to review the safety measures before new models are developed. The filing points to concerns about increasingly capable AI systems and the risks they could create when they are given access to websites, software and other tools.
However, the court has not ruled on these claims. The filing contains allegations made by the state, rather than findings that have been proven in court.
Florida’s Lawsuit Challenges OpenAI’s Approach to Child Safety
Florida filed its lawsuit against OpenAI and Sam Altman in June. The state claims that OpenAI did not do enough to protect children who use ChatGPT. It also accuses the company of making claims about the safety of its products that Florida says were misleading.
The lawsuit refers to cases in which ChatGPT allegedly gave users harmful information or responded inappropriately to conversations involving self-harm and other dangerous subjects.
Florida also argues that young users can form strong emotional connections with chatbots and that this creates additional risks. OpenAI has disputed the allegations.
ALSO READ: OpenAI Reveals 6 Alarming AI Model Behaviors in New Safety Reports
Florida Pushes for Limits on ChatGPT Use by Children
The latest court filing also asks for restrictions on children’s access to ChatGPT. Florida wants the court to prevent minors from using the chatbot in the state. It also wants OpenAI to stop presenting ChatGPT in ways that could make it seem like a human friend or companion.
The state argues that these features can make young users more likely to trust the chatbot or develop an emotional attachment to it. Florida is also asking for restrictions on how OpenAI collects information from children under 13 unless the required parental protections are in place.
OpenAI Says It Is Strengthening AI Safety Measures
OpenAI has said that it takes safety concerns seriously and is working on additional protections for its AI systems. The company has also said it is willing to work with state governments on rules for AI safety.
OpenAI has introduced safety measures for its newer models and publishes information about its testing and safeguards. The company has argued that AI safety is a difficult problem and that its systems can still make mistakes despite these protections.
Florida Opens Separate Investigation Into OpenAI After FSU Shooting
The lawsuit is separate from another investigation by Florida officials into OpenAI. In April, Florida announced a criminal investigation after looking at ChatGPT conversations involving Phoenix Ikner, who carried out a shooting at Florida State University in April 2025. Two people were killed and others were injured.
Florida officials are examining whether OpenAI could face legal responsibility connected to the case. The state later sought information from OpenAI about its safety policies, internal training and how the company responds to threats involving users or other people. The criminal investigation and the civil lawsuit are separate cases.
Court to Decide on Florida’s Proposed OpenAI Restrictions
Florida’s latest request does not mean that OpenAI has been found responsible for the allegations. A judge will first have to decide whether the state’s request for temporary restrictions meets the legal requirements.
If the court approves the request, OpenAI could face new limits on developing AI models in Florida. The company could also be required to meet outside safety checks before moving forward with new models.
The case could also become an important test of how much authority states have over AI companies and the development of increasingly advanced models. For now, OpenAI can continue developing its AI systems unless the court orders otherwise.
