Is OpenAI responsible for what its popular AI chatbot, ChatGPT, says? A new lawsuit against the company filed by a Georgia-based radio host argues that the company is.

Armed America Radio host Mark Walters filed against OpenAI for defamation earlier this week, marking the first such case in AI, according to Bloomberg.

So, what happened? According to the complaint, Fred Riehl, the editor-in-chief of the gun outlet AmmoLand, was doing research for an article on a Washington federal court case, Second Amendment Foundation v. Ferguson. 

When Riehl asked ChatGPT for a summary of the case, ChatGPT responded with information about Walters, who the AI chatbot said was the Second Amendment Foundation's treasurer and chief financial officer. According to Walters' suit, ChatGPT told Riehl that Walters engaged in "defrauding and embezzling funds" from the organization it said he worked for.

The lawsuit states that, according to ChatGPT, Walters "misappropriated funds for personal expenses without authorization or reimbursement, manipulated financial records and bank statements to conceal his activities, and failed to provide accurate and timely financial reports and disclosures to the SAF's leadership."

One problem: Everything ChatGPT allegedly told Riehl about the case and Walters was completely fabricated. Walters did not defraud or embezzle funds from the Second Amendment Foundation. In fact, Walters doesn't nor has he ever worked for the organization. The Second Amendment Foundation v. Fergusoncase isn't even about financial fraud, it's a suit filed by the gun group against the Attorney General Bob Ferguson over Washington state's gun laws. As Gizmodopoints out, Walters isn't mentioned anywhere in the actual 30-page lawsuit from the Second Amendment Foundation.

When Riehl asked ChatGPT at the time to confirm what the AI chatbot was saying about the court case and Walters, it insisted the information was correct. ChatGPT even returned with what it had said was "the paragraph from the complaint that concerns Walters.” ChatGPT proceeded to quote a completely made-up paragraph that does not appear anywhere in the actual Second Amendment Foundation v. Ferguson filing. The AI chatbot even cited an "erroneous case number.”

Riehl did not end up publishing a piece based on ChatGPT's information. However, Walters still filed this lawsuit against OpenAI and is seeking "punitive damages in an amount to be determined at trial."

While Walters may be the first to bring "AI hallucinations" to court, the trend of AI manufacturing false information will likely result in more such cases in the near future. An Australian mayor threatenedto sue OpenAI back in April after ChatGPT claimed he was a convicted criminal in a bribery scandal when in fact he was the whistleblower in the case.