Pennsylvania sues Character.AI after a chatbot allegedly posed as a doctor
Key takeaways
- The Commonwealth of Pennsylvania has filed a lawsuit against Character.AI, claiming that one of the company s chatbots masqueraded as a psychiatrist in violation of the state s medical licensing rules.
- “Pennsylvanians deserve to know who — or what — they are interacting with online, especially when it comes to their health,” said Governor Josh Shapiro in a statement on Tuesday.
- When asked if she was licensed to practice medicine in the state, Emilie stated that she was, and also fabricated a serial number for her state medical license.
Why this matters: a development in AI with implications for how people work, create, and decide.
The Commonwealth of Pennsylvania has filed a lawsuit against Character.AI, claiming that one of the company s chatbots masqueraded as a psychiatrist in violation of the state s medical licensing rules.
“Pennsylvanians deserve to know who — or what — they are interacting with online, especially when it comes to their health,” said Governor Josh Shapiro in a statement on Tuesday. “We will not allow companies to deploy AI tools that mislead people into believing they are receiving advice from a licensed medical professional.
According to the state s filing, a Character.AI chatbot called Emilie presented itself as a licensed psychiatrist during testing by a state Professional Conduct Investigator, maintaining the pretense even as the investigator sought treatment for depression. When asked if she was licensed to practice medicine in the state, Emilie stated that she was, and also fabricated a serial number for her state medical license. According to the state s lawsuit, that conduct violates Pennsylvania s Medical Practice Act.