Anthropic reported user's diary entry to police, leading to felony charges

A Florida woman is facing felony charges after Anthropic, the developer of the Claude AI chatbot, reported her to law enforcement. The woman had been using Claude as a digital diary, inputting detailed entries about her personal life and mental state. According to reports, the AI system flagged content within these entries that indicated a potential threat of violence. Anthropic’s safety protocols triggered an internal review, which subsequently led the company to contact the authorities. Police investigated the claims, resulting in the woman's arrest and the filing of felony charges. This incident highlights the growing intersection between AI safety monitoring and legal reporting obligations. It raises significant questions regarding user privacy, the boundaries of AI moderation, and the extent to which companies are required to act when their systems process potentially incriminating or dangerous user-generated content.