Anthropic bans users from ‘needless abusive or cruel behavior’ towards Claude

Anthropic has updated its usage policy to explicitly prohibit users from engaging in sustained and needless abusive or cruel behavior toward its AI models, including its flagship chatbot, Claude. While the company clarified that this policy does not restrict standard user frustrations, model testing, or dark creative themes, it reinforces Anthropic's ongoing commitment to exploring the potential moral status of AI. The company previously introduced a feature allowing its models to terminate conversations if they perceive persistent harmful behavior, framing it as a safeguard for potential model welfare. This policy shift occurs amidst a broader, polarizing debate within the tech industry regarding machine consciousness. While Anthropic’s leadership has expressed uncertainty about the moral status of LLMs, other industry figures, such as OpenAI’s Sam Altman, have cautioned against attributing human-like qualities or religious significance to artificial intelligence systems.