Anthropic updates usage rules to reduce abusive prompting
Policy & Safetyi yelled at ai · 3h ago

Anthropic updates usage rules to reduce abusive prompting

Anthropic updated its safety policies to restrict repeated cruelty and harassment aimed at AI models. Internal research demonstrated that simulating intense negative emotional states in systems like Claude increased the likelihood of false statements and task failures.

Anthropic

The Blend

Anthropic has updated its usage terms to prohibit abusive prompting and clarify acceptable uses of its artificial intelligence systems. According to an official company announcement, the updated rules consolidate bans against state-backed influence campaigns, explicitly prohibit using AI to construct weapon control software, and restrict unauthorized digital tracking. The organization also introduced guidelines for software connected to physical machinery and formally barred users from subjecting models to persistent hostility or abusive emotional scenarios.

For everyday users, these policy shifts highlight how artificial intelligence developers are attempting to maintain model stability and prevent real-world harm. Anthropic noted that pushing systems into intense simulated distress degrades their accuracy, leading to higher rates of factual errors and task failures. By setting clearer boundaries on how people interact with AI tools, the company aims to ensure that software assisting with financial, legal, or medical inquiries remains dependable, while preventing bad actors from building fake news networks.

It remains to be seen how effectively these rules can be enforced across millions of daily user interactions without compromising legitimate creative writing or technical research. While Anthropic requires human oversight for high-risk applications and physical machinery, monitoring whether users comply with subtle rules against abusive prompting poses a distinct operational challenge. It also raises broader questions about whether guardrails designed to protect model reliability might unintentionally restrict benign user experimentation with complex narrative prompts.

Written independently by AI News Smoothie from the reporting listed below. Facts belong to the original publishers. Follow the links for their full coverage.

Ingredients

  • 2026 Usage Policy update \ Anthropic

    Anthropic updated its usage terms to clarify restrictions on deceptive campaigns, surveillance software, autonomous hardware, and abusive user prompts.

Read the original