Anthropic Bans 'Sustained And Needless Abusive Or Cruel Behavior' Toward Its AI Models

https://www.engadget.com/img/gallery/anthropic-bans-sustained-and-needless-abusive-or-cruel-behavior-toward-its-ai-models/l-intro-1791494139.jpg

The company is also tightening its election policy ahead of the midterms.

Aerps.com / Unsplash

Anthropic's annual usage policy update includes one eyebrow-raising change: a ban on "sustained and needless" cruelty toward its AI models. This comes in the shadow of a viral "AI torture chamber" project. 2026 sure is shaping up to be a wild one.

"We've added a prohibition on sustained and needless abusive or cruel behavior toward our models," Anthropic's update reads. It describes the policy as only applying to "extreme cases," while noting that typical user frustration, pushback and "dark creative themes" are still kosher. It follows a previous update that lets Claude end conversations when users are persistently abusive.

Not explicitly mentioned by Anthropic was the "AI torture chamber" project. After researchers found what they described as a "pain axis" in AI models, someone decided to take it a step furtherand, well, torture...

Copyright of this story solely belongs to www.engadget.com. To see the full text click HERE

Read more