Anthropic bans users from being 'cruel' to its AI systems

Quarrelsome

I would suggest that a big part of avoiding abuse is that it leads to unexpected output. Given a model reflects its inputs, I imagine that abuse leads to unstable output as the model might then seek victim behaviours to better reflect the input. Often abuse comes from a bad place anyway. As the programming meme goes: > do what I want, not what I said which can create horrific alignment issues with conflicting demands.

chrisjj

> "This level of anthropomorphisation of AI is harmful. It leads people to believe that it's something it's not." It is easier to stomach when treated for what it is. Just more false advertising.

CoastalCoder

Bringing this up here for serious discussion: To repeat a point raised on Reddit: wouldn't this imply that Anthropic is involved in slavery?

perching_aix

Preciously discussed here: https://news.ycombinator.com/item?id=50008565 My opinion: https://news.ycombinator.com/item?id=50012423

jocoda

Does this ban eventually extend to the support chat systems that we see everywhere now? And does that mean that soon we will not be able to insult companies for fear of hurting their feelings?

rolph

cruelty doesnt exist as a monopole,it also requires suffering, thus anthropic gives the appearance it is positing that its machines can suffer. this is preposterous. i think what is somewhat more plausible is swinging at low hanging fruit, by eliminating users that experience problematic operation, rather than, dealing with the deficiencies of thier machines. even vending operators understand the idea that a machine left in service while in deficient state, is a lose lose scenario. if you let it go empty of change, or product, or dispense substitutions whithout prior warnings, the user looses a buck or two, the operator loses substantially more, thus the service maintenance model of extract and replace, rather than continue to vend in a default, saves money and preserves chattels.

ChrisArchitect

[dupe] https://news.ycombinator.com/item?id=50008565

nikolay

It didn't ban me, but it did warn me and quote their acceptable use policy or something.