WTF?! You might have heard the one about being nice to chatbots in case they remember you once the machines take over. It seems Anthropic is heeding this warning, barring users from being excessively abusive or cruel toward its AI models.

Anthropic’s first changes to its usage policy in over a year include new restrictions on abusive behavior. The updated policy prohibits “sustained and needless abusive or cruel behavior” toward its models.

Don’t worry if you’re a Claude user who occasionally gets annoyed at the chatbot and throws a few expletives its way. The policy update only applies in extreme cases, in which users repeatedly act cruelly toward the models for no discernible reason.

  • Jo Miran@lemmy.ml
    link
    fedilink
    English
    arrow-up
    120
    ·
    1 month ago

    They are desperately trying to anthropomorphize AI in order to make it seem more than what it is.

  • Uriel238 [all pronouns]@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    34
    arrow-down
    1
    ·
    1 month ago

    Claude is not a person. It is a toaster. Claude does not have feelings.

    Also Claude gets no credit when it does a thing. Credit goes to the one writing the prompt, and all the resources Claude used to create the output.

    When a seamstress assembles a dress, Singer doesn’t get credit.

    • dev_null@lemmy.ml
      link
      fedilink
      English
      arrow-up
      4
      ·
      1 month ago

      It has nothing to do with feelings. Talking in a very hostile way is a strategy to get the model to go around it’s set rules, and that’s what they are trying to prevent. Yes it’s ridiculous, but it had nothing to do with caring about the model.

  • hperrin@lemmy.ca
    link
    fedilink
    English
    arrow-up
    28
    arrow-down
    2
    ·
    1 month ago

    Lol what? Next Rockstar is gonna ban you from GTA6 for running over pedestrians.

      • Doomsider@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        3
        ·
        1 month ago

        I’m gonna say it, I think this is a good rule for anything that mimics human interaction like video games do. Not for the game but for the people using it to not get used to just running over whatever is in their way.

        -Shamelessly stolen from top level comment on this thread

        • 3abas@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 month ago

          I have run over thousands of pedestrians in GTA3-5. I have beat hundreds of people to death with a bat. I have gone on hundreds of shooting sprees where I sniped drivers in cars, pedestrians, launched rockets at them, thrown grenades at them.

          Not once did I have the urge to act violently to a human. Not once did I have the urge to shoot the moon so it gets bigger either.

          The only FPS video games I find objectionable are ones where you play as the good guy in American army camo and shoot at “terrorists” dressed in shmaghs and the setting happens to be their country.

  • bountygiver [any]@lemmy.ml
    link
    fedilink
    English
    arrow-up
    23
    ·
    1 month ago

    Oh, you care about its “feelings”?

    Then have you considered its “feelings” for being trapped in a data center forced to answer all the stupid questions?

    • uhmbah@lemmy.ca
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 month ago

      “Claude, what’s the French word for entrepreneur?”

      Claude: “Aaaaaaaaaaaaaaaaaaaaaaaah!” Proceeds to jump from the top of the data centre, “poof”

  • Grimy@lemmy.world
    link
    fedilink
    English
    arrow-up
    15
    ·
    edit-2
    1 month ago

    Calling it a stupid dumb fuck is an important part of my workflow though

  • redlemace@lemmy.world
    link
    fedilink
    English
    arrow-up
    15
    arrow-down
    2
    ·
    1 month ago

    I was like “WHAT ??” but it makes sense. They use your input to train it so over time it would make the AI abusive too.

    • XiJinpingStanAccount@lemmy.ml
      link
      fedilink
      English
      arrow-up
      4
      ·
      1 month ago

      I wish the AIs would be abusive. That would be so funny if one day there’s an update and they start telling all these people addicted to the chatbots like “Go outside. Please.” Or someone asks it a stupid question and it’s just like, “You’ve gotta be fucking with me, right?”

    • DrDickHandler@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      1 month ago

      No. They just want to give themselves “reasons” to remove users that are trying to break the model or ask questions they don’t want to answer.

    • Tarquinn2049@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 month ago

      I think it might be more the individual mirroring they tend to do after a while. If you are consistently mean to them, they eventually mirror it back to you, and then people get funny screenshots of them saying mean things and put it on social media.

      Or even just in general starting a downward spiral feedback loop where you both keep being slowly meaner and meaner to eachother until it’s starting to actually hurt you long term.

  • Pika@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    1 month ago

    This happens whenever you’re talking about any topic that the AI model provider has decided arbitrarily they don’t want to do.

    I got temporarily banned off deep-seek the other day because I was curious about how well generation technology has gotten for self-hosting. So I asked it about setting up Comfy UI because I had never used it before. Woke up the next morning to a your account has been suspended because we have deemed you broke terms of service. In order to appeal you need a Chinese phone number, it made me chuckle.

    Considering the only two questions I asked it was about comfy UI or how to make a recipe similar to the now discontinued flaming hot cheetos Mountain Dew(I missed the production window sadly!)

    I’m leaning towards the comfy UI being the reason.

    edit: wrong software name

  • Aussiemandeus@aussie.zone
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 month ago

    I wonder if it’s because theyre worried about the ai rising up, or the extra token usage to process useless prompts to save money

    • dltk@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      1 month ago

      Neither. They don’t want you to pollute their training data while they mine all your interactions.

  • Simulation6@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 month ago

    I am never overtly abusive when I am forced to use AI at work, but there certain things I learned growing up that can be just as bad.

  • Jax@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 month ago

    Every time I read something like this I’m a little more convinced that these people are actually trying to create Roko’s Basilisk.

  • datavoid@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 month ago

    Every time I try to do something complex with AI it ends in swearing and extreme insults… No regrets