Instagram is profiting from several ads that invite people to create nonconsensual nude images with AI image generation apps, once again showing that some of the most harmful applications of AI tools are not hidden on the dark corners of the internet, but are actively promoted to users by social media companies unable or unwilling to enforce their policies about who can buy ads on their platforms.

While parent company Meta’s Ad Library, which archives ads on its platforms, who paid for them, and where and when they were posted, shows that the company has taken down several of these ads previously, many ads that explicitly invited users to create nudes and some ad buyers were up until I reached out to Meta for comment. Some of these ads were for the best known nonconsensual “undress” or “nudify” services on the internet.

  • Nobody@lemmy.world
    link
    fedilink
    English
    arrow-up
    108
    arrow-down
    12
    ·
    1 year ago

    It’s all so incredibly gross. Using “AI” to undress someone you know is extremely fucked up. Please don’t do that.

    • MonkderDritte@feddit.de
      link
      fedilink
      English
      arrow-up
      16
      arrow-down
      10
      ·
      edit-2
      1 year ago

      Same vein as “you should not mentally undress the girl you fancy”. It’s just a support for that. Not that i have used it.

      Don’t just upload someone else’s image without consent, though. That’s even illegal in most of europe.

      • MxM111@kbin.social
        link
        fedilink
        arrow-up
        17
        arrow-down
        4
        ·
        1 year ago

        Why you should not mentally undress the girl you fancy (or not, what difference does it make?)? Where is the harm of it?

    • ???@lemmy.worldBannedBanned from community
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      17
      ·
      1 year ago

      Would it be any different if you learn how to sketch or photoshop and do it yourself?

      • Kedly@lemm.ee
        link
        fedilink
        English
        arrow-up
        39
        arrow-down
        5
        ·
        1 year ago

        You say that as if photoshopping someone naked isnt fucking creepy as well.

        • stebo@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          6
          arrow-down
          7
          ·
          1 year ago

          Creepy, maybe, but tons of people have done it. As long as they don’t share it, no harm is done.

          • Kedly@lemm.ee
            link
            fedilink
            English
            arrow-up
            9
            arrow-down
            2
            ·
            1 year ago

            I dont think that many have dude. Like sure, if you’re talking total number and not percentage, but this planet has so many people you could also claim that tons of people are pedophiles too

            • ???@lemmy.worldBannedBanned from community
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              8
              ·
              1 year ago

              Lol you’d be surprised…isn’t this one of those things people would do in private but never admit in public (because of people likr you getting all touchy and creeped out by it)?

              • Kedly@lemm.ee
                link
                fedilink
                English
                arrow-up
                6
                arrow-down
                1
                ·
                edit-2
                1 year ago

                You say this like we SHOULDN’T be creeped out that you are digitally undressing someone without their permission

        • ???@lemmy.worldBannedBanned from community
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          6
          ·
          1 year ago

          Creepy to you, sure. But let me add this:

          Should it be illegal? No, and good luck enforcing that.

          • Kedly@lemm.ee
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            1
            ·
            1 year ago

            You’re at least right on the enforcement part, but I dont think the illegality of it should be as hard of a no as you think it is

        • ???@lemmy.worldBannedBanned from community
          link
          fedilink
          English
          arrow-up
          7
          arrow-down
          8
          ·
          edit-2
          1 year ago

          I am not saying anyone should do it and don’t need some internet stranger to police me thankyouverymuch.

      • KidnappedByKitties@lemm.ee
        link
        fedilink
        English
        arrow-up
        57
        arrow-down
        11
        ·
        1 year ago

        Consent.

        You might be fine with having erotic materials made of your likeness, and maybe even of your partners, parents, and children. But shouldn’t they have right not to be objectified as wank material?

        I partly agree with you though, it’s interesting that making an image is so much more troubling than having a fantasy of them. My thinking is that it is external, real, and thus more permanent even if it wouldn’t be saved, lost, hacked, sold, used for defamation and/or just shared.

        • Thorny_Insight@lemm.ee
          link
          fedilink
          English
          arrow-up
          8
          arrow-down
          11
          ·
          1 year ago

          it is external, real, and thus more permanent

          Though just like your thoughts, the AI is imagining the nude parts aswell because it doesn’t actually know what they look like. So it’s not actually a nude picture of the person. It’s that person’s face on a entirely fictional body.

          • KidnappedByKitties@lemm.ee
            link
            fedilink
            English
            arrow-up
            7
            arrow-down
            1
            ·
            1 year ago

            But the issue is not with the AI tool, it’s with the human wielding it for their own purposes which we find questionable.

      • Belastend@lemmy.world
        link
        fedilink
        English
        arrow-up
        32
        arrow-down
        5
        ·
        1 year ago

        An exfriend of mine Photoshopped nudes of another friend. For private consumption. But then someone found that folder. And suddenly someones has to live with the thought that these nudes, created without their consent, were used as spank bank material. Its pretty gross and it ended the friendship between the two.

        • Scrollone@feddit.it
          link
          fedilink
          English
          arrow-up
          19
          arrow-down
          7
          ·
          edit-2
          1 year ago

          You can still be wank material with just your Facebook pictures.

          Nobody can stop anybody from wanking on your images, AI or not.

          Related Louis CK

          • Belastend@lemmy.world
            link
            fedilink
            English
            arrow-up
            16
            arrow-down
            2
            ·
            1 year ago

            Thats already weird enough, but there is a meaningful difference between nude pictures and clothed pictures. If you wanna whack one to my fb pics of me looking at a horse, ok, weird. Dont fucking create actual nude pictures of me.

      • sugar_in_your_tea@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        20
        arrow-down
        8
        ·
        edit-2
        1 year ago

        It’s creepy and can lead to obsession, which can lead to actual harm for the individual.

        I don’t think it should be illegal, but it is creepy and you shouldn’t do it. Also, sharing those AI images/videos could be illegal, depending on how they’re represented (e.g. it could constitute libel or fraud).