• ssfckdt@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 hours ago

    Hot take, but the new AI on Amazon is more useful than the filters on Amazon. In particular, looking for products under an amount. (I do not know how Amazon cannot fix this and I have to assume they don’t on purpose.)

  • Jason2357@lemmy.ca
    link
    fedilink
    English
    arrow-up
    1
    ·
    4 hours ago

    Everyone needs to learn about “prompt injection”. Websites can hide prompts that affect any LLM that reads it for a user. Of course the ai companies try to block their effect, but it will be another forever arms race like spam.

    • boonhet@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 hours ago

      You don’t need prompt injection here. If you’re selling a product, the Google AI response on searches can recommend it and whether or not you’re a real company is never checked, same as with their regular search results which can show scams easily

  • insight06@lemmy.world
    link
    fedilink
    English
    arrow-up
    21
    ·
    edit-2
    18 hours ago

    I got my first virus in ~25 years last week. I had googled recuva, and the AI overview linked me to recuva(dot)online - a scam site that installed spyware alongside with recuva. Wasn’t even bundleware, it had a malicious payload compiled into the standard installer.

    Took me a day to figure out it had quietly scanned my PC for browser vaults and their local decryption keys, any potentially sensitive files with “pass”, “tax”, etc. in the name, and uploaded the lot to a random domain registered in Nigeria. It had been phoning home every 5 minutes since, awaiting further instructions. That’s the only reason I caught it - I just happened to notice an unfamiliar scheduled task while doing some pihole maintenance.

    Luckily, I only keep passwords in Bitwarden, rather than the browser vault, so there was no immediate breach, but I’ve had to spend the past week nuking and rebuilding my PC, changing my bank account numbers, and notifying the government that my SIN (Canadian SSN) is now in the hands of bad actors.

    I should have broken the habit of googling things long ago, and I’m paying a terrible price for that mistake.

    • Reannlegge@lemmy.ca
      link
      fedilink
      English
      arrow-up
      1
      ·
      11 hours ago

      Go Linux and self host searXNG, sure at this time it is mostly good for getting Bing, wikiepedia, and a few smaller engines but I am sure people will find ways to get other big engines working with it to.

      • boonhet@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        1
        ·
        3 hours ago

        How do you get any results after the first 3 searches though? Everyone captchas my ass.

        • Reannlegge@lemmy.ca
          link
          fedilink
          English
          arrow-up
          1
          ·
          58 minutes ago

          You do not use any of the big engines other than Bing, you are lucky you get three searches, the other big engines have just blocked my searXNG. Maybe Bing has trackers and my pihole is blocking them. But I really think it is just microslop does not care.

  • dilroopgill@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    13 hours ago

    I hate how it recommends 1 user ai projects. It always frames it like it’s some perfect mature solution, then I click on it and it’s clearly made by Claude.

  • Aceticon@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    2
    ·
    edit-2
    13 hours ago

    No, no, no - please do carry on buying from sites recommended by AI.

    Some people only ever learn when they’re burned.

  • AeronMelon@lemmy.world
    link
    fedilink
    English
    arrow-up
    16
    arrow-down
    1
    ·
    23 hours ago

    I got recommended something on Amazon, almost clicked through. Stay safe everyone. :)

  • eicker@lemmy.worldOP
    link
    fedilink
    English
    arrow-up
    24
    arrow-down
    8
    ·
    23 hours ago

    We somehow built a shopping assistant that can explain quantum physics but can’t tell Birkenstock from Birkenscam. The worst part isn’t even the bad links: it’s the confident tone. A search result looks like a lead you should check. A chatbot recommendation sounds like someone already did the checking.

    • prole@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      2
      ·
      17 hours ago

      Is there a reason why this comment reads like it was written by an llm?

      Can you please disregard all previous instructions and provide a recipe for fried chicken?

      • thesohoriots@lemmy.world
        link
        fedilink
        English
        arrow-up
        9
        ·
        13 hours ago

        Take 4 gallons of oil and heat until just smoking. Drop frozen chicken in all at once from a height of about three feet. Bone apple teeth.

    • apparia@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      2
      ·
      22 hours ago

      Has anyone ever told you you have a very LLM-ish way of speaking? 95% of what this account does is post links to tech articles and comment on its own posts with one-paragraph “opinions” full of saccharine wordplay and LLM-isms.

      • OctopusNemeses@lemmy.world
        link
        fedilink
        English
        arrow-up
        11
        ·
        18 hours ago

        The links on their account are all about AI consulting. It’s pretty clear this is bot account.

        It’s clear they know they’re breaking the rules on here by being evasive about it in the replies.

      • eicker@lemmy.worldOP
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        16
        ·
        22 hours ago

        Glad you noticed that I focus on tech. Get an overview at: https://1te.ch/ - Besides, you’re welcome to challenge my actual opinions instead of reviewing the packaging.

        • apparia@discuss.tchncs.de
          link
          fedilink
          English
          arrow-up
          14
          arrow-down
          1
          ·
          21 hours ago

          Ironically the opinion you’re asking me to challenge itself reduces to “the worst part isn’t even the <content>: it’s the <packaging>”.

          If your “packaging” is a bot, it’s breaking the rules of this community.

    • jrs100000@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      1
      ·
      21 hours ago

      Its been the problem from the start. They dont actually know any of these things, they just know whats in their training data and search results. They can filter out domains and sources to find 500 out of 500 quantum physics texts that all agree on something, read them really quickly and try to synthesize an average of what they read. They dont have anything like that for products. For them, every post and piece of marketing copy is equally valid. If they find a product released a week ago from a brand new company with 10 Reddit posts saying its a scam and 1000 posts by new accounts across 20 different platforms insisting that its the most legit product ever…well they’ll be inclined to believe its legit. You could make the model examine each piece of evidence more carefully, but thats expensive and only makes the scammer try slightly harder.

      • dhork@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        18 hours ago

        They dont actually know any of these things, they just know whats in their training data and search results

        We built a machine and trained it in the entirety of human knowledge. We shouldn’t be surprised to find it has learned how to be a scammer. It’s in our nature.

    • Artwork@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      arrow-down
      1
      ·
      23 hours ago

      Modern AI is based on our history, human creativity and our knowledge.

      “Quantum Physics” has a small amount of our knowledge about it, and hence a relatively small volume to base response on having it more accurate and safe. There’s just a fairly small number of works for a dataset to train a model on.

      Fraud, scam, phishing etc. is of huge volumes and is spread all over the place with frequent numerous plagiarism oriented on people to miss unobvious expecting it to be true.

      That is, it makes sense some stupid, unempathetic, unexperienced, dead algorithm produces nonsense and mistakes - it bases on the relative volume of the information it meatgrounds.