I Asked AI to Count My Carbs 27,000 Times. It Couldn’t Give Me the Same Answer Twice. | Diabettech - Diabetes and Technology
www.diabettech.com
Ask ChatGPT to estimate the carbs in your lunch. Now ask it again. And again. Five hundred times. You’d expect the same answer each time. It’s the same photo, the same model, the same question. But you won’t get the same answer. Not even close — and the differences are large enough to cause a
  • Eager Eagle@lemmy.worldEnglish
    246·
    27 days ago

    Waste of energy. It’s like asking a person to estimate a non-trivial angle. Either use a model trained for that task, or don’t bother.

      • Eager Eagle@lemmy.worldEnglish
        57·
        26 days ago

        You’d expect the same answer each time. It’s the same photo, the same model, the same question. But you won’t get the same answer.

        I don’t know what ads show that, but anyone who knows the first thing about LLMs knows you don’t get the same answer twice.

        I’d get this expectation 5 years ago when most people weren’t familiar with it, but come on… you don’t need to feed it an image 500 times to see that.

    • Alvaro@lemmy.blahaj.zoneEnglish
      9·
      26 days ago

      The point is that:

      1. It is being used for ut, even though it is obviously not capable of giving a reliable and realistic answer
      2. It allows this usage, even though it is dangerous and not within it’s capabilities
      3. Each model gives answers that vary wildly, something that a human wouldn’t do. A human wouldn’t give you answers that are 10x more for the same question randomly.