• xiao yun@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    28
    arrow-down
    2
    ·
    15 hours ago

    For the first experiment with 354 participants, one group was tasked with solving 15 basic fraction problems without help, while another had ChatGPT open on the side to use for assistance and to even ask for the answer. The group with AI access started off more accurate than the group without it. Then, after 12 problems, researchers took away the AI tool. Almost immediately, the people in that group stopped solving questions accurately.

    A similar thing happened when they ran the experiment on a second, larger group of 667 participants. Whereas the AI users got answers wrong or gave up entirely when the AI assistance was withdrawn, the group without AI stuck with the task and were more successful at the end.

    Researchers then ran a third experiment with 201 participants and an SAT reading comprehension prompt. The results echoed those from the fraction problems: When the AI tool was removed, persistence and accuracy dropped.

    • P03 Locke@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      8
      ·
      14 hours ago

      Replace this with math and calculators. Similar results? Then it’s not AI’s fault, but a known phenomenon.

      Of course, they would never even get the funding for this “experiment” if they didn’t have AI fearmongering in the title.