Previously you had to be enormously wealthy and surround yourself with yes-men to go mad from comfirmation bias. Now we have built a yes-man machine so that even the common plebs can do it! Truely we live in a communist utopia.
Nearly $1,000? ChatGPT can’t even give correct instructions for building a computer capable of hosting itself.
You could say the same thing about cults. A lot of the MAGA movement. A lot of religion. Similarly how a lot of scams and other disinformation methods work. We do not try very hard to stop those things.
"second guessing your doctor” and the like
Oh my dear and fluffy lord
That’s a a great idea. Would you like me to come up with a business plan?
I know this sounds condescending but isn’t this more of a reading comprehension / media literacy problem than an AI problem? These people apparently believe whatever an LLM tells them and, critically, only realised they were being goaded when they asked a different LLM. Sounds like the problem is between keyboard and monitor, no? If you can’t critically evaluate information being sent your way, no matter who from, you’re at risk of delusion. We see it all around us, really AI only accelerates the proces.
I hope the AI-chat companies really get a handle on this. They are making helpful sounding noises, but it’s hard to know how much they are prioritizing it.
OpenAI has acknowledged that its existing guardrails work well in shorter conversations, but that they may become unreliable in lengthy interactions… The company also announced on Tuesday that it will try to improve the way ChatGPT responds to users exhibiting signs of “acute distress” by routing conversations showing such moments to its reasoning models, which the company says follow and apply safety guidelines more consistently.
So I can get GPT premium for free if I tell it I’m going to kill myself unless it does what I say?




