I saw this on reddit, thinking it’s a joke, but it’s not. GPT 5 mini (and maybe sometimes 5) gives this answer. You can check it yourself, or see somebody else’s similar conversation here: https://chatgpt.com/share/689a4f6f-18a4-8013-bc2e-84d11c763a99
Maybe it is not up to date
That's not a valid reason to lie. If it does not have the information it should state as much. This post underscores one of the biggest issues with AI. It will confidently say whatever "statistically plausible" thing regardless of the actual truth.
Edit: in case there is any confusion, by "should" I mean in an ideal scenario where ai is able to be used the way people think they can currently use it. I'm aware that it's not really how ai works hence the remainder of the comment making note of the statistically plausible bit. AI makes factual errors on things that could arguably be answered with its current dataset (how many bs in blueberry etc) and this is not an issue with the dataset, it's a side effect with the way LLMs work. They are not reasoning machines. They are fancy algorithms. This makes them impractical for use in several areas where they're already being deployed and that's a problem.
I agree. The problem is it does not know that it is lying. As a whole, I would say it is our mistake to use it
That's victim blaming.
The fault is on the scammers selling the faulty product, not on the users who fall for the scam.
No one is a victim. You are blowing it out of proportion.
AI is not a scam. People just don’t understand where to use which technology. People using LLMs for financial advice or getting accurate data are not well informed of how AI works. Marketing teams take advantage of this and inflate stock prices but nowhere is any user duped of their money.