I mean it's a problem in the marketing and common usage of LLMs. That's exactly it though, LLM companies, and people are describing LLMs as a way to do research.

IE you could say these criticisms come in things like wikipedia too. IE anyone can write what they want, but what does wikipedia require? right every single claim has to be cited. So if you go to wikipedia find misinformation, you click on the number and see it.

If you ask chatgpt What diseases should I be concerned about in africa, it lists you a few. You can then... google it, find the wikipedia page, and look for what's there. It's a tool without a purpose at that point. because it literally doesn't save you any steps. It doesn't guide you to the source to check it's facts, when it tells you them it may or may not be making up the sources. At which point, it has no factual use, or use in even directing to the facts.