So I'm curious — we're all here because we at least hate the current state of AI with hallucinating facts, being used to undress women and children, and all the fuckery that goes along with it.
I grew up watching Star Trek: The Next Generation, which takes place on a ship with a perfect AI that does everything right and basically does nothing wrong. It never hallucinates information; it's always right. It has never been used to undress people against their will; however, the Holodeck is kind of an extension of that and was used for that on Deep Space Nine, when operated by a Ferengi (capitalist alien race in a world where humans are communist). But the Enterprise holodeck would never do that. The shipwide AI also does not traditionally carry on conversations. The one time it does, the human was hallucinating — sort of. The doctor was in a pocket universe, people were disappearing, and at one point the AI told her she was the only crew person on the Enterprise, and no, that did not make sense, but that that was still how it was. Because, in her pocket universe, it was true.
So the question is... would you want a perfect AI that was incapable of lying or harbouring anything untrue? Basically you could ask it anything and it would give you the correct answer.
The one fault I can find with that fictional AI is when Data (the android), dressed like Sherlock Holmes, asked the computer to "create an enemy which rivals my intelligence." He meant to say Sherlock Holmes's intelligence, who he was cosplaying, but the computer made a self-aware malicious AI that got out of the Holodeck and tried to destroy the ship... because it was told to do so. Other than that, though.
...I'm not trying to mislead anyone, so I will drop the other shoe, answer the begged question now. I've always felt that to get to that level of AI, we need to wade through the shit we're in now. So yeah, before you ask, that's kind of the point of the thought exercise. However, I will also say that I do not think we will get to Star Trek AI, I think we will get to Terminator AI, destroying the world rather than lifting people up. I think maybe in the Star Trek universe, AI didn't really take off until people realised that war wasn't the answer, after WW3/the Eugenics Wars, and so they were making AI to make things better, not worse. We are not in that timeline. I look at what is happening now, IRL, and the timeline in the Terminator franchise, and it's clear to me that that one is more realistic.
That said, I still wonder if anyone would want AI if it did not have any of the problems.
What does that actually entail? The AI that is programmed with only right wing talking points is going to think that those are the objective truths even if they aren't so if you put guardrails on it to only say the "truth" you're going to get lies.
I think the best we can hope for is minimal bias in the AI we develop.
I don't think bias was part of the equation on Star Trek because we didn't see humans/Earthlings fundamentally disagreeing about basic science like we have in the real world.
But, yes, the AI does have bias on Star Trek. I'm sure it would describe the Founders from DS9, or the Borg from multiple series, in a less-than-objective manner.
A better example would be if, post-Voyager, you were to ask it about how Janeway handled the Omega Directive. It would correctly tell you that Janeway destroyed the warp technology of a whole civilisation, setting them back a few generations, because that civilisation used a kind of warp that created omega particles that made traditional warp travel impossible. The Omega Directive, used only that one time AFAIK, overrides the Prime Directive and says a captain/crew can violate the Prime Directive to stop a civilisation from using omega particles. The recounting of the incident would be very pro-Starfleet. The civilisation Janeway sabotaged would have a very different account of it.
I'd also bet on the ship computer not telling you half the shit Sisko got up to on DS9. I'm not talking about In the Pale Moonlight where he deleted the entire log (thus, the event was never recorded). How about when he killed a whole planet to get at the Maquis? Starfleet probably classified that in a big hurry.