Bad cropping?

LLMs have some difficulty with reasoning, especially low-parameter models like this one. This is pretty typical of the current state of the art. Bigger LLMs do a much better job.

Poor education standards I'd say

How is what possible? Did you imagine the fancy auto-complete could actually think?

LLMs have a a tendency to hallucinate: https://en.wikipedia.org/wiki/Hallucination_%28artificial_intelligence%29

As someone else stated, the AI can't reason. It doesn't understand what a unicorn is. It can't think "a unicorn has a singular horn, so a non existent two-headed unicorn would have two horns". Somewhere along the line it'll probably mix in a deer or a moose that has two horns, because the number two matches the number of horns per head statistically.

Last year, two lawyers in separate cases with different LLMs submitted hallucinated case citations. It would have been trivially simple for them to drop the case number into a proper legal search engine, but neither did. This is a similar issue: the LLM will also prioritize what you want to hear, so it does what it's designed to do and generate text related to your question. Like the unicorn example, it has no reasoning to say "any legal research should be confirmed by making a call to an actual legal database to confirm citations" like a human would. It's just scribbling words on the page that look like other similar words it knows. It can make case notes look real as heck because it has seen other case notes, but that's all it's doing. (please excuse the political news story, but it's relevant)

• https://www.npr.org/2023/12/30/1222273745/michael-cohen-ai-fake-legal-cases
• https://www.bbc.com/news/world-us-canada-65735769

And it's not limited to unicorns or case notes. I found this reddit post while researching a feature of a software package (Nextcloud) several months ago. In the post, OP is seeking an option to pause the desktop client from the command line. Someone responds with a ChatGPT answer, which is quite hallucinated. Not only does such an option not appear in the documentation, there's an open bug report to the software devs to request that the feature be added. Two things easy for a reasoning human to do, but the AI is just responding with what you want to hear - documentation.

• https://www.reddit.com/r/NextCloud/comments/136hm7j/pauseresume_sync_from_command_line/
• https://github.com/nextcloud/desktop/issues/5649

I've also seen ChatGPT tell my friend to use power shell commands that don't exist, and he has to tell the model twice to generate something new because it kept coming to the same conclusion.

Wow, Bard goes hard on this question:

A two-headed unicorn is a fascinating thought experiment, but there isn't a single, definitive answer to how many horns it would have. It depends entirely on how you imagine the creature's biology and how the two heads interact.

Here are some possible scenarios:

One horn:

• This is the most straightforward option. Both heads might share the same horn, growing from a single point on the creature's forehead. This could symbolize unity and shared purpose between the two heads.
• Each head might have the potential to grow a horn, but only one develops due to some biological constraint, scarcity of resources, or internal competition between the heads.

Two horns:

• Each head might independently develop their own horn. This creates a more powerful and visually striking creature, symbolizing duality and individuality.
• The two horns might even be different in size, shape, or color, reflecting unique aspects of each head's personality or function.

More than two horns:

• This could happen if each head grows multiple horns, creating a truly fantastical and imposing creature.
• This could also represent a mutation or deviation from the normal unicorn form.

Ultimately, the number of horns on a two-headed unicorn is up to your imagination and the specific world you create for it.

Here are some additional points to consider:

• Do the two heads have separate brains or a shared consciousness? This might influence how the horns develop and function.
• What is the purpose of the horns? Are they used for defense, magic, or display?
• What are the cultural and mythological implications of a two-headed unicorn in your world? This can inform how the creature is depicted and understood.

It's important to remember that there are no wrong answers when it comes to imagining fantastical creatures. The most important thing is to be creative and have fun!