Oh, it's so much worse than you think:
I posted about the full horror a while back:
The key opener:
First, I’d created 2000 free-text responses and labelled them ‘UK’. Then I copied and pasted the exact same 2000 responses but labelled these ‘US’. Finally, I combined them to create a dataset of 4000 total responses, and jumbled them up. Despite the responses being identical for the UK and US, Copilot produced a rich, detailed summary of how US and UK respondents differed.

LLMs amplify "conventional wisdom" to ludicrous levels. On almost any topic.