Can your calculator only serve problems you already solved? I really don't buy that take

Llms are in fact not at all good at retaining facts, it's one of the most worked on problems for them

Llms can solve novel problems. It's actually much more complex than just a lookup robot, which we already have for such tasks

You just take wild guesstimates on how they work and it just feels wrong to me to not point that out