Pretty much. We were still in extremely early tribal and nomad societies, so there was hardly any concerted effort to exterminate the Neanderthal. They simply could not outcompete their evolutionary cousins in a few mental aspects, and that's all it took for them to wither away over thousands of years.