I feel like for a long time, CUDA was a laser looking for a problem.
It's just that the current (AI) problem might solve expensive employment issues.
It's just that C-Suite/managers are pointing that laser at the creatives instead of the jobs whose task it is to accumulate easily digestible facts and produce a set of instructions. You know, like C-Suites and middle/upper managers do.
And NVidia have pushed CUDA so hard.

AMD have ROCM, an open source cuda equivalent for amd.
But it's kinda like Linux Vs windows. NVidia CUDA is just so damn prevalent.
I guess it was first. Cuda has wider compatibility with Nvidia cards than rocm with AMD cards.
The only way AMD can win is to show a performance boost for a power reduction and cheaper hardware. So many people are entrenched in NVidia, the cost to switching to rocm/amd is a huge gamble