Just saw a paper about shifting AI training to nvme drives. But the penality, even with direct from GPU access was high.
If this trend looks to go past a few quarters I would expect new software or features to prioritize it. I'm sure some cool cats in the FOSS world might indenpently be motivated by this as well as part of their contributions.
Honestly from an ecosystem side, it would be cool to see more of the green computing metrics being added to big projects