White prisoners make up ~50% of the populations. Are you really going to argue that the Union’s victory introduced white slavery to the US?

Yes, that's exactly what happened. The fact that white people make up 50% of the prison population while being 60% of the general population means that minorities are still getting hit harder than white people, but white people did get swept up in this.