Do you think you may be using USB sticks with a small SLC cache? If this is the case I would expect the transfer to be fast until the cache fills up then it would slow down to the speed of the rest of the NAND for remainder of the transfer. You wouldn't experience the slow down unless you were transferring files larger than the cache. This could explain why the issue has followed you across so many computers.
More affordable USB sticks may have cache sizes of 1 - 2 GB. I've seen high performance models available with 64GB caches.
If this is the cause of your issue, using a USB stick with a larger cache would be a solution.