System Restore can help. Some applications will kick off a restore point before installing but you can preempt that by grabbing one yourself. Microsoft support page
I’ve also had success with the portable and free version of Revo Uninstaller. It does the cleanup after the application has already been installed, so there is a chance it may miss something. Revo Uninstaller page
Hope this gets you pointed in the right direction