Quite a lot of games still run fine without actually being installed. Just start it from the .exe file in the game folder. I ran Star Wars Galaxies for 5 years without it ever being installed on my PC. I just kept the folder on my second hard drive and backed it up to the newest version before formatting my PC.
Save games can be quite annoying to find, especially when they save them to the hidden AppData folder in your User folder.