Old Office Updates should be removed along with Office when it is uninstalled.
Use free Revo uninstaller in Advanced Mode to remove Office most cleanly. After running the Windows Uninstaller, don't restart when prompted but click Next and it will present a list of hidden Registry Keys for you to delete all the ones in bold, followed by a list of files.
The only case where you ever need to remove Windows Updates is if they cause a malfunction. You can then remove them in the Installed Updates panel, by System Restoring from Windows or from the booted Windows 7 DVD or Repair CD. Every Update sets a Restore point, as does the Revo Uninstaller.