I noticed last night that Windows 7 Beta was crashing for me when I tried to open Windows Update.
I've just uninstalled Java, and Windows Update opened fine.
EDIT: Windows Installer was then playing up, so I went back with System Restore, and reinstalled Java because I need it. Windows Update seems to be working.