Setting ClearPageFileAtShutdown to zero changed the shutdown time from 2.5 minutes to about 30 seconds.
I am not so worried about the security concerns because I am using PGP Whole Disk Encryption. On security Windows is a sieve anyway for anyone determined to crack in, so it's not clear that it matters all that much.