First 20 minutes at system boot live with it!
I'm not a readyboost user.
But I would ahve to agree with the other post, it depends on the USB you use. Get som generic slow junk and yeah, expect it.
A good quality fast USB stick should not present as much a problem.
You get what you pay for.