This is going to sound very vague, but I troubleshooted a similar problem with a tool from "sysinternals"...
Windows Sysinternals: Documentation, downloads and additional resources
I don't recall the name of it, but it logged everything the PC was doing and by noting the exact time this occured you could pinpoint it in the log.
I hope this "may" point you in the right direction, and if you need me to I'll try to find the tool I used, but it's been some time and I really don't remember much more about this, but I do agree it's annoying.
Also, regarding to the driver suggestion. You can try disabling devices you don't use and see what happens. If you suspect your mouse driver, you can install a generic mouse driver as a test.