How to get rid of kb3123862?

Hi,

I'm just doing a new installation of Windows 7 x64 after which I installed office which seems to change my Windows Update settings from my preferred setting "check for updates but let choose..." to "install updates automatically" and during that time of not realizing that sneaky change, windows went a head and sneaked in the kb3123862 and right now, it is waiting for me to shut down my PC to install that stupid update which 'll invoke the Windows 10 update later on. Is there any way to get rid of this KB completely before it finishes its installation if I were to turn off my machine now?

Of course, what I'm aiming at right now is to remove it COMPLETELY from my machine (delete/revert any reg keys it added/modified + remove all garbage files it throw in). Will the uninstaller do all of this?! (I just don't trust Microsoft's uninstallers especially in these scenearios of trying so hard to push their updates upon us )
Thanks!

Hi Magmag,
The office installation would have created a restore point.

GO OFF LINE first.

Then after restore change WU settings, to let me choose.
Go back online and hide the offending update when offered.

Roy