After WU start menu shut down button doesnt clear

I have my PC set to install updates at 3AM automatically but if I see an update alert in the task-bar, I will usually go ahead and install them manually. I use my PC as my alarm clock and require a password to logon so if windows update reboots my PC in the middle of the night, I am going to have a bad start to my day. I have noticed the past several times after installing windows defender updates manually, the little update symbol in shutdown in the start menu does not go away. When I hover over the button, it says install updates and shut down PC. I check for more updates and there are none available. Normally the shutdown button puts the PC to sleep. When it happens i just reboot to avoid the PC automatically rebooting in the middle of the night and the button goes back to a sleep button. I am afraid though that one day i will forget and oversleep because the PC rebooted. Is there a way to fix this apparent bug?

Turn off automatic updates should fix this. Unless I misinterpreted your question.

~Lordbob