Wow, found it after all this time - Winsize has hotkeys for toggling always on top windows, and they were both defaulted to ALT alone.

It's an ancient program, but has been reliably pushing my windows to co-ordinates for over a decade