I found out what was causing my system to wake.

I have two network ports on my motherboard, let's call them A and B. A has WOL disabled and B has no option like that. I moved my desk and I'm in the process of redoing my cables. I plugged the Ethernet wire into B and didn't realize it. I switched it back to A (disabled B in the BIOS) and now I'm not experiencing any problems with sleep.

I don't know why I didn't look at that earlier.