New Router Works with Mac OSX but not Windows 7

My old wireless router went on the fritz so I exchanged the old one for a new one that is exactly the same model. I brought it home and set it up on my Mac running OSX and it worked perfectly. However, when I try to use the wireless on my Windows 7 based machine, as well as on the Bootcamp partition running Windows 7 on my Mac, the computer says that I am connected to the internet, but the internet browser cannot load any web pages. It remains stuck with the message "Loading web page." I am confused because the computers running windows worked fine with the previous router, but not with the new one. Am I missing something?

What is the make and model of the router?

NETGEAR's CG814M Wireless Cable Modem Gateway

How old is this router? Has it been a while since you have rebooted it? Turn off all devices that connect to your router, then unplug the routers power supply for a minute or so, then plug it back in. When the router is fully booted, start up Windows and see if the problem persists.