Unable to connect to internet with Win 7/XP

I have a problem with my connection, In Windows 7/XP I have trouble connecting to the internet, but on my Linux Mint install, I have no issues whatsoever. All this seems to have started when I installed my old router as a switch, so I could run a music server. It seems that Windows thinks that this old router is the main connection point to the world, and of course cannot connect. I need to know where I can change the network settings to get windows to use the main router. My other problem is my laptop, which can connect to the main router fine by wireless, but cannot get further. I checked the route, and it seems to go from the main router to the switch, then stop. Any help on these issues would be appreciated, thanks.

Update: Solution was simple, the router/switch was conflicting with the main router and causing connection problems. So I took it off the network and moved the server downstairs, and connected it directly to the router. Why didn't I think of that two days ago?