More info please:
How do you connect to the Internet? Cable Modem?
Does the Router use cables to connect to the PC or is it wireless?
The Brand Name and Model Number would also help.
Yes, you can use a Router to connect PC1, PC2, PC3, PC4, and possibly more to the Internet at the same time. I do this. May I help?