How are the computers connect to the router5, wireless of Ethernet? Have you done the power off procedure?
Power off all computes, router and modem.
Power on modem, wait till it settles down.
Power on the router, wait till it settles.
Power on each PC one at a time and let it finish booting.