There's nothing you can do about that, then...once everyone's been assigned an internal IP address by the router, that's it, until someone drops off again.
It doesn't matter how many of the connected users are actually going out on the Internet, as the IP assignment is strictly between the router and its clients.