Have you tried connecting your device directly to your modem during that time to test it?

I don't see why it would be an ISP issue. This sounds like a router issue.

Connecting it directly to your modem during that time (reboot the modem and adapter once you do it) will allow you to test it to see if it works. If it does, you'll know it's the router.