I can't believe I didn't think of this before. I pulled up the footage, and both have a stream until 02:00 in the night, this is exactly the time the NVR reboots daily.
So, they probably loose power for a few seconds, and they restart. Thanks for your comment, good thinking there.
Now, question...