I think WDR was turned off and I believe I had that one (although at the lowest setting).
I turned it on and now the image looks about the same again.
Stupid me, it's scheduled to reboot at that time.:facepalm:
So, the night image is repared, just weird the camera some how changed it during...