I have tried self-signed cert created by camera, the result is Synology unable to connect to the cam, if I remember correctly, it didn't provide any error, and I assumed it is due to certificate being untrusted. I think I saw a confirmation for this theory in docs or somewhere on internet.