I disagree. In my experience those "1 cent caps" as you call them do a poor job of preventing total moisture intrusion and subsequent corrosion if that's all you use, especially if in direct exposure to the elements.
I don't use those so-called "waterproof" connectors but instead treat the male RJ-45 with a touch of dielectric grease before I plug it into the camera pigtail and then wrap the union of the 2 with coax seal (self-vulcanizing rubber tape) and finally a tight layer of electrical tape (like 3M 33+ or 88) to speed the curing process. It takes 5 minutes...a small amount of time to invest to obtain a long lasting, reliable connection. Because I install a matching junction box so that I can drill a small 3/8" hole for un-terminated cable, there's plenty of room inside the box to perform the above.
If a box is not used, I perform the same procedure as stated above but wrap the coax seal / self-vulcanizing rubber tape starting about an inch BEFORE the female RJ-45 (camera end) and continue the wrap about an inch PAST the male RJ-45. 3M even makes a white vinyl electrical tape that can be used to help hide the black coax seal / rubber tape. I would still try to keep the camera and/or pigtail under a roof eave or behind a soffit and not expose it directly to rain.
Removal? A pair of reasonably-sharp diagonal cutters and some patience and it's off completely in less than 30 seconds. IMO, that's a small amount of time (that may not be needed) that outweighs the alternative.....the caps alone with no coax seal/rubber tape and no final wrap of 3M electrical tape.
But certainly, it's your camera, your time..... and your call.