New build 40 cameras 4K , what would you do ?

Cire3

n3wb
Joined
Mar 7, 2020
Messages
9
Reaction score
4
Location
US
Sure, this ought to work.

Finally Completed - New EPYC build & Limit Test - (Extremely Unnecessary Builds)

I estimate (40 * 8.3MP cameras @ 20FPS) using substreams if I did the math would be about 6500 MP/s effective full-rez recorded and another 600MP/s in substreams. With this configuration in testing, I got up to 52 cameras and 7200 MP/s effective running dual-GTX1650 video cards and drawing 200+ watts constantly from the wall.

Of course you could just build multiple little desktop systems for a lot less.
I don't think he's going to want to maintain multiple systems.

Are you off loading computing to the dual GTX1650's ? Can we do that ? Haven't built anything that needed or was able to do so.
 
Joined
Apr 26, 2016
Messages
1,048
Reaction score
746
Location
Colorado
Tried it both ways, post #10 I had 53 cameras running with substreams only on the CPU. My concern is that my 53 cameras were all lower than you are proposing, but if @bp2008 can check my math, I did have 6500 MP/s running in that configuration just on the CPU.
In post #11, I had 20 of the high MP cameras running without substreams on the GTX1660 SUPERs just to test some limitations. But I can't think of a practical reason to not use substreams for a large camera system.

Some things to consider:
  • Multiple business desktops running Blue Iris
    • You could probably run 6-10 repurposed business desktops for the same purchase cost as this system last year (pre-covid), and with substreams you probably would only need 2 or 3 for the load.
    • With Intel built-in graphics instead of a graphics card (required of all AMD CPU's unless you happen to have the new APU's available) I'm not sure there would be a big enough power difference to justify the added cost of a "single server".
    • A "single server" approach also means several "single points of failure" (memory, cpu, power supply, MB, graphics, onboard controllers) you have to tolerate or mediate (dual power supplies, multiple hard drives etc). Multiple desktops = built in redundancy.
    • Maybe consider a commercial solution instead.
  • Commercial Solutions are built for this type of use case. I cant remember the ones @fenderman always recommends, but on both IPTV and this forums there are multiple discussions to address the non-hobbyist systems. (
    Nxwitness which is sold in North America by digital watchdog ipvms.
  • Building ANY NEW system will be difficult this year.
    • You will significantly higher prices for all new components and double or triple price for ANY GPU
    • You will have availability challenges for power supplies, good CPU's or ANY GPU.
  • Power Consumption
    • Total power consumption may be slightly higher with separate smaller systems, but hard to tell for sure because you won't now how many smaller systems (2 x 100W systems would be about the same I was running)
    • You must add a video card with nearly all AMD CPUs, the built in Aspeed AST2500 graphics chip is worthless for anything but basic BIOS & windows desktop. Factor that into total power consumption.
    • I was tempted to use an older/cheaper Quadro card, but two newer GTX1660 SUPER cards were lower power and provided much more throughput. Be aware I hit a software limit on the number of streams I could offload to the GTX1660 cards, I believe Nvidia has this limit to differentiate between their consumer and commercial cards.
    • Cranking out 200w - 300w around the clock also means you have a significant amount of heat you need to plan to deal with or the room the systems are in will become a sauna.
 
Last edited:

DanDenver

Getting the hang of it
Joined
May 3, 2021
Messages
43
Reaction score
48
Location
Denver Colorado
"Building ANY NEW system will be difficult this year"

I agree. When I went in to order my computer in person, the only reason I went with a I7 rather than an I9 is the wait times, they could not find an I9 within 30 days so I went with the I7. Same story on hard drives, the only purple they could find within a few weeks was 8TB. All the smaller drives were sold out, don't need 8TB at all, but just wanted to keep moving forward.
 

Cire3

n3wb
Joined
Mar 7, 2020
Messages
9
Reaction score
4
Location
US
Oh I'm well aware of heat, and the stupid cost of hardware now. Fortunately money isn't a problem in this build, and he's aware that this isn't the time to find deals.

It's going to be expensive, but he wants me to put something together. And to be honest I want to build it :)

I believe I'm liking the i9-10900k , just still searching through boards as I need more sata ports.

CS380B SilverstoneCS380B Silverstone case
i9-10900k
750w 80+ gold PSU
JBOD card ? I have yet to have a good server grade card fail yet . Yea it's possible, but not probable in my experience.
32Gb memory is a no brainer for this build.
512Gb NVMe for OS and software
So I'm thinking 7 X 16TB RAID10 He's the one wanting 30 days as close to 4k as we can be. Or I liked the idea of grouping cameras per drive as I didn't think of that.

It's going to be his option as it's all about how important it will be to him with the cost of drives.

I believe it will be headless, so that should help as no one is going to want to sit next to this thing.
 
Joined
Apr 26, 2016
Messages
1,048
Reaction score
746
Location
Colorado
The only thing I'd be a little concerned about is exactly what memory bandwidth is required. In my testing substreams significantly reduced the need for high memory bandwidth but your proposed configuration is at the extreme end.

I usually check: Blue Iris Update Helper so see if there are any systems comparable to at least have SOME points of reference. The highest MP/s systems over there are using: i9-7980XE CPU which is an older CPU but does have quad-channel memory.
The CPU you proposed is newer, but is only dual-channel memory controller. Hard to know if that might be a problem with so many hi resolution video streams without testing. Probably OK, but worth testing before spending big money.
 
Last edited:

Cire3

n3wb
Joined
Mar 7, 2020
Messages
9
Reaction score
4
Location
US
I have a ASUS Prime X299 Deluxe here. Pairing that with a i9-7980XE would be a better solution ? Was pulled off the job for a bit, and just getting back at this.

Thoughts on that board ?

How many cameras can record to one drive at a time ? Any experience with that ? Skip the raid and just pair a few cameras to a single drive I'm thinking. Just to save drive cost for now. I also hate paying these prices.
 

iamnothim

Getting the hang of it
Joined
Jun 13, 2021
Messages
18
Reaction score
27
Location
san juan capistrano
This will not be taken well…consider
Putting it on a Synology NAS. All the data will be stored across two RAID I redundant drives. Calculate the necessary drive size. If you need more than 2 bays, get 4,6,8 bays
Surveillance Station will not have a problem.
Best of luck.

Screenshots

Synology NAS.
 
Top