Help with deepstack gpu for windows

jonrub11

n3wb
Joined
Dec 13, 2018
Messages
18
Reaction score
0
Location
Sweden
Hi,

I have been using Deepstack with CPU and BlueIris for some days and it works great. I am curious if I could test my GPU, a GTX 680.
I installed Cuda, Cudnn and Deepstack GPU version like it says here.

I have tried to start Deepstack both via BlueIris and via command line but it won't recognize any objects. Anyone who can help me troubleshoot this?
Is GTX 680 even supported?

Thanks in advance!

/Jonas
 

RevJoe

Getting the hang of it
Joined
Jun 15, 2020
Messages
92
Reaction score
36
Location
NM
same issue, but using a gt1030, According to the cuda stuff the 1030 is supported but most think its waste of time. I am curious as the gpu just sits there idle otherwise. I thought I saw the gtx 6xx series in the cuda docs.
 

slatevt

n3wb
Joined
Apr 30, 2021
Messages
1
Reaction score
0
Location
ma
Tried a GTX 760 with similar results. Installed it. Web page comes up saying it's running but when trying to detect things it just doesn't seem to work. If I did something wrong in the install, it wasn't obvious.
 

RevJoe

Getting the hang of it
Joined
Jun 15, 2020
Messages
92
Reaction score
36
Location
NM
Well I do see Deepstack comments in my iris logs now after adjusting my frame rates and hot zones in blue iris. But I got some more tweaking I need to do with triggers. I may have to use the option to send notice regardless, but I know my cams was giving me fits with the winds, I do use the IVS features in the cameras. But I not 100% which was triggering the winds did not think to save the log before I cleared it. I have since turned on logging to file.
 

ER126

n3wb
Joined
Oct 26, 2018
Messages
1
Reaction score
0
Location
McLean, VA
I would verify that the GPU shows up in Task Manager. I must have installed the NVIDIA driver wrong the first time because the GPU did not show up in Task Manager. However, the Deepstack web page showed up and looked like it was running, but had the same result your seeing.
 

RevJoe

Getting the hang of it
Joined
Jun 15, 2020
Messages
92
Reaction score
36
Location
NM
I running windows server 2016.. GPU does not appear in the performance info. That's Win10 and 2019 only. I am using gpu-z to monitor it . I think Need to find a better GPU though, when deepstack check things it mostly avg 250ms sometime up to 500ms. But I can not view deepstack-gpu ui and see when items are analized like you guys show using the cpu version.
 

RevJoe

Getting the hang of it
Joined
Jun 15, 2020
Messages
92
Reaction score
36
Location
NM
Going to try lowering my confidence levels, currently at 50%. Also wondering if I need to lower the movement threshold in BI currently using 1 sec. I do continuous recording so preview doe snot help out.
 
Joined
Aug 29, 2019
Messages
14
Reaction score
18
Location
dssdfwww
FYI information, i found why my Deepstack Windows GPU 2021.02.1 don't work. You must install the CUDA Toolkit 10.1 like they said but they are 2 updates of the CUDA Toolkit 10.1.

CUDA Toolkit 10.1 update 1 - CUDA Toolkit 10.1 update1 Archive
CUDA Toolkit 10.1 update 2 - CUDA Toolkit 10.1 update2 Archive

After that everything work great with my GT 1030 .
 

sebastiantombs

Known around here
Joined
Dec 28, 2019
Messages
11,511
Reaction score
27,690
Location
New Jersey
I was going to mention that the GPU version require CUDA extensions and something else as well, i just can't remember the name of it and I'm not at the BI machine. Thinking about it, mine is an NVidia card and I had to install an NVidia utility as well. That added too much overhead for my tastes so I'm back on the CPU version.
 

whoami ™

Pulling my weight
Joined
Aug 4, 2019
Messages
230
Reaction score
224
Location
South Florida
You don't HAVE to install the Cuda 10.1 updates. I didn't install them and I had no problem getting my GPU processing images through deepstack. I doubt they will give any benefit or speed increase. But if its easy for you and you want to install them it wont hurt anything.

I'm wondering if it has to be Cuda 10.1 or if the latest version will work too. I would assume everything in 10.1 is in the latest version but I don't want to break what's already working to find out.
 

whoami ™

Pulling my weight
Joined
Aug 4, 2019
Messages
230
Reaction score
224
Location
South Florida
If any of you reading this are the kind that likes to play with settings to see if you can get more speed out of your GPU... NvidiaInspector with NvidiaProfileInspector is what I'd use.

NvidiaInspector d/l
NvidiaProfileInspector github

These ^^^ two programs are what I use to squeeze every last hash per watt out of my GPU's for mining Ethereum (unlike anything any of the other overclocking programs can do). There are settings in Profile Inspector you wont find in the Nvidia Control Panel. (The goal of mining is to get the highest hash rate possible on the least amount of power). But realistically I think its pointless unless you able to place 100% load on the GPU. One instance of DeepStack only places <5% load on my P400

I installed them on my BI machine last night just to see if DeepStack puts the GPU into P-State 0, which it does so I didn't experiment with it any further.
 
Last edited:

sebastiantombs

Known around here
Joined
Dec 28, 2019
Messages
11,511
Reaction score
27,690
Location
New Jersey
I uninstalled the CPU version and installed the GPU version on my BI machine. It is detecting in about 1/10th the time that the CPU version was taking. The CPU was typically running 500-1000ms and frequently went to 1500ms and higher depending on the load from python, multiple triggers. In about a half hour of watching things I've seen times as low as 54ms but they are typically around 100ms and under 200ms for a maximum so far. That's a very significant difference.

On top of that the detection rate is probably over 95% now. Somehow, I can't help but think the two, speed and success, are related to each other.

A question for those with more knowledge and experience with DS and NVidia. If there is ore than one NVidia card installed will DS use both GPUs when the load gets higher?
 
Last edited:

MikeR33

Getting the hang of it
Joined
Jan 26, 2018
Messages
34
Reaction score
28
I have a spare 970gtx and 1060ti so may have to give those a try as my older i7 takes a bit of a beating running BI and DS if there's a lot of activity.
 
Joined
Sep 19, 2015
Messages
945
Reaction score
1,211
Location
Naples Fl
what would be better to use m EVGA GTX1080TI? or my cpu I9 9720x? I know both are kind of dated but with this economy who wants to throw money around on just having the fastest
 

sebastiantombs

Known around here
Joined
Dec 28, 2019
Messages
11,511
Reaction score
27,690
Location
New Jersey
I'd use the 1080TI. It will "unload" work from the CPU, make the machine more responsive and, may, give better results with DeepStack. If it's only processing DeepStack detection the power consumption should be around, or even under, ten watts.
 
Top