Running Bi and CPAI VMs

I believe that most people are likely running both servers on the same windows machine; either on an actual PC or on a single VM running windows, eventually somebody may answer!

Hans007 said:

Any idea or suggestions?

Click to expand...

Try making sure the firewall on both the Windows machine or VM and the Ubuntu machine running CPAI allow port 32168 in both directions.
Clicking the BI Settings/AI/Open AI Dashboard should open the main CPAI page on the Ubuntu machine.
On the CPAI dashboard, clicking the blue CodeProjectAIExplorer button at the top of the window will allow you to pass an image to various types of detection to tell you if CPAI itself is working.
If necessary, you can copy some images from the Blue Iris machine to test it.
If you get no results, typically we would uninstall and reinstall the CPAI application.
I've done this, but to be honest, running CPAI on the Blue Iris machine is just easier.
Before the CPAI project separated from Code Project, their web page had a great deal of information.
Not so much any more.
But for me, 2.9.5 has been rock solid on Windows.(Until the inference number reaches about one million.)
Btw, I alert on cars also, just to make sure it's working.
Firewall is important!


Sent from my iPlay_50 using Tapatalk

Hans007 said:

Any idea or suggestions?

Click to expand...

You can test if CPAI itself works.

Sent from my iPlay_50 using Tapatalk

Hans007 said:

So i managed to get CPAI up and running using Ubuntu 24.04 instead of Debian 12.
But the issue that i have is that eventho CPAI now sees and uses the GPU for Object Detection (YOLOv5 6.2) no triggers are sent from BI
And when i look at BI it says that GPU is used eventho non of the feeds are set to use GPU
View attachment 226487
View attachment 226488

did a manual "trigger now" from BI and it just cancels the trigger without even sending it to CPAI and even tried restarting both VMs
View attachment 226489

Click to expand...

A thought...
Do you have Blue Iris camera(s) configured to trigger and record?
Then once you are triggering and recording in Blue Iris, you need to configure AI for the camera.
Once you get Blue Iris triggering consistently, you can check CPAI.
From what you posted of the CPAI home page, you are not reviewing anything from Blue Iris.
That would indicate to me either wrong IP address/port or firewall.
Again, get Blue Iris to trigger and record. That way you can test communication to CPAI on Ubuntu.
(I use cars).
You could actually set Blue Iris to trigger every 30 seconds or a minute.
Trying to figure this out just by triggering manually is tough.

Sent from my iPlay_50 using Tapatalk

hapstabu said:

A thought...
Do you have Blue Iris camera(s) configured to trigger and record?
Then once you are triggering and recording in Blue Iris, you need to configure AI for the camera.
Once you get Blue Iris triggering consistently, you can check CPAI.
From what you posted of the CPAI home page, you are not reviewing anything from Blue Iris.
That would indicate to me either wrong IP address/port or firewall.
Again, get Blue Iris to trigger and record. That way you can test communication to CPAI on Ubuntu.
(I use cars).
You could actually set Blue Iris to trigger every 30 seconds or a minute.
Trying to figure this out just by triggering manually is tough.

Sent from my iPlay_50 using Tapatalk

Click to expand...

receiving


Sent from my iPlay_50 using Tapatalk

Hans007 said:

Any suggestions? Or do I really need to go back to a 2:1 setup meaning have both on one system (win 11)

Click to expand...

Have you checked this:
Last night I tried getting ver 2.9.5 on one of my Linux machines, but got hung up because I needed to install .Net version 9.0. I only had 8 something. And this morning I got tied up with something else.
Do you have the required cuda pieces installed?
Another thought, do you have enough resources on the Windows VM to run the CPAI on that VM? It's actually easier that way. The last time I ran CPAI on Linux was almost a year ago, and I think that was a docker.
I will try sometime tomorrow.
It seems to me you might be making this way too complicated, running on two vms, if I understand correctly.
And unless I don't understand your situation, you should be able to consistently produce alerts in Blue Iris. (Before trying to get the communication working) Then it will be easier to figure it out.

Sent from my iPlay_50 using Tapatalk

You ARE getting responses from CPAI in the Face recognition module? Means IP address and port should be good.
When you set Blue Iris to alert on something common (Like cars) you don't get responses.
You say that Blue Iris in not sending requests to CPAI server.
When you look at the log in CPAI, you DO NOT see client requests from Blue Iris.

Like this:


2025-08-22 05:34:50: Response rec'd from Object Detection (YOLOv5 .NET) command 'custom' (#reqid 8764a2cb-afde-4966-b1e0-955d184de65c) ['Found Car'] took 139ms
2025-08-22 05:34:50: Client request 'custom' in queue 'objectdetection_queue' (#reqid 0a44f603-9b84-4462-8c7e-5b3d245b0a97)
2025-08-22 05:34:50: Request 'custom' dequeued from 'objectdetection_queue' (#reqid 0a44f603-9b84-4462-8c7e-5b3d245b0a97)
2025-08-22 05:34:51: Response rec'd from Object Detection (YOLOv5 .NET) command 'custom' (#reqid 0a44f603-9b84-4462-8c7e-5b3d245b0a97) ['Found Car'] took 143ms
2025-08-22 05:34:51: Client request 'custom' in queue 'objectdetection_queue' (#reqid 7b5acd9b-8a3c-4eda-b7fd-e172e54dc1ed)
2025-08-22 05:34:51: Request 'custom' dequeued from 'objectdetection_queue' (#reqid 7b5acd9b-8a3c-4eda-b7fd-e172e54dc1ed)
2025-08-22 05:34:51: Response rec'd from Object Detection (YOLOv5 .NET) command 'custom' (#reqid 7b5acd9b-8a3c-4eda-b7fd-e172e54dc1ed) ['Found Car'] took 152ms
2025-08-22 05:34:51: Client request 'custom' in queue 'objectdetection_queue' (#reqid 1712ee8f-0a77-4907-906f-5e4bd37c62fa)
2025-08-22 05:34:51: Request 'custom' dequeued from 'objectdetection_queue' (#reqid 1712ee8f-0a77-4907-906f-5e4bd37c62fa)
2025-08-22 05:34:52: Response rec'd from Object Detection (YOLOv5 .NET) command 'custom' (#reqid 1712ee8f-0a77-4907-906f-5e4bd37c62fa) ['Found Car'] took 153ms
2025-08-22 05:34:52: Client request 'custom' in queue 'objectdetection_queue' (#reqid 3dd0ebe3-2bd1-432c-b71b-1918d888a722)
2025-08-22 05:34:52: Request 'custom' dequeued from 'objectdetection_queue' (#reqid 3dd0ebe3-2bd1-432c-b71b-1918d888a722)
2025-08-22 05:34:52: Response rec'd from Object Detection (YOLOv5 .NET) command 'custom' (#reqid 3dd0ebe3-2bd1-432c-b71b-1918d888a722) ['Found Car'] took 166ms

If you DO NOT see client request in the CPAI log, then you can actually verify what Blue Iris is sending by doing a packet capture. The calls and responses are http calls. (Documented somewhere in CPAI docs, don't know where off hand).

See this:


If Blue Iris IS NOT sending requests for object detection, then the configuration in the camera / Blue Iris is wrong. (Do one camera at a time. Change one thing at a time.)

If that is the case I would suggest disable all but one camera, (maybe point at the street, detect cars), work on getting that one to work.

I will send screenshots of my configuration that I have been using for years. (I used to disable custom models and switch back and forth between CPAI and Deepstack just by changing the IP address and port.

Like some others have said, running CPAI on a linux machine or VM is throwing a lot more complication into the mix. Trust me, running CPAI on the same box as the Blue Iris is much easier. Version 2.9.5 has been pretty good for me, I've gotten 900,000 inferences before rebooting the machine. ( I did have an issue last week where CPAI quit for no apparent reason however.)
This version has been running on my Windows 11 box for almost eight months.

Ken does keep changing the UI and organization of the menu system, but I have not really changed anything substantial for years.

Ken does keep changing the UI and organization of the menu system, but I have not really changed anything substantial for years.

View attachment 226985View attachment 226986View attachment 226987View attachment 226988View attachment 226989View attachment 226990

Upon looking at your AI window, I believe the Objects:0 in the Custom Models field may be the issue.
I don't think we've used that for years. I know I haven't.

hapstabu said:

Upon looking at your AI window, I believe the Objects:0 in the Custom Models field may be the issue.
I don't think we've used that for years. I know I haven't.

Click to expand...

IIRC, this was used when we did not have the Custom Models / Default Objects option check boxes on the main AI page.

See:
Post in thread 'Blue Iris Long Delay with CodeProject Object Detection' Blue Iris Long Delay with CodeProject Object Detection

hapstabu said:

IIRC, this was used when we did not have the Custom Models / Default Objects option check boxes on the main AI page.

See:
Post in thread 'Blue Iris Long Delay with CodeProject Object Detection' Blue Iris Long Delay with CodeProject Object Detection

Click to expand...

So, on the main AI page, you have Default Objects selected, then in the camera models field, you are telling Blue Iris to not use default objects.
That could explain this behavior.
If you want to use a custom model, on the main AI page, check Custom Models and uncheck Default Objects. Then remove the objects:0 from the model field on the camera.

And take it from me, do one thing at a time.
I have screwed myself up many times by thinking I know what the issue is, and doing more than one thing at once.

Hans007 said:

so here an update, i spinned up a new lxc container (debian) running docker i followed the step one by one that was provided ad created a docker container with following image :cuda12_2-2.9.7, but got the same issue so i tried with another docker image: cuda12_2 (version 2.9.5) without touching anything in BI and i everything just worked. and i dont know why but i went from 100-200ms (running BI and CPAI 2.9.5 on same machine "dedicated pc") down to 20-50 ms (running proxmox with win11 in VM and CPAI in docker) ...

Click to expand...

Good deal.
If I may ask, what version of Blue Iris are you using?
It seems like an older one from your screen shots.
It doesn't matter, as long as it works.
Good luck.

Sent from my iPlay_50 using Tapatalk