Low power hardware (Orange PI / Rockchip, Coral Edge TPU, etc.) for CPAI or other AI platform

AlwaysSomething

Pulling my weight
Apr 24, 2023
192
172
US
TLDR:

I saw another member on here mention he used an Orange Pi 5 with Rockchip RK3588 to host both CPAI as well as the ALPR Database. It got me curious as to how many other people are running low power devices like this? Specifically for Blue IRIS and CPAI (or another AI Platform but with BI not Frigate). Want to see their experiences with them and some data as to how well they are performing (e.g.: inference speed or throughput).

Must be low power.

I see there is a Hailo-8 for Raspberry Pi that seems to have great performance but not currently supported for CPAI.

Also, thoughts on long term support by these vendors since Google seems to have abandoned Coral Edge TPU almost right after it came out.

As always, thanks in advance.

I'm probably not alone here with this...

I have limited funds at the moment and the cost of electricity keeps going up exponentially. The bigger reason though is I also experience a decent amount of brown/black outs and need low power for the UPS/battery backups (backup generator not an option at this time).

Also, not all my cameras have AI on them and can only upgrade as funds allow (but funds tend to go to additional cameras not replacement :lol:). Plus, I use two EmpireTech B52IR-Z12E at full zoom for LPR which I don't even think there is a camera that can do LPR at that range (for a reasonable price).

I'm currently using a Coral Edge TPU (PCIe) in a SFF PC but it is limited to Object Detection. Only the standard COCO models are available and no LPR. I've been trying to create a custom model to remove the 70+ classes I don't care about (and add 1-2) to improve performance but Google seems to have (unofficially) abandoned Coral making it very difficult (or it could just be me). If I got that working my next step was to add Mike Ludd's license plate dataset/class and incorporate LPR too. But that hope is fading fast.

Finally, as I'm adding more cameras I'm starting to miss events. The PC idles around 10-15% with no motion but if there is motion in front yard (where I have 5 cameras) it pegs the CPU at 100%. I think offloading CPAI will help which is why I started thinking about hardware options and created this thread.
 
  • Like
Reactions: mat200