8-9ms inference speeds with OpenVino on a cpu 7th gen!!

Pentagano

Getting comfortable
Joined
Dec 11, 2020
Messages
616
Reaction score
283
Location
Uruguay
Well after using coral tpu devices (usb and m2) with Frigate, I came across openvino model on Frigate.
Decided to give it a try, very simple set up, just a few lines of code in the config.

Fire it up on my dell 7th gen intel with no gpu or tpu.

Well I'll be dipped!

Faster than the coral usb and hardly touches the cpu. Not sure how they have done that.
Detects people perfectly (if you don't need it for small animals etc) it is perfect.

Even tried it on an old i5 -3470t lenovo mini. 45ms not too shabby at all.
 

silencery

Pulling my weight
Joined
Oct 6, 2015
Messages
230
Reaction score
157
those are great numbers. I wonder if there's a way to incorporate into BI
 
Top