8-9ms inference speeds with OpenVino on a cpu 7th gen!!

Pentagano

Getting comfortable
Joined
Dec 11, 2020
Messages
616
Reaction score
283
Location
Uruguay
Well after using coral tpu devices (usb and m2) with Frigate, I came across openvino model on Frigate.
Decided to give it a try, very simple set up, just a few lines of code in the config.

Fire it up on my dell 7th gen intel with no gpu or tpu.

Well I'll be dipped!

Faster than the coral usb and hardly touches the cpu. Not sure how they have done that.
Detects people perfectly (if you don't need it for small animals etc) it is perfect.

Even tried it on an old i5 -3470t lenovo mini. 45ms not too shabby at all.
 

CCTVCam

Known around here
Joined
Sep 25, 2017
Messages
2,687
Reaction score
3,528
Suggest it to the Code Project Developers. At the very least they can take a look at how it's functioning.
 
Top