simple comparison of deepstack on x86 vs arm64 + intel compute stick

silencery · Jan 29, 2022

Been experimenting with deepstack performance and wanted to share some quick results

x86 setup
Intel i7 10700K 32GB
Dockerized deepstack

arm64 setup
raspberrypi 4 with 8GB + intel compute stick
Dockerized deepstack

Sample results below (Both sets are from the same video clip from a doorbell camera which is observing a mix of people and street scenery (cars, foliage, etc))

intel i7 10700K

Bash:

[GIN] 2022/01/29 - 13:36:29 | 200 |    144.0811ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:29 | 200 |    235.0075ms |      172.19.0.1 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:29 | 200 |    145.8144ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:29 | 200 |    208.6846ms |      172.19.0.1 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:29 | 200 |    155.6102ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:30 | 200 |    253.5007ms |      172.19.0.1 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:30 | 200 |    147.7443ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:30 | 200 |    280.3374ms |      172.19.0.1 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:30 | 200 |     158.757ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:31 | 200 |     256.149ms |      172.19.0.1 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:31 | 200 |    156.2366ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:31 | 200 |    276.6197ms |      172.19.0.1 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:31 | 200 |    138.5007ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:32 | 200 |    245.3834ms |      172.19.0.1 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:32 | 200 |    142.9165ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:32 | 200 |    227.2236ms |      172.19.0.1 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:32 | 200 |    161.8928ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:32 | 200 |    225.4481ms |      172.19.0.1 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:33 | 200 |    150.2783ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:33 | 200 |    233.6359ms |      172.19.0.1 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:33 | 200 |    147.5255ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:33 | 200 |     236.678ms |      172.19.0.1 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:33 | 200 |    137.8911ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:34 | 200 |    253.5469ms |      172.19.0.1 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:34 | 200 |    145.2642ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:34 | 200 |    238.0903ms |      172.19.0.1 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:34 | 200 |    162.7617ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:34 | 200 |    241.8945ms |      172.19.0.1 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:35 | 200 |    144.4725ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:35 | 200 |    282.9614ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:35 | 200 |    268.3662ms |      172.19.0.1 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:36:36 | 200 |    163.2668ms |      172.19.0.1 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:36:36 | 200 |    161.1319ms |      172.19.0.1 | POST     "/v1/vision/detection"

raspberry pi with intel compute stick

Bash:

[GIN] 2022/01/29 - 13:31:02 | 200 |  628.507234ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:31:03 | 200 |  565.178846ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:31:03 | 200 |   545.20545ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:05 | 200 |    1.1637142s |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:05 | 200 |  1.185697217s |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:10 | 200 |  4.287451304s |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:11 | 200 |  4.973740657s |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:11 | 200 |  4.855885109s |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:11 | 200 |  4.909537283s |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:11 | 200 |  4.264715478s |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:12 | 200 |   717.70289ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:12 | 200 |  633.380371ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:13 | 200 |  659.939259ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:14 | 200 |   523.52719ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:14 | 200 |   668.78562ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:15 | 200 |  537.773452ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:15 | 200 |  625.981089ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:16 | 200 |  646.493254ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:17 | 200 |  713.380195ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:17 | 200 |  594.163669ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:18 | 200 |  668.415426ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:19 | 200 |  612.091011ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:19 | 200 |  668.137168ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:20 | 200 |  581.065402ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:21 | 200 |  731.903696ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:21 | 200 |  544.288218ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:22 | 200 |  672.054963ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:23 | 200 |  590.767033ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:23 | 200 |  752.856687ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:24 | 200 |  619.732785ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:25 | 200 |  699.337323ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:25 | 200 |   564.60764ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:26 | 200 |   656.19117ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:26 | 200 |  497.768181ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:27 | 200 |  616.710227ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:28 | 200 |  494.753658ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:28 | 200 |    625.7175ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:29 | 200 |  479.499749ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:29 | 200 |  647.232268ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:30 | 200 |  499.800642ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:31 | 200 |  617.169573ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:31 | 200 |  483.839197ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:32 | 200 |  802.215223ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:32 | 200 |  547.335468ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:33 | 200 |  714.176389ms |    192.168.3.19 | POST     "/v1/vision/detection"
[GIN] 2022/01/29 - 13:35:34 | 200 |  509.190544ms |    192.168.3.19 | POST     "/v1/vision/face/recognize"
[GIN] 2022/01/29 - 13:35:34 | 200 |  715.635647ms |    192.168.3.19 | POST     "/v1/vision/detection"

Summary:

This is certainly an apples to oranges comparison, but hopefully it'll help anyone curious about performance differences. The more powerful i7 wins out with performance about 4-6x faster detection speed, but the low cost of an RPI + intel compute stick is compelling.

Smilingreen · Jan 29, 2022

I refuse to use BI until it is fully supported on a M1........ :blankstare:

Search

simple comparison of deepstack on x86 vs arm64 + intel compute stick

silencery

Pulling my weight

Smilingreen

Known around here