Menu
What's new

CodeProject.AI Version 2.5

M

mailseth

Getting the hang of it
Joined
Dec 22, 2023
Messages
126
Reaction score
88
Location
California
Do the failed inferences leave any messages in the log file?
 
H

hapstabu

Getting the hang of it
Joined
Aug 29, 2020
Messages
68
Reaction score
42
Location
US
mailseth said:
Do the failed inferences leave any messages in the log file?
Click to expand...
I don't really know what to look for. In searching, I don't see any responses to "fail" or "error".

I do see a bunch of these entries:

2024-04-21 16:26:52: objectdetection_coral_adapter.py: Ï?™äÜ4¬äÕ?®AŽ½Ó>Ó?‘ƒ•™qÃ?eÔ:Á -?=XlÔ€²©¿ Info: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: No interpreter found. Recreating.
2024-04-21 16:26:52: objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3]), 'shape_signature': array([ 1, 300, 300, 3]), 'dtype': <class 'numpy.uint8'>, 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127]), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
2024-04-21 16:26:52: objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20]), 'shape_signature': array([ 1, 20]), 'dtype': <class 'numpy.float32'>, 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([ 1, 300, 300, 3]), 'shape_signature': array([ 1, 300, 300, 3]), 'dtype': <class 'numpy.uint8'>, 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127]), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
2024-04-21 16:26:52: objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20]), 'shape_signature': array([ 1, 20]), 'dtype': <class 'numpy.float32'>, 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: ling back to CPU detection
2024-04-21 16:26:52: objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
2024-04-21 16:26:52: Response rec'd from Object Detection (Coral) command 'detect' (#reqid 9a696cc7-e136-4150-ba96-3cb36099284c) ['Found car, car, car...'] took 37ms
2024-04-21 16:26:52: Client request 'detect' in queue 'objectdetection_queue' (#reqid c1f6c50d-7163-44dd-b788-befd285d97fe)
2024-04-21 16:26:52: Request 'detect' dequeued from 'objectdetection_queue' (#reqid c1f6c50d-7163-44dd-b788-befd285d97fe)
2024-04-21 16:26:52: Object Detection (Coral): Retrieved objectdetection_queue command 'detect' in Object Detection (Coral)
2024-04-21 16:26:52: Response rec'd from Object Detection (Coral) command 'detect' (#reqid c1f6c50d-7163-44dd-b788-befd285d97fe) ['Found car, car, car...'] took 12ms

Also these, which I have seen periodically for a long time, they might just be "noise".

2024-04-21 16:23:07: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:12: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:17: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:22: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:27: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:32: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:37: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:42: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:47: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:52: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:23:57: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:24:02: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:24:07: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:24:12: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:24:17: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:24:22: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:24:27: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs.
2024-04-21 16:24:32: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs

But other than that, nothing that shouts out "Error".

HTH
 
M

mailseth

Getting the hang of it
Joined
Dec 22, 2023
Messages
126
Reaction score
88
Location
California
It should really never fall back to CPU and it’s something that only happens on a failed instantiation, so there is something wrong with your installation. (I personally think it’s a confusing design choice and it should fail 100% instead of falling back to CPU.)
 
H

hapstabu

Getting the hang of it
Joined
Aug 29, 2020
Messages
68
Reaction score
42
Location
US
mailseth said:
It should really never fall back to CPU and it’s something that only happens on a failed instantiation, so there is something wrong with your installation. (I personally think it’s a confusing design choice and it should fail 100% instead of falling back to CPU.)
Click to expand...
I can try uninstalling and reinstalling the Coral module and see if that improves it. I don't suppose there is a somewhat easy way to roll back to ver 2.2.0? I could swear that I was seeing zero fails with 2.2.0 I believe.
 
M

mailseth

Getting the hang of it
Joined
Dec 22, 2023
Messages
126
Reaction score
88
Location
California
Only the IPcam-general is ready to be used in that repo. Ive sent it along to be included in the next version of CPAI, but I don’t know when that will be or how it’ll be handled.

Unfortunately it also doesn’t run that great on one TPU because the compiler says there is a CPU-only operation halfway through the model so the remaining half of the model is forced to run off-TPU.
 
wittaj

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
25,209
Reaction score
49,112
Location
USA
@MikeLud1 - I updated to 2.6.2 today and my computer doesn't like it. The YOLOv5.net shows not configured to Autostart and when I do start it, it shuts down.

The ALPR (not shown here as I deleted it and rolling back to 2.5.6) wouldn't run either, even though it showed started.

1714069018805.png
 
wittaj

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
25,209
Reaction score
49,112
Location
USA
MikeLud1 said:
Did any errors show in the log?
Click to expand...
No, it all looked good. I even did the uninstall, delete the directories, and loaded fresh and still didn't work.

Now that you are around I will try again.
 
MikeLud1

MikeLud1

IPCT Contributor
Joined
Apr 5, 2017
Messages
2,221
Reaction score
4,268
Location
Brooklyn, NY
wittaj said:
No, it all looked good. I even did the uninstall, delete the directories, and loaded fresh and still didn't work.

Now that you are around I will try again.
Click to expand...
Do you have some firewall blocking the install?
 
wittaj

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
25,209
Reaction score
49,112
Location
USA
MikeLud1 said:
Do you have some firewall blocking the install?
Click to expand...
No, the other versions have installed fine and the log was clear. Going to do the upgrade from current version to new version now and see what happens.
 
wittaj

wittaj

IPCT Contributor
Joined
Apr 28, 2019
Messages
25,209
Reaction score
49,112
Location
USA
As luck would have it, it is working now LOL.

I forget, this means it is using the on-board GPU (I thought it said iGPU before but I am not positive)?

1714092757588.png
 
R

roymickton

Young grasshopper
Joined
Jun 1, 2023
Messages
31
Reaction score
12
Location
UK
Is it only me that gets much faster times using YOLOv5-6.2 than YOLOv5.net? I'm using a 1660 Super on unRAID with CodeProject.AI 2.6.2 CUDA docker.

IPCAM-General; Person
6.2 gives me around 14ms (84% confidence)
.net gives me around 100ms (76% confidence)
 
H

hapstabu

Getting the hang of it
Joined
Aug 29, 2020
Messages
68
Reaction score
42
Location
US
hapstabu said:
I can try uninstalling and reinstalling the Coral module and see if that improves it. I don't suppose there is a somewhat easy way to roll back to ver 2.2.0? I could swear that I was seeing zero fails with 2.2.0 I believe.
Click to expand...
@mailseth

I had tried to change the Coral model size from small to medium several days ago. It took a lot of fiddling to get the status to stop displaying CPU Tflite to TPU Tflite.
I am now looking at the log after several days being occupied with other things, and I am seeing lots and lots of these:

File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\tflite_runtime\interpreter.py", line 818, in <lambda>
return lambda: self._interpreter.tensor(self._interpreter, tensor_index)
ValueError: Tensor data is null. Run allocate_tensors() first
in Object Detection (Coral)
2024-04-26 13:01:43: Response rec'd from Object Detection (Coral) command 'detect' (#reqid db3610cd-4954-4a47-af20-83141a945cc4)
2024-04-26 13:01:43: Client request 'detect' in queue 'objectdetection_queue' (#reqid 9820afcb-79e5-434c-9df9-44125fc1615c)
2024-04-26 13:01:43: Request 'detect' dequeued from 'objectdetection_queue' (#reqid 9820afcb-79e5-434c-9df9-44125fc1615c)
2024-04-26 13:01:43: Object Detection (Coral): Retrieved objectdetection_queue command 'detect' in Object Detection (Coral)
2024-04-26 13:01:43: Object Detection (Coral): [ValueError] : Traceback (most recent call last):
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_adapter.py", line 182, in _do_detection
result = do_detect(opts, img, score_threshold)
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_multitpu.py", line 121, in do_detect
return odcs.do_detect(options, image, score_threshold)
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_singletpu.py", line 266, in do_detect
_, scale = common.set_resized_input(
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\pycoral\adapters\common.py", line 95, in set_resized_input
tensor = input_tensor(interpreter)
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\pycoral\adapters\common.py", line 65, in input_tensor
return interpreter.tensor(tensor_index)()[0]
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\tflite_runtime\interpreter.py", line 818, in <lambda>
return lambda: self._interpreter.tensor(self._interpreter, tensor_index)
ValueError: Tensor data is null. Run allocate_tensors() first
in Object Detection (Coral)
2024-04-26 13:01:43: Response rec'd from Object Detection (Coral) command 'detect' (#reqid 9820afcb-79e5-434c-9df9-44125fc1615c)
2024-04-26 13:01:44: Client request 'detect' in queue 'objectdetection_queue' (#reqid a4af2e03-edda-4496-b217-22696cb46e64)
2024-04-26 13:01:44: Request 'detect' dequeued from 'objectdetection_queue' (#reqid a4af2e03-edda-4496-b217-22696cb46e64)
2024-04-26 13:01:44: Object Detection (Coral): Retrieved objectdetection_queue command 'detect' in Object Detection (Coral)
2024-04-26 13:01:44: Object Detection (Coral): [ValueError] : Traceback (most recent call last):
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_adapter.py", line 182, in _do_detection
result = do_detect(opts, img, score_threshold)
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_multitpu.py", line 121, in do_detect
return odcs.do_detect(options, image, score_threshold)
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\objectdetection_coral_singletpu.py", line 266, in do_detect
_, scale = common.set_resized_input(
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\pycoral\adapters\common.py", line 95, in set_resized_input
tensor = input_tensor(interpreter)
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\pycoral\adapters\common.py", line 65, in input_tensor
return interpreter.tensor(tensor_index)()[0]
File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionCoral\bin\windows\python39\venv\lib\site-packages\tflite_runtime\interpreter.py", line 818, in <lambda>
return lambda: self._interpreter.tensor(self._interpreter, tensor_index)
ValueError: Tensor data is null. Run allocate_tensors() first
in Object Detection (Coral)
2024-04-26 13:01:44: Response rec'd from Object Detection (Coral) command 'detect' (#reqid a4af2e03-edda-4496-b217-22696cb46e64)
2024-04-26 13:01:47: objectdetection_coral_adapter.py: WARNING:root:No work in 60.0 seconds, watchdog shutting down TPUs

I don't recall seeing anything like this before. Also lots of reverting to CPU entries as before.

I have changed back to YOLOv5 .NET. maybe it is more stable.

Again, It seems like the Coral version prior to 2.2.2 ran with next to no failed inferences, is there any way to roll back to that version in CPAI version 2.6.2, or should I try doing a complete uninstall/ reinstall of CPAI 2.6.2 and NOT upgrade the Coral module to 2.2.2?
 
M

mailseth

Getting the hang of it
Joined
Dec 22, 2023
Messages
126
Reaction score
88
Location
California
Thanks for the report. I haven’t seen that problem before. From the stack trace, it looks like it’s using the original single-TPU code which hasn’t been changed recently (as far as I know.) I’m on my phone now, I’ll take a closer look when I get a chance.
 
M

mailseth

Getting the hang of it
Joined
Dec 22, 2023
Messages
126
Reaction score
88
Location
California
The easiest way to ‘fix’ the problem you’re seeing would just be to be running the multi-TPU code on your single TPU. Do you see any earlier problems that would show why that’s not working?
 
You must log in or register to reply here.
Top