YOLO v8 issue with Coral TPU

[mailseth]

I'm using a pre-pre-release version. Normal pre-release versions can be found here:

CodeProject.AI-Custom-IPcam-Models/TensorFlow Edge TPU Models/YOLOv8/custom-models at main · MikeLud/CodeProject.AI-Custom-IPcam-Models

Contribute to MikeLud/CodeProject.AI-Custom-IPcam-Models development by creating an account on GitHub.

github.com

 

[jjj111]

@mailseth yeah I'd seen those, but the problem is that it seems like there's a bunch of people trying to figure out how to load custom models in codeproject.ai for using those -- there's even a post on their forum from an hour ago where a team member says "Unfortunately, custom models for Coral are not currently supported."

Would you mind sharing how you were able to accomplish using that pre-release model?

 

[mailseth]

I'm actually running these tests with the objectdetection_coral_mulitpu.py file on the CLI, independent of most of the rest of CPAI. It's just calling the tpu_runner.py file for my local testing purposes. (I don't even have the CPAI server running on my machine right now.)

So I'm running the pre-release model simply by specifying it as an option to objectdetection_coral_mulitpu.py, but unfortunately it's not going to be a very useful method for anyone else here.

 

[jjj111]

my bad, I shouldn't have assumed you were using cpai.

 

[Pentagano]

I'm using a pre-pre-release version. Normal pre-release versions can be found here:

CodeProject.AI-Custom-IPcam-Models/TensorFlow Edge TPU Models/YOLOv8/custom-models at main · MikeLud/CodeProject.AI-Custom-IPcam-Models

Contribute to MikeLud/CodeProject.AI-Custom-IPcam-Models development by creating an account on GitHub.

github.com

So coming soon then possibly?

 

[mailseth]

Possibly. I found it has a CPU-only instruction midway through the model so it doesn’t run as well as you’d think it should. Everything after that instruction ends up also being CPU-only. (Unless you’re running multi-TPUs, because then you can run the remaining instructions on the next TPU segment.)