Thanks for the response, I'll give that a try. I was really hoping to cut the response times down but the YOLOv5 seems to run at the same timing on my GTX960 vs the Coral Edge TPU. I'm getting pretty close to just building a dedicated box with an RTX GPU.
I'll try making sure the multi-TPU is...