Recent content by mailseth
-
M
Which nVidia GPUs are you using?
It's not quite that simple because DL inference actually use tensor cores with FP16 (or int8). I thought this was a great article on the subject: https://timdettmers.com/2023/01/30/which-gpu-for-deep-learning/#Raw_Performance_Ranking_of_GPUs Unfortunately, it doesn't directly answer your... -
M
CodeProject.AI Version 2.9.0
You would need to check out the code from my fork (‘git clone git@github.com:seth-planet/CodeProject.AI-ObjectDetectionCoral.git’ and ‘git checkout fix_single_fallback’). And then make a few changes in the code to get it running. I basically see three things to work on: File downloading from... -
M
CodeProject.AI Version 2.9.0
Not much support, unfortunately. I have a working branch for some changes to support more models on more TPUs and make it faster here: https://github.com/seth-planet/CodeProject.AI-ObjectDetectionCoral/tree/fix_single_fallback But the GitHub pull request has been sitting in limbo since June and... -
M
Sharing setups with CodeProject AI on Coral hardware (Spring 2024)
My current code is fast, but not functional in CPAI. It needs to start downloading models correctly from the hugging face repo I mentioned above. https://github.com/seth-planet/CodeProject.AI-ObjectDetectionCoral/tree/fix_single_fallback -
M
Sharing setups with CodeProject AI on Coral hardware (Spring 2024)
The short answer is no, that model needs to be reworked to run on Coral. The long answer is yes, I’ve done so and you can download it here: https://huggingface.co/mailseth/coral/blob/main/all_segments_ipcam-general-v8_edgetpu.tflite Unfortunately, I don’t have a good guide for getting it... -
M
Trying to download Codeproject ai server win x64 2.6 5 help!
Related to this? Looks like the site is down and moved. https://www.reddit.com/r/BlueIris/s/a39ADjhVRv -
M
CodeProject.AI Version 2.5
Yeah, I’m afraid that I don’t have much advice for you. It’s been a few months since I looked at the code. The single-TPU fallback would need to be debugged, but I’m not confident what that means or how to do it here. Different versions would be a good way to get things working more easily. -
M
CodeProject.AI Version 2.5
That's what happens when multiple threads hit the old single-TPU code at the same time (or it could be a bug in the multi-TPU code, but it sounds like that's not running). I'd be curious as to why it's falling back to single-TPU; fixing that and running the newer multi-TPU code would likely fix... -
M
CodeProject.AI Version 2.5
FWIW, I’ve been working on a model larger than @MikeLud1 ‘s for a few months, with additional classes for things like packages, license plates, and fire. I’m currently on the fourth iteration. I’ve been using the package ‘fiftyone’ to curate the dataset sourced from a bunch of different sources... -
M
CodeProject.AI Version 2.5
You should put your GPU time up for sale on vast.ai and make some money. :) -
M
CodeProject.AI Version 2.5
You could also use a PCIe extension cable that will run an extra 5-10" and then hang the GPU outside of the case. The cable extensions work well at PCIe 3.0 speeds, but start to throw errors at 4.0 speeds. You may also need to investigate additional power supply if that's something you're... -
M
Sharing setups with CodeProject AI on Coral hardware (Spring 2024)
Yeah, there are a few available models for Coral, but they all need to be quantized to 8-bits, which reduces accuracy. Hopefully we can get the IPcam-general Coral model released soon. -
M
Sharing setups with CodeProject AI on Coral hardware (Spring 2024)
I'm afraid that the module file management & installation stuff is all outside of what I've worked on. I've looked into it before, but haven't made sense of it, unfortunately. I just send Chris a zip file of the compiled models and he has been setting things up to fit in the larger CPAI system... -
M
CodeProject.AI Version 2.5
Did you try something like this? https://www.codeproject.com/Articles/5322557/CodeProject-AI-Server-AI-the-easy-way?fid=1979732&df=90&mpp=25&sort=Position&spc=Relaxed&prof=True&view=Normal&fr=26#xx0xx -
M
CodeProject.AI Version 2.5
Looks like you’re another victim of the numpy v2 release. Look around for what other folks are doing to get around that