nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Sep_21_10:41:10_Pacific_Daylight_Time_2022
Cuda compilation tools, release 11.8, V11.8.89
Build cuda_11.8.r11.8/compiler.31833905_0
It looks like you are running a VM, did you obtain a license for the GRID P100-16Q driver. I am still not sure if this is the issue, what GPU do you have, is it a P100.@MikeLud1 Help. Now spent 3 days ripping my hair out.
I have read the 52 pages on this post looking for answers and tried every suggestion you recommend to others. Still I cannot get APLR working with my GPU. Works fine with CPU but is slow.
This is what happens the first couple of time then nothing is found.
View attachment 195628
Server version: 2.6.5
System: Windows
Operating System: Windows (Microsoft Windows 10.0.19045)
CPUs: Intel(R) Xeon(R) CPU E5-2698 v4 @ 2.20GHz (Intel)
2 CPUs x 8 cores. 8 logical processors (x64)
GPU (Primary): GRID P100-16Q (16 GiB) (NVIDIA)
Driver: 538.33, CUDA: 11.8.89 (up to: 12.2), Compute: 6.0, cuDNN: 8.9
System RAM: 32 GiB
Platform: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
Runtimes installed:
.NET runtime: 7.0.20
.NET SDK: 7.0.410
Default Python: Not found
Go: Not found
NodeJS: Not found
Rust: Not found
Video adapter info:
NVIDIA GRID P100-16Q:
Driver Version 31.0.15.3833
Video Processor GRID P100-16Q
System GPU info:
GPU 3D Usage 0%
GPU RAM Usage 2.3 GiB
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168
Status Page:
View attachment 195629
ALLUSERSPROFILE=C:\ProgramData
APPDATA=C:\Users\Dan\AppData\Roaming
CLIENTNAME=DESKTOP-0S742NF
CommonProgramFiles=C:\Program Files\Common Files
CommonProgramFiles(x86)=C:\Program Files (x86)\Common Files
CommonProgramW6432=C:\Program Files\Common Files
COMPUTERNAME=BLUEIRIS-VM
ComSpec=C:\Windows\system32\cmd.exe
CUDA_PATH=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.8
CUDA_PATH_V11_8=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.8
DriverData=C:\Windows\System32\Drivers\DriverData
FPS_BROWSER_APP_PROFILE_STRING=Internet Explorer
FPS_BROWSER_USER_PROFILE_STRING=Default
HOMEDRIVE=C:
HOMEPATH=\Users\Dan
LOCALAPPDATA=C:\Users\Dan\AppData\Local
LOGONSERVER=\\BLUEIRIS-VM
NUMBER_OF_PROCESSORS=16
OneDrive=C:\Users\Dan\OneDrive
OS=Windows_NT
Path=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.8\bin;C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.8\libnvvp;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\OpenSSH\;C:\Program Files\dotnet\;C:\Users\Dan\AppData\Local\Microsoft\WindowsApps;C:\Users\Dan\.dotnet\tools;C:\Program Files\NVIDIA\CUDNN\v8.9\zlib\dll_x64;C:\Program Files\NVIDIA\CUDNN\v8.9\bin;C:\Users\Dan\AppData\Local\Microsoft\WindowsApps;C:\Users\Dan\.dotnet\tools
PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC
PROCESSOR_ARCHITECTURE=AMD64
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 79 Stepping 1, GenuineIntel
PROCESSOR_LEVEL=6
PROCESSOR_REVISION=4f01
ProgramData=C:\ProgramData
ProgramFiles=C:\Program Files
ProgramFiles(x86)=C:\Program Files (x86)
ProgramW6432=C:\Program Files
PROMPT=$P$G
PSModulePath=C:\Program Files\WindowsPowerShell\Modules;C:\Windows\system32\WindowsPowerShell\v1.0\Modules
PUBLIC=C:\Users\Public
SESSIONNAME=RDP-Tcp#0
SystemDrive=C:
SystemRoot=C:\Windows
TEMP=C:\Users\Dan\AppData\Local\Temp
TMP=C:\Users\Dan\AppData\Local\Temp
USERDOMAIN=BLUEIRIS-VM
USERDOMAIN_ROAMINGPROFILE=BLUEIRIS-VM
USERNAME=Dan
USERPROFILE=C:\Users\Dan
windir=C:\Windows
NVCC Output:
Code:nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2022 NVIDIA Corporation Built on Wed_Sep_21_10:41:10_Pacific_Daylight_Time_2022 Cuda compilation tools, release 11.8, V11.8.89 Build cuda_11.8.r11.8/compiler.31833905_0
Module 'License Plate Reader' 3.1.0 (ID: ALPR)
Valid: True
Module Path: <root>\modules\ALPR
Module Location: Internal
AutoStart: True
Queue: alpr_queue
Runtime: python3.9
Runtime Location: Local
FilePath: ALPR_adapter.py
Start pause: 3 sec
Parallelism: 0
LogVerbosity:
Platforms: all
GPU Libraries: installed if available
GPU: use if supported
Accelerator:
Half Precision: enable
Environment Variables
AUTO_PLATE_ROTATE = True
CROPPED_PLATE_DIR = <root>\Server\wwwroot
MIN_COMPUTE_CAPABILITY = 6
MIN_CUDNN_VERSION = 7
OCR_OPTIMAL_CHARACTER_HEIGHT = 60
OCR_OPTIMAL_CHARACTER_WIDTH = 30
OCR_OPTIMIZATION = True
PLATE_CONFIDENCE = 0.7
PLATE_RESCALE_FACTOR = 2
PLATE_ROTATE_DEG = 0
REMOVE_SPACES = False
ROOT_PATH = <root>
SAVE_CROPPED_PLATE = False
Status Data: {
"inferenceDevice": "GPU",
"inferenceLibrary": "CUDA",
"canUseGPU": "true",
"successfulInferences": 0,
"failedInferences": 0,
"numInferences": 0,
"averageInferenceMs": 0
}
Started: 31 May 2024 8:01:44 PM GMT Standard Time
LastSeen: 31 May 2024 8:03:15 PM GMT Standard Time
Status: Started
Requests: 42 (includes status calls)
Installation Log
2024-05-31 18:18:02: Installing CodeProject.AI Analysis Module
2024-05-31 18:18:02: ======================================================================
2024-05-31 18:18:02: CodeProject.AI Installer
2024-05-31 18:18:02: ======================================================================
2024-05-31 18:18:03: 78.5Gb of 261Gb available on
2024-05-31 18:18:03: General CodeProject.AI setup
2024-05-31 18:18:03: Creating Directories...done
2024-05-31 18:18:03: GPU support
2024-05-31 18:18:04: CUDA Present...Yes (CUDA 11.8, cuDNN 8.9)
2024-05-31 18:18:04: ROCm Present...No
2024-05-31 18:18:06: Checking for .NET 7.0...Checking SDKs...All good. .NET is 7.0.410
2024-05-31 18:18:13: Reading ALPR settings.......done
2024-05-31 18:18:13: Installing module License Plate Reader 3.1.0
2024-05-31 18:18:13: Installing Python 3.9
2024-05-31 18:18:29: Downloading Python 3.9 interpreter...Expanding...done.
2024-05-31 18:19:12: Creating Virtual Environment (Local)...done
2024-05-31 18:19:13: Confirming we have Python 3.9 in our virtual environment...present
2024-05-31 18:19:16: Downloading ALPR models...Expanding...done.
2024-05-31 18:19:16: Copying contents of ocr-en-pp_ocrv4-paddle.zip to paddleocr...done
2024-05-31 18:19:16: Installing Python packages for License Plate Reader
2024-05-31 18:19:16: [0;Installing GPU-enabled libraries: If available
2024-05-31 18:19:21: Ensuring Python package manager (pip) is installed...done
2024-05-31 18:19:56: Ensuring Python package manager (pip) is up to date...done
2024-05-31 18:19:56: Python packages specified by requirements.windows.cuda11_8.txt
2024-05-31 18:22:11: - Installing PaddlePaddle, Parallel Distributed Deep Learning...(✅ checked) done
2024-05-31 18:27:52: - Installing PaddleOCR, the OCR toolkit based on PaddlePaddle...(✅ checked) done
2024-05-31 18:28:03: - Installing imutils, the image utilities library...(✅ checked) done
2024-05-31 18:28:08: - Installing Pillow, a Python Image Library...Already installed
2024-05-31 18:28:12: - Installing OpenCV, the Computer Vision library for Python...Already installed
2024-05-31 18:28:47: - Installing NumPy, a package for scientific computing...Already installed
2024-05-31 18:28:47: Installing Python packages for the CodeProject.AI Server SDK
2024-05-31 18:28:53: Ensuring Python package manager (pip) is installed...done
2024-05-31 18:29:03: Ensuring Python package manager (pip) is up to date...done
2024-05-31 18:29:03: Python packages specified by requirements.txt
2024-05-31 18:29:08: - Installing Pillow, a Python Image Library...Already installed
2024-05-31 18:29:13: - Installing Charset normalizer...Already installed
2024-05-31 18:29:31: - Installing aiohttp, the Async IO HTTP library...(✅ checked) done
2024-05-31 18:29:43: - Installing aiofiles, the Async IO Files library...(✅ checked) done
2024-05-31 18:29:53: - Installing py-cpuinfo to allow us to query CPU info...(✅ checked) done
2024-05-31 18:29:57: - Installing Requests, the HTTP library...Already installed
2024-05-31 18:29:58: Scanning modulesettings for downloadable models...No models specified
2024-05-31 18:29:58: Executing post-install script for License Plate Reader
2024-05-31 18:29:58: Applying PaddleOCR patch
2024-05-31 18:29:58: 1 file(s) copied.
2024-05-31 18:30:49: Self test: Self-test passed
2024-05-31 18:30:49: Module setup time 00:12:41.93
2024-05-31 18:30:49: Setup complete
2024-05-31 18:30:49: Total setup time 00:12:46.69
Installer exited with code 0
It looks like you are running a VM, did you obtain a license for the GRID P100-16Q driver. I am still not sure if this is the issue, what GPU do you have, is it a P100.
View attachment 195630
Try replacing the cuDNN version with the bellow version. Delete the highlighted folders and replace them with the cuDNN version in the below link. After change the cuDNN version restart CP.AI server.View attachment 195633
Yes it is a P100. The "Object Detection (YOLOv5 6.2)" module works very well and quick with the GPU.
Just tried it all have similar results to before.Try replacing the cuDNN version with the bellow version. Delete the highlighted folders and replace them with the cuDNN version in the below link. After change the cuDNN version restart CP.AI server.
Log in
developer.nvidia.com
View attachment 195637
Here is the log showing it giving random result and then stops and start throwing an errorJust tried it all have similar results to before.
View attachment 195652 View attachment 195653
Any other ideas? (Please dont say replace the gpu )
I am finding older GPU are very finnicky on what version CUDA and cuDNN is installed. Try uninstalling CUDA 11.8 and install CUDA 11.2 also install cuDNN v8.2.1. After changing the CUDA and cuDNN versions uninstall the ALPR module restart CP.AI then reinstall the ALPR module.Just tried it all have similar results to before.
View attachment 195652 View attachment 195653
Any other ideas? (Please dont say replace the gpu )
I am finding older GPU are very finnicky on what version CUDA and cuDNN is installed. Try uninstalling CUDA 11.8 and install CUDA 11.2 also install cuDNN v8.2.1. After changing the CUDA and cuDNN versions uninstall the ALPR module restart CP.AI then reinstall the ALPR module.
If this does not work you may need CUDA 10.2 and cuDNN v7.6.5. I have older GPU then yours working with CUDA 10.2 and cuDNN v7.6.5.
CUDA 11.2 Link
cuDNN v8.2.1 link
Log in
developer.nvidia.com