CodeProject.AI Discussions

Change in setup.bat is reporting cuda not present

27-Nov-23 10:47

Your setup is a little outside the scope of what we support but there's clearly an OpenCV installation or path issue going on.

Could I suggest you switch from using the ObjectDetectionYOLO module to the ObjectDetectionNet module and see if that helps?

cheers
Chris Maunder

Jebus598-Nov-23 14:56

Re: Change in setup.bat is reporting cuda not present

8-Nov-23 14:56

So it doesnt jump to requirements.windows.cuda.txt...

I see the changes in setup bat from 2.2.4.

:: Report on GPU ability

:: GPU / CPU support ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

call "!sdkScriptsDirPath!\utils.bat" WriteLine "GPU support" "White" "Blue" !lineWidth!
call "!sdkScriptsDirPath!\utils.bat" WriteLine ""

REM Test for CUDA drivers 
call "!sdkScriptsDirPath!\utils.bat" Write "CUDA Present..."

set hasCUDA=false

I changed to:

set hasCUDA=true

and the correct requirements were used. I have not perused utils.bat for why it is reporting no cuda.

nvsmi path...

C:\Program Files\NVIDIA Corporation\NVSMI

BTW, the error was "not enough memory"...

Mike Lud8-Nov-23 17:10

Mike Lud

8-Nov-23 17:10

When installing CUDA did you do a full install?
The issue is nvcc is not installed. Open a command prompt and see if you get the below screenshot when executing nvcc --version.

Re: Change in setup.bat is reporting cuda not present

Jebus598-Nov-23 18:03

Coogle Coral for Face Recognition

8-Nov-23 18:03

It's all working.

Server version: 2.3.4-Beta
System: Windows
Operating System: Windows (Microsoft Windows 6.1.7601 Service Pack 1)
CPUs: Intel(R) Core(TM) i7-6850K CPU @ 3.60GHz (Intel)
1 CPU x 6 cores. 12 logical processors (x64)
GPU: NVIDIA GeForce RTX 3060 (12 GiB) (NVIDIA)
Driver: 474.11 CUDA: 11.4.48 (max supported: 11.4) Compute:
System RAM: 48 GiB
Target: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
.NET framework: .NET 7.0.5
Video adapter info:
NVIDIA GeForce RTX 3060:
Driver Version 30.0.14.7411
Video Processor NVIDIA GeForce RTX 3060
System GPU info:
GPU 3D Usage 3%
GPU RAM Usage 11.8 GiB
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168

It did not see my cuda install and went to default requirements.txt and tossed "not enough memory" error until I bypassed that check.

A bit of log trace right after loading CP.AI server. Everything functioning great now.

19:50:15:Started Object Detection (YOLOv5 6.2) module
19:50:16:face.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
19:50:16:face.py: Vision AI services setup: Retrieving environment variables...
19:50:16:face.py: USE_MPS not found. Setting to default True
19:50:16:face.py: GPU in use: NVIDIA GeForce RTX 3060
19:50:16:face.py: APPDIR: C:\Program Files\CodeProject\AI\modules\FaceProcessing\intelligencelayer
19:50:16:face.py: PROFILE: desktop_gpu
19:50:16:face.py: USE_CUDA: True
19:50:16:face.py: DATA_DIR: C:\ProgramData\CodeProject\AI
19:50:16:face.py: MODELS_DIR: C:\Program Files\CodeProject\AI\modules\FaceProcessing\assets
19:50:16:face.py: MODE: MEDIUM
19:50:16:Running init for Face Processing
19:50:16:Face Processing: Face Processing started.
19:50:19:detect_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
19:50:19:detect_adapter.py: APPDIR: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
19:50:19:detect_adapter.py: MODEL_SIZE: medium
19:50:19:detect_adapter.py: MODELS_DIR: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\assets
19:50:19:Running init for Object Detection (YOLOv5 6.2)
19:50:19:Object Detection (YOLOv5 6.2): Object Detection (YOLOv5 6.2) started.

AndreyNVKZ7-Nov-23 21:09

AndreyNVKZ

7-Nov-23 21:09

Hi!

Is it possible to use Coral for Face Recognition?

Re: Coogle Coral for Face Recognition

Sean Ewington9-Nov-23 8:50

Sean Ewington

9-Nov-23 8:50

Thanks very much for your message. Using CodeProject.AI Server only, no. To have Coral work as a face detector you would need an object detection model for Coral trained on faces. Like this one:
mediapipe/mediapipe/examples/coral/models at master · google/mediapipe · GitHub[^]

Thanks,
Sean Ewington
CodeProject

ObjectDetectionYolo, FaceProcessing, module install's from dashboard

Jebus597-Nov-23 11:31

Re: ObjectDetectionYolo, FaceProcessing, module install's from dashboard

7-Nov-23 11:31

I have both modules working, using cuda. The python installs are not downloading. so I had to copy over python37 folder from old save 2.2.4. Wondering if that gives me all the correct packages?

Here is the partial log from the last try on install. The whole log is huge on verbose, I would be happy to send some way...

This jumps out: 2023-11-07 13:12:40: FaceProcessing: Not enough memory.

The exceptions on log access jump out also...

Any guidence?

Server version: 2.3.4-Beta
System: Windows
Operating System: Windows (Microsoft Windows 6.1.7601 Service Pack 1)
CPUs: Intel(R) Core(TM) i7-6850K CPU @ 3.60GHz (Intel)
1 CPU x 6 cores. 12 logical processors (x64)
GPU: NVIDIA GeForce RTX 3060 (12 GiB) (NVIDIA)
Driver: 474.11 CUDA: 11.4.48 (max supported: 11.4) Compute:
System RAM: 48 GiB
Target: Windows
BuildConfig: Release
Execution Env: Native
Runtime Env: Production
.NET framework: .NET 7.0.5
Video adapter info:
NVIDIA GeForce RTX 3060:
Driver Version 30.0.14.7411
Video Processor NVIDIA GeForce RTX 3060
System GPU info:
GPU 3D Usage 3%
GPU RAM Usage 11.8 GiB
Global Environment variables:
CPAI_APPROOTPATH = <root>
CPAI_PORT = 32168

2023-11-07 13:12:21: Preparing to install module 'FaceProcessing'
2023-11-07 13:12:21: Downloading module 'FaceProcessing'
2023-11-07 13:12:21: Preparing to install module 'FaceProcessing'
2023-11-07 13:12:21: Downloading module 'FaceProcessing'
2023-11-07 13:12:22: Installing module 'FaceProcessing'
2023-11-07 13:12:22: Installer script at 'C:\Program Files\CodeProject\AI\setup.bat'
2023-11-07 13:12:22: FaceProcessing: [0;33m[49m Installing CodeProject.AI Analysis Module [0m
2023-11-07 13:12:22: FaceProcessing: [0;32m[49m========================================================================[0m
2023-11-07 13:12:22: FaceProcessing: [0;32m[49m CodeProject.AI Installer [0m
2023-11-07 13:12:22: FaceProcessing: [0;32m[49m========================================================================[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49msetupMode = InstallModule[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49mexecutionEnvironment = Production[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49minstallerScriptsPath = C:\Program Files\CodeProject\AI\[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49msdkScriptsDirPath = C:\Program Files\CodeProject\AI\SDK\Scripts[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49mabsoluteAppRootDir = C:\Program Files\CodeProject\AI\[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49mruntimesDirPath = C:\Program Files\CodeProject\AI\runtimes[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49mmodulesDirPath = C:\Program Files\CodeProject\AI\modules[0m
2023-11-07 13:12:22: FaceProcessing: [0;37m[49mdownloadDirPath = C:\Program Files\CodeProject\AI\downloads[0m
2023-11-07 13:12:22: FaceProcessing: [0;97m[104mGeneral CodeProject.AI setup [0m
2023-11-07 13:12:22: Installing module 'FaceProcessing'
2023-11-07 13:12:22: Installer script at 'C:\Program Files\CodeProject\AI\setup.bat'
2023-11-07 13:12:22 [System.IO.IOException: The process cannot access the file 'C:\Program Files\CodeProject\AI\modules\FaceProcessing\install.log' because it is being used by another process.
at Microsoft.Win32.SafeHandles.SafeFileHandle.CreateFile(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode)
at System.IO.File.AppendText(String path)
at CodeProject.AI.Server.Modules.ModuleInstaller.InstallModuleAsync(String installPackagePath, String moduleId, LogVerbosity verbosity)
at CodeProject.AI.Server.Modules.ModuleInstaller.DownloadAndInstallModuleAsync(String moduleId, String version, Boolean noCache, LogVerbosity verbosity)
at CodeProject.AI.Server.Controllers.ModuleController.InstallModuleAsync(String moduleId, String version, Boolean noCache, LogVerbosity verbosity)
at lambda_method95(Closure, Object)
at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.AwaitableObjectResultExecutor.Execute(ActionContext actionContext, IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokeactionmethodasync>g__Awaited|12_0(ControllerActionInvoker invoker, ValueTask`1 actionResultValueTask)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokenextactionfilterasync>g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokeinnerfilterasync>g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokefilterpipelineasync>g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokeasync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokeasync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Routing.EndpointMiddleware.<invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context)
at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.Http.HttpProtocol.ProcessRequests[TContext](IHttpApplication`1 application)]: Connection id "0HMUVQNTJL7FS", Request id "0HMUVQNTJL7FS:000000A1": An unhandled exception was thrown by the application.
2023-11-07 13:12:22: FaceProcessing: [0;39m[49mCreating Directories...[0m[0;92m[49mDone[0m
2023-11-07 13:12:22: FaceProcessing: [0;97m[104mGPU support [0m
2023-11-07 13:12:22: FaceProcessing: [0;39m[49mCUDA Present...[0m[0;33m[49mNo[0m
2023-11-07 13:12:22: FaceProcessing: [0;39m[49mROCm Present...[0m[0;33m[49mFalse[0m
2023-11-07 13:12:22: FaceProcessing: [0;97m[104mVariable Dump [0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mmoduleName = FaceProcessing[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mmoduleVersion = 1.8.1[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mruntime = python3.7[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49minstallGPU = true[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mpythonLocation = Shared[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mpythonVersion = 3.7[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mvirtualEnvDirPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mvenvPythonCmdPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python.exe[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mpackagesDirPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages[0m
2023-11-07 13:12:22: FaceProcessing: [0;97m[104mInstalling module FaceProcessing 1.8.1 [0m
2023-11-07 13:12:22: FaceProcessing: [0;39m[49mInstalling Python 3.7[0m
2023-11-07 13:12:22: FaceProcessing: [0;95m[49mInstalling python37 in C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37[0m
2023-11-07 13:12:22: FaceProcessing: [0;32m[49mPython 3.7 is already installed[0m
2023-11-07 13:12:22: FaceProcessing: [0;39m[49mCreating Virtual Environment (Shared)...[0m[0;32m[49mVirtual Environment already present[0m
2023-11-07 13:12:23: FaceProcessing: [0;39m[49mConfirming we have Python 3.7 in our virtual environment...[0m
2023-11-07 13:12:23: FaceProcessing: [0;39m[49m-------------------------------------------------------------[0m
2023-11-07 13:12:23: FaceProcessing: [0;91m[49mError: Python not installed[0m
2023-11-07 13:12:23: FaceProcessing: [0;95m[49mDownloading models.zip to C:\Program Files\CodeProject\AI\downloads\FaceProcessing[0m
2023-11-07 13:12:23: FaceProcessing: [0;30m[49mDownloading YOLO models...[0m[0;95m[49mChecking 'C:\Program Files\CodeProject\AI\downloads\FaceProcessing\models.zip'[0m
2023-11-07 13:12:23: FaceProcessing: [0;95m[49malready exists...[0m[0;95m[49mExpanding...[0m[0;95m[49mHeading to C:\Program Files\CodeProject\AI\downloads\FaceProcessing[0m
2023-11-07 13:12:23: FaceProcessing: [0;95m[49mExtracting models.zip[0m
2023-11-07 13:12:31: FaceProcessing: [0;95m[49mTar failed - moving to PowerShell...[0m[0;32m[49mDone.[0m
2023-11-07 13:12:32: FaceProcessing: [0;39m[49mCopying contents of models.zip to assets...[0m[0;32m[49mdone[0m
2023-11-07 13:12:32: FaceProcessing: [0;39m[49mCleaning up...[0m[0;39m[49mCleaning up extracted files[0m
2023-11-07 13:12:32: FaceProcessing: [0;32m[49mdone[0m
2023-11-07 13:12:32: FaceProcessing: [0;39m[49mInstalling Python packages for FaceProcessing[0m
2023-11-07 13:12:32: FaceProcessing: [0;[49mInstalling GPU-enabled libraries: [0m[0;32m[49mIf available[0m
2023-11-07 13:12:33: FaceProcessing: [0;39m[49mEnsuring Python package manager (pip) is installed...[0mLooking in links: c:\Users\Joey\AppData\Local\Temp\tmptse0292i
2023-11-07 13:12:33: FaceProcessing: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:12:33: FaceProcessing: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:12:33: FaceProcessing: [0;32m[49mDone[0m
2023-11-07 13:12:34: FaceProcessing: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0mRequirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:12:35: FaceProcessing: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:12:36: FaceProcessing: [0;32m[49mDone[0m
2023-11-07 13:12:36: FaceProcessing: [0;95m[49mRequirements Search Path is C:\Program Files\CodeProject\AI\modules\FaceProcessing[0m
2023-11-07 13:12:36: FaceProcessing: [0;95m[49mSearching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\modules\FaceProcessing[0m
2023-11-07 13:12:36: FaceProcessing: [0;95m[49mPython packages specified by requirements.txt[0m
2023-11-07 13:12:36: FaceProcessing: [0;95m[49mChoosing Python packages from C:\Program Files\CodeProject\AI\modules\FaceProcessing\requirements.txt[0m
2023-11-07 13:12:36: FaceProcessing: Not enough memory.
2023-11-07 13:12:36: FaceProcessing: [0;39m[49mInstalling Python packages for the CodeProject.AI Server SDK[0m
2023-11-07 13:12:37: FaceProcessing: [0;39m[49mEnsuring Python package manager (pip) is installed...[0mLooking in links: c:\Users\Joey\AppData\Local\Temp\tmp399821cb
2023-11-07 13:12:37: FaceProcessing: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:12:37: FaceProcessing: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:12:37: FaceProcessing: [0;32m[49mDone[0m
2023-11-07 13:12:38: FaceProcessing: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0mRequirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:12:39: FaceProcessing: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:12:40: FaceProcessing: [0;32m[49mDone[0m
2023-11-07 13:12:40: FaceProcessing: [0;95m[49mRequirements Search Path is C:\Program Files\CodeProject\AI\SDK\Python[0m
2023-11-07 13:12:40: FaceProcessing: [0;95m[49mSearching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\SDK\Python[0m
2023-11-07 13:12:40: FaceProcessing: [0;95m[49mPython packages specified by requirements.txt[0m
2023-11-07 13:12:40: FaceProcessing: [0;95m[49mChoosing Python packages from C:\Program Files\CodeProject\AI\SDK\Python\requirements.txt[0m
2023-11-07 13:12:40: FaceProcessing: Not enough memory.
2023-11-07 13:12:40: FaceProcessing: [0;97m[42mSetup complete [0m
2023-11-07 13:12:40: Module FaceProcessing installed successfully.
2023-11-07 13:12:40: Command: C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python
2023-11-07 13:12:40:
2023-11-07 13:12:40: Attempting to start FaceProcessing with C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python "C:\Program Files\CodeProject\AI\modules\FaceProcessing\intelligencelayer\face.py"
2023-11-07 13:12:40: Starting C:\Program Files...ws\python37\venv\Scripts\python "C:\Program Files...ing\intelligencelayer\face.py"
2023-11-07 13:12:40:
2023-11-07 13:12:40: ** Module 'Face Processing' 1.8.1 (ID: FaceProcessing)
2023-11-07 13:12:40: ** Module Path: C:\Program Files\CodeProject\AI\modules\FaceProcessing
2023-11-07 13:12:40: ** AutoStart: True
2023-11-07 13:12:40: ** Queue: faceprocessing_queue
2023-11-07 13:12:40: ** Platforms: windows,linux,linux-arm64,macos,macos-arm64
2023-11-07 13:12:40: ** GPU Libraries: installed if available
2023-11-07 13:12:40: ** GPU Enabled: enabled
2023-11-07 13:12:40: ** Parallelism: 0
2023-11-07 13:12:40: ** Accelerator:
2023-11-07 13:12:40: ** Half Precis.: enable
2023-11-07 13:12:40: ** Runtime: python3.7
2023-11-07 13:12:40: ** Runtime Loc: Shared
2023-11-07 13:12:40: ** FilePath: intelligencelayer\face.py
2023-11-07 13:12:40: ** Pre installed: False
2023-11-07 13:12:40: ** Start pause: 3 sec
2023-11-07 13:12:40: ** LogVerbosity:
2023-11-07 13:12:40: ** Valid: True
2023-11-07 13:12:40: ** Environment Variables
2023-11-07 13:12:40: ** APPDIR = %CURRENT_MODULE_PATH%\intelligencelayer
2023-11-07 13:12:40: ** DATA_DIR = %DATA_DIR%
2023-11-07 13:12:40: ** MODE = MEDIUM
2023-11-07 13:12:40: ** MODELS_DIR = %CURRENT_MODULE_PATH%\assets
2023-11-07 13:12:40: ** PROFILE = desktop_gpu
2023-11-07 13:12:40: ** USE_CUDA = True
2023-11-07 13:12:40: ** YOLOv5_AUTOINSTALL = false
2023-11-07 13:12:40: ** YOLOv5_VERBOSE = false
2023-11-07 13:12:40:
2023-11-07 13:12:40: Started Face Processing module
2023-11-07 13:12:40: Installer exited with code 0
2023-11-07 13:12:43: Module FaceProcessing started successfully.
2023-11-07 13:12:44: face.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
2023-11-07 13:12:44: face.py: Vision AI services setup: Retrieving environment variables...
2023-11-07 13:12:44: face.py: USE_MPS not found. Setting to default True
2023-11-07 13:12:44: face.py: GPU in use: NVIDIA GeForce RTX 3060
2023-11-07 13:12:44: face.py: APPDIR: C:\Program Files\CodeProject\AI\modules\FaceProcessing\intelligencelayer
2023-11-07 13:12:44: face.py: PROFILE: desktop_gpu
2023-11-07 13:12:44: face.py: USE_CUDA: True
2023-11-07 13:12:44: face.py: DATA_DIR: C:\ProgramData\CodeProject\AI
2023-11-07 13:12:44: Running init for Face Processing
2023-11-07 13:12:44: face.py: MODELS_DIR: C:\Program Files\CodeProject\AI\modules\FaceProcessing\assets
2023-11-07 13:12:44: face.py: MODE: MEDIUM
2023-11-07 13:12:44: Face Processing: Face Processing started. in Face Processing
2023-11-07 13:12:54: Preparing to install module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Downloading module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Preparing to install module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Downloading module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Installing module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Installer script at 'C:\Program Files\CodeProject\AI\setup.bat'
2023-11-07 13:12:54: ObjectDetectionYolo: [0;33m[49m Installing CodeProject.AI Analysis Module [0m
2023-11-07 13:12:54: ObjectDetectionYolo: [0;32m[49m========================================================================[0m
2023-11-07 13:12:54: ObjectDetectionYolo: [0;32m[49m CodeProject.AI Installer [0m
2023-11-07 13:12:54: ObjectDetectionYolo: [0;32m[49m========================================================================[0m
2023-11-07 13:12:54: ObjectDetectionYolo: [0;37m[49msetupMode = InstallModule[0m
2023-11-07 13:12:54: ObjectDetectionYolo: [0;37m[49mexecutionEnvironment = Production[0m
2023-11-07 13:12:54: Installing module 'ObjectDetectionYolo'
2023-11-07 13:12:54: Installer script at 'C:\Program Files\CodeProject\AI\setup.bat'
2023-11-07 13:12:55 [System.IO.IOException: The process cannot access the file 'C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\install.log' because it is being used by another process.
at Microsoft.Win32.SafeHandles.SafeFileHandle.CreateFile(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options)
at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode)
at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode)
at System.IO.File.AppendText(String path)
at CodeProject.AI.Server.Modules.ModuleInstaller.InstallModuleAsync(String installPackagePath, String moduleId, LogVerbosity verbosity)
at CodeProject.AI.Server.Modules.ModuleInstaller.DownloadAndInstallModuleAsync(String moduleId, String version, Boolean noCache, LogVerbosity verbosity)
at CodeProject.AI.Server.Controllers.ModuleController.InstallModuleAsync(String moduleId, String version, Boolean noCache, LogVerbosity verbosity)
at lambda_method95(Closure, Object)
at Microsoft.AspNetCore.Mvc.Infrastructure.ActionMethodExecutor.AwaitableObjectResultExecutor.Execute(ActionContext actionContext, IActionResultTypeMapper mapper, ObjectMethodExecutor executor, Object controller, Object[] arguments)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokeactionmethodasync>g__Awaited|12_0(ControllerActionInvoker invoker, ValueTask`1 actionResultValueTask)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokenextactionfilterasync>g__Awaited|10_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Rethrow(ActionExecutedContextSealed context)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.Next(State& next, Scope& scope, Object& state, Boolean& isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ControllerActionInvoker.<invokeinnerfilterasync>g__Awaited|13_0(ControllerActionInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokefilterpipelineasync>g__Awaited|20_0(ResourceInvoker invoker, Task lastTask, State next, Scope scope, Object state, Boolean isCompleted)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokeasync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Mvc.Infrastructure.ResourceInvoker.<invokeasync>g__Awaited|17_0(ResourceInvoker invoker, Task task, IDisposable scope)
at Microsoft.AspNetCore.Routing.EndpointMiddleware.<invoke>g__AwaitRequestTask|6_0(Endpoint endpoint, Task requestTask, ILogger logger)
at Microsoft.AspNetCore.Authorization.AuthorizationMiddleware.Invoke(HttpContext context)
at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.Http.HttpProtocol.ProcessRequests[TContext](IHttpApplication`1 application)]: Connection id "0HMUVQNTJL7FS", Request id "0HMUVQNTJL7FS:000000F4": An unhandled exception was thrown by the application.
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49minstallerScriptsPath = C:\Program Files\CodeProject\AI\[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49msdkScriptsDirPath = C:\Program Files\CodeProject\AI\SDK\Scripts[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49mabsoluteAppRootDir = C:\Program Files\CodeProject\AI\[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49mruntimesDirPath = C:\Program Files\CodeProject\AI\runtimes[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49mmodulesDirPath = C:\Program Files\CodeProject\AI\modules[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;37m[49mdownloadDirPath = C:\Program Files\CodeProject\AI\downloads[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;97m[104mGeneral CodeProject.AI setup [0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mCreating Directories...[0m[0;92m[49mDone[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;97m[104mGPU support [0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mCUDA Present...[0m[0;33m[49mNo[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mROCm Present...[0m[0;33m[49mFalse[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;97m[104mVariable Dump [0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mmoduleName = ObjectDetectionYolo[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mmoduleVersion = 1.7.1[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mruntime = python3.7[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49minstallGPU = true[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mpythonLocation = Shared[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mpythonVersion = 3.7[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mvirtualEnvDirPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mvenvPythonCmdPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python.exe[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mpackagesDirPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;97m[104mInstalling module ObjectDetectionYolo 1.7.1 [0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mInstalling Python 3.7[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mInstalling python37 in C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;32m[49mPython 3.7 is already installed[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mCreating Virtual Environment (Shared)...[0m[0;32m[49mVirtual Environment already present[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49mConfirming we have Python 3.7 in our virtual environment...[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;39m[49m-------------------------------------------------------------[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;91m[49mError: Python not installed[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mDownloading models-yolo5-pt.zip to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;30m[49mDownloading Standard YOLO models...[0m[0;95m[49mChecking 'C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo\models-yolo5-pt.zip'[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49malready exists...[0m[0;95m[49mExpanding...[0m[0;95m[49mHeading to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo[0m
2023-11-07 13:12:55: ObjectDetectionYolo: [0;95m[49mExtracting models-yolo5-pt.zip[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;95m[49mTar failed - moving to PowerShell...[0m[0;32m[49mDone.[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;39m[49mCopying contents of models-yolo5-pt.zip to assets...[0m[0;32m[49mdone[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;39m[49mCleaning up...[0m[0;39m[49mCleaning up extracted files[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;32m[49mdone[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;95m[49mDownloading custom-models-yolo5-pt.zip to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;30m[49mDownloading Custom YOLO models...[0m[0;95m[49mChecking 'C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo\custom-models-yolo5-pt.zip'[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;95m[49malready exists...[0m[0;95m[49mExpanding...[0m[0;95m[49mHeading to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo[0m
2023-11-07 13:12:58: ObjectDetectionYolo: [0;95m[49mExtracting custom-models-yolo5-pt.zip[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;95m[49mTar failed - moving to PowerShell...[0m[0;32m[49mDone.[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;39m[49mCopying contents of custom-models-yolo5-pt.zip to custom-models...[0m[0;32m[49mdone[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;39m[49mCleaning up...[0m[0;39m[49mCleaning up extracted files[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;32m[49mdone[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;39m[49mInstalling Python packages for ObjectDetectionYolo[0m
2023-11-07 13:13:02: ObjectDetectionYolo: [0;[49mInstalling GPU-enabled libraries: [0m[0;32m[49mIf available[0m
2023-11-07 13:13:03: ObjectDetectionYolo: [0;39m[49mEnsuring Python package manager (pip) is installed...[0mLooking in links: c:\Users\Joey\AppData\Local\Temp\tmpvk6ykxnz
2023-11-07 13:13:03: ObjectDetectionYolo: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:13:03: ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:13:04: ObjectDetectionYolo: [0;32m[49mDone[0m
2023-11-07 13:13:04: ObjectDetectionYolo: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0mRequirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:13:06: ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:13:06: ObjectDetectionYolo: [0;32m[49mDone[0m
2023-11-07 13:13:06: ObjectDetectionYolo: [0;95m[49mRequirements Search Path is C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo[0m
2023-11-07 13:13:06: ObjectDetectionYolo: [0;95m[49mSearching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo[0m
2023-11-07 13:13:06: ObjectDetectionYolo: [0;95m[49mPython packages specified by requirements.txt[0m
2023-11-07 13:13:06: ObjectDetectionYolo: [0;95m[49mChoosing Python packages from C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\requirements.txt[0m
2023-11-07 13:13:06: ObjectDetectionYolo: Not enough memory.
2023-11-07 13:13:06: ObjectDetectionYolo: [0;39m[49mInstalling Python packages for the CodeProject.AI Server SDK[0m
2023-11-07 13:13:07: ObjectDetectionYolo: [0;39m[49mEnsuring Python package manager (pip) is installed...[0mLooking in links: c:\Users\Joey\AppData\Local\Temp\tmp36gxmpt7
2023-11-07 13:13:07: ObjectDetectionYolo: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:13:07: ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:13:08: ObjectDetectionYolo: [0;32m[49mDone[0m
2023-11-07 13:13:08: ObjectDetectionYolo: [0;39m[49mEnsuring Python package manager (pip) is up to date...[0mRequirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
2023-11-07 13:13:09: ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
2023-11-07 13:13:10: ObjectDetectionYolo: [0;32m[49mDone[0m
2023-11-07 13:13:10: ObjectDetectionYolo: [0;95m[49mRequirements Search Path is C:\Program Files\CodeProject\AI\SDK\Python[0m
2023-11-07 13:13:10: ObjectDetectionYolo: [0;95m[49mSearching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\SDK\Python[0m
2023-11-07 13:13:10: ObjectDetectionYolo: [0;95m[49mPython packages specified by requirements.txt[0m
2023-11-07 13:13:10: ObjectDetectionYolo: [0;95m[49mChoosing Python packages from C:\Program Files\CodeProject\AI\SDK\Python\requirements.txt[0m
2023-11-07 13:13:10: ObjectDetectionYolo: Not enough memory.
2023-11-07 13:13:10: ObjectDetectionYolo: [0;97m[42mSetup complete [0m
2023-11-07 13:13:10: Module ObjectDetectionYolo installed successfully.
2023-11-07 13:13:10: Command: C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python
2023-11-07 13:13:10:
2023-11-07 13:13:10: Attempting to start ObjectDetectionYolo with C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python "C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\detect_adapter.py"
2023-11-07 13:13:10: Starting C:\Program Files...ws\python37\venv\Scripts\python "C:\Program Files...tectionYolo\detect_adapter.py"
2023-11-07 13:13:10:
2023-11-07 13:13:10: ** Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
2023-11-07 13:13:10: ** Module Path: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
2023-11-07 13:13:10: ** AutoStart: True
2023-11-07 13:13:10: ** Queue: objectdetection_queue
2023-11-07 13:13:10: ** Platforms: all
2023-11-07 13:13:10: ** GPU Libraries: installed if available
2023-11-07 13:13:10: ** GPU Enabled: enabled
2023-11-07 13:13:10: ** Parallelism: 0
2023-11-07 13:13:10: ** Accelerator:
2023-11-07 13:13:10: ** Half Precis.: enable
2023-11-07 13:13:10: ** Runtime: python3.7
2023-11-07 13:13:10: ** Runtime Loc: Shared
2023-11-07 13:13:10: ** FilePath: detect_adapter.py
2023-11-07 13:13:10: ** Pre installed: False
2023-11-07 13:13:10: ** Start pause: 1 sec
2023-11-07 13:13:10: ** LogVerbosity:
2023-11-07 13:13:10: ** Valid: True
2023-11-07 13:13:10: ** Environment Variables
2023-11-07 13:13:10: ** APPDIR = %CURRENT_MODULE_PATH%
2023-11-07 13:13:10: ** CUSTOM_MODELS_DIR = %CURRENT_MODULE_PATH%/custom-models
2023-11-07 13:13:10: ** MODELS_DIR = %CURRENT_MODULE_PATH%/assets
2023-11-07 13:13:10: ** MODEL_SIZE = Medium
2023-11-07 13:13:10: ** USE_CUDA = True
2023-11-07 13:13:10: ** YOLOv5_AUTOINSTALL = false
2023-11-07 13:13:10: ** YOLOv5_VERBOSE = false
2023-11-07 13:13:10:
2023-11-07 13:13:10: Started Object Detection (YOLOv5 6.2) module
2023-11-07 13:13:10: Installer exited with code 0
2023-11-07 13:13:11: Module ObjectDetectionYolo started successfully.
2023-11-07 13:13:15: detect_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
2023-11-07 13:13:15: detect_adapter.py: APPDIR: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
2023-11-07 13:13:15: detect_adapter.py: MODEL_SIZE: medium
2023-11-07 13:13:15: detect_adapter.py: MODELS_DIR: C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\assets
2023-11-07 13:13:15: Running init for Object Detection (YOLOv5 6.2)
2023-11-07 13:13:15: Object Detection (YOLOv5 6.2): Object Detection (YOLOv5 6.2) started. in Object Detection (YOLOv5 6.2)

modified 7-Nov-23 16:45pm.

Chris Maunder7-Nov-23 12:00

Re: ObjectDetectionYolo, FaceProcessing, module install's from dashboard

7-Nov-23 12:00

48Gb is a fair whack of memory and shouldn't be stressed at all. I run the installed on an 8Gb raspberry Pi and a 2GB Jetson and it works (though the Jetson is creaking badly).

There are file access issues in their that are unrelated, but I wonder if the memory error is actually bogus. In image processing in .NET there is an issue where unsupported formats through a 'out of memory' error rather than a 'I don't understand this format'. I'm wondering if it's the same type of issue.

Is anything else running on your system during install?

(and if you copied the entire Python37 folder it should all be good)

cheers
Chris Maunder

Jebus597-Nov-23 15:20

New Install - Local install

7-Nov-23 15:20

Nothing else running, 30 gigs free. Before I had 16 gigs and a GTX 960 w/2 gigs. Two modules ran great. Of note, every install od CP.AI I have installed, just this box, has the amazon bit bucket permissions error. I can "open the doors" on this box, router too, and it will still error on permissions dowloading python and all any libraries, plus the model zips. I can make it run. It runs great. Very acceptable times.

I should add that I can go to a browser(Firefox) and download python37.zip from the bitbucket...

https://codeproject-ai.s3.ca-central-1.amazonaws.com/sense/installer/dev/python37.zip

rdcrumbaker7-Nov-23 5:33

rdcrumbaker

7-Nov-23 5:33

I get the following error on a brand new install of 2.3.4. When I go to AI Explorer, and try to register a new face, I get "

Quote:
Response timeout. Try increasing the timeout value

So I started looking at the logs.

08:02:16:System:           Windows
08:02:16:Operating System: Windows (Microsoft Windows 11 version 10.0.22635)
08:02:16:CPUs:             AMD Ryzen Threadripper 3960X 24-Core Processor  (AMD)
08:02:16:                  1 CPU x 24 cores. 48 logical processors (x64)
08:02:16:GPU:              NVIDIA GeForce RTX 3070 (8 GiB) (NVIDIA)
08:02:16:                  Driver: 546.01 CUDA: 11.8.89 (max supported: 12.3) Compute: 8.6
08:02:16:System RAM:       128 GiB
08:02:16:Target:           Windows
08:02:16:BuildConfig:      Release
08:02:16:Execution Env:    Native
08:02:16:Runtime Env:      Production
08:02:16:.NET framework:   .NET 7.0.13
08:02:16:App DataDir:      C:\ProgramData\CodeProject\AI
08:02:16:Video adapter info:
08:02:16:  NVIDIA GeForce RTX 3070:
08:02:16:    Driver Version     31.0.15.4601
08:02:16:    Video Processor    NVIDIA GeForce RTX 3070
08:02:16:STARTING CODEPROJECT.AI SERVER
08:02:16:RUNTIMES_PATH             = C:\Program Files\CodeProject\AI\runtimes
08:02:16:PREINSTALLED_MODULES_PATH = C:\Program Files\CodeProject\AI\preinstalled-modules
08:02:16:MODULES_PATH              = C:\Program Files\CodeProject\AI\modules
08:02:16:PYTHON_PATH               = \bin\windows\%PYTHON_DIRECTORY%\venv\Scripts\python
08:02:16:Data Dir                  = C:\ProgramData\CodeProject\AI
08:02:16:Server version:   2.3.4-Beta
08:02:19:Setting up initial modules. Please be patient...
08:02:19:Installing initial module FaceProcessing.
08:02:19:Preparing to install module 'FaceProcessing'
08:02:20:Downloading module 'FaceProcessing'
08:02:21:Installing module 'FaceProcessing'
08:02:21:FaceProcessing:              Installing CodeProject.AI Analysis Module                
08:02:21:FaceProcessing: ========================================================================
08:02:21:FaceProcessing:                    CodeProject.AI Installer                             
08:02:21:FaceProcessing: ========================================================================
08:02:21:FaceProcessing: General CodeProject.AI setup                                          
08:02:21:FaceProcessing: Creating Directories...Done
08:02:21:FaceProcessing: GPU support                                                           
08:02:21:FaceProcessing: CUDA Present...Yes (version 11.8)
08:02:21:FaceProcessing: ROCm Present...False
08:02:22:Server: This is the latest version
08:02:22:FaceProcessing: Installing module FaceProcessing 1.8.1                                
08:02:22:FaceProcessing: Installing Python 3.7
08:05:03:FaceProcessing: Downloading Python 3.7 interpreter...Expanding...Done.
08:05:16:FaceProcessing: Creating Virtual Environment (Shared)...Done
08:05:16:FaceProcessing: Confirming we have Python 3.7 in our virtual environment...present
08:22:21:Module FaceProcessing installed successfully.
08:22:21:FaceProcessing: Downloading YOLO models...
08:22:21:
08:22:21:Module 'Face Processing' 1.8.1 (ID: FaceProcessing)
08:22:21:Module Path:   C:\Program Files\CodeProject\AI\modules\FaceProcessing
08:22:21:AutoStart:     True
08:22:21:Queue:         faceprocessing_queue
08:22:21:Platforms:     windows,linux,linux-arm64,macos,macos-arm64
08:22:21:GPU Libraries: installed if available
08:22:21:GPU Enabled:   enabled
08:22:21:Parallelism:   0
08:22:21:Accelerator:
08:22:21:Half Precis.:  enable
08:22:21:Runtime:       python3.7
08:22:21:Runtime Loc:   Shared
08:22:21:FilePath:      intelligencelayer\face.py
08:22:21:Pre installed: False
08:22:21:Start pause:   3 sec
08:22:21:LogVerbosity:
08:22:21:Valid:         True
08:22:21:Environment Variables
08:22:21:APPDIR             = %CURRENT_MODULE_PATH%\intelligencelayer
08:22:21:DATA_DIR           = %DATA_DIR%
08:22:21:MODE               = MEDIUM
08:22:21:MODELS_DIR         = %CURRENT_MODULE_PATH%\assets
08:22:21:PROFILE            = desktop_gpu
08:22:21:USE_CUDA           = True
08:22:21:YOLOv5_AUTOINSTALL = false
08:22:21:YOLOv5_VERBOSE     = false
08:22:21:
08:22:21:Started Face Processing module
08:22:21:Unable to install FaceProcessing: Timed out attempting to install Module 'FaceProcessing' (A task was canceled.)
08:22:21:Installing initial module ObjectDetectionNet.
08:22:21:Preparing to install module 'ObjectDetectionNet'
08:22:21:Downloading module 'ObjectDetectionNet'
08:22:21:face.py: Traceback (most recent call last):
08:22:21:face.py:   File "C:\Program Files\CodeProject\AI\modules\FaceProcessing\intelligencelayer\face.py", line 21, in 
08:22:21:face.py:     from request_data import RequestData
08:22:21:face.py:   File "../../SDK/Python\request_data.py", line 7, in 
08:22:21:face.py:     from PIL import Image
08:22:21:face.py: ModuleNotFoundError: No module named 'PIL'
08:22:21:face.py: has exited
08:22:21:Module FaceProcessing has shutdown
08:22:22:Installing module 'ObjectDetectionNet'
08:22:22:ObjectDetectionNet:              Installing CodeProject.AI Analysis Module                
08:22:22:ObjectDetectionNet: ========================================================================
08:22:22:ObjectDetectionNet:                    CodeProject.AI Installer                             
08:22:22:ObjectDetectionNet: ========================================================================
08:22:22:ObjectDetectionNet: General CodeProject.AI setup                                          
08:22:22:ObjectDetectionNet: Creating Directories...Done
08:22:23:ObjectDetectionNet: GPU support                                                           
08:22:23:ObjectDetectionNet: CUDA Present...Yes (version 11.8)
08:22:23:ObjectDetectionNet: ROCm Present...False
08:22:23:ObjectDetectionNet: Installing module ObjectDetectionNet 1.7.1                            
08:22:24:Module FaceProcessing started successfully.
08:27:33:ObjectDetectionNet: Downloading ObjectDetectionNet-DirectML-1.7.1.zip...Expanding...Done.
08:27:34:ObjectDetectionNet: Copying contents of ObjectDetectionNet-DirectML-1.7.1.zip to ...done
08:27:34:ObjectDetectionNet: Cleaning up...done
08:42:22:Module ObjectDetectionNet installed successfully.
08:42:22:Module ObjectDetectionNet not configured to AutoStart.
08:42:22:ObjectDetectionNet: Downloading YOLO ONNX models...
08:42:22:Unable to install ObjectDetectionNet: Timed out attempting to install Module 'ObjectDetectionNet' (A task was canceled.)
08:42:22:Installing initial module ObjectDetectionYolo.
08:42:22:Preparing to install module 'ObjectDetectionYolo'
08:42:22:Downloading module 'ObjectDetectionYolo'
08:42:23:Installing module 'ObjectDetectionYolo'
08:42:23:ObjectDetectionYolo:              Installing CodeProject.AI Analysis Module                
08:42:23:ObjectDetectionYolo: ========================================================================
08:42:23:ObjectDetectionYolo:                    CodeProject.AI Installer                             
08:42:23:ObjectDetectionYolo: ========================================================================
08:42:23:ObjectDetectionYolo: General CodeProject.AI setup                                          
08:42:24:ObjectDetectionYolo: Creating Directories...Done
08:42:24:ObjectDetectionYolo: GPU support                                                           
08:42:24:ObjectDetectionYolo: CUDA Present...Yes (version 11.8)
08:42:24:ObjectDetectionYolo: ROCm Present...False
08:42:24:ObjectDetectionYolo: Installing module ObjectDetectionYolo 1.7.1                           
08:42:24:ObjectDetectionYolo: Installing Python 3.7
08:42:24:ObjectDetectionYolo: Python 3.7 is already installed
08:42:24:ObjectDetectionYolo: Creating Virtual Environment (Shared)...Virtual Environment already present
08:42:24:ObjectDetectionYolo: Confirming we have Python 3.7 in our virtual environment...present
08:55:26:ObjectDetectionYolo: Downloading Standard YOLO models...Expanding...Done.
08:55:27:ObjectDetectionYolo: Copying contents of models-yolo5-pt.zip to assets...done
08:55:27:ObjectDetectionYolo: Cleaning up...done
09:02:23:Module ObjectDetectionYolo installed successfully.
09:02:23:
09:02:23:Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
09:02:23:Module Path:   C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
09:02:23:AutoStart:     True
09:02:23:Queue:         objectdetection_queue
09:02:23:Platforms:     all
09:02:23:GPU Libraries: installed if available
09:02:23:GPU Enabled:   enabled
09:02:23:Parallelism:   0
09:02:23:Accelerator:
09:02:23:Half Precis.:  enable
09:02:23:Runtime:       python3.7
09:02:23:Runtime Loc:   Shared
09:02:23:FilePath:      detect_adapter.py
09:02:23:Pre installed: False
09:02:23:Start pause:   1 sec
09:02:23:LogVerbosity:
09:02:23:Valid:         True
09:02:23:Environment Variables
09:02:23:APPDIR             = %CURRENT_MODULE_PATH%
09:02:23:CUSTOM_MODELS_DIR  = %CURRENT_MODULE_PATH%/custom-models
09:02:23:MODELS_DIR         = %CURRENT_MODULE_PATH%/assets
09:02:23:MODEL_SIZE         = Medium
09:02:23:USE_CUDA           = True
09:02:23:YOLOv5_AUTOINSTALL = false
09:02:23:YOLOv5_VERBOSE     = false
09:02:23:
09:02:23:Started Object Detection (YOLOv5 6.2) module
09:02:23:ObjectDetectionYolo: Downloading Custom YOLO models...
09:02:23:Unable to install ObjectDetectionYolo: Timed out attempting to install Module 'ObjectDetectionYolo' (A task was canceled.)
09:02:23:detect_adapter.py: Traceback (most recent call last):
09:02:23:detect_adapter.py:   File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\detect_adapter.py", line 12, in 
09:02:23:detect_adapter.py:     from request_data import RequestData
09:02:23:detect_adapter.py:   File "../../SDK/Python\request_data.py", line 7, in 
09:02:23:detect_adapter.py:     from PIL import Image
09:02:23:detect_adapter.py: ModuleNotFoundError: No module named 'PIL'
09:02:23:Module ObjectDetectionYolo has shutdown
09:02:23:detect_adapter.py: has exited
09:02:24:Module ObjectDetectionYolo started successfully.

Here is my System Tab

<blockquote class="quote"><div class="op">Quote:</div>Server version:   2.3.4-Beta
System:           Windows
Operating System: Windows (Microsoft Windows 11 version 10.0.22635)
CPUs:             AMD Ryzen Threadripper 3960X 24-Core Processor  (AMD)
                  1 CPU x 24 cores. 48 logical processors (x64)
GPU:              NVIDIA GeForce RTX 3070 (8 GiB) (NVIDIA) 
                  Driver: 546.01 CUDA: 11.8.89 (max supported: 12.3) Compute: 8.6
System RAM:       128 GiB
Target:           Windows
BuildConfig:      Release
Execution Env:    Native
Runtime Env:      Production
.NET framework:   .NET 7.0.13
Video adapter info:
  NVIDIA GeForce RTX 3070:
    Driver Version     31.0.15.4601
    Video Processor    NVIDIA GeForce RTX 3070
System GPU info:
  GPU 3D Usage       27%
  GPU RAM Usage      3.1 GiB
Global Environment variables:
  CPAI_APPROOTPATH = <root>
  CPAI_PORT        = 32168</blockquote>

Re: New Install - Local install

Sean Ewington7-Nov-23 8:43

Sean Ewington

7-Nov-23 8:43

Thanks very much for the report and all that info. It could be that all you have to do is try uninstalling and reinstalling the modules you want to use, one by one.

It looks like there was also a timeout issue, though. You may need to change the ModuleInstallTimeout value in appsettings.json. You can also download the module manually: CodeProject.AI Server Modules Registry[^]

Thanks,
Sean Ewington
CodeProject

Load balance coral/YoloCPU

VavoVavo5-Nov-23 11:17

VavoVavo

5-Nov-23 11:17

I noticed that if you use default model then requests will be balanced between two engines I have enabled

Object Detection (YOLOv5 6.2)

and

ObjectDetection (Coral)

Coral is usually 3-4x faster.

Yolo is faster if I use `ipcam-general` model but that one is not available for Coral so if the software is set to use custom model it will error out when it will try to get response from the Coral Engine.

- Is it possible to get the same models for Coral? I see that it is a 3th party repo on github? That way both engines can use the same custom engine.

- Is it possible to disable coral from using CPU? Sometimes (for unknown reasons for now) the TPU is not available and it will switch to CPU which is WAY slower. I would prefer for it to remain OFF then switch to CPU. In that case YoloCPU will process all object detections and it is faster the Coral CPU

- What are the cli commands to restart an engine? Sometimes a restart of Coral fixes the issue (Sometimes Face-detection also crashes and needs manual restart)

Using 2.2.4 on Docker on Linux

Re: Load balance coral/YoloCPU

Chris Maunder7-Nov-23 11:43

Re: Load balance coral/YoloCPU

7-Nov-23 11:43

Converting YOLOv5 to edgeTPU is walked through here. A bit of fiddling and it should be straightforward enough. Unfortunately I don't have the time at the moment to dive in myself.

VavoVavo wrote:
Is it possible to disable coral from using CPU

Not now, but I can add that option. The Coral module would just stop in that case.

VavoVavo wrote:
What are the cli commands to restart an engine

POST: localhost:32168/v1/settings/<ModuleId>
Where moduleID is ObjectDetectionCoral for the coral module, and include a name/value pair name = 'Restart', value = 'now' in the form data sent.

cheers
Chris Maunder

VavoVavo10-Nov-23 6:21

VavoVavo

10-Nov-23 6:21

Terminal

15:46:08:ObjectDetection (Coral): Retrieved objectdetection_queue command
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([  1, 300, 300,   3], dtype=int32), 'shape_signature': array([  1, 300, 300,   3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([  1, 300, 300,   3], dtype=int32), 'shape_signature': array([  1, 300, 300,   3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([  1, 300, 300,   3], dtype=int32), 'shape_signature': array([  1, 300, 300,   3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([  1, 300, 300,   3], dtype=int32), 'shape_signature': array([  1, 300, 300,   3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([  1, 300, 300,   3], dtype=int32), 'shape_signature': array([  1, 300, 300,   3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([  1, 300, 300,   3], dtype=int32), 'shape_signature': array([  1, 300, 300,   3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([  1, 300, 300,   3], dtype=int32), 'shape_signature': array([  1, 300, 300,   3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Input details: {'name': 'serving_default_input:0', 'index': 0, 'shape': array([  1, 300, 300,   3], dtype=int32), 'shape_signature': array([  1, 300, 300,   3], dtype=int32), 'dtype': , 'quantization': (0.007843137718737125, 127), 'quantization_parameters': {'scales': array([0.00784314], dtype=float32), 'zero_points': array([127], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Output details: {'name': 'StatefulPartitionedCall:3;StatefulPartitionedCall:2;StatefulPartitionedCall:1;StatefulPartitionedCall:02', 'index': 8, 'shape': array([ 1, 20], dtype=int32), 'shape_signature': array([ 1, 20], dtype=int32), 'dtype': , 'quantization': (0.0, 0), 'quantization_parameters': {'scales': array([], dtype=float32), 'zero_points': array([], dtype=int32), 'quantized_dimension': 0}, 'sparsity_parameters': {}}
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:objectdetection_coral_adapter.py: Refreshing the Tensorflow Interpreter
15:46:10:ObjectDetection (Coral): Rec'd request for ObjectDetection (Coral) command 'detect' (...b8118a) took 2689ms

After this blurp in the log the TPU is not working, The UI still says GPU (TPU) but the numbers are > 1sec, otherwise it takes ~20ms
Probably switching to CPU

Terminal

17:11:32:ObjectDetection (Coral): Retrieved objectdetection_queue command
17:11:33:ObjectDetection (Coral): Rec'd request for ObjectDetection (Coral) command 'detect' (...b80a07) took 1003ms
17:11:52:ObjectDetection (Coral): Retrieved objectdetection_queue command
17:11:53:ObjectDetection (Coral): Rec'd request for ObjectDetection (Coral) command 'detect' (...2532f7) took 1006ms
17:12:04:ObjectDetection (Coral): Retrieved objectdetection_queue command
17:12:05:ObjectDetection (Coral): Rec'd request for ObjectDetection (Coral) command 'detect' (...020032) took 1003ms
17:12:35:ObjectDetection (Coral): Retrieved objectdetection_queue command
17:12:36:ObjectDetection (Coral): Rec'd request for ObjectDetection (Coral) command 'detect' (...58423f) took 1003ms

I can detect this by periodic tests from my monitoring system by sending a detection request with a known image periodically. So I can automate the restarts or CPAI can implement service autorestart?

Docker image size of codeproject/ai-server is more than 10GB

Angry Unkle5-Nov-23 6:10

Angry Unkle

5-Nov-23 6:10

Just installed codeproject/ai-server:cuda11_7 in docker and it reports size of 10.9GB. This is plain insane. Why it needs to be that huge? I bet it can fit couple hundreds megs at max. Fix it please, it makes no sense at all.

Re: Docker image size of codeproject/ai-server is more than 10GB

Chris Maunder5-Nov-23 10:30

Not able to use CUDA GPU in 2.3.4

5-Nov-23 10:30

Welcome to the world of AI.

The main culprits are

PyTorch and other AI / GPU libraries. Well over a Gb each
The AI models themselves. 10's of Mb each
The base OS
The NVIDIA drivers and libraries.

cheers
Chris Maunder

Jepsh4-Nov-23 22:59

Jepsh

4-Nov-23 22:59

I installed 2.3.4 on my Win10 machine with Quadro P1000 but I can't get YOLOv5 6.2 - 1.7.1 to use GPU anymore. Always says CPU. I tried reinstalling CPAI and the module without cache. Logs looks like it detects CUDA and is looking to use it, but info for the module says it's running on CPU.
Previous CPAI version listed it as running on GPU.

UPDATE 1

Did a clean and re-install of latest supported drivers and CUDA 11.8 as per instructions.

Server version:   2.3.4-Beta
System:           Windows
Operating System: Windows (Microsoft Windows 10.0.19045)
CPUs:             Intel(R) Core(TM) i7-8700T CPU @ 2.40GHz (Intel)
                  1 CPU x 6 cores. 12 logical processors (x64)
GPU:              Quadro P1000 (4 GiB) (NVIDIA) 
                  Driver: 537.70 CUDA: 11.8.89 (max supported: 12.2) Compute: 6.1
System RAM:       16 GiB
Target:           Windows
BuildConfig:      Release
Execution Env:    Native
Runtime Env:      Production
.NET framework:   .NET 7.0.5
Video adapter info:
  NVIDIA Quadro P1000:
    Driver Version     31.0.15.3770
    Video Processor    Quadro P1000
  Intel(R) UHD Graphics 630:
    Driver Version     31.0.101.2125
    Video Processor    Intel(R) UHD Graphics Family
System GPU info:
  GPU 3D Usage       0%
  GPU RAM Usage      398 MiB
Global Environment variables:
  CPAI_APPROOTPATH = <root>
  CPAI_PORT        = 32168

Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
Module Path:   <root>\modules\ObjectDetectionYolo
AutoStart:     True
Queue:         objectdetection_queue
Platforms:     all
GPU Libraries: installed if available
GPU Enabled:   enabled
Parallelism:   0
Accelerator:<br />
Half Precis.:  enable
Runtime:       python3.7
Runtime Loc:   Shared
FilePath:      detect_adapter.py
Pre installed: False
Start pause:   1 sec
LogVerbosity:<br />
Valid:         True
Environment Variables
   APPDIR             = <root>\modules\ObjectDetectionYolo
   CUSTOM_MODELS_DIR  = <root>\modules\ObjectDetectionYolo\custom-models
   MODELS_DIR         = <root>\modules\ObjectDetectionYolo\assets
   MODEL_SIZE         = Medium
   USE_CUDA           = True
   YOLOv5_AUTOINSTALL = false
   YOLOv5_VERBOSE     = false
Started:      05 nov. 2023 11:36:08 a.m. W. Europe Standard Time
LastSeen:     05 nov. 2023 11:39:07 a.m. W. Europe Standard Time
Status:       Started
Processed:    0
Provider:<br />
CanUseGPU:    False
HardwareType: CPU

Terminal

11:34:18:Call to Uninstall on module ObjectDetectionYolo has completed.
11:35:37:Preparing to install module 'ObjectDetectionYolo'
11:35:37:Downloading module 'ObjectDetectionYolo'
11:35:38:Installing module 'ObjectDetectionYolo'
11:35:38:ObjectDetectionYolo:              Installing CodeProject.AI Analysis Module<br />
11:35:38:ObjectDetectionYolo: ========================================================================
11:35:38:ObjectDetectionYolo:                    CodeProject.AI Installer<br />
11:35:38:ObjectDetectionYolo: ========================================================================
11:35:38:ObjectDetectionYolo: General CodeProject.AI setup<br />
11:35:38:ObjectDetectionYolo: Creating Directories...Done
11:35:38:ObjectDetectionYolo: GPU support<br />
11:35:38:ObjectDetectionYolo: CUDA Present...Yes (version 11.8)
11:35:38:ObjectDetectionYolo: ROCm Present...False
11:35:39:ObjectDetectionYolo: Installing module ObjectDetectionYolo 1.7.1<br />
11:35:39:ObjectDetectionYolo: Installing Python 3.7
11:35:39:ObjectDetectionYolo: Python 3.7 is already installed
11:35:39:ObjectDetectionYolo: Creating Virtual Environment (Shared)...Virtual Environment already present
11:35:39:ObjectDetectionYolo: Confirming we have Python 3.7 in our virtual environment...present
11:35:40:ObjectDetectionYolo: Downloading Standard YOLO models...already exists...Expanding...Done.
11:35:40:ObjectDetectionYolo: Copying contents of models-yolo5-pt.zip to assets...done
11:35:40:ObjectDetectionYolo: Cleaning up...done
11:35:41:ObjectDetectionYolo: Downloading Custom YOLO models...already exists...Expanding...Done.
11:35:41:ObjectDetectionYolo: Copying contents of custom-models-yolo5-pt.zip to custom-models...done
11:35:41:ObjectDetectionYolo: Cleaning up...done
11:35:41:ObjectDetectionYolo: Installing Python packages for ObjectDetectionYolo
11:35:41:ObjectDetectionYolo: [0;Installing GPU-enabled libraries: If available
11:35:43:ObjectDetectionYolo: Ensuring Python package manager (pip) is installed...Done
11:35:46:ObjectDetectionYolo: Ensuring Python package manager (pip) is up to date...Done
11:35:46:ObjectDetectionYolo: Python packages specified by requirements.windows.cuda.txt
11:35:48:ObjectDetectionYolo:   - Installing Pandas, a data analysis / data manipulation tool...Already installed
11:35:49:ObjectDetectionYolo:   - Installing CoreMLTools, for working with .mlmodel format models...Already installed
11:35:50:ObjectDetectionYolo:   - Installing OpenCV, the Open source Computer Vision library...Already installed
11:35:51:ObjectDetectionYolo:   - Installing Pillow, a Python Image Library...Already installed
11:35:52:ObjectDetectionYolo:   - Installing SciPy, a library for mathematics, science, and engineering...Already installed
11:35:53:ObjectDetectionYolo:   - Installing PyYAML, a library for reading configuration files...Already installed
11:35:54:ObjectDetectionYolo:   - Installing PyTorch, an open source machine learning framework...Already installed
11:35:55:ObjectDetectionYolo:   - Installing TorchVision, for working with computer vision models...Already installed
11:35:56:ObjectDetectionYolo:   - Installing Ultralytics YoloV5 package for object detection in images...Already installed
11:35:58:ObjectDetectionYolo:   - Installing Seaborn, a data visualization library based on matplotlib...Already installed
11:35:58:ObjectDetectionYolo: Installing Python packages for the CodeProject.AI Server SDK
11:35:59:ObjectDetectionYolo: Ensuring Python package manager (pip) is installed...Done
11:36:02:ObjectDetectionYolo: Ensuring Python package manager (pip) is up to date...Done
11:36:02:ObjectDetectionYolo: Python packages specified by requirements.txt
11:36:03:ObjectDetectionYolo:   - Installing Pillow, a Python Image Library...Already installed
11:36:04:ObjectDetectionYolo:   - Installing Charset normalizer...Already installed
11:36:05:ObjectDetectionYolo:   - Installing aiohttp, the Async IO HTTP library...Already installed
11:36:06:ObjectDetectionYolo:   - Installing aiofiles, the Async IO Files library...Already installed
11:36:07:ObjectDetectionYolo:   - Installing py-cpuinfo to allow us to query CPU info...Already installed
11:36:08:ObjectDetectionYolo:   - Installing Requests, the HTTP library...Already installed
11:36:08:ObjectDetectionYolo: Setup complete<br />
11:36:08:Module ObjectDetectionYolo installed successfully.
11:36:08:
11:36:08:Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
11:36:08:Module Path:   C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
11:36:08:AutoStart:     True
11:36:08:Queue:         objectdetection_queue
11:36:08:Platforms:     all
11:36:08:GPU Libraries: installed if available
11:36:08:GPU Enabled:   enabled
11:36:08:Parallelism:   0
11:36:08:Accelerator:
11:36:08:Half Precis.:  enable
11:36:08:Runtime:       python3.7
11:36:08:Runtime Loc:   Shared
11:36:08:FilePath:      detect_adapter.py
11:36:08:Pre installed: False
11:36:08:Start pause:   1 sec
11:36:08:LogVerbosity:
11:36:08:Valid:         True
11:36:08:Environment Variables
11:36:08:APPDIR             = %CURRENT_MODULE_PATH%
11:36:08:CUSTOM_MODELS_DIR  = %CURRENT_MODULE_PATH%/custom-models
11:36:08:MODELS_DIR         = %CURRENT_MODULE_PATH%/assets
11:36:08:MODEL_SIZE         = Medium
11:36:08:USE_CUDA           = True
11:36:08:YOLOv5_AUTOINSTALL = false
11:36:08:YOLOv5_VERBOSE     = false
11:36:08:
11:36:08:Started Object Detection (YOLOv5 6.2) module
11:36:08:Installer exited with code 0
11:36:08:Call to Install on module ObjectDetectionYolo has completed.

modified 5-Nov-23 5:43am.

Chris Maunder5-Nov-23 10:24

5-Nov-23 10:24

Do you see the folder c:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo or c:\Program Files\CodeProject\AI\preinstalled-modules\ObjectDetectionYolo or both?

If you see `c:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo does that contain \bin\windows\python3.7\venv\lib\python37\site-packages (doing this off the top of my head so folder may be slightly misspelled), and if so do you see a Torch folder, and do you see mention of torch 1.13 or torch 2.0?

It should have installed torch 1.13 (and that's what the install self check says it did) but sometimes things go weird.

Everything seems in place. Not sure why it's not reporting GPU usage. Have you tried performing a detection using the explorer to give it a kick?

cheers
Chris Maunder

Jepsh5-Nov-23 10:45

Jepsh

5-Nov-23 10:45

Thank you for your reply.
I only got c:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
No bin folder inside that. The Torch folders are in C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages
Inside that folder there is torch, torch-1.13.0+cpu.dist-info and torch-1.13.1.dist-info.

Detection using explorer seems fine, but it's using CPU.
Also, what is the difference on using "Detect Objects" vs "Custom Detect" in the explorer? Custom detect is about twice as fast as Detect Objects.

modified 5-Nov-23 15:54pm.

Chris Maunder7-Nov-23 11:47

7-Nov-23 11:47

Sorry, I forgot YOLO was using the shared runtime space.

Your install log says

ObjectDetectionYolo: Python packages specified by requirements.windows.cuda.txt

which would install

--find-links <a href="https://download.pytorch.org/whl/torch_stable.html">https://download.pytorch.org/whl/torch_stable.html</a>
torch==1.13.0+cu117     # Installing PyTorch, an open source machine learning framework
--find-links <a href="https://download.pytorch.org/whl/torch_stable.html">https://download.pytorch.org/whl/torch_stable.html</a>
torchvision==0.14.0+cu117 # Installing TorchVision, for working with computer vision models

and yet it's showing CPU versions installed.

Can you please let me know if there's an install.log file in modules/FaceProcessing (it shares the same virtual environment) and if so, post it here?

cheers
Chris Maunder