CodeProject.AI Discussions

cee55-Nov-23 22:28

5-Nov-23 22:28

Server version:   2.3.4-Beta
System:           Windows
Operating System: Windows (Microsoft Windows 11 version 10.0.22621)
CPUs:             Intel(R) Core(TM) i7-8750H CPU @ 2.20GHz (Intel)
                  1 CPU x 6 cores. 12 logical processors (x64)
GPU:              NVIDIA GeForce GTX 1060 (6 GiB) (NVIDIA) 
                  Driver: 516.01 CUDA: 11.7.64 (max supported: 11.7) Compute: 6.1
System RAM:       32 GiB
Target:           Windows
BuildConfig:      Release
Execution Env:    Native
Runtime Env:      Production
.NET framework:   .NET 7.0.5
Video adapter info:
  Intel(R) UHD Graphics 630:
    Driver Version     31.0.101.2125
    Video Processor    Intel(R) UHD Graphics Family
  NVIDIA GeForce GTX 1060:
    Driver Version     31.0.15.1601
    Video Processor    NVIDIA GeForce GTX 1060
System GPU info:
  GPU 3D Usage       1%
  GPU RAM Usage      92 MiB
Global Environment variables:
  CPAI_APPROOTPATH = <root>
  CPAI_PORT        = 32168

Mike Lud6-Nov-23 6:43

6-Nov-23 6:43

You might have an issue downloading the paddle package, try the below link to see if you can download it.

https://paddle-wheel.bj.bcebos.com/2.5.1/windows/windows-gpu-cuda11.7-cudnn8.4.1-mkl-avx-vs2019/paddlepaddle_gpu-2.5.1.post117-cp37-cp37m-win_amd64.whl

cee56-Nov-23 18:44

6-Nov-23 18:44

Thanks for the link, but is not opening...

Mike Lud6-Nov-23 18:47

6-Nov-23 18:47

If you can not open the link and download the package you must have some firewall blocking the download.

Mike Lud6-Nov-23 18:56

6-Nov-23 18:56

If you can not download from the link I posted you can try upgrading your CUDA to 11.8. This version downloads the Paddle package from a different site that is more reliable. Below is a link to CUDA 11.8

CUDA Toolkit 11.8 Downloads | NVIDIA Developer[^]

cee59-Nov-23 19:05

9-Nov-23 19:05

11.8 didn't change anything...ahhh more deleting and reloading.

Mike Lud9-Nov-23 19:31

9-Nov-23 19:31

Can you post the install log for the ALPR module so we can see where it is failing

cee59-Nov-23 20:37

High CPU usage with integration with BI

9-Nov-23 20:37

22:29:25:Preparing to install module 'ALPR'
22:29:25:Downloading module 'ALPR'
22:29:26:Installing module 'ALPR'
22:29:26:ALPR: Installing CodeProject.AI Analysis Module
22:29:26:ALPR: ========================================================================
22:29:26:ALPR: CodeProject.AI Installer
22:29:26:ALPR: ========================================================================
22:29:26:ALPR: General CodeProject.AI setup
22:29:26:ALPR: Creating Directories...Done
22:29:26:ALPR: GPU support
22:29:27:ALPR: CUDA Present...Yes (version 11.8)
22:29:27:ALPR: ROCm Present...False
22:29:27:ALPR: Installing module ALPR 2.7.2
22:29:28:ALPR: Installing Python 3.7
22:29:28:ALPR: Python 3.7 is already installed
22:29:32:ALPR: Creating Virtual Environment (Local)...Done
22:29:32:ALPR: Confirming we have Python 3.7 in our virtual environment...present
22:29:32:ALPR: Downloading ALPR models...already exists...Expanding...Done.
22:29:33:ALPR: Copying contents of paddleocr-models.zip to paddleocr...done
22:29:33:ALPR: Cleaning up...done
22:29:33:ALPR: Installing Python packages for ALPR
22:29:33:ALPR: [0;Installing GPU-enabled libraries: If available
22:29:34:ALPR: Ensuring Python package manager (pip) is installed...Done
22:29:37:Object Detection (YOLOv5 .NET): Command completed in 259 ms.
22:29:42:ALPR: Ensuring Python package manager (pip) is up to date...Done
22:29:42:ALPR: Python packages specified by requirements.windows.cuda11_8.txt
22:30:11:Object Detection (YOLOv5 .NET): Command completed in 209 ms.
22:30:34:Object Detection (YOLOv5 .NET): Command completed in 200 ms.
22:30:47:ALPR: - Installing PaddlePaddle, Parallel Distributed Deep Learning...(✔️ checked) Done
22:31:36:Object Detection (YOLOv5 .NET): Command completed in 288 ms.
22:31:38:ALPR: - Installing PaddleOCR, the OCR toolkit based on PaddlePaddle...(✔️ checked) Done
22:31:42:ALPR: - Installing imutils, the image utilities library...(✔️ checked) Done
22:31:43:ALPR: - Installing Pillow, a Python Image Library...Already installed
22:31:44:ALPR: - Installing OpenCV, the Computer Vision library for Python...Already installed
22:31:45:ALPR: - Installing NumPy, a package for scientific computing...Already installed
22:31:45:ALPR: Installing Python packages for the CodeProject.AI Server SDK
22:31:47:ALPR: Ensuring Python package manager (pip) is installed...Done
22:31:50:ALPR: Ensuring Python package manager (pip) is up to date...Done
22:31:50:ALPR: Python packages specified by requirements.txt
22:31:52:ALPR: - Installing Pillow, a Python Image Library...Already installed
22:31:53:ALPR: - Installing Charset normalizer...Already installed
22:32:00:ALPR: - Installing aiohttp, the Async IO HTTP library...(✔️ checked) Done
22:32:03:ALPR: - Installing aiofiles, the Async IO Files library...(✔️ checked) Done
22:32:07:ALPR: - Installing py-cpuinfo to allow us to query CPU info...(✔️ checked) Done
22:32:08:ALPR: - Installing Requests, the HTTP library...Already installed
22:32:08:ALPR: Setup complete
22:32:08:Module ALPR installed successfully.
22:32:08:
22:32:08:Module 'License Plate Reader' 2.7.2 (ID: ALPR)
22:32:08:Module Path: C:\Program Files\CodeProject\AI\modules\ALPR
22:32:08:AutoStart: True
22:32:08:Queue: alpr_queue
22:32:08:Platforms: windows,linux,linux-arm64,macos,macos-arm64,!orangepi,!jetson
22:32:08:GPU Libraries: installed if available
22:32:08:GPU Enabled: enabled
22:32:08:Parallelism: 0
22:32:08:Accelerator:
22:32:08:Half Precis.: enable
22:32:08:Runtime: python3.7
22:32:08:Runtime Loc: Local
22:32:08:FilePath: ALPR_adapter.py
22:32:08:Pre installed: False
22:32:08:Start pause: 1 sec
22:32:08:LogVerbosity:
22:32:08:Valid: True
22:32:08:Environment Variables
22:32:08:AUTO_PLATE_ROTATE = True
22:32:08:MIN_COMPUTE_CAPABILITY = 7
22:32:08:MIN_CUDNN_VERSION = 7
22:32:08:OCR_OPTIMAL_CHARACTER_HEIGHT = 60
22:32:08:OCR_OPTIMAL_CHARACTER_WIDTH = 36
22:32:08:OCR_OPTIMIZATION = True
22:32:08:PLATE_CONFIDENCE = 0.7
22:32:08:PLATE_RESCALE_FACTOR = 2
22:32:08:PLATE_ROTATE_DEG = 0
22:32:08:
22:32:08:Started License Plate Reader module
22:32:08:Installer exited with code 0
22:32:08:ALPR_adapter.py: Traceback (most recent call last):
22:32:08:ALPR_adapter.py: File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR_adapter.py", line 17, in
22:32:08:ALPR_adapter.py: from ALPR import init_detect_platenumber, detect_platenumber
22:32:08:ALPR_adapter.py: File "C:\Program Files\CodeProject\AI\modules\ALPR\ALPR.py", line 19, in
22:32:08:ALPR_adapter.py: from paddleocr import PaddleOCR
22:32:08:ALPR_adapter.py: File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python37\venv\lib\site-packages\paddleocr\__init__.py", line 14, in
22:32:08:ALPR_adapter.py: from .paddleocr import *
22:32:08:ALPR_adapter.py: File "C:\Program Files\CodeProject\AI\modules\ALPR\bin\windows\python37\venv\lib\site-packages\paddleocr\paddleocr.py", line 21, in
22:32:08:ALPR_adapter.py: import paddle
22:32:08:ALPR_adapter.py: ModuleNotFoundError: No module named 'paddle'
22:32:08:Module ALPR has shutdown
22:32:08:ALPR_adapter.py: has exited
22:32:09:Module ALPR started successfully.
22:32:10:Object Detection (YOLOv5 .NET): Command completed in 179 ms.
22:32:33:Object Detection (YOLOv5 .NET): Command completed in 185 ms.

AI: Alert canceled

JR 20234-Nov-23 21:54

JR 2023

4-Nov-23 21:54

I don't get alerts and it seems like AI doesn't recognize people or cars

Frown | :(

Re: AI: Alert canceled

Sean Ewington6-Nov-23 9:32

Sean Ewington

6-Nov-23 9:32

Based on that log I would recommend uninstalling and reinstalling the Face Processing module, and the Object Detection module that you're using. I'd also be curious to know if detections work just fine in the CodeProject.AI Server Explorer.

Thanks,
Sean Ewington
CodeProject

Re: AI: Alert canceled

JR 20237-Nov-23 11:10

JR 2023

7-Nov-23 11:10

So I had uninstalled and installed before but this time it worked, the only difference is that I had Person and License plate installed before but not object, this go around I installed person and object as you suggested.

Thanks Sean

Fun-Fisherman-5824-Nov-23 6:17

4-Nov-23 6:17

Hello everyone. I have BI running for my business. I have about 26 cameras set up that are set to record substream continuously direct to disk recording with most cameras using INTEL +VPP for hardware decoding. I have them set to record main stream upon triggering but right now, I have turned this off while I get CPAI figured out. While I have read a lot, CPAI is bleeding edge tech so some of the stuff I have might not be correct or correct with what I have. I am looking for a stable system to use in a business not a system to spy on the KGB.

Here is my set up

Windows (Microsoft Windows 10.0.17763)
CPUs: Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz (Intel)
1 CPU x 8 cores. 16 logical processors (x64)
Intel(R) UHD Graphics 630 (1,024 MiB) (Intel Corporation)
Driver: 30.0.100.9955
System RAM: 16 GiB
.NET framework: .NET 7.0.10
Video adapter info:
Intel(R) UHD Graphics 630:
Driver Version 30.0.100.9955
Video Processor Intel(R) UHD Graphics Family
NVIDIA Quadro M4000:
Driver Version 30.0.14.7414
Video Processor Quadro M4000
NVCUDA64.DLL NVIDIA CUDA 11.88 driver

BlueIris 5.8.0.14 x64
With this set up my cpu runs between 10% to 25%. When I look at the GUP's they are @ 0%

I have installed CPAI before (2.3.4, but the CPU was at 100% for a lot of the time and thus I suspected something was not right and the dashboard showed that the GPU was not being used.

I have gone through this page and tried this

https://www.codeproject.com/ai/docs/faq/gpu.html

and was not sure if CUDA 11.88 was close enough to solve not using the GPU issue but no luck

I have access to several version of CPAI (2.3.4-BETA, 2.1.9,2.1.8).

Just looking for some advice as to where to go from here. A lot of the walk throughs seem to just say install CPAI and you are good to go, but that has not been my experience.

Thank you.
++++++FOLLOW UP+++++++
I decided to try an install CPAI again 2.3.4. I stopped BI service and let it run. When it installed things went smoothly and after the facial recognition showed up, it looks like it can see the GPU and was using it!

So it looks like it loaded

Face Processing
Object Detection (YOLOv5 .NET) - no GPU
Object Detection (YOLOv5 6.2) - newer GPUs
Do I assume that I have a newer GPU? It does show CUDA GPU on the dash board.

As of this point I do not have BI set to use CPAI

***********MORE FOLLOW UP************

So when I turned on AI in BI things were running smoothly until I got some CPU spikes to 100% like before. The logs have a bunch of red in them at these time points. There is a RuntimeError in the middle. I have included some ok logs with the red logs.

07:59:21:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...5cd180) took 7219ms
07:59:22:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...ca6461) took 7059ms
07:59:22:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
07:59:22:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...74bedf) took 7871ms
07:59:22:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...9594e6) took 7167ms
07:59:26:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
07:59:26:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...5bffb3) took 6442ms
07:59:27:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
07:59:27:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...f56750) took 6511ms
07:59:28:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
07:59:28:Object Detection (YOLOv5 6.2):  [RuntimeError] : Traceback (most recent call last):
  File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\detect.py", line 141, in do_detection
    det                  = detector(img, size=640)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\torch\nn\modules\module.py", line 1190, in _call_impl
    return forward_call(*input, **kwargs)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\torch\autograd\grad_mode.py", line 27, in decorate_context
    return func(*args, **kwargs)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\yolov5\models\common.py", line 705, in forward
    y = self.model(x, augment=augment)  # forward
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\torch\nn\modules\module.py", line 1190, in _call_impl
    return forward_call(*input, **kwargs)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\yolov5\models\common.py", line 515, in forward
    y = self.model(im, augment=augment, visualize=visualize) if augment or visualize else self.model(im)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\torch\nn\modules\module.py", line 1190, in _call_impl
    return forward_call(*input, **kwargs)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages\yolov5\models\yolo.py", line 209, in forward
    return self._forward_once(x, profile, visualize)  # single-scale inference, train
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages\yolov5\models\yolo.py", line 121, in _forward_once
    x = m(x)  # run
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\torch\nn\modules\module.py", line 1190, in _call_impl
    return forward_call(*input, **kwargs)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages\yolov5\models\yolo.py", line 74, in forward
    xy = (xy * 2 + self.grid[i]) * self.stride[i]  # xy
RuntimeError: The size of tensor a (48) must match the size of tensor b (80) at non-singleton dimension 3
07:59:28:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...78f36f) took 6531ms
07:59:28:Object Detection (YOLOv5 6.2): Detecting using actionnetv2

I suspect that this is why the CPU is going to 100% as when I turn off the IA integration, it stops. So any help with this is appreciated.

Fun-Fisherman-5824-Nov-23 6:41

4-Nov-23 6:41

As another follow up. After stopping the integration with BI, the server now shows the Object Dection as only using the CPU where as the facial Processing shows CUDA

Also it looks like maybe my GPU is underpowered for this application but any thoughts are apperciated.

Mike Lud4-Nov-23 6:51

4-Nov-23 6:51

Post your system info like the below

Fun-Fisherman-5824-Nov-23 7:07

4-Nov-23 7:07

Thank you for the reply I hope this is right

Mike Lud4-Nov-23 7:19

4-Nov-23 7:19

So far I do not see any issues with your system info. Try uninstall the Object Detection (YOLOv5 6.2) then reinstall the module using Do not use download cache and Install verbosity set to Loud

Fun-Fisherman-5824-Nov-23 18:26

4-Nov-23 18:26

Uninstalled it and also the FaceProcessing as I want to limit it to just one module at this time for simplicity.

20:09:44:Call to run Uninstall on module FaceProcessing has completed.
20:10:02:Sending shutdown request to python/ObjectDetectionYolo
20:10:12:detect_adapter.py: Inference processing will occur on device 'CPU'
20:10:12:detect_adapter.py: Inference processing will occur on device 'CPU'
20:10:12:detect_adapter.py: Inference processing will occur on device 'CPU'
20:10:12:detect_adapter.py: Inference processing will occur on device 'CPU'
20:10:12:detect_adapter.py: Inference processing will occur on device 'CPU'
20:10:13:Module ObjectDetectionYolo has shutdown
20:10:13:detect_adapter.py: has exited
20:10:35:ObjectDetectionYolo went quietly
20:10:35:Call to run Uninstall on module ObjectDetectionYolo has completed

Loaded again and this time loud and to not use download cache

20:18:55:System:           Windows
20:18:55:Operating System: Windows (Microsoft Windows 10.0.17763)
20:18:55:CPUs:             Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz (Intel)
20:18:55:                  1 CPU x 8 cores. 16 logical processors (x64)
20:18:55:GPU:              Quadro M4000 (8 GiB) (NVIDIA)
20:18:55:                  Driver: 522.06 CUDA: 11.8.89 (max supported: 11.8) Compute: 5.2
20:18:55:System RAM:       16 GiB
20:18:55:Target:           Windows
20:18:55:BuildConfig:      Release
20:18:55:Execution Env:    Native
20:18:55:Runtime Env:      Production
20:18:55:.NET framework:   .NET 7.0.10
20:18:55:App DataDir:      C:\ProgramData\CodeProject\AI
20:18:55:Video adapter info:
20:18:55:  Intel(R) UHD Graphics 630:
20:18:55:    Driver Version     30.0.100.9955
20:18:55:    Video Processor    Intel(R) UHD Graphics Family
20:18:55:  NVIDIA Quadro M4000:
20:18:55:    Driver Version     31.0.15.2206
20:18:55:    Video Processor    Quadro M4000
20:18:55:STARTING CODEPROJECT.AI SERVER
20:18:55:RUNTIMES_PATH             = C:\Program Files\CodeProject\AI\runtimes
20:18:55:PREINSTALLED_MODULES_PATH = C:\Program Files\CodeProject\AI\preinstalled-modules
20:18:55:MODULES_PATH              = C:\Program Files\CodeProject\AI\modules
20:18:55:PYTHON_PATH               = \bin\windows\%PYTHON_DIRECTORY%\venv\Scripts\python
20:18:55:Data Dir                  = C:\ProgramData\CodeProject\AI
20:18:55:Server version:   2.3.4-Beta
20:18:55:ModuleRunner Start
20:18:55:Starting Background AI Modules
20:19:01:Current Version is 2.3.4-Beta
20:19:01:Server: This is the latest version
20:21:01:Preparing to install module 'ObjectDetectionYolo'
20:21:01:Downloading module 'ObjectDetectionYolo'
20:21:01:Installing module 'ObjectDetectionYolo'
20:21:01:Installer script at 'C:\Program Files\CodeProject\AI\setup.bat'
20:21:01:ObjectDetectionYolo:              Installing CodeProject.AI Analysis Module                
20:21:01:ObjectDetectionYolo: ========================================================================
20:21:01:ObjectDetectionYolo:                    CodeProject.AI Installer                             
20:21:01:ObjectDetectionYolo: ========================================================================
20:21:01:ObjectDetectionYolo: setupMode             = InstallModule
20:21:01:ObjectDetectionYolo: executionEnvironment  = Production
20:21:01:ObjectDetectionYolo: installerScriptsPath  = C:\Program Files\CodeProject\AI\
20:21:01:ObjectDetectionYolo: sdkScriptsDirPath     = C:\Program Files\CodeProject\AI\SDK\Scripts
20:21:01:ObjectDetectionYolo: absoluteAppRootDir    = C:\Program Files\CodeProject\AI\
20:21:01:ObjectDetectionYolo: runtimesDirPath       = C:\Program Files\CodeProject\AI\runtimes
20:21:01:ObjectDetectionYolo: modulesDirPath        = C:\Program Files\CodeProject\AI\modules
20:21:01:ObjectDetectionYolo: downloadDirPath       = C:\Program Files\CodeProject\AI\downloads
20:21:01:ObjectDetectionYolo: General CodeProject.AI setup                                          
20:21:02:ObjectDetectionYolo: Creating Directories...Done
20:21:02:ObjectDetectionYolo: GPU support                                                           
20:21:02:ObjectDetectionYolo: CUDA Present...Yes (version 11.8)
20:21:02:ObjectDetectionYolo: ROCm Present...False
20:21:02:ObjectDetectionYolo: Variable Dump                                                         
20:21:02:ObjectDetectionYolo: moduleName        = ObjectDetectionYolo
20:21:02:ObjectDetectionYolo: moduleVersion     = 1.7.1
20:21:02:ObjectDetectionYolo: runtime           = python3.7
20:21:02:ObjectDetectionYolo: installGPU        = true
20:21:02:ObjectDetectionYolo: pythonLocation    = Shared
20:21:02:ObjectDetectionYolo: pythonVersion     = 3.7
20:21:03:ObjectDetectionYolo: virtualEnvDirPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv
20:21:03:ObjectDetectionYolo: venvPythonCmdPath = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python.exe
20:21:03:ObjectDetectionYolo: packagesDirPath   = C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages
20:21:03:ObjectDetectionYolo: Installing module ObjectDetectionYolo 1.7.1                           
20:21:03:ObjectDetectionYolo: Installing Python 3.7
20:21:03:ObjectDetectionYolo: Installing python37 in C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37
20:21:03:ObjectDetectionYolo: Python 3.7 is already installed
20:21:03:ObjectDetectionYolo: Creating Virtual Environment (Shared)...Virtual Environment already present
20:21:03:ObjectDetectionYolo: Confirming we have Python 3.7 in our virtual environment...present
20:21:03:ObjectDetectionYolo: Downloading models-yolo5-pt.zip to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo
20:21:03:ObjectDetectionYolo: Downloading Standard YOLO models...Checking 'C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo\models-yolo5-pt.zip'
20:21:03:ObjectDetectionYolo: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo
20:21:03:ObjectDetectionYolo: Extracting models-yolo5-pt.zip
20:21:05:ObjectDetectionYolo: Done.
20:21:05:ObjectDetectionYolo: Copying contents of models-yolo5-pt.zip to assets...done
20:21:06:ObjectDetectionYolo: Cleaning up...Cleaning up extracted files
20:21:06:ObjectDetectionYolo: done
20:21:06:ObjectDetectionYolo: Downloading custom-models-yolo5-pt.zip to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo
20:21:06:ObjectDetectionYolo: Downloading Custom YOLO models...Checking 'C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo\custom-models-yolo5-pt.zip'
20:21:06:ObjectDetectionYolo: already exists...Expanding...Heading to C:\Program Files\CodeProject\AI\downloads\ObjectDetectionYolo
20:21:06:ObjectDetectionYolo: Extracting custom-models-yolo5-pt.zip
20:21:08:ObjectDetectionYolo: Done.
20:21:09:ObjectDetectionYolo: Copying contents of custom-models-yolo5-pt.zip to custom-models...done
20:21:09:ObjectDetectionYolo: Cleaning up...Cleaning up extracted files
20:21:09:ObjectDetectionYolo: done
20:21:09:ObjectDetectionYolo: Installing Python packages for ObjectDetectionYolo
20:21:09:ObjectDetectionYolo: [0;Installing GPU-enabled libraries: If available
20:21:10:ObjectDetectionYolo: Ensuring Python package manager (pip) is installed...Looking in links: c:\Windows\TEMP\tmpvzwbwo_b
20:21:10:ObjectDetectionYolo: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
20:21:10:ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
20:21:12:ObjectDetectionYolo: Done
20:21:13:ObjectDetectionYolo: Ensuring Python package manager (pip) is up to date...Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
20:21:14:ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
20:21:15:ObjectDetectionYolo: Done
20:21:15:ObjectDetectionYolo: Requirements Search Path is C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
20:21:15:ObjectDetectionYolo: Searching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
20:21:15:ObjectDetectionYolo: CUDA version is 11.8 (11_8 / 11)
20:21:15:ObjectDetectionYolo: Python packages specified by requirements.windows.cuda.txt
20:21:15:ObjectDetectionYolo: Choosing Python packages from C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\requirements.windows.cuda.txt
20:21:16:ObjectDetectionYolo:   - Installing Pandas, a data analysis / data manipulation tool...Already installed
20:21:17:ObjectDetectionYolo:   - Installing CoreMLTools, for working with .mlmodel format models...Already installed
20:21:18:ObjectDetectionYolo:   - Installing OpenCV, the Open source Computer Vision library...Already installed
20:21:19:ObjectDetectionYolo:   - Installing Pillow, a Python Image Library...Already installed
20:21:20:ObjectDetectionYolo:   - Installing SciPy, a library for mathematics, science, and engineering...Already installed
20:21:21:ObjectDetectionYolo:   - Installing PyYAML, a library for reading configuration files...Already installed
20:21:22:ObjectDetectionYolo:   - Installing PyTorch, an open source machine learning framework...Already installed
20:21:23:ObjectDetectionYolo:   - Installing TorchVision, for working with computer vision models...Already installed
20:21:24:ObjectDetectionYolo:   - Installing Ultralytics YoloV5 package for object detection in images...Already installed
20:21:25:ObjectDetectionYolo:   - Installing Seaborn, a data visualization library based on matplotlib...Already installed
20:21:25:ObjectDetectionYolo: Installing Python packages for the CodeProject.AI Server SDK
20:21:26:ObjectDetectionYolo: Ensuring Python package manager (pip) is installed...Looking in links: c:\Windows\TEMP\tmp44xqhcbz
20:21:26:ObjectDetectionYolo: Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
20:21:26:ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
20:21:27:ObjectDetectionYolo: Done
20:21:27:ObjectDetectionYolo: Ensuring Python package manager (pip) is up to date...Requirement already satisfied: setuptools in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (68.0.0)
20:21:29:ObjectDetectionYolo: Requirement already satisfied: pip in c:\program files\codeproject\ai\runtimes\bin\windows\python37\venv\lib\site-packages (23.3.1)
20:21:29:ObjectDetectionYolo: Done
20:21:29:ObjectDetectionYolo: Requirements Search Path is C:\Program Files\CodeProject\AI\SDK\Python
20:21:29:ObjectDetectionYolo: Searching for a suitable requirements.txts file in C:\Program Files\CodeProject\AI\SDK\Python
20:21:29:ObjectDetectionYolo: CUDA version is 11.8 (11_8 / 11)
20:21:29:ObjectDetectionYolo: Python packages specified by requirements.txt
20:21:29:ObjectDetectionYolo: Choosing Python packages from C:\Program Files\CodeProject\AI\SDK\Python\requirements.txt
20:21:31:ObjectDetectionYolo:   - Installing Pillow, a Python Image Library...Already installed
20:21:32:ObjectDetectionYolo:   - Installing Charset normalizer...Already installed
20:21:33:ObjectDetectionYolo:   - Installing aiohttp, the Async IO HTTP library...Already installed
20:21:34:ObjectDetectionYolo:   - Installing aiofiles, the Async IO Files library...Already installed
20:21:35:ObjectDetectionYolo:   - Installing py-cpuinfo to allow us to query CPU info...Already installed
20:21:35:ObjectDetectionYolo:   - Installing Requests, the HTTP library...Already installed
20:21:36:ObjectDetectionYolo: Setup complete                                                        
20:21:36:Module ObjectDetectionYolo installed successfully.
20:21:36:Command: C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python
20:21:36:
20:21:36:
20:21:36:Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
20:21:36:Starting C:\Program Files...ws\python37\venv\Scripts\python "C:\Program Files...tectionYolo\detect_adapter.py"
20:21:36:Attempting to start ObjectDetectionYolo with C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python "C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\detect_adapter.py"
20:21:36:Module Path:   C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
20:21:36:AutoStart:     True
20:21:36:Queue:         objectdetection_queue
20:21:36:Platforms:     all
20:21:36:GPU Libraries: installed if available
20:21:36:GPU Enabled:   enabled
20:21:36:Parallelism:   0
20:21:36:Accelerator:
20:21:36:Half Precis.:  enable
20:21:36:Runtime:       python3.7
20:21:36:Runtime Loc:   Shared
20:21:36:FilePath:      detect_adapter.py
20:21:36:Pre installed: False
20:21:36:Start pause:   1 sec
20:21:36:LogVerbosity:
20:21:36:Valid:         True
20:21:36:Environment Variables
20:21:36:APPDIR             = %CURRENT_MODULE_PATH%
20:21:36:CUSTOM_MODELS_DIR  = %CURRENT_MODULE_PATH%/custom-models
20:21:36:MODELS_DIR         = %CURRENT_MODULE_PATH%/assets
20:21:36:MODEL_SIZE         = Medium
20:21:36:USE_CUDA           = True
20:21:36:YOLOv5_AUTOINSTALL = false
20:21:36:YOLOv5_VERBOSE     = false
20:21:36:
20:21:36:Started Object Detection (YOLOv5 6.2) module
20:21:36:Installer exited with code 0
20:21:36:Call to run Install on module ObjectDetectionYolo has completed.
20:21:37:Module ObjectDetectionYolo started successfully.
20:21:47:detect_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
20:21:47:detect_adapter.py: APPDIR:      C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
20:21:47:detect_adapter.py: MODEL_SIZE:  medium
20:21:47:detect_adapter.py: MODELS_DIR:  C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\assets
20:21:47:Running init for Object Detection (YOLOv5 6.2)
20:21:47:Object Detection (YOLOv5 6.2): Object Detection (YOLOv5 6.2) started.

Looks Like the GPU is now detected!

Fun-Fisherman-5824-Nov-23 18:44

4-Nov-23 18:44

BI service was stopped while I did this. Starting the service and turning on the AI in the BI settings causes CPU usage to spike to 100% after a bit. The CUDA has changed back to CPU under the Server Status in the Codeproject AI dashboard

It seems like at ~ 20:21:36 the Module Tries to start but crashes then starts again, but this time isn't using the CUDA. at ~ 20:30:26 there is a runtime error again.

20:28:16:Client request 'list-custom' in queue 'objectdetection_queue' (...3c3731)
20:28:16:Request 'list-custom' dequeued from 'objectdetection_queue' (...3c3731)
20:28:16:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:28:16:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'list-custom' (...3c3731) took 3ms
20:28:16:Response received (...3c3731)
20:28:17:Sending shutdown request to python/ObjectDetectionYolo
20:28:17:Client request 'Quit' in queue 'objectdetection_queue' (...322fc8)
20:28:17:Request 'Quit' dequeued from 'objectdetection_queue' (...322fc8)
20:28:17:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:28:18:Client request 'detect' in queue 'objectdetection_queue' (...733485)
20:28:18:Client request 'detect' in queue 'objectdetection_queue' (...c45e30)
20:28:18:Request 'detect' dequeued from 'objectdetection_queue' (...733485)
20:28:18:Request 'detect' dequeued from 'objectdetection_queue' (...c45e30)
20:28:18:Client request 'detect' in queue 'objectdetection_queue' (...73c7de)
20:28:18:Request 'detect' dequeued from 'objectdetection_queue' (...73c7de)
20:28:18:Client request 'detect' in queue 'objectdetection_queue' (...feb7b5)
20:28:18:Request 'detect' dequeued from 'objectdetection_queue' (...feb7b5)
20:28:18:Client request 'detect' in queue 'objectdetection_queue' (...42446f)
20:28:18:Client request 'detect' in queue 'objectdetection_queue' (...3a6ef1)
20:28:18:Client request 'detect' in queue 'objectdetection_queue' (...f8d35e)
20:28:18:Client request 'detect' in queue 'objectdetection_queue' (...8d6170)
20:28:18:Request 'detect' dequeued from 'objectdetection_queue' (...42446f)
20:28:18:Client request 'detect' in queue 'objectdetection_queue' (...c64c3b)
20:28:18:Request 'detect' dequeued from 'objectdetection_queue' (...3a6ef1)
20:28:18:Client request 'detect' in queue 'objectdetection_queue' (...5cb73a)
20:28:18:Request 'detect' dequeued from 'objectdetection_queue' (...f8d35e)
20:28:18:Request 'detect' dequeued from 'objectdetection_queue' (...8d6170)
20:28:18:Request 'detect' dequeued from 'objectdetection_queue' (...c64c3b)
20:28:18:Request 'detect' dequeued from 'objectdetection_queue' (...5cb73a)
20:28:18:Client request 'detect' in queue 'objectdetection_queue' (...fac9f8)
20:28:18:Request 'detect' dequeued from 'objectdetection_queue' (...fac9f8)
20:28:18:Client request 'detect' in queue 'objectdetection_queue' (...b2fbcd)
20:28:18:Client request 'detect' in queue 'objectdetection_queue' (...61cf32)
20:28:18:Client request 'detect' in queue 'objectdetection_queue' (...23fa4e)
20:28:19:Client request 'detect' in queue 'objectdetection_queue' (...e7d8f7)
20:28:19:Client request 'detect' in queue 'objectdetection_queue' (...268c9f)
20:28:19:Client request 'detect' in queue 'objectdetection_queue' (...784ef3)
20:28:19:Client request 'detect' in queue 'objectdetection_queue' (...16fd66)
20:28:19:Client request 'detect' in queue 'objectdetection_queue' (...b5569e)
20:28:19:Client request 'detect' in queue 'objectdetection_queue' (...b6145a)
20:28:19:Client request 'detect' in queue 'objectdetection_queue' (...a9362b)
20:28:19:Client request 'detect' in queue 'objectdetection_queue' (...0b04ee)
20:28:19:Client request 'detect' in queue 'objectdetection_queue' (...c812e2)
20:28:19:Client request 'detect' in queue 'objectdetection_queue' (...c8ead1)
20:28:19:Client request 'detect' in queue 'objectdetection_queue' (...6cd8ad)
20:28:19:Client request 'detect' in queue 'objectdetection_queue' (...4bab4f)
20:28:25:detect_adapter.py: GPU compute capability is 5.2
20:28:25:detect_adapter.py: Not using half-precision for the device 'Quadro M4000'
20:28:25:detect_adapter.py: Inference processing will occur on device 'Quadro M4000'
20:28:25:Response received (...733485): Found sink, refrigerator
20:28:25:Client request 'custom' in queue 'objectdetection_queue' (...636298)
20:28:26:Module ObjectDetectionYolo has shutdown
20:28:26:detect_adapter.py: has exited
20:28:50:ObjectDetectionYolo went quietly
20:28:50:Command: C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python
20:28:50:
20:28:50:Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
20:28:50:Starting C:\Program Files...ws\python37\venv\Scripts\python "C:\Program Files...tectionYolo\detect_adapter.py"
20:28:50:
20:28:50:Attempting to start ObjectDetectionYolo with C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python "C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\detect_adapter.py"
20:28:50:Module Path:   C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
20:28:50:AutoStart:     True
20:28:50:Queue:         objectdetection_queue
20:28:50:Platforms:     all
20:28:50:GPU Libraries: installed if available
20:28:50:GPU Enabled:   enabled
20:28:50:Parallelism:   0
20:28:50:Accelerator:
20:28:50:Half Precis.:  enable
20:28:50:Runtime:       python3.7
20:28:50:Runtime Loc:   Shared
20:28:50:FilePath:      detect_adapter.py
20:28:50:Pre installed: False
20:28:50:Start pause:   1 sec
20:28:50:LogVerbosity:
20:28:50:Valid:         True
20:28:50:Environment Variables
20:28:50:APPDIR                 = %CURRENT_MODULE_PATH%
20:28:50:CUSTOM_MODELS_DIR      = %CURRENT_MODULE_PATH%/custom-models
20:28:50:MODELS_DIR             = %CURRENT_MODULE_PATH%/assets
20:28:50:MODEL_SIZE             = Large
20:28:50:USE_CUDA               = False
20:28:50:YOLOv5_AUTOINSTALL     = false
20:28:50:YOLOv5_VERBOSE         = false
20:28:50:CPAI_MODULE_ENABLE_GPU = False
20:28:50:
20:28:50:Started Object Detection (YOLOv5 6.2) module
20:28:55:detect_adapter.py: CPAI_MODULE_REQUIRED_MB not found. Setting to default 0
20:28:55:detect_adapter.py: APPDIR:      C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
20:28:55:detect_adapter.py: MODEL_SIZE:  large
20:28:55:detect_adapter.py: MODELS_DIR:  C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\assets
20:28:55:Request 'detect' dequeued from 'objectdetection_queue' (...b2fbcd)
20:28:55:Request 'detect' dequeued from 'objectdetection_queue' (...61cf32)
20:28:55:Request 'detect' dequeued from 'objectdetection_queue' (...23fa4e)
20:28:55:Request 'detect' dequeued from 'objectdetection_queue' (...e7d8f7)
20:28:55:Request 'detect' dequeued from 'objectdetection_queue' (...268c9f)
20:28:55:Request 'detect' dequeued from 'objectdetection_queue' (...784ef3)
20:28:55:Request 'detect' dequeued from 'objectdetection_queue' (...16fd66)
20:28:55:Request 'detect' dequeued from 'objectdetection_queue' (...b5569e)
20:28:55:Request 'detect' dequeued from 'objectdetection_queue' (...b6145a)
20:28:55:Request 'detect' dequeued from 'objectdetection_queue' (...a9362b)
20:28:55:Request 'detect' dequeued from 'objectdetection_queue' (...0b04ee)
20:28:55:Request 'detect' dequeued from 'objectdetection_queue' (...c812e2)
20:28:55:Request 'detect' dequeued from 'objectdetection_queue' (...c8ead1)
20:28:55:Request 'detect' dequeued from 'objectdetection_queue' (...6cd8ad)
20:28:55:Request 'detect' dequeued from 'objectdetection_queue' (...4bab4f)
20:28:55:Running init for Object Detection (YOLOv5 6.2)
20:28:55:Request 'custom' dequeued from 'objectdetection_queue' (...636298)
20:28:55:Object Detection (YOLOv5 6.2): Object Detection (YOLOv5 6.2) started.
20:30:16:Client request 'detect' in queue 'objectdetection_queue' (...3fabbc)
20:30:16:Request 'detect' dequeued from 'objectdetection_queue' (...3fabbc)
20:30:16:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:17:Client request 'detect' in queue 'objectdetection_queue' (...8b3e4e)
20:30:17:Request 'detect' dequeued from 'objectdetection_queue' (...8b3e4e)
20:30:17:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:17:Client request 'detect' in queue 'objectdetection_queue' (...131052)
20:30:17:Request 'detect' dequeued from 'objectdetection_queue' (...131052)
20:30:17:Client request 'detect' in queue 'objectdetection_queue' (...753f07)
20:30:17:Request 'detect' dequeued from 'objectdetection_queue' (...753f07)
20:30:17:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:17:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:17:Client request 'detect' in queue 'objectdetection_queue' (...4c4b83)
20:30:17:Request 'detect' dequeued from 'objectdetection_queue' (...4c4b83)
20:30:17:Client request 'detect' in queue 'objectdetection_queue' (...fa0ca0)
20:30:17:Request 'detect' dequeued from 'objectdetection_queue' (...fa0ca0)
20:30:17:Client request 'detect' in queue 'objectdetection_queue' (...992955)
20:30:17:Request 'detect' dequeued from 'objectdetection_queue' (...992955)
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...1a272c)
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...d2ceff)
20:30:18:Request 'detect' dequeued from 'objectdetection_queue' (...1a272c)
20:30:18:Request 'detect' dequeued from 'objectdetection_queue' (...d2ceff)
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...a2da95)
20:30:18:Request 'detect' dequeued from 'objectdetection_queue' (...a2da95)
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...3d690b)
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Request 'detect' dequeued from 'objectdetection_queue' (...3d690b)
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...e3f6f9)
20:30:18:Request 'detect' dequeued from 'objectdetection_queue' (...e3f6f9)
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...6e81e2)
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...3b1c6d)
20:30:18:Request 'detect' dequeued from 'objectdetection_queue' (...6e81e2)
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...5ee06e)
20:30:18:Request 'detect' dequeued from 'objectdetection_queue' (...3b1c6d)
20:30:18:Request 'detect' dequeued from 'objectdetection_queue' (...5ee06e)
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...cb687e)
20:30:18:Request 'detect' dequeued from 'objectdetection_queue' (...cb687e)
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...5c0a1d)
20:30:18:Request 'detect' dequeued from 'objectdetection_queue' (...5c0a1d)
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...d1ab21)
20:30:18:Request 'detect' dequeued from 'objectdetection_queue' (...d1ab21)
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...571a53)
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...92e1b6)
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...72deac)
20:30:18:Request 'detect' dequeued from 'objectdetection_queue' (...571a53)
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...29e5c5)
20:30:18:Request 'detect' dequeued from 'objectdetection_queue' (...92e1b6)
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...dae240)
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...df8c7f)
20:30:18:Client request 'detect' in queue 'objectdetection_queue' (...91da95)
20:30:19:Client request 'detect' in queue 'objectdetection_queue' (...03a503)
20:30:20:Object Detection (YOLOv5 6.2): Model Path is C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\assets\yolov5l.pt
20:30:24:Response received (...992955): No objects found
20:30:24:Request 'detect' dequeued from 'objectdetection_queue' (...72deac)
20:30:24:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...992955) took 6820ms
20:30:24:Client request 'custom' in queue 'objectdetection_queue' (...336130)
20:30:24:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:25:Request 'detect' dequeued from 'objectdetection_queue' (...29e5c5)
20:30:25:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...a2da95) took 6433ms
20:30:25:Response received (...a2da95): Found car
20:30:25:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:25:Client request 'custom' in queue 'objectdetection_queue' (...ab39f8)
20:30:25:Response received (...1a272c): Found mouse, book, book...
20:30:25:Request 'detect' dequeued from 'objectdetection_queue' (...dae240)
20:30:25:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...1a272c) took 7004ms
20:30:25:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:25:Client request 'custom' in queue 'objectdetection_queue' (...d8ef5a)
20:30:25:Response received (...3fabbc): No objects found
20:30:25:Request 'detect' dequeued from 'objectdetection_queue' (...df8c7f)
20:30:25:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...3fabbc) took 8560ms
20:30:25:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:25:Client request 'custom' in queue 'objectdetection_queue' (...ab9c28)
20:30:25:Request 'detect' dequeued from 'objectdetection_queue' (...91da95)
20:30:25:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...8b3e4e) took 8546ms
20:30:25:Response received (...8b3e4e): Found train
20:30:25:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:25:Client request 'custom' in queue 'objectdetection_queue' (...140e08)
20:30:26:Response received (...753f07): Found refrigerator, sink
20:30:26:Request 'detect' dequeued from 'objectdetection_queue' (...03a503)
20:30:26:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...753f07) took 8415ms
20:30:26:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:26:Client request 'custom' in queue 'objectdetection_queue' (...75deb3)
20:30:26:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...131052) took 8638ms
20:30:26:Response received (...131052): Found refrigerator, sink
20:30:26:Request 'custom' dequeued from 'objectdetection_queue' (...336130)
20:30:26:Client request 'custom' in queue 'objectdetection_queue' (...782842)
20:30:26:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:26:Response received (...d2ceff): Found laptop, tv, tv...
20:30:26:Request 'custom' dequeued from 'objectdetection_queue' (...ab39f8)
20:30:26:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...d2ceff) took 7944ms
20:30:26:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:26:Client request 'custom' in queue 'objectdetection_queue' (...fdec19)
20:30:27:Object Detection (YOLOv5 6.2):  [RuntimeError] : Traceback (most recent call last):
  File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\detect.py", line 141, in do_detection
    det                  = detector(img, size=640)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\torch\nn\modules\module.py", line 1190, in _call_impl
    return forward_call(*input, **kwargs)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\torch\autograd\grad_mode.py", line 27, in decorate_context
    return func(*args, **kwargs)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\yolov5\models\common.py", line 705, in forward
    y = self.model(x, augment=augment)  # forward
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\torch\nn\modules\module.py", line 1190, in _call_impl
    return forward_call(*input, **kwargs)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\yolov5\models\common.py", line 515, in forward
    y = self.model(im, augment=augment, visualize=visualize) if augment or visualize else self.model(im)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\torch\nn\modules\module.py", line 1190, in _call_impl
    return forward_call(*input, **kwargs)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages\yolov5\models\yolo.py", line 209, in forward
    return self._forward_once(x, profile, visualize)  # single-scale inference, train
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages\yolov5\models\yolo.py", line 121, in _forward_once
    x = m(x)  # run
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\torch\nn\modules\module.py", line 1190, in _call_impl
    return forward_call(*input, **kwargs)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages\yolov5\models\yolo.py", line 74, in forward
    xy = (xy * 2 + self.grid[i]) * self.stride[i]  # xy
RuntimeError: The size of tensor a (48) must match the size of tensor b (80) at non-singleton dimension 2
20:30:27:Request 'custom' dequeued from 'objectdetection_queue' (...d8ef5a)
20:30:27:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...fa0ca0) took 9270ms
20:30:27:Response received (...fa0ca0)
20:30:27:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:27:Request 'custom' dequeued from 'objectdetection_queue' (...ab9c28)
20:30:27:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...4c4b83) took 9834ms
20:30:27:Response received (...4c4b83): No objects found
20:30:27:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:27:Client request 'custom' in queue 'objectdetection_queue' (...a0303f)
20:30:29:Request 'custom' dequeued from 'objectdetection_queue' (...140e08)
20:30:29:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...cb687e) took 5195ms
20:30:29:Response received (...cb687e): Found suitcase, refrigerator, bed
20:30:30:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:30:Client request 'custom' in queue 'objectdetection_queue' (...57d9fb)
20:30:30:Object Detection (YOLOv5 6.2):  [RuntimeError] : Traceback (most recent call last):
  File "C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\detect.py", line 141, in do_detection
    det                  = detector(img, size=640)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\torch\nn\modules\module.py", line 1190, in _call_impl
    return forward_call(*input, **kwargs)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\torch\autograd\grad_mode.py", line 27, in decorate_context
    return func(*args, **kwargs)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\yolov5\models\common.py", line 705, in forward
    y = self.model(x, augment=augment)  # forward
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\torch\nn\modules\module.py", line 1190, in _call_impl
    return forward_call(*input, **kwargs)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\yolov5\models\common.py", line 515, in forward
    y = self.model(im, augment=augment, visualize=visualize) if augment or visualize else self.model(im)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\torch\nn\modules\module.py", line 1190, in _call_impl
    return forward_call(*input, **kwargs)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages\yolov5\models\yolo.py", line 209, in forward
    return self._forward_once(x, profile, visualize)  # single-scale inference, train
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages\yolov5\models\yolo.py", line 121, in _forward_once
    x = m(x)  # run
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\lib\site-packages\torch\nn\modules\module.py", line 1190, in _call_impl
    return forward_call(*input, **kwargs)
  File "C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Lib\site-packages\yolov5\models\yolo.py", line 75, in forward
    wh = (wh * 2) ** 2 * self.anchor_grid[i]  # wh
RuntimeError: The size of tensor a (48) must match the size of tensor b (80) at non-singleton dimension 3
20:30:30:Response received (...d1ab21)
20:30:30:Request 'custom' dequeued from 'objectdetection_queue' (...75deb3)
20:30:30:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...d1ab21) took 4905ms
20:30:30:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:30:Response received (...92e1b6): Found bottle, cake, cup...
20:30:30:Request 'custom' dequeued from 'objectdetection_queue' (...782842)
20:30:30:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...92e1b6) took 5397ms
20:30:30:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:30:Client request 'custom' in queue 'objectdetection_queue' (...d6d1e0)
20:30:30:Response received (...3d690b): No objects found
20:30:30:Request 'custom' dequeued from 'objectdetection_queue' (...fdec19)
20:30:30:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...3d690b) took 5508ms
20:30:30:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:30:Client request 'custom' in queue 'objectdetection_queue' (...e88125)
20:30:31:Response received (...6e81e2): Found bottle, tv, vase...
20:30:31:Request 'custom' dequeued from 'objectdetection_queue' (...a0303f)
20:30:31:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...6e81e2) took 5013ms
20:30:31:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:31:Client request 'custom' in queue 'objectdetection_queue' (...89a97d)
20:30:31:Request 'custom' dequeued from 'objectdetection_queue' (...57d9fb)
20:30:31:Response received (...e3f6f9): Found chair, motorcycle
20:30:31:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...e3f6f9) took 5446ms
20:30:31:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:31:Client request 'custom' in queue 'objectdetection_queue' (...cd9e40)
20:30:31:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:31:Response received (...3b1c6d): No objects found
20:30:31:Request 'custom' dequeued from 'objectdetection_queue' (...d6d1e0)
20:30:31:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...3b1c6d) took 5402ms
20:30:31:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:31:Client request 'custom' in queue 'objectdetection_queue' (...8af96e)
20:30:31:Request 'custom' dequeued from 'objectdetection_queue' (...e88125)
20:30:31:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...571a53) took 5286ms
20:30:31:Response received (...571a53): Found book, chair, chair...
20:30:31:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:31:Client request 'custom' in queue 'objectdetection_queue' (...c0d8f5)
20:30:32:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:32:Request 'custom' dequeued from 'objectdetection_queue' (...89a97d)
20:30:32:Response received (...5c0a1d): Found person
20:30:32:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...5c0a1d) took 5263ms
20:30:32:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:32:Client request 'custom' in queue 'objectdetection_queue' (...54dc3c)
20:30:32:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:33:Request 'custom' dequeued from 'objectdetection_queue' (...cd9e40)
20:30:33:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...5ee06e) took 5959ms
20:30:33:Response received (...5ee06e): Found chair, suitcase, clock...
20:30:33:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:35:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:35:Response received (...dae240): Found bird
20:30:35:Request 'custom' dequeued from 'objectdetection_queue' (...8af96e)
20:30:35:Object Detection (YOLOv5 6.2): Model Path is C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\custom-models\actionnetv2.pt
20:30:35:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...dae240) took 5447ms
20:30:35:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:35:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:36:Response received (...03a503): Found sports ball, sports ball, person
20:30:36:Request 'custom' dequeued from 'objectdetection_queue' (...c0d8f5)
20:30:36:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...03a503) took 4664ms
20:30:36:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:36:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:36:Response received (...df8c7f): Found train
20:30:36:Request 'custom' dequeued from 'objectdetection_queue' (...54dc3c)
20:30:36:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...df8c7f) took 5512ms
20:30:36:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:30:36:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:36:Response received (...72deac): No objects found
20:30:36:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...72deac) took 6826ms
20:30:36:Response received (...91da95): No objects found
20:30:36:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...91da95) took 5605ms
20:30:36:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:37:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:37:Response received (...29e5c5): Found keyboard, tv, bottle...
20:30:37:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'detect' (...29e5c5) took 6813ms
20:30:42:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:42:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...ab39f8) took 10610ms
20:30:42:Response received (...ab39f8): No objects found
20:30:42:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...ab9c28) took 8867ms
20:30:42:Response received (...ab9c28): No objects found
20:30:43:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:43:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:43:Response received (...d8ef5a): No objects found
20:30:43:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...d8ef5a) took 10346ms
20:30:43:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:43:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...336130) took 12568ms
20:30:43:Response received (...336130): No objects found
20:30:45:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:45:Response received (...d6d1e0): Found sleeping
20:30:45:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...d6d1e0) took 9761ms
20:30:46:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:46:Response received (...75deb3): No objects found
20:30:46:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...75deb3) took 10664ms
20:30:46:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:47:Response received (...140e08): No objects found
20:30:47:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...140e08) took 10718ms
20:30:47:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...57d9fb) took 10711ms
20:30:47:Response received (...57d9fb): No objects found
20:30:47:Response received (...fdec19): No objects found
20:30:47:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...fdec19) took 11327ms
20:30:47:Object Detection (YOLOv5 6.2): Detecting using actionnetv2
20:30:48:Response received (...782842): No objects found
20:30:48:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...782842) took 11236ms
20:30:49:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...e88125) took 7541ms
20:30:49:Response received (...e88125): No objects found
20:30:50:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...89a97d) took 7206ms
20:30:50:Response received (...89a97d): No objects found
20:30:51:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...a0303f) took 7305ms
20:30:51:Response received (...a0303f): No objects found
20:30:51:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...cd9e40) took 8995ms
20:30:51:Response received (...cd9e40): Found cycling
20:30:51:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...8af96e) took 5378ms
20:30:51:Response received (...8af96e): No objects found
20:30:51:Response received (...c0d8f5): No objects found
20:30:51:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...c0d8f5) took 5907ms
20:30:52:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'custom' (...54dc3c) took 4416ms
20:30:52:Response received (...54dc3c): No objects found
20:31:57:Client request 'list-custom' in queue 'objectdetection_queue' (...85092e)
20:31:57:Request 'list-custom' dequeued from 'objectdetection_queue' (...85092e)
20:31:57:Response received (...85092e)
20:31:57:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:31:57:Object Detection (YOLOv5 6.2): Rec'd request for Object Detection (YOLOv5 6.2) command 'list-custom' (...85092e) took 4ms
20:31:58:Sending shutdown request to python/ObjectDetectionYolo
20:31:58:Client request 'Quit' in queue 'objectdetection_queue' (...1787aa)
20:31:58:Request 'Quit' dequeued from 'objectdetection_queue' (...1787aa)
20:31:58:Object Detection (YOLOv5 6.2): Retrieved objectdetection_queue command
20:32:07:detect_adapter.py: Inference processing will occur on device 'CPU'
20:32:07:detect_adapter.py: Inference processing will occur on device 'CPU'
20:32:08:Module ObjectDetectionYolo has shutdown
20:32:08:detect_adapter.py: has exited
20:32:16:Client request 'detect' in queue 'objectdetection_queue' (...4601e2)
20:32:16:Client request 'detect' in queue 'objectdetection_queue' (...e2a59c)
20:32:16:Client request 'detect' in queue 'objectdetection_queue' (...05ca01)
20:32:16:Client request 'detect' in queue 'objectdetection_queue' (...ed7dbc)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...1e3d75)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...bd2597)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...4c6c47)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...56bb7f)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...29b383)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...7d0bd2)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...f75ad0)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...25010b)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...e15bb8)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...7dd491)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...2ad532)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...30d757)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...c458f7)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...ffa89b)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...3f0013)
20:32:17:Client request 'detect' in queue 'objectdetection_queue' (...ce5170)
20:32:18:Client request 'detect' in queue 'objectdetection_queue' (...026112)
20:32:18:Client request 'detect' in queue 'objectdetection_queue' (...03de65)
20:32:18:Client request 'detect' in queue 'objectdetection_queue' (...d79f9a)
20:32:18:Client request 'detect' in queue 'objectdetection_queue' (...410c6e)
20:32:18:Client request 'detect' in queue 'objectdetection_queue' (...542da1)
20:32:18:Client request 'detect' in queue 'objectdetection_queue' (...48a4b0)
20:32:31:ObjectDetectionYolo went quietly
20:32:31:Command: C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python
20:32:31:
20:32:31:Starting C:\Program Files...ws\python37\venv\Scripts\python "C:\Program Files...tectionYolo\detect_adapter.py"
20:32:31:
20:32:31:Attempting to start ObjectDetectionYolo with C:\Program Files\CodeProject\AI\runtimes\bin\windows\python37\venv\Scripts\python "C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo\detect_adapter.py"
20:32:31:Module 'Object Detection (YOLOv5 6.2)' 1.7.1 (ID: ObjectDetectionYolo)
20:32:31:Module Path:   C:\Program Files\CodeProject\AI\modules\ObjectDetectionYolo
20:32:31:AutoStart:     True
20:32:31:Queue:         objectdetection_queue
20:32:31:Platforms:     all
20:32:31:GPU Libraries: installed if available
20:32:31:GPU Enabled:   enabled
20:32:31:Parallelism:   0
20:32:31:Accelerator:
20:32:31:Half Precis.:  enable
20:32:31:Runtime:       python3.7
20:32:31:Runtime Loc:   Shared
20:32:31:FilePath:      detect_adapter.py
20:32:31:Pre installed: False
20:32:31:Start pause:   1 sec
20:32:31:LogVerbosity:
20:32:31:Valid:         True
20:32:31:Environment Variables
20:32:31:APPDIR                 = %CURRENT_MODULE_PATH%
20:32:31:CUSTOM_MODELS_DIR      = %CURRENT_MODULE_PATH%/custom-models
20:32:31:MODELS_DIR             = %CURRENT_MODULE_PATH%/assets
20:32:31:MODEL_SIZE             = Large
20:32:31:USE_CUDA               = False
20:32:31:YOLOv5_AUTOINSTALL     = false
20:32:31:YOLOv5_VERBOSE         = false
20:32:31:CPAI_MODULE_ENABLE_GPU = False

Not sure if these logs help or if there is a better way to put them here, let me know and I'll do it. One weird thing is that I have all my cameras turned off so that the are not triggering and sending stuff to CPAI for processing as I only wanted to step through this set up and trouble shoot what was going on. Again thank you for any further direction to get this working.

Fun-Fisherman-5824-Nov-23 18:59

4-Nov-23 18:59

Tried one more time of uninstalling all modules and just loading the Object Detection (YOLOv5 6.2) and this time the GPU was listed as being used the entire time, however there were some spikes in the CPU but now only to 50%. They seem to happen when there is a runtime error. Hope this give anyone some insight to the issues that might help me fix this. Thank you.

Mike Lud4-Nov-23 19:13

4-Nov-23 19:13

Two things you can try first in Blue Iris main AI settings disable Auto start/stop with Blue Iris. The second is try using a small or medium model.

Fun-Fisherman-5824-Nov-23 19:48

4-Nov-23 19:48

I changes this to not start or stop with BI and restarted the machine. When it came up, BI was running. I started CPAI and the Object Detection (YOLOv5 6.2) was stopped. Starting it made it start with just the CPU and not the GPU. The cycles of high CPU use started to happen and since the GPU was not used would peg at 100%. I had also changed the model to small, but had to do it on the CPAI desktop. Should I be using Object Detection (YOLOv5 3.1)? Is my GPU "older"

Mike Lud4-Nov-23 19:53

4-Nov-23 19:53

Try the Object Detection (YOLOv5 .NET) module. This module will also use your GPU

Fun-Fisherman-5824-Nov-23 20:28

4-Nov-23 20:28

Thanks. It is working but CPU usage at ~ 70% with peaks but some drops down to 30%. Is this what I should expect? GPU is getting use as well. when I tried to change to small model, it lost contact with the server? and won't restart...I'll uninstall and reinstall...

Fun-Fisherman-5825-Nov-23 6:02

5-Nov-23 6:02

Hi Mike. Thanks for all the help. After tinkering with this for a while, I am able to get it to work...Kind of. I am wondering if my performance issues could be better if I had a better GPU. I deleted the custom model for license plates as I am not using this. I cleaned up my system path as for some reason there were multiple entries for the CUDNN targets. I set all my cameras to use my graphic card for hardware acceleration to NVIDA NVDEC and am using the YOLOv5 6.2 Module. It is detecting the GPU.

I did a lot of file deleting and reinstalling over and over. I have set up BI to autostart and stop CPAI and have the model set to medium

The CPAI is taking about 300ms

At the risk of making things more complicated, could you recommend a current graphic card that would play well with CPAI? Thanks for the help Links to discussions would be helpful if you have them.

Here you can see the GPU is working

modified 5-Nov-23 11:08am.

Mike Lud5-Nov-23 7:20