<div dir="ltr"><div>Hi,</div><div>If you have a Python variable holding memory, you can simply call <br></div><div><span style="font-family:monospace">del variable_name</span></div><div>If you want to clear the GPU memory for an image, you can access the CPU buffer pointer to have it moved to the computer RAM. Examples below. </div><div>Simon</div><div><br></div><span style="font-family:monospace">>>> import os<br>>>> os.system('nvidia-smi')<br>Fri Jun 16 08:49:38 2023 <br>+-----------------------------------------------------------------------------+<br>| NVIDIA-SMI 510.39.01 Driver Version: 510.39.01 CUDA Version: 11.6 |<br>|-------------------------------+----------------------+----------------------+<br>| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |<br>| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |<br>| | | MIG M. |<br>|===============================+======================+======================|<br>| 0 Quadro P2000 Off | 00000000:01:00.0 Off | N/A |<br>| N/A 52C P8 N/A / N/A | 0MiB / 4096MiB | 0% Default |<br>| | | N/A |<br>+-------------------------------+----------------------+----------------------+<br> <br>+-----------------------------------------------------------------------------+<br>| Processes: |<br>| GPU GI CI PID Type Process name GPU Memory |<br>| ID ID Usage |<br>|=============================================================================|<br>| No running processes found |<br>+-----------------------------------------------------------------------------+<br>0<br>>>> import itk<br>>>> from itk import RTK as rtk<br>>>> img=itk.CudaImage[itk.F, 3].New()<br>>>> img.SetRegions([500]*3)<br>>>> img.Allocate()<br>>>> os.system('nvidia-smi')<br>Fri Jun 16 08:51:28 2023 <br>+-----------------------------------------------------------------------------+<br>| NVIDIA-SMI 510.39.01 Driver Version: 510.39.01 CUDA Version: 11.6 |<br>|-------------------------------+----------------------+----------------------+<br>| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |<br>| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |<br>| | | MIG M. |<br>|===============================+======================+======================|<br>| 0 Quadro P2000 Off | 00000000:01:00.0 Off | N/A |<br>| N/A 58C P8 N/A / N/A | 45MiB / 4096MiB | 0% Default |<br>| | | N/A |<br>+-------------------------------+----------------------+----------------------+<br> <br>+-----------------------------------------------------------------------------+<br>| Processes: |<br>| GPU GI CI PID Type Process name GPU Memory |<br>| ID ID Usage |<br>|=============================================================================|<br>| 0 N/A N/A 10890 C python 43MiB |<br>+-----------------------------------------------------------------------------+<br>0<br>>>> img.GetCudaDataManager().GetGPUBufferPointer()<br><Swig Object of type 'void *' at 0x7f20d3327f60><br>>>> os.system('nvidia-smi')<br>Fri Jun 16 08:52:05 2023 <br>+-----------------------------------------------------------------------------+<br>| NVIDIA-SMI 510.39.01 Driver Version: 510.39.01 CUDA Version: 11.6 |<br>|-------------------------------+----------------------+----------------------+<br>| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |<br>| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |<br>| | | MIG M. |<br>|===============================+======================+======================|<br>| 0 Quadro P2000 Off | 00000000:01:00.0 Off | N/A |<br>| N/A 54C P0 N/A / N/A | 525MiB / 4096MiB | 0% Default |<br>| | | N/A |<br>+-------------------------------+----------------------+----------------------+<br> <br>+-----------------------------------------------------------------------------+<br>| Processes: |<br>| GPU GI CI PID Type Process name GPU Memory |<br>| ID ID Usage |<br>|=============================================================================|<br>| 0 N/A N/A 10890 C python 523MiB |<br>+-----------------------------------------------------------------------------+<br>0<br>>>> del img<br>>>> os.system('nvidia-smi')<br>Fri Jun 16 08:52:21 2023 <br>+-----------------------------------------------------------------------------+<br>| NVIDIA-SMI 510.39.01 Driver Version: 510.39.01 CUDA Version: 11.6 |<br>|-------------------------------+----------------------+----------------------+<br>| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |<br>| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |<br>| | | MIG M. |<br>|===============================+======================+======================|<br>| 0 Quadro P2000 Off | 00000000:01:00.0 Off | N/A |<br>| N/A 56C P0 N/A / N/A | 2MiB / 4096MiB | 0% Default |<br>| | | N/A |<br>+-------------------------------+----------------------+----------------------+<br> <br>+-----------------------------------------------------------------------------+<br>| Processes: |<br>| GPU GI CI PID Type Process name GPU Memory |<br>| ID ID Usage |<br>|=============================================================================|<br>| No running processes found |<br>+-----------------------------------------------------------------------------+<br>0<br>>>> img=itk.CudaImage[itk.F, 3].New()<br>>>> img.SetRegions([500]*3)<br>>>> img.GetCudaDataManager().GetGPUBufferPointer()<br><Swig Object of type 'void *' at 0x7f20b2c30870><br>>>> os.system('nvidia-smi')<br>Fri Jun 16 08:54:10 2023 <br>+-----------------------------------------------------------------------------+<br>| NVIDIA-SMI 510.39.01 Driver Version: 510.39.01 CUDA Version: 11.6 |<br>|-------------------------------+----------------------+----------------------+<br>| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |<br>| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |<br>| | | MIG M. |<br>|===============================+======================+======================|<br>| 0 Quadro P2000 Off | 00000000:01:00.0 Off | N/A |<br>| N/A 58C P0 N/A / N/A | 525MiB / 4096MiB | 0% Default |<br>| | | N/A |<br>+-------------------------------+----------------------+----------------------+<br> <br>+-----------------------------------------------------------------------------+<br>| Processes: |<br>| GPU GI CI PID Type Process name GPU Memory |<br>| ID ID Usage |<br>|=============================================================================|<br>| 0 N/A N/A 10890 C python 523MiB |<br>+-----------------------------------------------------------------------------+<br>0<br>>>> img.GetCudaDataManager().GetCPUBufferPointer()<br>>>> os.system('nvidia-smi')<br>Fri Jun 16 08:54:20 2023 <br>+-----------------------------------------------------------------------------+<br>| NVIDIA-SMI 510.39.01 Driver Version: 510.39.01 CUDA Version: 11.6 |<br>|-------------------------------+----------------------+----------------------+<br>| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |<br>| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |<br>| | | MIG M. |<br>|===============================+======================+======================|<br>| 0 Quadro P2000 Off | 00000000:01:00.0 Off | N/A |<br>| N/A 58C P0 N/A / N/A | 47MiB / 4096MiB | 0% Default |<br>| | | N/A |<br>+-------------------------------+----------------------+----------------------+<br> <br>+-----------------------------------------------------------------------------+<br>| Processes: |<br>| GPU GI CI PID Type Process name GPU Memory |<br>| ID ID Usage |<br>|=============================================================================|<br>| 0 N/A N/A 10890 C python 45MiB |<br><span style="font-family:monospace">+-----------------------------------------------------------------------------+<br>0<br></span></span></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jun 15, 2023 at 5:33 PM Rahman, Obaid <<a href="mailto:rahmano@ornl.gov">rahmano@ornl.gov</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
Hi,
<div><br>
<div>I am using ink-rtk-cuda116 with <b>python</b>.</div>
<div>I have too many cuda variables (images and filters).</div>
<div>I would like to clear some of these variables.</div>
<div><br>
</div>
<div>I am getting the following error:</div>
<div><font color="#ffa893">ITK ERROR: CUDA ERROR: out of memory</font></div>
<div><br>
</div>
<div>Does anyone know how to clear Cuda variables in python?</div>
<div>Thanks.</div>
<div><br>
</div>
<div>Best,</div>
<div>Obaidullah Rahman</div>
</div>
<div>Oak Ridge National Laboratory, TN, United States</div>
</div>
_______________________________________________<br>
Rtk-users mailing list<br>
<a href="mailto:rtk-users@openrtk.org" target="_blank">rtk-users@openrtk.org</a><br>
<a href="https://www.creatis.insa-lyon.fr/mailman/listinfo/rtk-users" rel="noreferrer" target="_blank">https://www.creatis.insa-lyon.fr/mailman/listinfo/rtk-users</a><br>
</blockquote></div>