Install NVIDIA driver and CUDA on Host

This plugin demands high computation costs. GPU parallelization is used with the Nvidia CUDA Library. A discrete NVIDIA Graphics card is required.

• The most straightforward way to install CUDA support on Ubuntu 24.04 is:

  • Install NVIDIA driver 555 at additional drivers on Ubuntu (Needs restart)

    • Here’s one example with graphical and command-line options. (same for Ubuntu 24.04, but look for the nvidia-driver 555, which is compatible with the latest CUDA version)

    <aside> ⭐ Remember to restart your device after making the necessary driver changes. Otherwise, it may throw some errors like NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running.

    </aside>

  • Install CUDA 12.5 (https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=24.04&target_type=deb_network)

    wget <https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/cuda-keyring_1.1-1_all.deb>
    sudo dpkg -i cuda-keyring_1.1-1_all.deb
    sudo apt-get update
    sudo apt-get -y install cuda-toolkit-12-5
    

  • This installs the Nvidia CUDA toolkit from the Ubuntu repository.

  The final step is to add paths to the CUDA executables and libraries. Add these lines to .bashrc to include them. You may resource it by source ~/.bashrc :

  export PATH=/usr/local/cuda/bin${PATH:+:${PATH}}$
  export LD_LIBRARY_PATH=/usr/local/cuda/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}`
  

  Once you are done, you will see something like the following msg with the nvidia-smi command.

Thu Jul 25 18:33:06 2024       
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 555.42.06              Driver Version: 555.42.06      CUDA Version: 12.5     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce MX330           Off |   00000000:2B:00.0 Off |                  N/A |
| N/A   56C    P3             N/A / ERR!  |       2MiB /   2048MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
                                                                                         
+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|    0   N/A  N/A      2644      G   /usr/bin/gnome-shell                            0MiB |
+-----------------------------------------------------------------------------------------+

Also, check CUDA version with nvcc --version. You would see version 12.5:

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Thu_Jun__6_02:18:23_PDT_2024
Cuda compilation tools, release 12.5, V12.5.82
Build cuda_12.5.r12.5/compiler.34385749_0