NVIDIA Driver and CUDA Toolkit Configuration Documentation
Summary: This documentation provides clear instructions for setting up NVIDIA drivers and the CUDA Toolkit on Ubuntu (20.04 or 22.04). It ensures any NVIDIA GPU will work, with specific guidance for those using the GH200 480GB model. The key benefit is that it automates environment variable setup, saving you time and ensuring tools and libraries work smoothly. This lets you focus on using CUDA applications instead of complex configuration..
System Requirements
- Operating Systems: Ubuntu 20.04 LTS or Ubuntu 22.04 LTS
- GPUs: All NVIDIA GPUs are supported. Special setup for NVIDIA GH200 480GB on Ubuntu 22.04 LTS.
Environment Configuration
After installation, the following environment variables are configured to ensure proper functionality of CUDA tools:
- PATH: Includes
/usr/local/cuda-12.2/binfor easy access to CUDA binaries.
- LD_LIBRARY_PATH: Set to
/usr/local/cuda-12.2/lib64for linking CUDA libraries.
These settings are automatically applied from /etc/environment and do not require user intervention.
Special Case for NVIDIA GH200 Systems
If you are using an NVIDIA GH200 480GB GPU:
- Kernel Requirement: Ubuntu 22.04 LTS uses the
linux-nvidia-64k-hwekernel package specifically for compatibility with this GPU model.
- Drivers: NVIDIA driver version 535 and CUDA version 12.2 are installed.
Usage
Once the system is configured, you can start utilizing CUDA-dependent applications. Ensure that your application configurations use the correct paths if they require manual setup.
Support
For any issues related to the NVIDIA drivers or CUDA functionality, please contact your system administrator or refer to the official NVIDIA documentation for troubleshooting guidance.