Hydra FAQs
How do I configure the NVIDIA driver and CUDA toolkit?
I want to configure the NVIDIA driver and CUDA toolkit on my Brokkr server. How do I do that?
Solution
With proper system and environment setup we can install everything you need on your Brokkr server.
System Requirements
- Operating System: Ubuntu 22.04 LTS or Ubuntu 24.04 LTS
- NVIDIA GPU: Any supported NVIDIA GPU. Note below for GH200.
Environment Configuration
After installation, the following environment variables are configured to ensure proper functionality of CUDA tools:
- PATH: Includes
/usr/local/cuda-12.2/binfor easy access to CUDA binaries. - LD_LIBRARY_PATH: Set to
/usr/local/cuda-12.2/lib64for linking CUDA libraries.
These settings are automatically applied from /etc/environment and do not require user intervention.
Usage
Once the system is configured, you can start utilizing CUDA-dependent applications. Ensure that your application configurations use the correct paths if they require manual setup.
Notes
Special Case for NVIDIA GH200 480GB Systems
- Kernel Requirement: Ubuntu 22.04 LTS uses the
linux-nvidia-64k-hwekernel package specifically for compatibility with this GPU model. - Drivers: NVIDIA driver version 535 and CUDA version 12.2 are installed.
Support
For any issues related to the NVIDIA drivers or CUDA functionality, please contact your system administrator or refer to the official NVIDIA documentation for troubleshooting guidance.