Deploying and Configuring Nvidia DLS for AI Enterprise and vGPU: Step-by-Step Guide

Posted on

NB! At the end of the blog post, there is a YouTube video and an eBook – a photo-based step-by-step guide

Download Nvidia vGPU Drivers for ESXi

  • Log in to the Nvidia Application Hub at login.nvgs.nvidia.com.
  • Download Nvidia vGPU Drivers for ESXi:
    • Go to Software Downloads from the left menu.
    • Select Driver Downloads -> Product Family -> vGPU.
    • Use the Platform filter to select VMware vSphere.
    • Choose your Platform Version (e.g., VMware vSphere 8.0).
    • Select your Product Version (Nvidia vGPU version) based on your GPU model. Verify compatibility using the Nvidia vGPU support matrix.
    • Click Download on the right side.

Download Nvidia vGPU License Server:

  • Go to Non-Driver Downloads.
  • Select Platform -> VMware vSphere.
  • Download the latest NLS License Server (DLS) for VMware vSphere.

Installing Nvidia vGPU Drivers on ESXi

  • Prepare the ESXi Host:
    • Place the ESXi host in Maintenance Mode.
    • Log in to the ESXi GUI.
  • Upload Nvidia vGPU Drivers:
    • Click on Storage and select the datastore where you want to upload the drivers (e.g., ESX-3 4TB SSD).
    • Open the Datastore Browser.
    • Create a new directory named vGPU.
    • Upload the following VIB files to the vGPU folder:
      • NVD_bootbank_NVD-VMware_ESXi_8.0.0_Driver_535.183.04-1OEM.800.1.0.20613240.vibNVD_bootbank_nvdgpumgmtdaemon_535.183.04-1OEM.700.1.0.15843807.vib
      • NVD_bootbank_nvdgpumgmtdaemon_535.183.04-1OEM.700.1.0.15843807.vib
  • Prepare for Installation:
    • Copy the file paths of the VIBs to a text editor:
      • /vmfs/volumes/[datastore-ID]/vGPU/NVD_bootbank_NVD-VMware_ESXi_8.0.0_Driver_535.183.04-1OEM.800.1.0.20613240.vib
      • /vmfs/volumes/[datastore-ID]/vGPU/NVD_bootbank_nvdgpumgmtdaemon_535.183.04-1OEM.700.1.0.15843807.vib
  • Install Nvidia vGPU Drivers:
    • Enable SSH and the ESXi Shell.
    • Log in to ESXi using PuTTY.
    • Run the following commands to install the drivers:
      • esxcli software vib install -v /vmfs/volumes/[datastore-ID]/vGPU/NVD_bootbank_NVD-VMware_ESXi_8.0.0_Driver_535.183.04-1OEM.800.1.0.20613240.vib
      • esxcli software vib install -v /vmfs/volumes/[datastore-ID]/vGPU/NVD_bootbank_nvdgpumgmtdaemon_535.183.04-1OEM.700.1.0.15843807.vib
  • Verify and Reboot:
    • Test the installation with the command nvidia-smi.
    • Reboot the server.

Deploying the NvidiaDLS OVA to vSphere

  • Upload the OVA File:
    • Upload the OVF file to vSphere.
  • Configure Network Settings:
    • During the upload process, enter the IP Address, Gateway (GW), and DNS information.
  • Start the VM:
    • Once the upload is complete, start the VM.

Configuring Nvidia DLS (License) Server

  • Initial Setup:
    • Click New Installation and create a new user.
  • Configure Service Instance:
    • Go to Service Instance, click Actions, and select Edit.
    • Name your instance as desired.
    • Download the DLS Instance Token.
  • Register DLS Instance:
    • Log in to the Nvidia Application Hub.
    • Go to Service Instances, click Actions, and select Register DLS Instance.
    • Upload your Instance Token.
  • Create and Download License Server:
    • In the Nvidia Application Hub, click License Servers from the left menu, then click Create Server.
    • Fill in the required information and click Create Server.
    • After creation, click Actions and download the license file.
  • Upload License File to DLS Server:
    • Return to the DLS server in vSphere.
    • Click Select License Server File and upload your downloaded license file.

Installing Nvidia Drivers on a Windows VM

  • Add vGPU to the VM.
  • Copy Nvidia Drivers to your VM (538.78_grid_win10_win11_server2019_server2022_dch_64bit_international).
  • Install the Drivers.
    • After installation, the Display Adapter in Device Manager will change to your vGPU.
    • Task Manager will now show a GPU.
  • License the VM:
    • Go to your on-prem license server.
    • Click Action and generate a Client Config Token.
    • Copy the token to your VM and place it in:
    • C:\Program Files\NVIDIA Corporation\vGPU Licensing\ClientConfigToken
    • Your VM will now be licensed.
  • Verify License:
    • Open Nvidia Control Panel, go to Manage License, and confirm that your DLS server IP is displayed.

Ebook- Deploying and Configuring Nvidia DLS for AI Enterprise and vGPU (ebook) v1.0

Deploying and Configuring Nvidia DLS for AI Enterprise and vGPU (ebook) v1.0Download