Skip to content
Menu
vAndu
  • Home
  • Home Lab
  • AI/ML & vGPU
  • Snapshot
  • The Lab Floor
vAndu

Deploying and Configuring Nvidia DLS for AI Enterprise and vGPU: Step-by-Step Guide

Posted on August 11, 2024August 11, 2024

NB! At the end of the blog post, there is a YouTube video and an eBook – a photo-based step-by-step guide

Download Nvidia vGPU Drivers for ESXi

  • Log in to the Nvidia Application Hub at login.nvgs.nvidia.com.
  • Download Nvidia vGPU Drivers for ESXi:
    • Go to Software Downloads from the left menu.
    • Select Driver Downloads -> Product Family -> vGPU.
    • Use the Platform filter to select VMware vSphere.
    • Choose your Platform Version (e.g., VMware vSphere 8.0).
    • Select your Product Version (Nvidia vGPU version) based on your GPU model. Verify compatibility using the Nvidia vGPU support matrix.
    • Click Download on the right side.

Download Nvidia vGPU License Server:

  • Go to Non-Driver Downloads.
  • Select Platform -> VMware vSphere.
  • Download the latest NLS License Server (DLS) for VMware vSphere.

Installing Nvidia vGPU Drivers on ESXi

  • Prepare the ESXi Host:
    • Place the ESXi host in Maintenance Mode.
    • Log in to the ESXi GUI.
  • Upload Nvidia vGPU Drivers:
    • Click on Storage and select the datastore where you want to upload the drivers (e.g., ESX-3 4TB SSD).
    • Open the Datastore Browser.
    • Create a new directory named vGPU.
    • Upload the following VIB files to the vGPU folder:
      • NVD_bootbank_NVD-VMware_ESXi_8.0.0_Driver_535.183.04-1OEM.800.1.0.20613240.vibNVD_bootbank_nvdgpumgmtdaemon_535.183.04-1OEM.700.1.0.15843807.vib
      • NVD_bootbank_nvdgpumgmtdaemon_535.183.04-1OEM.700.1.0.15843807.vib
  • Prepare for Installation:
    • Copy the file paths of the VIBs to a text editor:
      • /vmfs/volumes/[datastore-ID]/vGPU/NVD_bootbank_NVD-VMware_ESXi_8.0.0_Driver_535.183.04-1OEM.800.1.0.20613240.vib
      • /vmfs/volumes/[datastore-ID]/vGPU/NVD_bootbank_nvdgpumgmtdaemon_535.183.04-1OEM.700.1.0.15843807.vib
  • Install Nvidia vGPU Drivers:
    • Enable SSH and the ESXi Shell.
    • Log in to ESXi using PuTTY.
    • Run the following commands to install the drivers:
      • esxcli software vib install -v /vmfs/volumes/[datastore-ID]/vGPU/NVD_bootbank_NVD-VMware_ESXi_8.0.0_Driver_535.183.04-1OEM.800.1.0.20613240.vib
      • esxcli software vib install -v /vmfs/volumes/[datastore-ID]/vGPU/NVD_bootbank_nvdgpumgmtdaemon_535.183.04-1OEM.700.1.0.15843807.vib
  • Verify and Reboot:
    • Test the installation with the command nvidia-smi.
    • Reboot the server.

Deploying the NvidiaDLS OVA to vSphere

  • Upload the OVA File:
    • Upload the OVF file to vSphere.
  • Configure Network Settings:
    • During the upload process, enter the IP Address, Gateway (GW), and DNS information.
  • Start the VM:
    • Once the upload is complete, start the VM.

Configuring Nvidia DLS (License) Server

  • Initial Setup:
    • Click New Installation and create a new user.
  • Configure Service Instance:
    • Go to Service Instance, click Actions, and select Edit.
    • Name your instance as desired.
    • Download the DLS Instance Token.
  • Register DLS Instance:
    • Log in to the Nvidia Application Hub.
    • Go to Service Instances, click Actions, and select Register DLS Instance.
    • Upload your Instance Token.
  • Create and Download License Server:
    • In the Nvidia Application Hub, click License Servers from the left menu, then click Create Server.
    • Fill in the required information and click Create Server.
    • After creation, click Actions and download the license file.
  • Upload License File to DLS Server:
    • Return to the DLS server in vSphere.
    • Click Select License Server File and upload your downloaded license file.

Installing Nvidia Drivers on a Windows VM

  • Add vGPU to the VM.
  • Copy Nvidia Drivers to your VM (538.78_grid_win10_win11_server2019_server2022_dch_64bit_international).
  • Install the Drivers.
    • After installation, the Display Adapter in Device Manager will change to your vGPU.
    • Task Manager will now show a GPU.
  • License the VM:
    • Go to your on-prem license server.
    • Click Action and generate a Client Config Token.
    • Copy the token to your VM and place it in:
    • C:\Program Files\NVIDIA Corporation\vGPU Licensing\ClientConfigToken
    • Your VM will now be licensed.
  • Verify License:
    • Open Nvidia Control Panel, go to Manage License, and confirm that your DLS server IP is displayed.

Ebook- Deploying and Configuring Nvidia DLS for AI Enterprise and vGPU (ebook) v1.0

Deploying and Configuring Nvidia DLS for AI Enterprise and vGPU (ebook) v1.0Download

Home Labber who likes to build things and push it to the limits. vSphere is like Lego for adults.

“The fastest way to learn IT is 80% labbing and 20% studying theory. Just do it and have fun.” – vAndu

“If you wish to achieve worthwhile things in your personal and career life, you must become a worthwhile person in your own self-development” – Brian Tracy

VMware vExpert 2023
VMware vExpert NSX
VMware vExpert Pro
©2026 vAndu | Powered by SuperbThemes!