Transcription
VIRTUAL GPU SOFTWARE R384 FORCITRIX XENSERVERRN-06927-001 v5.0 through 5.4 Revision 04 May 2020Release Notes
TABLE OF CONTENTSChapter 1. Release Notes. 11.1. Updates in Release 5.0. 21.2. Updates in Release 5.1. 21.3. Updates in Release 5.2. 21.4. Updates in Release 5.3. 31.5. Updates in Release 5.4. 3Chapter 2. Validated Platforms.42.1. Supported NVIDIA GPUs and Validated Server Platforms. 42.2. Hypervisor Software Releases. 52.3. Guest OS Support. 62.3.1. Windows Guest OS Support. 62.3.2. Linux Guest OS Support. 82.4. NVIDIA CUDA Toolkit Version Support. 8Chapter 3. Known Product Limitations. 93.1. vGPU profiles with 512 Mbytes or less of frame buffer support only 1 virtual display headon Windows 10. 93.2. NVENC requires at least 1 Gbyte of frame buffer. 103.3. VM running older NVIDIA vGPU drivers fails to initialize vGPU when booted. 103.4. Virtual GPU fails to start if ECC is enabled. 113.5. Single vGPU benchmark scores are lower than pass-through GPU. 133.6. nvidia-smi fails to operate when all GPUs are assigned to GPU passthrough mode. 143.7. Windows Aero is disabled on XenDesktop session using 3 or 4 monitors in 2560 1600resolution. 153.8. VMs configured with large memory fail to initialize vGPU when booted. 153.9. vGPU host driver RPM upgrade fails. 16Chapter 4. Resolved Issues. 17Chapter 5. NVIDIA Software Security Updates. 20Chapter 6. Known Issues. 216.1. Cloned VMs configured with a vGPU type different than the type in the master imagefail to start.216.2. NVIDIA Control Panel Crashes in a VM connected to two 4K displays. 226.3. vGPU guest VM driver not properly loaded on servers with more than 512 GB or 1 TB ormore of system memory. 226.4. 5.1, 5.2 Only: Issues in remote desktop sessions if a license is acquired after a sessionis started.236.5. License settings configured through a GPO are ignored. 246.6. Licensing pop-up windows contain the text microsoft.explorer.notification. 246.7. 5.2 Only: The license expires prematurely in Linux guest VMs. 256.8. Multiple display heads are not detected by Ubuntu 14.04 guest VMs.256.9. CILP is not working in Windows VMs.26www.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 ii
6.10. Luxmark causes a segmentation fault on an unlicensed Linux client.266.11. Ubuntu 16.04 VMs run slowly after acquiring a license. 276.12. Since 5.1: On GPUs based on the Pascal architecture, Ubuntu 16.04 VMs run slowly afteracquiring a license. 286.13. Resolution is not updated after a VM acquires a license and is restarted. 286.14. On Tesla P40, P6, and P4 GPUs, the default ECC setting prevents NVIDIA vGPU fromstarting. 296.15. NVIDIA vGPU utilization in guest VMs is incorrectly reported for vGPUs using a fixedshare scheduler. 296.16. NVIDIA vGPU encoder and process utilization counters don't work with WindowsPerformance Counters. 306.17. A segmentation fault in DBus code causes nvidia-gridd to exit on Red Hat EnterpriseLinux and CentOS. 316.18. Since 5.1: No Manage License option available in NVIDIA X Server Settings by default. 326.19. Since 5.1: The nvidia-gridd service fails because the required configuration is notprovided.336.20. Since 5.1: The Apply button is disabled after change to unlicensed mode. 346.21. Licenses remain checked out when VMs are forcibly powered off.346.22. Memory exhaustion can occur with vGPU profiles that have 512 Mbytes or less of framebuffer. 356.23. VM bug checks after the guest VM driver for Windows 10 RS2 is installed.366.24. On XenServer 7.0, VMs unexpectedly reboot and XenServer crashes or freezes. 376.25. With no NVIDIA driver installed, XenServer misidentifies Tesla M10 cards.386.26. GNOME Display Manager (GDM) fails to start on Red Hat Enterprise Linux 7.2 and CentOS7.0.386.27. Video goes blank when run in loop in Windows Media Player. 396.28. Local VGA console is momentarily unblanked when XenDesktop changes resolution ofthe VM desktop. 406.29. VM bugchecks on shutdown/restart when XenDesktop is installed and NVIDIA driver isuninstalled or upgraded. 406.30. Application frame rate may drop when running XenDesktop at 2560 1600 resolution. 416.31. Windows VM BSOD. 416.32. Windows VM BSOD when upgrading NVIDIA drivers over a XenDesktop session.426.33. XenCenter does not allow vGPUs to be selected as a GPU type for Linux VMs.436.34. If X server is killed on a RHEL7 VM running vGPU, XenCenter console may notautomatically switch to text console. 436.35. XenDesktop shows only a black screen when connected to a vGPU VM. 44www.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 iii
www.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 iv
Chapter 1.RELEASE NOTESThese Release Notes summarize current status, information on validated platforms,and known issues with NVIDIA vGPU software and associated hardware on CitrixXenServer.The releases in this release family of NVIDIA vGPU software include the software listedin the following table:Software5.05.15.25.35.4NVIDIA Virtual GPU Manager for the CitrixXenServer releases listed in HypervisorSoftware Releases384.73384.99384.111384.137384.155NVIDIA Windows driver385.41385.90386.09386.37386.57NVIDIA Linux driver version384.73384.99384.111384.137384.155CautionIf you install the wrong package for the version of Citrix XenServer you are using,NVIDIA Virtual GPU Manager will fail to load.The releases of the vGPU Manager and guest VM drivers that you install must becompatible. Different versions of the vGPU Manager and guest VM driver from withinthe same main release branch can be used together. For example, you can use thevGPU Manager from release 5.1 with guest VM drivers from release 5.0. However,versions of the vGPU Manager and guest VM driver from different main releasebranches cannot be used together. For example, you cannot use the vGPU Managerfrom release 5.1 with guest VM drivers from release 4.4. See VM running older NVIDIAvGPU drivers fails to initialize vGPU when booted.This requirement does not apply to the NVIDIA vGPU software license sever. Allreleases of NVIDIA vGPU software are compatible with all releases of the license server.www.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 1
Release Notes1.1. Updates in Release 5.0New Features in Release 5.0‣‣‣‣‣‣‣New NVIDIA vGPU schedulers for GPUs based on the NVIDIA Pascal architectureSupport for NVML and nvidia-smi on 32-bit Windows VMsApplication-level monitoring of NVIDIA vGPU engine utilizationEncoder session monitoringSupport for NVENC on Linux NVIDIA vGPUsSoftware enforcement of licensing requirementsMiscellaneous bug fixesHardware and Software Support Introduced in Release 5.0‣‣ Support for GPUs based on the NVIDIA Pascal architectureCompute mode support for NVIDIA vGPU and pass-through GPU on GPUs basedon the NVIDIA Pascal architectureFeature Support Withdrawn in Release 5.0‣GRID K1 and GRID K2 GPUs are no longer supported.1.2. Updates in Release 5.1New Features in Release 5.1‣Miscellaneous bug fixesHardware and Software Support Introduced in Release 5.1‣Support for Citrix XenDesktop 7.151.3. Updates in Release 5.2New Features in Release 5.2‣New default values for the license borrow time and license linger time:‣‣ The default license borrow time is reduced from 7 days to 1 day.‣ The default license linger time is reduced from 10 minutes to 0 minutes.New setting LingerInterval for overriding the default license linger timewww.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 2
Release Notes‣Miscellaneous bug fixes1.4. Updates in Release 5.3New Features in Release 5.3‣‣‣Plain-text logging on Windows of significant licensing eventsNew setting EnableLogging for disabling or enabling logging of significantlicensing eventsMiscellaneous bug fixes1.5. Updates in Release 5.4New Features in Release 5.4‣Miscellaneous bug fixesHardware and Software Support Introduced in Release 5.4‣‣Support for Citrix XenDesktop 7.18Support for Red Hat Enteprise Linux 7.5 and CentOS 7.5 as a guest OSFeature Support Withdrawn in Release 5.4‣‣Citrix XenServer 7.3, 7.2, and 6.5 are no longer supported.Citrix XenDesktop 7.6, 7.8, and 7.11 are no longer supported.www.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 3
Chapter 2.VALIDATED PLATFORMSThis release family of NVIDIA vGPU software provides support for several NVIDIAGPUs on validated server hardware platforms, Citrix XenServer hypervisor softwareversions, and guest operating systems. It also supports the version of NVIDIA CUDAToolkit that is compatible with R384 drivers.2.1. Supported NVIDIA GPUs and Validated ServerPlatformsThis release of NVIDIA vGPU software provides support for the following NVIDIAGPUs on Citrix XenServer, running on validated server hardware platforms:‣‣‣‣‣‣‣‣Tesla M6Tesla M10Tesla M60Tesla P4Tesla P6Tesla P40Tesla P100Since 5.1: Tesla P100 12GBFor a list of validated server platforms, refer to NVIDIA GRID Certified Servers.Tesla M60 and M6 GPUs support compute mode and graphics mode. NVIDIA vGPUrequires GPUs that support both modes to operate in graphics mode.Recent Tesla M60 GPUs and M6 GPUs are supplied in graphics mode. However, yourGPU might be in compute mode if it is an older Tesla M60 GPU or M6 GPU, or if itsmode has previously been changed.To configure the mode of Tesla M60 and M6 GPUs, use the gpumodeswitch toolprovided with NVIDIA vGPU software releases.www.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 4
Validated Platforms2.2. Hypervisor Software ReleasesSupported Citrix XenServer ReleasesThis release supports only the hypervisor software releases listed in the table.Support for NVIDIA vGPU software requires the Premium Edition (previously EnterpriseEdition) of Citrix XenServer. For details, see Licensing in the Citrix documentation.If a specific release, even an update release, is not listed, it’s not supported.SoftwareRelease SupportedNotes5.1-5.3 only: Citrix XenServerRTM build is supported.All NVIDIA GPUs that supportNVIDIA vGPU software are7.3supported.5.0-5.3 only: Citrix XenServerAll NVIDIA GPUs that supportRTM build is supported.NVIDIA vGPU software are7.2supported.Citrix XenServer 7.1All NVIDIA GPUs that supportRTM build is supported.NVIDIA vGPU software aresupported.Citrix XenServer 7.0RTM build 125380 is supported.All NVIDIA GPUs that supportNVIDIA vGPU software aresupported.5.0-5.3 only: Citrix XenServerVersion 6.5 with XS65ESP1. TheOnly the following NVIDIA GPUs6.5NVIDIA Virtual GPU Managerare supported:included in this release will not‣Tesla M6‣Tesla M10‣Tesla M60install without XenServer 6.5SP1.Supported Virtual Desktop Software ReleasesThis release supports only the virtual desktop software releases listed in the table.SoftwareReleases SupportedCitrix XenDesktopSince 5.4: Version 7.18 in HDX 3D Pro mode.Since 5.1: Version 7.15 in HDX 3D Pro mode.www.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 5
Validated PlatformsSoftwareReleases Supported5.0-5.3 only: Version 7.6, 7.8, and 7.11 in HDX 3DPro mode.2.3. Guest OS SupportNVIDIA vGPU software supports several Windows releases and Linux distributions asa guest OS. The supported guest operating systems depend on the hypervisor softwareversion.Use only a guest OS release that is listed as supported by NVIDIA vGPU software withyour virtualization software. To be listed as supported, a guest OS release must besupported not only by NVIDIA vGPU software, but also by your virtualization software.NVIDIA cannot support guest OS releases that your virtualization software does notsupport.In pass-through mode, GPUs based on the Pascal architecture support only 64-bitguest operating systems. No 32-bit guest operating systems are supported in passthrough mode for these GPUs.2.3.1. Windows Guest OS SupportNVIDIA vGPU software supports only the Windows releases listed in the table as aguest OS on Citrix XenServer. The releases of Citrix XenServer for which a Windowsrelease is supported depend on whether NVIDIA vGPU or pass-through GPU is used.If a specific release, even an update release, is not listed, it’s not supported.Guest OSNVIDIA vGPU - CitrixXenServer ReleasesPass-Through GPU- Citrix XenServerReleasesWindows Server 2016 1607, 17095.1-5.3 only: 7.35.1-5.3 only: 7.35.0-5.3 only: 7.25.0-5.3 only: 7.27.1, 7.07.1, 7.05.1-5.3 only: 7.35.1-5.3 only: 7.35.0-5.3 only: 7.25.0-5.3 only: 7.27.1, 7.07.1, 7.05.0-5.3 only: 6.5 SP15.0-5.3 only: 6.5 SP15.1-5.3 only: 7.35.1-5.3 only: 7.35.0-5.3 only: 7.25.0-5.3 only: 7.27.1, 7.07.1, 7.05.0-5.3 only: 6.5 SP15.0-5.3 only: 6.5 SP1Windows Server 2012 R2Windows Server 2008 R2www.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 6
Validated PlatformsGuest OSWindows 10 RTM (1507), November Update (1511),Anniversary Update (1607), Creators Update (1703)(64-bit)Windows 10 RTM (1507), November Update (1511),Anniversary Update (1607), Creators Update (1703)(32-bit)Windows 8.1 Update (64-bit)Windows 8.1 Update (32-bit)Windows 8.1 (64-bit)NVIDIA vGPU - CitrixXenServer ReleasesPass-Through GPU- Citrix XenServerReleases5.1-5.3 only: 7.35.1-5.3 only: 7.35.0-5.3 only: 7.25.0-5.3 only: 7.27.1, 7.07.1, 7.05.0-5.3 only: 6.5 SP15.0-5.3 only: 6.5 SP15.1-5.3 only: 7.35.1-5.3 only: 7.35.0-5.3 only: 7.25.0-5.3 only: 7.27.1, 7.07.1, 7.05.0-5.3 only: 6.5 SP15.0-5.3 only: 6.5 SP15.1-5.3 only: 7.35.1-5.3 only: 7.35.0-5.3 only: 7.25.0-5.3 only: 7.27.1, 7.07.1, 7.05.0-5.3 only: 6.5 SP15.0-5.3 only: 6.5 SP15.1-5.3 only: 7.35.1-5.3 only: 7.35.0-5.3 only: 7.25.0-5.3 only: 7.27.1, 7.07.1, 7.06.5 SP16.5 SP15.1-5.3 only: 7.3-5.0-5.3 only: 7.27.1, 7.05.0-5.3 only: 6.5 SP1Windows 8.1 (32-bit)5.1-5.3 only: 7.3-5.0-5.3 only: 7.27.1, 7.05.0-5.3 only: 6.5 SP1Windows 8 (32/64-bit)5.1-5.3 only: 7.3-5.0-5.3 only: 7.27.1, 7.05.0-5.3 only: 6.5 SP1Windows 7 (32/64-bit)5.1-5.3 only: 7.35.1-5.3 only: 7.35.0-5.3 only: 7.25.0-5.3 only: 7.27.1, 7.07.1, 7.05.0-5.3 only: 6.5 SP15.0-5.3 only: 6.5 SP1Supported only on TeslaM6, Tesla M10, and TeslaM60 GPUswww.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 7
Validated Platforms2.3.2. Linux Guest OS SupportNVIDIA vGPU software supports only the Linux distributions listed in the table as aguest OS on Citrix XenServer. The releases of Citrix XenServer for which a Linux releaseis supported depend on whether NVIDIA vGPU or pass-through GPU is used.If a specific release, even an update release, is not listed, it’s not supported.Guest OSNVIDIA vGPU - CitrixXenServer ReleasesPass-Through GPU- Citrix XenServerReleasesSince 5.4: Red Hat Enterprise Linux 7.57.1, 7.07.1, 7.0Red Hat Enterprise Linux 7.0-7.45.1-5.3 only: 7.35.1-5.3 only: 7.35.0-5.3 only: 7.25.0-5.3 only: 7.27.1, 7.07.1, 7.0Since 5.4: CentOS 7.57.1, 7.07.1, 7.0CentOS 7.0-7.45.1-5.3 only: 7.35.1-5.3 only: 7.35.0-5.3 only: 7.25.0-5.3 only: 7.27.1, 7.07.1, 7.05.1-5.3 only: 7.35.1-5.3 only: 7.35.0-5.3 only: 7.25.0-5.3 only: 7.27.1, 7.07.1, 7.05.1-5.3 only: 7.35.1-5.3 only: 7.35.0-5.3 only: 7.25.0-5.3 only: 7.27.1, 7.07.1, 7.0Ubuntu 16.04 LTSUbuntu 14.04 LTS2.4. NVIDIA CUDA Toolkit Version SupportThe releases in this release family of NVIDIA vGPU software support NVIDIA CUDAToolkit 9.0.For more information about NVIDIA CUDA Toolkit, see CUDA Toolkit 9.0Documentation.www.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 8
Chapter 3.KNOWN PRODUCT LIMITATIONSKnown product limitations for this release of NVIDIA vGPU software are described inthe following sections.3.1. vGPU profiles with 512 Mbytes or less offrame buffer support only 1 virtual display headon Windows 10DescriptionTo reduce the possibility of memory exhaustion, vGPU profiles with 512 Mbytes or lessof frame buffer support only 1 virtual display head on a Windows 10 guest OS.The following vGPU profiles have 512 Mbytes or less of frame buffer:‣‣‣Tesla M6-0B, M6-0QTesla M10-0B, M10-0QTesla M60-0B, M60-0QWorkaroundUse a profile that supports more than 1 virtual display head and has at least 1 Gbyte offrame buffer.www.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 9
Known Product Limitations3.2. NVENC requires at least 1 Gbyte of framebufferDescriptionUsing the frame buffer for the NVIDIA hardware-based H.264/HEVC video encoder(NVENC) may cause memory exhaustion with vGPU profiles that have 512 Mbytesor less of frame buffer. To reduce the possibility of memory exhaustion, NVENC isdisabled on profiles that have 512 Mbytes or less of frame buffer. Application GPUacceleration remains fully supported and available for all profiles, including profileswith 512 MBytes or less of frame buffer. NVENC support from both Citrix and VMwareis a recent feature and, if you are using an older version, you should experience nochange in functionality.The following vGPU profiles have 512 Mbytes or less of frame buffer:‣‣‣Tesla M6-0B, M6-0QTesla M10-0B, M10-0QTesla M60-0B, M60-0QWorkaroundIf you require NVENC to be enabled, use a profile that has at least 1 Gbyte of framebuffer.3.3. VM running older NVIDIA vGPU drivers fails toinitialize vGPU when bootedDescriptionA VM running a version of the NVIDIA guest VM drivers from a previous main releasebranch, for example release 4.4, will fail to initialize vGPU when booted on a CitrixXenServer platform running the current release of Virtual GPU Manager.In this scenario, the VM boots in standard VGA mode with reduced resolution and colordepth. The NVIDIA virtual GPU is present in Windows Device Manager but displays awarning sign, and the following device status:Windows has stopped this device because it has reported problems. (Code 43)Depending on the versions of drivers in use, the Citrix XenServer VM’s /var/log/messages log file reports one of the following errors:‣An error message:www.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 10
Known Product Limitations‣‣vmiop log: error: Unable to fetch Guest NVIDIA driver informationA version mismatch between guest and host drivers:vmiop log: error: Guest VGX version(1.1) and Host VGX version(1.2) do notmatchA signature mismatch:vmiop log: error: VGPU message signature mismatch.ResolutionInstall the current NVIDIA guest VM driver in the VM.3.4. Virtual GPU fails to start if ECC is enabledDescriptionTesla M60, Tesla M6, and GPUs based on the Pascal GPU architecture, for exampleTesla P100 or Tesla P4, support error correcting code (ECC) memory for improved dataintegrity. Tesla M60 and M6 GPUs in graphics mode are supplied with ECC memorydisabled by default, but it may subsequently be enabled using nvidia-smi. GPUsbased on the Pascal GPU architecture are supplied with ECC memory enabled.However, NVIDIA vGPU does not support ECC memory. If ECC memory is enabled,NVIDIA vGPU fails to start.Citrix XenCenter displays the following error message:An emulator required to run this VM failed to startThe following error is logged in the Citrix XenServer VM’s /var/log/messages logfile:vmiop log: error: Initialization: VGX not supported with ECC Enabled.ResolutionEnsure that ECC is disabled on all GPUs.Before you begin, ensure that NVIDIA Virtual GPU Manager is installed on yourhypervisor.1.Use nvidia-smi to list the status of all GPUs, and check for ECC noted as enabledon GPUs.# nvidia-smi -q NVSMI LOG TimestampDriver Versionwww.nvidia.comVirtual GPU Software R384 for Citrix XenServer: Tue Dec 19 18:36:45 2017: 384.99RN-06927-001 v5.0 through 5.4 Revision 04 11
Known Product LimitationsAttached GPUsGPU 0000:02:00.0: 1[.]Ecc ModeCurrentPending2.: Enabled: Enabled[.]Change the ECC status to off on each GPU for which ECC is enabled.‣‣If you want to change the ECC status to off for all GPUs on your host machine,run this command:# nvidia-smi -e 0If you want to change the ECC status to off for a specific GPU, run thiscommand:# nvidia-smi -i id -e 0id is the index of the GPU as reported by nvidia-smi.This example disables ECC for the GPU with index 0000:02:00.0.3.4.# nvidia-smi -i 0000:02:00.0 -e 0Reboot the host.# shutdown –r nowConfirm that ECC is now disabled for the GPU.# nvidia-smi -q NVSMI LOG TimestampDriver Version: Tue Dec 19 18:37:53 2017: 384.99Attached GPUsGPU 0000:02:00.0[.]: 1Ecc ModeCurrentPending: Disabled: Disabled[.]If you later need to enable ECC on your GPUs, run one of the following commands:‣‣If you want to change the ECC status to on for all GPUs on your host machine, runthis command:# nvidia-smi -e 1If you want to change the ECC status to on for a specific GPU, run this command:# nvidia-smi -i id -e 1id is the index of the GPU as reported by nvidia-smi.www.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 12
Known Product LimitationsThis example enables ECC for the GPU with index 0000:02:00.0.# nvidia-smi -i 0000:02:00.0 -e 1After changing the ECC status to on, reboot the host.3.5. Single vGPU benchmark scores are lower thanpass-through GPUDescriptionA single vGPU configured on a physical GPU produces lower benchmark scores thanthe physical GPU run in pass-through mode.Aside from performance differences that may be attributed to a vGPU’s smaller framebuffer size, vGPU incorporates a performance balancing feature known as Frame RateLimiter (FRL). On vGPUs that use the best-effort scheduler, FRL is enabled. On vGPUsthat use the fixed share or equal share scheduler, FRL is disabled.FRL is used to ensure balanced performance across multiple vGPUs that are residenton the same physical GPU. The FRL setting is designed to give good interactive remotegraphics experience but may reduce scores in benchmarks that depend on measuringframe rendering rates, as compared to the same benchmarks running on a pass-throughGPU.ResolutionFRL is controlled by an internal vGPU setting. On vGPUs that use the best-effortscheduler, NVIDIA does not validate vGPU with FRL disabled, but for validationof benchmark performance, FRL can be temporarily disabled by specifyingframe rate limiter 0 in the VM’s platform:vgpu extra args parameter:[root@xenserver ]# xe vm-param-set uuid e71afda4-53f4-3a1b-6c92-a364a7f619c2platform:vgpu extra args "frame rate limiter 0"[root@xenserver ]#The setting takes effect the next time the VM is started or rebooted.With this setting in place, the VM’s vGPU will run without any frame rate limit. The FRLcan be reverted back to its default setting in one of the following ways:‣‣‣Removing the vgpu extra args key from the platform parameterRemoving frame rate limiter 0 from the vgpu extra args keySetting frame rate limiter 1. For example:[root@xenserver ]# xe vm-param-set uuid e71afda4-53f4-3a1b-6c92a364a7f619c2 platform:vgpu extra args "frame rate limiter 1"[root@xenserver ]#www.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 13
Known Product Limitations3.6. nvidia-smi fails to operate when all GPUsare assigned to GPU passthrough modeDescriptionIf all GPUs in the platform are assigned to VMs in passthrough mode, nvidia-smi willreturn an error:[root@xenserver-vgx-test ]# nvidia-smiFailed to initialize NVML: Unknown ErrorThis is because GPUs operating in passthrough mode are not visible to nvidia-smiand the NVIDIA kernel driver operating in the Citrix XenServer dom0.To confirm that all GPUs are operating in passthrough, use XenCenter’s GPU tab toreview current GPU assignment:www.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 14
Known Product LimitationsResolutionN/A3.7. Windows Aero is disabled on XenDesktopsession using 3 or 4 monitors in 2560 1600resolutionDescriptionWindows Aero may be disabled when XenDesktop is connected to a VM with a vGPU orpassthrough GPU, with 3 or 4 monitors at 2560 1600 resolution.This limitation is a limitation of Windows 7. For details, see the Microsoft knowledgebase article Desktop background disappears with very large extended desktop onWindows 7.3.8. VMs configured with large memory fail toinitialize vGPU when bootedDescriptionWhen starting multiple VMs configured with large amounts of RAM (typically morethan 32GB per VM), a VM may fail to initialize vGPU. In this scenario, the VM bootsin standard VGA mode with reduced resolution and color depth. The NVIDIA vGPUsoftware GPU is present in Windows Device Manager but displays a warning sign, andthe following device status:Windows has stopped this device because it has reported problems. (Code 43)The Citrix XenServer VM’s /var/log/messages log file contains these error messages:vmiop log:vmiop log:vmiop log:.vmiop log:.vmiop log:vmiop log:vmiop log:.vmiop log:error: NVOS status 0x29error: Assertion Failed at 0x7620fd4b:179error: 8 frames returned by backtraceerror: VGPU message 12 failed, result code: 0x29error: NVOS status 0x8error: Assertion Failed at 0x7620c8df:280error: 8 frames returned by backtraceerror: VGPU message 26 failed, result code: 0x8www.nvidia.comVirtual GPU Software R384 for Citrix XenServerRN-06927-001 v5.0 through 5.4 Revision 04 15
Known Product LimitationsResolutionvGPU reserves a portion of the VM’s framebuffer for use in GPU mapping of VM systemmemory. The reservation is sufficient to support up to 32GB of system memory, and maybe increased to accommodate up to 64GB by specifying enable large sys mem 1 inthe VM’s platform:vgpu extra args parameter:[root@xenserver ]# xe vm-param-set uuid e71afda4-53f4-3a1b-6c92-a364a7f619c2platform:vgpu extra args "enable large sys mem 1"The setting takes effect the next time the VM is started or rebooted. With this settingin place, less GPU FB is available to applications running in the VM. To accommodatesystem memory larger than 64GB, the reservation can be further increased by specifyingextra fb reservation in the VM’s platform:vgpu extra args parameter,and setting its value to the desired reservation size in megabytes. The default value of64M is sufficient to support 64GB of RAM. We recommend adding 2M of reservationfor each additional 1GB of syste
‣ Support for Citrix XenDesktop 7.18 ‣ Support for Red Hat Enteprise Linux 7.5 and CentOS 7.5 as a guest OS Feature Support Withdrawn in Release 5.4 ‣ Citrix XenServer 7.3, 7.2, and 6.5 are no longer supported. ‣ Citrix XenDesktop 7.6, 7.8, and 7.11 are no longer supported.
