November 27, 20241 yr Hello, I am having an issue with trying to passthrough a gpu to a VM. I have an UnRaid server with: 1) ASRockRack ROMED8-2T/BCM 2) AMD EPYC 7282 16-Core 3) Nvidia tesla P4 & Tesla P100 I am already running a couple of VMs with no gpus. I installed a fresh ubuntu server 22.04 VM with no issues. Then i tried to passthrough the P100 gpu. the moment i start the VM the unraid GUI freezes. Any tab i try to go to it just keeps loading and never loads the page. My only option is to do hard reboot. The interesting bit is that the services / websites running on the other VMs run fine. Even with the unraid gui unresponsive / not loading. I wonder if i need to do anything extra than just selecting the GPU in the dropdown? If I select the GPU the server gui freezes and i can not reconnect to this vm. So any config needs to happen on the xml? Thanks, George Edited November 27, 20241 yr by [email protected] More info
November 27, 20241 yr Solution Are any docker's using the GPU? I can't remember if the Epyc chips had integrated graphics. So if docker is using it you have to unmap that as it can't live in both worlds local to the kernel and as passthrough to a VM. If not verify passthrough in the tools> system devices and check the boxes next to the card and card audio. Reboot I think is required afterwards. Word of warning, you may not get a display until you assign to the VM and turn the VM on. IOMMU passthrough without a secondary GPU can be "weird" for lack of better words. Edited November 27, 20241 yr by nimble_bitz Warning added.
November 27, 20241 yr Community Expert 53 minutes ago, [email protected] said: Hello, I am having an issue with trying to passthrough a gpu to a VM. I have an UnRaid server with: 1) ASRockRack ROMED8-2T/BCM 2) AMD EPYC 7282 16-Core 3) Nvidia tesla P4 & Tesla P100 I am already running a couple of VMs with no gpus. I installed a fresh ubuntu server 22.04 VM with no issues. Then i tried to passthrough the P100 gpu. the moment i start the VM the unraid GUI freezes. Any tab i try to go to it just keeps loading and never loads the page. My only option is to do hard reboot. The interesting bit is that the services / websites running on the other VMs run fine. Even with the unraid gui unresponsive / not loading. I wonder if i need to do anything extra than just selecting the GPU in the dropdown? If I select the GPU the server gui freezes and i can not reconnect to this vm. So any config needs to happen on the xml? Thanks, George Have you bound GPU to vfio?
November 27, 20241 yr Author Epyc CPUs do not have a integrated iGPU unfortunately. No, the P100 is not used by docker. Also there is not display connected to the GPU as it has no display ports and no sound. Its a Nvidia Tesla. I don't need it for display. I plan use it for compute. I checked the box in the tools and rebooted the server. Assigned the GPU to the VM Started the VM For a minute or so the server was still responsive but eventually the GUI froze again. However i opened the logs before starting the VM.
November 27, 20241 yr Community Expert 3 minutes ago, [email protected] said: Epyc CPUs do not have a integrated iGPU unfortunately. No, the P100 is not used by docker. Also there is not display connected to the GPU as it has no display ports and no sound. Its a Nvidia Tesla. I don't need it for display. I plan use it for compute. I checked the box in the tools and rebooted the server. Assigned the GPU to the VM Started the VM For a minute or so the server was still responsive but eventually the GUI froze again. However i opened the logs before starting the VM. You should not need the Nvidia drivers if passing to a VM. If not bound to vfio it tries to do and it will remove from nv driver which may be the issue.
November 27, 20241 yr Author 44 minutes ago, nimble_bitz said: Are any docker's using the GPU? I can't remember if the Epyc chips had integrated graphics. So if docker is using it you have to unmap that as it can't live in both worlds local to the kernel and as passthrough to a VM. If not verify passthrough in the tools> system devices and check the boxes next to the card and card audio. Reboot I think is required afterwards. Word of warning, you may not get a display until you assign to the VM and turn the VM on. IOMMU passthrough without a secondary GPU can be "weird" for lack of better words. I am so F******g do**** ****** stupid... When checking the box make sure you press the "save" button and make SURE it gets clicked, it saves and the message comes up... sorry for wasting your time
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.