Hey all, hoping to get some help with this, I am stumped.

 

I recently upgraded from a Crosshair VII, amd 2700x, 32gb ram and a 1060 to a B550 creator, amd 5950x, 64gb ram and a 3060.

 

I am also running a Supermicro AOC-S3008I-L8E HBA.

 

I had problems from the get go and could not boot unraid in UEFI mode so I changed to legacy and thought I fixed everything but when I started the array my boot usb with unraid will disconnect.

 

I thought maybe it was because of not being able to boot UEFI mode so I figured that out which I had to disable CMS, change to "UEFI other", and turn my PCIe slots to gen 3. Once I got this working the same thing is happening, as soon as I start the array my usb will disconnect.

 

So I then created a new USB and copied my old config over to it and still the same problem.

 

I have tried every usb port on the board now and still the same problem.

 

Any ideas at all, I have attached an unraid diagnostics file to this

 

nas-diagnostics-20230911-2214.zip

Update, I can start the array in maintenance mode but as soon as I mount the HDDs the USB boot disconnects, any ideas?

You are passing through a USB controller to the Win10 VM:

 

<hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
      </source>
      <boot order='1'/>
      <address type='pci' domain='0x0000' bus='0x06' slot='0x00' function='0x0'/>
    </hostdev>

 

Remove this from the XML

3 hours ago, JorgeB said:

You are passing through a USB controller to the Win10 VM:

 

<hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
      </source>
      <boot order='1'/>
      <address type='pci' domain='0x0000' bus='0x06' slot='0x00' function='0x0'/>
    </hostdev>

 

Remove this from the XML

How do I get access to the VM XMLs if I can't start the array and or dockers? Is this on the Unraid USB somewhere?

Easiest way I can think of would be edit /boot/config/domain.cfg and change SERVICE="enable" to "disable", then start array and rename that vdisk so that the VM doesn't start, start the VM service and edit the XML, once done rename the vdisk back.

15 minutes ago, JorgeB said:

Easiest way I can think of would be edit /boot/config/domain.cfg and change SERVICE="enable" to "disable", then start array and rename that vdisk so that the VM doesn't start, start the VM service and edit the XML, once done rename the vdisk back.

 

Progress, I was able to start the array. I renamed that VM to something else but as soon I start the VM service to edit the XML the unraid USB disconnects like before. I've attached another log.

 

Thank you so much for helping with this : )

todaynas-diagnostics-20230912-0904.zip

Before there a thing you could to to prevent VM auto start for a situation like this, @SimonFcan you think of a way to currently resolve this?

2 hours ago, JorgeB said:

Before there a thing you could to to prevent VM auto start for a situation like this, @SimonFcan you think of a way to currently resolve this?

So this VM runs on a baremetal NVME, could I just delete the VM and try to recreate the VM since all my data is on the NVME drive?

In that case it should be OK.

16 minutes ago, JorgeB said:

In that case it should be OK.

Just discovered on this MB the NVME isn't in it own IMMOU group : (, any work arounds?

You can try enabling PCIe ACS override, if it's already enabled not much more you can do.

3 hours ago, JorgeB said:

Before there a thing you could to to prevent VM auto start for a situation like this, @SimonFcan you think of a way to currently resolve this?

Manual mount of libvirt image and remove autostart link then unmount is only way at present.

1 hour ago, JorgeB said:

You can try enabling PCIe ACS override, if it's already enabled not much more you can do.

This worked mostly but had to swap some ports/slots around

Just wanted to say thank ya'll so much for helping me with this : )