• 6.12.0-RC1 VMs do not display


    ross232
    • Solved Minor

    After upgrading to 6.12.0-RC1 Virtual Machines are not displaying. In the dashboard these are visible.

    If a VM was set to autostart it is actually running.

     

    Virtual Machines are correctly shown using virsh list-all:

     

    root@Tower:~# virsh list --all
     Id   Name                State
    ------------------------------------
     1    Fedora Silverblue   running
     -    Fedora SB           shut off
     -    Windows 11          shut off

    Screenshot_20230316_164336.png

    Screenshot_20230316_163727.png

    tower-diagnostics-20230317-0554.zip




    User Feedback

    Recommended Comments



    Same, upgraded from 6.11.5 and thought was related to docker.folder pluugin, so I removed the plugin and same issue. Rebooted in safe mode and same issue, so I don't know at this point. I do have this error from the libvirt log:

     

    2023-03-16 21:08:22.958+0000: 9244: info : libvirt version: 8.7.0
    2023-03-16 21:08:22.958+0000: 9244: info : hostname: unRAID-Prod
    2023-03-16 21:08:22.958+0000: 9244: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error

     

     

    Link to comment
    1 hour ago, ross232 said:


    6.11.5

    Your issue may be related to the PCI devices on your Windows machine. Source devices in XML are not matching the PCI. looks like you have a RX480 guessing that should be 29 and 2a not 29.00.0 and 29.00.1

     

    Can you confirm which devices should be mapped to the Windows VM?

     

       <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x29' slot='0x00' function='0x0'/>
          </source>
          <rom file='/mnt/user/isos/XFX.RX480.8192.161014.rom'/>
          <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0'/>
        </hostdev>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x29' slot='0x00' function='0x1'/>
          </source>
          <address type='pci' domain='0x0000' bus='0x05' slot='0x00' function='0x0'/>
        </hostdev>
        <hostdev mode='subsystem' type='pci' managed='yes'>
          <driver name='vfio'/>
          <source>
            <address domain='0x0000' bus='0x27' slot='0x00' function='0x0'/>
          </source>
          <address type='pci' domain='0x0000' bus='0x06' slot='0x00' function='0x0'/>
        </hostdev>
     

    27:00.0 USB controller [0c03]: Renesas Technology Corp. uPD720201 USB 3.0 Host Controller [1912:0014] (rev 03)
        Kernel driver in use: vfio-pci
    29:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Upstream Port of PCI Express Switch [1002:1478] (rev c7)
        Kernel driver in use: pcieport
    2a:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Downstream Port of PCI Express Switch [1002:1479]
        Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Downstream Port of PCI Express Switch [1002:1479]
        Kernel driver in use: pcieport
    2b:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Navi 23 [Radeon RX 6600/6600 XT/6600M] [1002:73ff] (rev c7)
        Subsystem: ASRock Incorporation Navi 23 [Radeon RX 6600/6600 XT/6600M] [1849:5217]
        Kernel driver in use: vfio-pci
        Kernel modules: amdgpu
    2b:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Navi 21/23 HDMI/DP Audio Controller [1002:ab28]
        Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Navi 21 HDMI Audio [Radeon RX 6800/6800 XT / 6900 XT] [1002:ab28]
        Kernel driver in use: vfio-pci
    2c:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function [1022:145a]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function [1022:145a]
    2c:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor (PSP) 3.0 Device [1022:1456]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor [1022:1456]
        Kernel driver in use: ccp
        Kernel modules: ccp
    2c:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller [1022:145c]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Family 17h (Models 00h-0fh) USB 3.0 Host Controller [1462:7a34]
        Kernel driver in use: xhci_hcd
    2d:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function [1022:1455]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function [1022:1455]
    2d:00.2 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
        Subsystem: Micro-Star International Co., Ltd. [MSI] FCH SATA Controller [AHCI mode] [1462:7a34]
        Kernel driver in use: ahci
        Kernel modules: ahci
    2d:00.3 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) HD Audio Controller [1022:1457]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Family 17h (Models 00h-0fh) HD Audio Controller [1462:da34]

     

    Link to comment
    14 minutes ago, Govnah said:

    Same, upgraded from 6.11.5 and thought was related to docker.folder pluugin, so I removed the plugin and same issue. Rebooted in safe mode and same issue, so I don't know at this point. I do have this error from the libvirt log:

     

    2023-03-16 21:08:22.958+0000: 9244: info : libvirt version: 8.7.0
    2023-03-16 21:08:22.958+0000: 9244: info : hostname: unRAID-Prod
    2023-03-16 21:08:22.958+0000: 9244: error : virNetSocketReadWire:1791 : End of file while reading data: Input/output error

     

     

    Can you post diagnostics.

    Link to comment
    1 hour ago, Govnah said:

    On OPNSense VM you have 

     

    <driver name="vfio"/>


    -<source>

    <address bus="0x03" function="0x3" slot="0x00" domain="0x0000"/>

    </source>

    <address type="pci" bus="0x03" function="0x0" slot="0x00" domain="0x0000"/>

     

    but there is no bus 3 function 3. Should that be the usb on 5:00.3?

     

    03:00.0 Serial Attached SCSI controller [0107]: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] [1000:0072] (rev 03)
        Subsystem: Broadcom / LSI 9211-8i [1000:3020]
        Kernel driver in use: mpt3sas
        Kernel modules: mpt3sas
    04:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
    05:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
    05:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Starship USB 3.0 Host Controller [1462:7c59]
        Kernel driver in use: xhci_hcd

     

    TrueScale

     

    -<source>

    <address bus="0x4a" function="0x0" slot="0x00" domain="0x0000"/>

    </source>

     

    4a:00.0 Non-Volatile memory controller [0108]: Sandisk Corp WD Black SN750 / PC SN730 NVMe SSD [15b7:5006]
        Subsystem: Sandisk Corp WD Black SN750 / PC SN730 NVMe SSD [15b7:5006]
        Kernel driver in use: nvme
        Kernel modules: nvme

     

    Ubuntu-HQPlayer looks ok for the GPU.

     


    -<hostdev type="pci" mode="subsystem" managed="yes">

    <driver name="vfio"/>


    -<source>

    <address bus="0x4c" function="0x0" slot="0x00" domain="0x0000"/>

    </source>

    <address type="pci" bus="0x04" function="0x0" slot="0x00" domain="0x0000"/>

    </hostdev>


    -<hostdev type="pci" mode="subsystem" managed="yes">

    <driver name="vfio"/>


    -<source>

    <address bus="0x4c" function="0x1" slot="0x00" domain="0x0000"/>

    </source>

    <address type="pci" bus="0x05" function="0x0" slot="0x00" domain="0x0000"/>

    </hostdev>

     

    4c:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP106GL [Quadro P2200] [10de:1c31] (rev a1)
        Subsystem: Dell GP106GL [Quadro P2200] [1028:131b]
        Kernel driver in use: vfio-pci
    4c:00.1 Audio device [0403]: NVIDIA Corporation GP106 High Definition Audio Controller [10de:10f1] (rev a1)
        Subsystem: Dell GP106 High Definition Audio Controller [1028:131b]
        Kernel driver in use: vfio-pci

    Link to comment

    Do your VMs actually turn on? Mine are visible via the portal - but passthrough of devices aren't happening - no display, lights on key/mouse, etc. Even though portal says the VM is on.

    Link to comment

    Yes, the VMs that are enabled for "autostart" but I just don't have anything listed under the VM Tab. I am trying to decipher what SimonF is telling me at the moment...

    Link to comment
    37 minutes ago, SimonF said:

    On OPNSense VM you have 

     

    <driver name="vfio"/>


    -<source>

    <address bus="0x03" function="0x3" slot="0x00" domain="0x0000"/>

    </source>

    <address type="pci" bus="0x03" function="0x0" slot="0x00" domain="0x0000"/>

     

    but there is no bus 3 function 3. Should that be the usb on 5:00.3?

     

    03:00.0 Serial Attached SCSI controller [0107]: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] [1000:0072] (rev 03)
        Subsystem: Broadcom / LSI 9211-8i [1000:3020]
        Kernel driver in use: mpt3sas
        Kernel modules: mpt3sas
    04:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
    05:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
        Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
    05:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
        Subsystem: Micro-Star International Co., Ltd. [MSI] Starship USB 3.0 Host Controller [1462:7c59]
        Kernel driver in use: xhci_hcd

     

    TrueScale

     

    -<source>

    <address bus="0x4a" function="0x0" slot="0x00" domain="0x0000"/>

    </source>

     

    4a:00.0 Non-Volatile memory controller [0108]: Sandisk Corp WD Black SN750 / PC SN730 NVMe SSD [15b7:5006]
        Subsystem: Sandisk Corp WD Black SN750 / PC SN730 NVMe SSD [15b7:5006]
        Kernel driver in use: nvme
        Kernel modules: nvme

     

    Ubuntu-HQPlayer looks ok for the GPU.

     


    -<hostdev type="pci" mode="subsystem" managed="yes">

    <driver name="vfio"/>


    -<source>

    <address bus="0x4c" function="0x0" slot="0x00" domain="0x0000"/>

    </source>

    <address type="pci" bus="0x04" function="0x0" slot="0x00" domain="0x0000"/>

    </hostdev>


    -<hostdev type="pci" mode="subsystem" managed="yes">

    <driver name="vfio"/>


    -<source>

    <address bus="0x4c" function="0x1" slot="0x00" domain="0x0000"/>

    </source>

    <address type="pci" bus="0x05" function="0x0" slot="0x00" domain="0x0000"/>

    </hostdev>

     

    4c:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP106GL [Quadro P2200] [10de:1c31] (rev a1)
        Subsystem: Dell GP106GL [Quadro P2200] [1028:131b]
        Kernel driver in use: vfio-pci
    4c:00.1 Audio device [0403]: NVIDIA Corporation GP106 High Definition Audio Controller [10de:10f1] (rev a1)
        Subsystem: Dell GP106 High Definition Audio Controller [1028:131b]
        Kernel driver in use: vfio-pci

    I removed the OPNSense VM, not in use and that addressed the issue, thanks for the assistance!

     

    Link to comment
    17 hours ago, ross232 said:


    6.11.5

    I have submitted a fix so the vms show but devices may need to re added to the vm

    • Like 1
    Link to comment

    I can confirm i experience the same, however even under VM tab it doesn't give me an option to even create/add new VMs.

    virsh list --all
     Id   Name                  State
    --------------------------------------
     2    Windows Server 2019   running
     -    OPNSense              shut off
     -    pfSense               shut off
     -    Ubuntu                shut off
     

    Screenshot 2023-03-17 at 19.39.51.png

    Screenshot 2023-03-17 at 19.39.28.png

    Link to comment
    7 minutes ago, Xploit61 said:

    I can confirm i experience the same, however even under VM tab it doesn't give me an option to even create/add new VMs.

    virsh list --all
     Id   Name                  State
    --------------------------------------
     2    Windows Server 2019   running
     -    OPNSense              shut off
     -    pfSense               shut off
     -    Ubuntu                shut off
     

    Screenshot 2023-03-17 at 19.39.51.png

    Screenshot 2023-03-17 at 19.39.28.png

    one of the vms may have pci device allocated and pci id has changed should be a fix in rc2

    • Like 2
    Link to comment

    RC2 is out now and this should show all VMs. You may have issues starting VMs if the PCI ID has changed which you will need to fix but updating the VM Template to re add the PCI devices.

    Link to comment

    Hey guys,

     

    pardon me for reopening this thread, but I'm having the exact same issue.

    I just upgraded to 6.12.0-rc5 from 6.11.5 and as far as I can tell, everything seems to be running smooth so far - except the VMs Tab. All the VMs are still there though and can be managed/started from the dashboard.

    Tried toggling vm-manager off/on and rebooting the server to no avail. 😕

     

    See attached the virsh list and diagnostics

     

    # virsh list --all
     Id   Name       State
    ---------------------------
     1    DebServ    running
     2    WinServ    running
     -    MacVania   shut off

     

     

    Any pointers on how to fix this?

    unraid vms tab issue.jpg

    theserver-diagnostics-20230505-0154.zip

    Edited by paddesb
    Link to comment
    7 hours ago, paddesb said:

    -    MacVania   shut off

    The XML is malformed for this VM. Can you delete it?

    Link to comment
    32 minutes ago, SimonF said:

    The XML is malformed for this VM. Can you delete it?

     

    yes, I just (completely) deleted the VM right now via the Dashboard and checked /etc/libvirt/qemu for any residual files. As far as I can tell everything's gone but the issue persists.

    Maybe as a note: this vm was created with ED's macinabox script and there still may be some leftover files I don't know about elsewhere

    Edited by paddesb
    Link to comment

    I have exactly the same issue. (RC6)
    VMs are shown on the dashboard and all start/stop etc without issue. I don't beleive this is a "virsh" etc issue.
    The VMS page has the headers but no content.

    Updraded from current stable.
    All aspects work fine in current stable.

     

    [edit]

     

    Don't know if this sheds any light?

    root@Tower:~# cat /var/log/unraid-api/stderr.log
    [2023-06-04T12:23:01.550] [7893] [ERROR] [libvirt] Failed watching with "invalid connection pointer in virConnectListAllDomains"

    Edited by ThrashMan
    Link to comment
    10 minutes ago, ThrashMan said:

    I have exactly the same issue. (RC6)
    VMs are shown on the dashboard and all start/stop etc without issue. I don't beleive this is a "virsh" etc issue.
    The VMS page has the headers but no content.

    Updraded from current stable.
    All aspects work fine in current stable.

     

    [edit]

     

    Don't know if this sheds any light?

    root@Tower:~# cat /var/log/unraid-api/stderr.log
    [2023-06-04T12:23:01.550] [7893] [ERROR] [libvirt] Failed watching with "invalid connection pointer in virConnectListAllDomains"

    Are you able to post diagnostics?

    Link to comment
    48 minutes ago, paddesb said:

    Hey @SimonF

    Referring to my earlier post I updated to RC6 (from RC5) as well and the problem persists.

    I attached the updated diagnostics.

    Maybe it helps investigating why this is happening. 🤞

     

    virsh list --all
     Id   Name      State
    -------------------------
     1    DebServ   running
     2    WinServ   running

     

     

    Cheers

    theserver-diagnostics-20230604-1454.zip

    and @ThrashMan Can you provide the out of cat /sys/devices/system/cpu/*/topology/thread_siblings_list|sort -nu for me please.

    Link to comment



    Join the conversation

    You can post now and register later. If you have an account, sign in now to post with your account.
    Note: Your post will require moderator approval before it will be visible.

    Guest
    Add a comment...

    ×   Pasted as rich text.   Restore formatting

      Only 75 emoji are allowed.

    ×   Your link has been automatically embedded.   Display as a link instead

    ×   Your previous content has been restored.   Clear editor

    ×   You cannot paste images directly. Upload or insert images from URL.


  • Status Definitions

     

    Open = Under consideration.

     

    Solved = The issue has been resolved.

     

    Solved version = The issue has been resolved in the indicated release version.

     

    Closed = Feedback or opinion better posted on our forum for discussion. Also for reports we cannot reproduce or need more information. In this case just add a comment and we will review it again.

     

    Retest = Please retest in latest release.


    Priority Definitions

     

    Minor = Something not working correctly.

     

    Urgent = Server crash, data loss, or other showstopper.

     

    Annoyance = Doesn't affect functionality but should be fixed.

     

    Other = Announcement or other non-issue.