Skip to content
View in the app

A better way to browse. Learn more.
Unraid

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.
Unraid Summer Sale in live: 20% off Starter and Unleashed + buy one, get one 50% off

[SOLVED] Trying to pass through Tesla P4. internal error: Unknown PCI header type '127' for device '0000:04:00.0'

ghstridr
in VM Engine (KVM)

Featured Replies

Unraid version 7.0.1

CPU: i9-9900K

RAM: 96GB

MB: Gigabyte Z390 DESIGNARE-CF

This was working just find in Unraid 6.xx. 

VM Config:  

<?xml version='1.0' encoding='UTF-8'?>
<domain type='kvm'>
  <name>Ollama2</name>
  <uuid>14860697-0187-87b2-54ba-225059a6a357</uuid>
  <metadata>
    <vmtemplate xmlns="unraid" name="Ubuntu" icon="ubuntu.png" os="ubuntu" webui=""/>
  </metadata>
  <memory unit='KiB'>16777216</memory>
  <currentMemory unit='KiB'>16777216</currentMemory>
  <memoryBacking>
    <nosharepages/>
  </memoryBacking>
  <vcpu placement='static'>8</vcpu>
  <cputune>
    <vcpupin vcpu='0' cpuset='0'/>
    <vcpupin vcpu='1' cpuset='8'/>
    <vcpupin vcpu='2' cpuset='1'/>
    <vcpupin vcpu='3' cpuset='9'/>
    <vcpupin vcpu='4' cpuset='2'/>
    <vcpupin vcpu='5' cpuset='10'/>
    <vcpupin vcpu='6' cpuset='3'/>
    <vcpupin vcpu='7' cpuset='11'/>
  </cputune>
  <os>
    <type arch='x86_64' machine='pc-q35-9.1'>hvm</type>
    <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader>
    <nvram>/etc/libvirt/qemu/nvram/14860697-0187-87b2-54ba-225059a6a357_VARS-pure-efi.fd</nvram>
  </os>
  <features>
    <acpi/>
    <apic/>
  </features>
  <cpu mode='host-passthrough' check='none' migratable='on'>
    <topology sockets='1' dies='1' clusters='1' cores='4' threads='2'/>
    <cache mode='passthrough'/>
  </cpu>
  <clock offset='utc'>
    <timer name='hpet' present='no'/>
    <timer name='hypervclock' present='no'/>
    <timer name='pit' tickpolicy='delay'/>
    <timer name='rtc' tickpolicy='catchup'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <devices>
    <emulator>/usr/local/sbin/qemu</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='writeback' discard='ignore'/>
      <source file='/mnt/user/domains/Ollama2/vdisk1.img'/>
      <target dev='hdc' bus='virtio'/>
      <serial>vdisk1</serial>
      <boot order='1'/>
      <address type='pci' domain='0x0000' bus='0x03' slot='0x00' function='0x0'/>
    </disk>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci2'>
      <master startport='2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci3'>
      <master startport='4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pcie-root'/>
    <controller type='pci' index='1' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='1' port='0x8'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0' multifunction='on'/>
    </controller>
    <controller type='pci' index='2' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='2' port='0x9'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
    </controller>
    <controller type='pci' index='3' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='3' port='0xa'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>
    </controller>
    <controller type='pci' index='4' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='4' port='0xb'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x3'/>
    </controller>
    <controller type='pci' index='5' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='5' port='0xc'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x4'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x00' function='0x0'/>
    </controller>
    <controller type='sata' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/>
    </controller>
    <interface type='bridge'>
      <mac address='52:54:00:1e:fe:2f'/>
      <source bridge='br0'/>
      <model type='virtio-net'/>
      <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
    </interface>
    <serial type='pty'>
      <target type='isa-serial' port='0'>
        <model name='isa-serial'/>
      </target>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
    </console>
    <channel type='unix'>
      <target type='virtio' name='org.qemu.guest_agent.0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='tablet' bus='usb'>
      <address type='usb' bus='0' port='1'/>
    </input>
    <input type='mouse' bus='ps2'/>
    <input type='keyboard' bus='ps2'/>
    <graphics type='vnc' port='-1' autoport='yes' websocket='-1' listen='0.0.0.0' keymap='en-us' sharePolicy='ignore'>
      <listen type='address' address='0.0.0.0'/>
    </graphics>
    <audio id='1' type='none'/>
    <video>
      <model type='qxl' ram='65536' vram='65536' vgamem='16384' heads='1' primary='yes'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1e' function='0x0'/>
    </video>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x04' slot='0x00' function='0x0'/>
      </source>
      <rom file='/mnt/user/isos/vbios/NVIDIA.TeslaP4.8192.171211.rom'/>
      <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0'/>
    </hostdev>
    <watchdog model='itco' action='reset'/>
    <memballoon model='none'/>
  </devices>
</domain>

Relevant Logs (can't find link to generate support zip now): 

Apr 21 13:20:58 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:20:58 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:20:59 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:20:59 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:22:41 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:22:41 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:22:41 pinkfloyd usb_manager: Info: rc.usb_manager  vm_action Ollama2 prepare begin -
Apr 21 13:22:41 pinkfloyd usb_manager: Info: rc.usb_manager  vm_action Ollama2 stopped end -
Apr 21 13:22:51 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:22:51 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:22:56 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:22:56 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:30 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:30 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:30 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:30 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:30 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:30 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:36 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:36 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:26 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:26 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:32 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:32 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:32 pinkfloyd usb_manager: Info: rc.usb_manager  vm_action Ollama2 prepare begin -
Apr 21 13:24:33 pinkfloyd usb_manager: Info: rc.usb_manager  vm_action Ollama2 stopped end -
Apr 21 13:24:45 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:45 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:33:28 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:33:28 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:26 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:26 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:26 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:26 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:32 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:32 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:32 pinkfloyd usb_manager: Info: rc.usb_manager  vm_action Ollama2 prepare begin -
Apr 21 13:35:32 pinkfloyd usb_manager: Info: rc.usb_manager  vm_action Ollama2 stopped end -
Apr 21 13:35:46 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:46 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:39:02 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:39:02 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible

 

Been doing the usual searching here for 'Tesla P4' and nothing relevant to my issues. My Google-fu seems to have failed me also. I will do a complete cold restart on the whole server because of the power state messages. I had discovered one core on the cpu stuck at 100%. That and the powerstate messages make me believe that the Tesla P4 might be in a stuck state and need a power cycle. I'll report back in a bit if that fixes it or not.

TIA.

Edited by ghstridr
Solved issue, so updating.

  • Quote

    • Solved by ghstridr

    Go to solution
    • Community Expert
    22 minutes ago, ghstridr said:

    Unraid version 7.0.1

    CPU: i9-9900K

    RAM: 96GB

    MB: Gigabyte Z390 DESIGNARE-CF

    This was working just find in Unraid 6.xx. 

    VM Config:  

    <?xml version='1.0' encoding='UTF-8'?>
<domain type='kvm'>
  <name>Ollama2</name>
  <uuid>14860697-0187-87b2-54ba-225059a6a357</uuid>
  <metadata>
    <vmtemplate xmlns="unraid" name="Ubuntu" icon="ubuntu.png" os="ubuntu" webui=""/>
  </metadata>
  <memory unit='KiB'>16777216</memory>
  <currentMemory unit='KiB'>16777216</currentMemory>
  <memoryBacking>
    <nosharepages/>
  </memoryBacking>
  <vcpu placement='static'>8</vcpu>
  <cputune>
    <vcpupin vcpu='0' cpuset='0'/>
    <vcpupin vcpu='1' cpuset='8'/>
    <vcpupin vcpu='2' cpuset='1'/>
    <vcpupin vcpu='3' cpuset='9'/>
    <vcpupin vcpu='4' cpuset='2'/>
    <vcpupin vcpu='5' cpuset='10'/>
    <vcpupin vcpu='6' cpuset='3'/>
    <vcpupin vcpu='7' cpuset='11'/>
  </cputune>
  <os>
    <type arch='x86_64' machine='pc-q35-9.1'>hvm</type>
    <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader>
    <nvram>/etc/libvirt/qemu/nvram/14860697-0187-87b2-54ba-225059a6a357_VARS-pure-efi.fd</nvram>
  </os>
  <features>
    <acpi/>
    <apic/>
  </features>
  <cpu mode='host-passthrough' check='none' migratable='on'>
    <topology sockets='1' dies='1' clusters='1' cores='4' threads='2'/>
    <cache mode='passthrough'/>
  </cpu>
  <clock offset='utc'>
    <timer name='hpet' present='no'/>
    <timer name='hypervclock' present='no'/>
    <timer name='pit' tickpolicy='delay'/>
    <timer name='rtc' tickpolicy='catchup'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <devices>
    <emulator>/usr/local/sbin/qemu</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='writeback' discard='ignore'/>
      <source file='/mnt/user/domains/Ollama2/vdisk1.img'/>
      <target dev='hdc' bus='virtio'/>
      <serial>vdisk1</serial>
      <boot order='1'/>
      <address type='pci' domain='0x0000' bus='0x03' slot='0x00' function='0x0'/>
    </disk>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci2'>
      <master startport='2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci3'>
      <master startport='4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/>
    </controller>
    <controller type='pci' index='0' model='pcie-root'/>
    <controller type='pci' index='1' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='1' port='0x8'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0' multifunction='on'/>
    </controller>
    <controller type='pci' index='2' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='2' port='0x9'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
    </controller>
    <controller type='pci' index='3' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='3' port='0xa'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>
    </controller>
    <controller type='pci' index='4' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='4' port='0xb'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x3'/>
    </controller>
    <controller type='pci' index='5' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='5' port='0xc'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x4'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x00' function='0x0'/>
    </controller>
    <controller type='sata' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/>
    </controller>
    <interface type='bridge'>
      <mac address='52:54:00:1e:fe:2f'/>
      <source bridge='br0'/>
      <model type='virtio-net'/>
      <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
    </interface>
    <serial type='pty'>
      <target type='isa-serial' port='0'>
        <model name='isa-serial'/>
      </target>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
    </console>
    <channel type='unix'>
      <target type='virtio' name='org.qemu.guest_agent.0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='tablet' bus='usb'>
      <address type='usb' bus='0' port='1'/>
    </input>
    <input type='mouse' bus='ps2'/>
    <input type='keyboard' bus='ps2'/>
    <graphics type='vnc' port='-1' autoport='yes' websocket='-1' listen='0.0.0.0' keymap='en-us' sharePolicy='ignore'>
      <listen type='address' address='0.0.0.0'/>
    </graphics>
    <audio id='1' type='none'/>
    <video>
      <model type='qxl' ram='65536' vram='65536' vgamem='16384' heads='1' primary='yes'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1e' function='0x0'/>
    </video>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x04' slot='0x00' function='0x0'/>
      </source>
      <rom file='/mnt/user/isos/vbios/NVIDIA.TeslaP4.8192.171211.rom'/>
      <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0'/>
    </hostdev>
    <watchdog model='itco' action='reset'/>
    <memballoon model='none'/>
  </devices>
</domain>

    Relevant Logs (can't find link to generate support zip now): 

    Apr 21 13:20:58 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:20:58 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:20:59 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:20:59 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:22:41 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:22:41 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:22:41 pinkfloyd usb_manager: Info: rc.usb_manager  vm_action Ollama2 prepare begin -
Apr 21 13:22:41 pinkfloyd usb_manager: Info: rc.usb_manager  vm_action Ollama2 stopped end -
Apr 21 13:22:51 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:22:51 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:22:56 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:22:56 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:30 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:30 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:30 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:30 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:30 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:30 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:36 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:23:36 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:26 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:26 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:32 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:32 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:32 pinkfloyd usb_manager: Info: rc.usb_manager  vm_action Ollama2 prepare begin -
Apr 21 13:24:33 pinkfloyd usb_manager: Info: rc.usb_manager  vm_action Ollama2 stopped end -
Apr 21 13:24:45 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:24:45 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:33:28 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:33:28 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:26 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:26 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:26 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:26 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:27 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:32 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:32 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:32 pinkfloyd usb_manager: Info: rc.usb_manager  vm_action Ollama2 prepare begin -
Apr 21 13:35:32 pinkfloyd usb_manager: Info: rc.usb_manager  vm_action Ollama2 stopped end -
Apr 21 13:35:46 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:35:46 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:39:02 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible
Apr 21 13:39:02 pinkfloyd kernel: vfio-pci 0000:04:00.0: Unable to change power state from D3cold to D0, device inaccessible

     

    Been doing the usual searching here for 'Tesla P4' and nothing relevant to my issues. My Google-fu seems to have failed me also. I will do a complete cold restart on the whole server because of the power state messages. I had discovered one core on the cpu stuck at 100%. That and the powerstate messages make me believe that the Tesla P4 might be in a stuck state and need a power cycle. I'll report back in a bit if that fixes it or not.

    TIA.

    Is there an audio part to the card try adding that to the VM also.

    Maybe 04:00.1?

  • Quote
    • Author
    • Solution

    Solved: Cold restart fixed things. I'll leave this post up in case someone happens to come across a similar issue.

  • Quote
    • Like 1
    • ghstridr changed the title to [SOLVED] Trying to pass through Tesla P4. internal error: Unknown PCI header type '127' for device '0000:04:00.0'
    • Author

    @SimonF There isn't a audio port. This is a headless gpu meant for things like processing for LLMs. That is how I am using it right now. No display output needed..

    The issue turned out to be a stuck state for the board where it wasn't responding. So a cold start from power on fixed things for now. I'll update if it occurs again.

  • Quote

    • Join the conversation

    You can post now and register later. If you have an account, sign in now to post with your account.
    Note: Your post will require moderator approval before it will be visible.

    Guest
    Reply to this topic...
    Go to topic listing

    Account

    Navigation

    Search

    Search

    Configure browser push notifications
    Chrome (Android)
    1. Tap the lock icon next to the address bar.
    2. Tap Permissions → Notifications.
    3. Adjust your preference.
    Chrome (Desktop)
    1. Click the padlock icon in the address bar.
    2. Select Site settings.
    3. Find Notifications and adjust your preference.