VM Freezes up

Hi all, I have just encountered a repeatable issue where my VM would freeze up and my VM tab would not be accessible, then my server would shut down. This has happened for a few times now and I'm not exactly sure what is going on. Can I please get support for this issue? I pasted below the logs before it shut down my server as well as diagnostic reports after the server booted up.

System spec

Motherboard -  EVGA Corp. X299 FTW K bio v1.24

CPU - 10980xe
RAM - 128GB (4x32GB) G.Skill Ripjaws V 3600 Mhz CL18

Dec 29 13:06:47 Zoo kernel: sdi: sdi1 sdi2
Dec 29 13:06:47 Zoo rc.diskinfo[12677]: SIGHUP received, forcing refresh of disks info.
Dec 29 13:06:47 Zoo unassigned.devices: Disk with serial 'Samsung_SSD_850_EVO_500GB_S2RANX0J423685P', mountpoint 'Samsung_SSD_850_EVO_500GB_S2RANX0J423685P-part2' is not set to auto mount.
Dec 29 13:06:47 Zoo unassigned.devices: Disk with serial 'Samsung_SSD_850_EVO_500GB_S2RANX0J423685P', mountpoint 'EFI' is not set to auto mount.
Dec 29 13:06:47 Zoo unassigned.devices: Don't spin down device '/dev/sdi'.
Dec 29 13:06:47 Zoo unassigned.devices: Don't spin down device '/dev/sdi'.
Dec 29 13:08:46 Zoo nginx: 2020/12/29 13:08:46 [error] 15144#15144: *1169005 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 192.168.1.208, server: , request: "POST /plugins/dynamix.vm.manager/include/VMajax.php HTTP/1.1", upstream: "fastcgi://unix:/var/run/php5-fpm.sock", host: "192.168.1.138", referrer: "http://192.168.1.138/Dashboard"
Dec 29 13:09:52 Zoo kernel: vfio-pci 0000:17:00.0: enabling device (0100 -> 0103)
Dec 29 13:09:52 Zoo kernel: vfio_ecap_init: 0000:17:00.0 hiding ecap 0x19@0x270
Dec 29 13:09:52 Zoo kernel: vfio_ecap_init: 0000:17:00.0 hiding ecap 0x1b@0x2d0
Dec 29 13:09:52 Zoo kernel: vfio_ecap_init: 0000:17:00.0 hiding ecap 0x1e@0x370
Dec 29 13:09:52 Zoo kernel: vfio-pci 0000:17:00.1: enabling device (0100 -> 0102)
Dec 29 13:10:44 Zoo kernel: DMAR: DRHD: handling fault status reg 40
Dec 29 13:11:33 Zoo kernel: DMAR: DRHD: handling fault status reg 40
Dec 29 13:11:43 Zoo kernel: rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
Dec 29 13:11:43 Zoo kernel: rcu:     14-...0: (11 GPs behind) idle=842/1/0x4000000000000000 softirq=82647151/82647151 fqs=14345 
Dec 29 13:11:43 Zoo kernel: rcu:     (detected by 29, t=60002 jiffies, g=120045541, q=2514330)
Dec 29 13:11:43 Zoo kernel: Sending NMI from CPU 29 to CPUs 14:
Dec 29 13:11:43 Zoo kernel: NMI backtrace for cpu 14
Dec 29 13:11:43 Zoo kernel: CPU: 14 PID: 8335 Comm: qemu-system-x86 Tainted: P           O      4.19.107-Unraid #1
Dec 29 13:11:43 Zoo kernel: Hardware name: EVGA Corp. X299 FTW K/X299 FTW K, BIOS 1.24 10/20/2020
Dec 29 13:11:43 Zoo kernel: RIP: 0010:qi_submit_sync+0x154/0x2db
Dec 29 13:11:43 Zoo kernel: Code: 30 02 0f 84 40 01 00 00 4d 8b 96 b0 00 00 00 49 8b 42 10 83 3c 30 03 75 0b 41 bc f5 ff ff ff e9 27 01 00 00 49 8b 06 8b 48 34 <f6> c1 10 74 68 49 8b 06 8b 80 80 00 00 00 c1 f8 04 41 39 c3 75 57
Dec 29 13:11:43 Zoo kernel: RSP: 0018:ffffc9002926fba0 EFLAGS: 00000093
Dec 29 13:11:43 Zoo kernel: RAX: ffffc9000003e000 RBX: 0000000000000100 RCX: 0000000000000000
Dec 29 13:11:43 Zoo kernel: RDX: 0000000000000001 RSI: 0000000000000244 RDI: ffff88a01f035080
Dec 29 13:11:43 Zoo kernel: RBP: ffffc9002926fc00 R08: 000000000000008f R09: 0000000000000009
Dec 29 13:11:43 Zoo kernel: R10: ffff88a01f035080 R11: 0000000000000090 R12: 0000000000000910
Dec 29 13:11:43 Zoo kernel: R13: ffff88a01f035080 R14: ffff88a01f023200 R15: 0000000000000046
Dec 29 13:11:43 Zoo kernel: FS:  0000147373db6e00(0000) GS:ffff88a01f980000(0000) knlGS:0000000000000000
Dec 29 13:11:43 Zoo kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Dec 29 13:11:43 Zoo kernel: CR2: 00000001213bb000 CR3: 000000010cb08004 CR4: 00000000003626e0
Dec 29 13:11:43 Zoo kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Dec 29 13:11:43 Zoo kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Dec 29 13:11:43 Zoo kernel: Call Trace:
Dec 29 13:11:43 Zoo kernel: qi_flush_dev_iotlb+0x98/0xb4
Dec 29 13:11:43 Zoo kernel: iommu_flush_dev_iotlb.part.0+0x5f/0x7b
Dec 29 13:11:43 Zoo kernel: intel_iommu_unmap+0xde/0x129
Dec 29 13:11:43 Zoo kernel: __iommu_unmap+0xa5/0x10f
Dec 29 13:11:43 Zoo kernel: vfio_unmap_unpin+0x136/0x2a6
Dec 29 13:11:43 Zoo kernel: vfio_remove_dma+0x12/0x3b
Dec 29 13:11:43 Zoo kernel: vfio_iommu_type1_ioctl+0x647/0x758
Dec 29 13:11:43 Zoo kernel: ? kvm_vm_ioctl+0x303/0x7b2 [kvm]
Dec 29 13:11:43 Zoo kernel: vfs_ioctl+0x19/0x26
Dec 29 13:11:43 Zoo kernel: do_vfs_ioctl+0x533/0x55d
Dec 29 13:11:43 Zoo kernel: ksys_ioctl+0x37/0x56
Dec 29 13:11:43 Zoo kernel: __x64_sys_ioctl+0x11/0x14
Dec 29 13:11:43 Zoo kernel: do_syscall_64+0x57/0xf2
Dec 29 13:11:43 Zoo kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
Dec 29 13:11:43 Zoo kernel: RIP: 0033:0x1473755a44b7
Dec 29 13:11:43 Zoo kernel: Code: 00 00 90 48 8b 05 d9 29 0d 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d a9 29 0d 00 f7 d8 64 89 01 48
Dec 29 13:11:43 Zoo kernel: RSP: 002b:00007ffd5439daa8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
Dec 29 13:11:43 Zoo kernel: RAX: ffffffffffffffda RBX: 00007ffd5439dbd0 RCX: 00001473755a44b7
Dec 29 13:11:43 Zoo kernel: RDX: 00007ffd5439dac0 RSI: 0000000000003b72 RDI: 000000000000002c
Dec 29 13:11:43 Zoo kernel: RBP: 00001473733a9a00 R08: 0000000000000000 R09: 0000000090000000
Dec 29 13:11:43 Zoo kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffd5439dac0
Dec 29 13:11:43 Zoo kernel: R13: 00007ffd5439dab0 R14: 00001473733a9a00 R15: 0000000000000000
Dec 29 13:12:05 Zoo kernel: DMAR: DRHD: handling fault status reg 40

zoo-diagnostics-20201229-1321.zip

Edited December 29, 20205 yr by jamesy829