Libvirt Service failed to start

[terafil]

After the recreation of the VM all seams to be ok for a while. But today, again, the VM is working properly, but I cannot manage it from the web GUI.

From myunraid.net I can see my vm

 

but from  the vms page I don't

[SimonF]

Do they show on dashboard?

[terafil]

Hi SimonF, no, they don't

[SimonF]

46 minutes ago, terafil said:

Hi SimonF, no, they don't

Can you post diagnostics. 

[terafil]

Yes, sure

microserver-diagnostics-20240126-1841.zip

[terafil]

Thank you

[SimonF]

34 minutes ago, terafil said:

Yes, sure

microserver-diagnostics-20240126-1841.zip 119.34 kB · 0 downloads

The XML shows ok on my test systems. Disk has a strange path but should be ok.

Can you goto tools->php settings and if available does the view log have any errors you can send?

 

[kal-el681]

I'm having the same issue currently. Diagnostics are posted below. I've tried all the previous fixes.

lovenest-diagnostics-20240616-2045.zip

[JorgeB]

14 hours ago, kal-el681 said:

I'm having the same issue currently

A reboot should resolve it, if it doesn't post new diags.

[kal-el681]

I've rebooted multiple times. The VMs will start and then two of them will pause. These diags posted are after a restart. If I disable VMs they won't re-enable unless I reboot and again some of them will pause and not start properly.  

[JorgeB]

30 minutes ago, kal-el681 said:

These diags posted are after a restart

The service initially started, but then it was stopped.

[kal-el681]

I've restarted and taken two additional diagnostics. First from right after restart, second from restart + ~ 2mins when some of the VMs pause themselves. I can do additional diags after stopping and restarting VM service if needed. 

after-restart-lovenest-diagnostics-20240617-1251.zip after-vms-load-and-pause-lovenest-diagnostics-20240617-1253.zip

[JorgeB]

1 hour ago, kal-el681 said:

some of the VMs pause themselves.

If the VMs are pausing you need to fix this first, after that you won't need to restart the libvirt service

 

AFAIK there are only two reasons for VMs pausing, sleep is enabled in the VM, or they are running out of space, assuming it's not the former, where are the vdisks for the affected VMs being stored?

[kal-el681]

Here's a couple screenshots that should show what you need:

[JorgeB]

14 hours ago, kal-el681 said:

Here's a couple screenshots that should show what you need:

 

According to the diags, domains share exists on disks 1, 2 and 3, and disk1 is completely full:
 

Filesystem      Size  Used Avail Use% Mounted on
/dev/md1p1      5.5T  5.5T   16K 100% /mnt/disk1

 

So any vdisks stored there will have issues.

[kal-el681]

I've figured it out. It seems that my vdisk1.img files were corrupt. I rebuilt the VM and it worked without issue. I did also notice through all of this that I had to manually assign the port for VNC on them to avoid them all trying to use the same one and crashing.