VMs missing on reboot

[Singularity42]

I was doing some work to my unraid server, rebooted, came back up without any vms.  I tried some backup vibvirt.img's as well, with no luck.  Im wondering if it has anything to do with using a new version of virtio drivers, and having the iso in a different location, but I went back to the ones listed in the vm page, with no luck either.  

 

I also did have the libvirt image split between a disk on the array and cache.  I copied the image and removed it from disk2, kept it on the cache drive.  I had no issues with kvm after I did this (for about 1-2 days, until now).

 

The vmdisks are still around, so I could recreate, but thats going to be a pain with dhcp/new macs.  

 

Any ideas on what I can try?  

Attached is my diagnostics.  Here is a copy of the domain.conf:

SERVICE="enable"
IMAGE_FILE="/mnt/cache/system/libvirt/libvirt.img"
IMAGE_SIZE="2"
DEBUG="no"
DOMAINDIR="/mnt/user/domains/"
MEDIADIR="/mnt/user/isos/"
VIRTIOISO="/mnt/user/isos/virtio-win-0.1.190-1.iso"
BRNAME="br0"
VMSTORAGEMODE="auto"
HOSTSHUTDOWN="shutdown"
TIMEOUT="60"

singularity-diagnostics-20210909-1343.zip

[Singularity42]

If I try to set:  

IMAGE_FILE="/mnt/cache/system/libvirt/libvirt.img"

to 

IMAGE_FILE="/mnt/user/system/libvirt/libvirt.img"

then trying to start the service, i get:

root@Singularity:~# /etc/rc.d/rc.libvirt start
Starting virtlockd...
2021-09-09 18:56:39.544+0000: 22776: info : libvirt version: 6.5.0
2021-09-09 18:56:39.544+0000: 22776: info : hostname: Singularity
2021-09-09 18:56:39.544+0000: 22776: error : main:977 : Can't load config file: Failed to open file '/etc/libvirt/virtlockd.conf': No such file or directory: /etc/libvirt/virtlockd.conf
Starting virtlogd...
2021-09-09 18:56:39.574+0000: 22779: info : libvirt version: 6.5.0
2021-09-09 18:56:39.574+0000: 22779: info : hostname: Singularity
2021-09-09 18:56:39.574+0000: 22779: error : main:756 : Can't load config file: Failed to open file '/etc/libvirt/virtlogd.conf': No such file or directory: /etc/libvirt/virtlogd.conf
no image mounted at /etc/libvirt

 

[Singularity42]

Oddly, I have two directories:

 

drwxr-xr-x  2 root root      40 Apr  7 13:48 libvirt/
drwxr-xr-x  5 root root     420 Apr  7 13:48 libvirt-/

where libvirt- appears to have the correct data

root@Singularity:/etc/libvirt-# ls
hooks/              nwfilter/        virt-login-shell.conf  virtnetworkd.conf   virtqemud.conf
libvirt-admin.conf  qemu/            virtinterfaced.conf    virtnodedevd.conf   virtsecretd.conf
libvirt.conf        qemu-lockd.conf  virtlockd.conf         virtnwfilterd.conf  virtstoraged.conf
libvirtd.conf       qemu.conf        virtlogd.conf          virtproxyd.conf

 

[Singularity42]

At second glance, it may appear that Ive now lost the actual vdisks for each vm.  

I really need some help. 

[Singularity42]

Also, it appears I have a user and user0 dir.  Im not really sure what is going on here.  I do appear to have the vdisks for the vms, but why double of every dir?

[Singularity42]

Im really not sure what happened, but I ended up rebuilding all my vm's and just fixing up dhcp to match the new macs.  This is a bit worrisome since I'm seeing two libvirt dirs and now 2 user dirs. 

If anyone is able to explain what may have happened here, and why I have duplicated folders, I would greatly appreciate it.   The emergency is over for now, I have everything back up and running. 

Always keep backups!

[JonathanM]

7 hours ago, Singularity42 said:

why I have duplicated folders,

Different views of exactly the same files.

 

/mnt/user0 contains the files/directories on only the parity array data disks.

 

/mnt/user contains the files/directories on all the pools and data disks.

 

Also, user shares are the aggregate of the disk and pool shares. Same exact files in a different path, not duplicates.