June 9, 20224 yr @trurl It seems now that i have 21.5 GB free now. So, the warnings have gone. I'm adding another Cache drive today as well. Thanks for the help. I guess since one of my VMs (heave video rendering app) has been down for a while the cache may have been cleaned up.
June 9, 20224 yr 2 hours ago, sysop-gwg said: I'm adding another Cache drive today as well. What exactly are your plans? Adding another drive doesn't automatically give you more space, if that's what you are after.
June 9, 20224 yr 5 minutes ago, sysop-gwg said: Yes, that is what I'm after...I was told to follow these instructions. There are multiple parts to that video, so it doesn't help me understand what you plan to do. By default 2 devices are set to mirror each other, which limits the capacity to the smaller of the 2, and doesn't add any capacity, and if the added device is smaller than the original, it will reduce the capacity of the pool to match the smaller device. That's why I asked what you planned to do.
June 9, 20224 yr @JonathanM We currently have 500GB drive installed in the box dedicated for cache. It was running out of space (per above). My intent is to add additional cache capacity. I have purchased a 1TB drive of the same type and manufacturer. I suspect we could either: Replace the current 500GB drive with 1TB drive Add the 1TB drive to extend the cache volume of the 1.5TB Either one is fine with me. I would need guidance. Sorry, but I'm a newbee to UNRAID. Our IT person moved on and now I'm left to figure out how to support this system. I've worked mostly with VMWare in the past, but never on my own hardware. Your input is greatly appreciated. PS> I'd like to know how you stop the cache from just filling up. I found ours just filling up to 99% - not sure where, or if, we can set a limit. Truly, I'm really not sure why it has 21 gb free now....I don't recall doing anything other than turning off a VM that has issues (still working on that) and cleaning out the syslog files. Eric Edited June 9, 20224 yr by sysop-gwg
June 9, 20224 yr Community Expert 1 hour ago, sysop-gwg said: I found ours just filling up to 99% - not sure where, or if, we can set a limit. This is covered here in the online documentations accessible via the ‘Manual’ link at the bottom of the GUI.
June 10, 20224 yr Community Expert You also might reconsider how you use cache. There is no need to cache unattended writes such as backups or queued downloads, for example, since nobody is waiting for them to complete.
June 10, 20224 yr Community Expert You have backups set to cache-no, but it has files on cache. Mover ignores cache-no shares. You will have to set it to cache-yes to get it moved to the array, then you can set it to cache-no. domains and system have files on the array. Typically you want these to stay on cache for docker/VM performance and so array disks can spin down since these files are always open. You will have to disable Docker and VM Manager in Settings to get these moved since nothing can move open files. Probably no need to have isos on cache, since these may not be needed after they are installed.
June 13, 20224 yr @trurl Thank for the help. I ran the mover. I'm now doing a parity check (10 hrs). After which, I will set up the cache as you prescribed above and see how we do. Thanks again! Erok
June 13, 20224 yr @trurl After I ran Mover, here is what my Shares looks like. I appears that I would need quite a bit more Cache disk size to leave Domains and System on "Yes". Do you agree? I have a new 1.0TB drive that I can add, if need be. Also, I notices that Cache has a warning now. Not sure why? NOTE: I have NOT restarted the system, turned on the Array, Docker or VMs as of this screen shot. Currently, I'm waiting for the Parity Check to complete (8 more hrs.)
June 13, 20224 yr Community Expert Almost certainly the system files on disk1 are duplicates, probably a duplicate 20G docker.img, with a 1G libvirt.img on disk1. Mover won't move duplicates, you will have to clean those up yourself. You want all of system on cache. I didn't mention appdata before because it was already on cache but now you have changed that. You want appdata cache-prefer and all on cache for the same reasons you want domains and system on cache. On 6/10/2022 at 11:12 AM, trurl said: you want these to stay on cache for docker/VM performance and so array disks can spin down since these files are always open. You will have to disable Docker and VM Manager in Settings to get these moved since nothing can move open files. For some reason appdata doesn't seem to have much data (and none in earlier screenshot). Do you have any dockers? Why is your domains so large? It often isn't necessary to have very large vdisks for your VMs because your VMs can access Unraid storage and only the vdisk for the VM OS is needed. Attach diagnostics to your NEXT post in this thread.
June 14, 20224 yr 17 hours ago, trurl said: @trurl Almost certainly the system files on disk1 are duplicates, probably a duplicate 20G docker.img, with a 1G libvirt.img on disk1. Mover won't move duplicates, you will have to clean those up yourself. You want all of system on cache. I can only find 1 docker.img of 21G on the system. I didn't mention appdata before because it was already on cache but now you have changed that. You want appdata cache-prefer and all on cache for the same reasons you want domains and system on cache. I changed them to allow Mover to work. I was waiting for Parity Check to finish before resetting them. Below is an image of how I have it now based on your recommendations. For some reason appdata doesn't seem to have much data (and none in earlier screenshot). Do you have any dockers? We don't have any dockers. I have docker turned off. Can I shrink or delete it since we don't use it? Why is your domains so large? It often isn't necessary to have very large vdisks for your VMs because your VMs can access Unraid storage and only the vdisk for the VM OS is needed. I have two vm's - the disks on domains are: VM 1 vdisk1.img - 256gb - windows 10 and cad apps and video rendering vdisk1.img - 429gb - cad and mp4 files VM 2 vdisk1.img - 275gb - windows 10, general purpose stuff Attach diagnostics to your NEXT post in this thread. Attached Looking forward to your input - Thank you! 17 hours ago, trurl said: renderserver-diagnostics-20220614-0752.zip
June 14, 20224 yr Community Expert 1 hour ago, sysop-gwg said: I can only find 1 docker.img of 21G on the system. If you looked for that in the system share, you would only see one. You have to look on each disk (cache, disk1) separately to see duplicates. 1 hour ago, sysop-gwg said: don't have any dockers. I have docker turned off. Can I shrink or delete it since we don't use it? You can delete docker.img on the same Settings page where you disable Docker. You can delete appdata share after deleting its contents. If you need to keep those vdisks on the array just be aware that these can only be written as fast as parity, and array disks with open files can't spin down, including parity.
June 14, 20224 yr 7 hours ago, trurl said: @trurl If you looked for that in the system share, you would only see one. You have to look on each disk (cache, disk1) separately to see duplicates. Will do. Thx You can delete docker.img on the same Settings page where you disable Docker. You can delete appdata share after deleting its contents. Will do. Thx. If you need to keep those vdisks on the array just be aware that these can only be written as fast as parity, and array disks with open files can't spin down, including parity. I believe I need at least 256gb for O/S and app for my VM. So, I don't suspect I can change that. Right? But, it does sound like I need to move vdisk2 to somewhere else! What do you suggest? I'm newbee...so go slow.
June 14, 20224 yr Nothing in here: root@RenderServer:/mnt/cache/system/docker# ls root@RenderServer:/mnt/cache/system/docker# Only 1 file in here for my one test VM: root@RenderServer:/mnt/cache/domains# ls Windows\ 10\ TEST/ root@RenderServer:/mnt/cache/domains# cd Windows\ 10\ TEST/ root@RenderServer:/mnt/cache/domains/Windows 10 TEST# ls vdisk1.img In System I found this: root@RenderServer:/mnt/disk1# cd system root@RenderServer:/mnt/disk1/system# ls docker/ libvirt/ root@RenderServer:/mnt/disk1/system# cd docker root@RenderServer:/mnt/disk1/system/docker# ls root@RenderServer:/mnt/disk1/system/docker# cd .. root@RenderServer:/mnt/disk1/system# ls docker/ libvirt/ root@RenderServer:/mnt/disk1/system# cd libvirt/ root@RenderServer:/mnt/disk1/system/libvirt# ls -l total 1048576 -rw-rw-rw- 1 nobody users 1073741824 Jun 14 17:56 libvirt.img @trurl I didn't find any duplicates - agreed? Here are my disk files: root@RenderServer:~# df Filesystem 1K-blocks Used Available Use% Mounted on rootfs 65824696 890084 64934612 2% / tmpfs 32768 452 32316 2% /run /dev/sdc1 15612024 676616 14935408 5% /boot overlay 65824696 890084 64934612 2% /lib/firmware overlay 65824696 890084 64934612 2% /lib/modules devtmpfs 8192 0 8192 0% /dev tmpfs 65895440 0 65895440 0% /dev/shm cgroup_root 8192 0 8192 0% /sys/fs/cgroup tmpfs 131072 468 130604 1% /var/log tmpfs 1024 0 1024 0% /mnt/disks tmpfs 1024 0 1024 0% /mnt/remotes tmpfs 1024 0 1024 0% /mnt/rootshare /dev/md1 976285620 421643424 554642196 44% /mnt/disk1 /dev/md2 7811939620 1066612328 6745327292 14% /mnt/disk2 /dev/sdf1 488386552 19404732 467906148 4% /mnt/cache shfs 8788225240 1488255752 7299969488 17% /mnt/user0 shfs 8788225240 1488255752 7299969488 17% /mnt/user /dev/sda1 976759804 837085300 139674504 86% /mnt/disks/External-Disk /dev/sdb2 3906885628 2299209608 1607676020 59% /mnt/disks/Seagate_Backup_Plus_Drive //192.168.1.99/External-Disk 976759804 837085300 139674504 86% /mnt/remotes/192.168.1.99_External-Disk /dev/loop2 1048576 4216 925832 1% /etc/libvirt I do find that these are identical. Not sure why they are two places. Edited June 14, 20224 yr by sysop-gwg
June 14, 20224 yr Community Expert user0 is the shares excluding pools. Do you have any files at the top of cache?
June 14, 20224 yr @trurl No files at the top of cache: root@RenderServer:/mnt/cache# ls -l total 0 drwxrwxrwx 1 nobody users 0 Jun 14 18:41 appdata/ drwxrwxrwx 1 nobody users 30 Jun 14 10:08 domains/ drwxrwxrwx 1 nobody users 12 Nov 3 2020 system/
June 15, 20224 yr @trurl Attached. Thank you. Note: At the time of of this download, I don't have any VMs running. renderserver-diagnostics-20220615-0825.zip
June 15, 20224 yr Community Expert 2 minutes ago, sysop-gwg said: At the time of of this download, I don't have any VMs running. But VM Manager is enabled. Disable it, set system share to cache-prefer, run mover to get it moved to cache.
June 16, 20224 yr @trurl Here is my current Share setup. I ran mover last night. I attached diags. renderserver-diagnostics-20220616-0850.zip
June 16, 20224 yr Community Expert That looks OK. I'll leave it to you whether or not you want to try to get domains off the array.
June 17, 20224 yr @trurl Fantastic. Now, that we are level-set, what would suggest for the following: What part of the domains should be removed from the array? We have a VM with disk 1 and disk 2. I thought you need to run a VM on the array? We need at least 265gb to store the apps and and O/S for this VM. (Am I misunderstanding the relationship between Arrays, vms, and vdisks?) Should we increase the size of our Cache? As we started this thread, we purchased a 1gb drive to do so. But, with your suggestion in this thread, we don't seem need to increase it anymore. Agreed? Based on the fact that we have an storage array of 7.46 gb, is that the best practice for utilization? Above, you seem to suggest that we should store our files (in our case - cad and video) somewhere else. Can you elaborate?
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.