August 20, 20232 yr I created a VM in Unraid that is hosted on a zfs array and is 35 terabytes in size. its purpose is to do a migration of about 20TB from one cloud provider to another. it is ungodly slow. the zfs pool is capable of sustained read/write speeds of over 3.5Gbps. I ensured that nothing else is going on in that zfs pool, and this is my vm config: Is there a config tweak I can do to get it to speed up some? or something I messed up? note: the primary vdisk location is actually on /mnt/tank/VMs/Jump Box/vdisk1.img:
August 20, 20232 yr Community Expert 43 minutes ago, TheSkaz said: I created a VM in Unraid that is hosted on a zfs array and is 35 terabytes in size. its purpose is to do a migration of about 20TB from one cloud provider to another. it is ungodly slow. the zfs pool is capable of sustained read/write speeds of over 3.5Gbps. I ensured that nothing else is going on in that zfs pool, and this is my vm config: Is there a config tweak I can do to get it to speed up some? or something I messed up? note: the primary vdisk location is actually on /mnt/tank/VMs/Jump Box/vdisk1.img: Is data coming over network is that performing as expected? how is network defined in vm?
August 21, 20232 yr Author eth0 and eth1 are 10G NICs. The performance from Box.com (its the one that is downloading) is subpar. But i am assuming it is that way due to the fact that the vdisk cannot write fast enough to go any faster. I could be wrong, maybe if the download speed was faster, it would bounce up and down as it was writing? My internet speed is 2x1G fiber connections load balanced.
August 31, 20232 yr Solution A vdisk on HDDs is always going to be slow, a couple of things that may help a little: -create a small disk for the OS on SSD storage, and set the pool as a second volume -if usins raidz try mirrors if possible -use a zvol instead
September 1, 20232 yr Author I initially tried that. The issue is that the box application has to be on the c drive. and It has to be a minimum of 14T (I have a pool of nvme drives but they total 5.4T) so Im stuck with using the one zpool for housing the vdisk. What I havent figured out is, I know the pool is capable of 3.6Gbps throughput. but when writing to it from within the pool, it seems that there is a ton of activity for such small chunks. Im basing it on the blue activity lights on the front of the drives. I have datasets on there that didnt show that kind of activity as they were being downloaded and hashed. but simply downloading a file with the app inside a Win 11 vm, it seems to be thrashing those drives.
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.