Kuusoft

Hi, I have a 10Gbps network environment. When I use iperf3 from my machine --> Unraid, I get the following output. PS C:\iperf3> .\iperf3.exe -c 192.168.9.248 -p 5201 Connecting to host 192.168.9.248, port 5201 [ 4] local 192.168.9.51 port 51406 connected to 192.168.9.248 port 5201 [ ID] Interval Transfer Bandwidth [ 4] 0.00-1.00 sec 557 MBytes 4.67 Gbits/sec [ 4] 1.00-2.00 sec 539 MBytes 4.52 Gbits/sec [ 4] 2.00-3.00 sec 567 MBytes 4.76 Gbits/sec [ 4] 3.00-4.00 sec 516 MBytes 4.33 Gbits/sec [ 4] 4.00-5.00 sec 543 MBytes 4.56 Gbits/sec [ 4] 5.00-6.00 sec 562 MBytes 4.71 Gbits/sec [ 4] 6.00-7.00 sec 555 MBytes 4.66 Gbits/sec [ 4] 7.00-8.00 sec 566 MBytes 4.75 Gbits/sec [ 4] 8.00-9.00 sec 563 MBytes 4.73 Gbits/sec [ 4] 9.00-10.00 sec 574 MBytes 4.82 Gbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth [ 4] 0.00-10.00 sec 5.41 GBytes 4.65 Gbits/sec sender [ 4] 0.00-10.00 sec 5.41 GBytes 4.65 Gbits/sec receiver However, when I use a VM running inside Unraid and use iperf3 --> Unraid server, I get the following output. PS C:\iperf-3.1.3-win64> .\iperf3.exe -c 192.168.9.248 -p 5201 Connecting to host 192.168.9.248, port 5201 [ 4] local 192.168.122.12 port 50413 connected to 192.168.9.248 port 5201 [ ID] Interval Transfer Bandwidth [ 4] 0.00-1.00 sec 92.9 MBytes 778 Mbits/sec [ 4] 1.00-2.00 sec 106 MBytes 892 Mbits/sec [ 4] 2.00-3.00 sec 112 MBytes 941 Mbits/sec [ 4] 3.00-4.00 sec 111 MBytes 931 Mbits/sec [ 4] 4.00-5.00 sec 110 MBytes 917 Mbits/sec [ 4] 5.00-6.00 sec 110 MBytes 928 Mbits/sec [ 4] 6.00-7.00 sec 113 MBytes 946 Mbits/sec [ 4] 7.00-8.00 sec 111 MBytes 932 Mbits/sec [ 4] 8.00-9.00 sec 109 MBytes 913 Mbits/sec [ 4] 9.00-10.00 sec 98.0 MBytes 823 Mbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth [ 4] 0.00-10.00 sec 1.05 GBytes 900 Mbits/sec sender [ 4] 0.00-10.00 sec 1.05 GBytes 900 Mbits/sec receiver iperf Done. The Unraid VM is using virtio-net as a network interface and running on bridge mode. I can confirm that the Windows VM detected the network interface and showed 10Gbps. Two questions 1. In a 10Gbps network configuration, when running iperf3, is it correct to show only 4.65 Gbits/sec for sender and receiver? Or is this only 50% of the speed? (Side notes: when I copy a file, I can copy from the client to the Unraid server at 1GB/sec, which is 10Gbps) 2. Does the link speed between VM and Unraid not exceed 1Gbps? Or is there a setting I am missing somewhere? Any help would be fantastic!

Thanks @Kilrah, I'll leave it running and hope we can bring everything back to normal :). Thank you!

Hi, I'm in the process of resilver one of the disk that's having SMART error. During the resilver process, the 2nd disk in the same group also encountering SMART error. I'm not sure if I should stop the Resilvering process and replace the 2nd hard drive in the same group now, or should I wait for the first hard drive to finish resilvering then replace the 2nd drive? This is my current ZFS Pool Status. pool: zfs_raidz2_storage state: DEGRADED status: One or more devices is currently being resilvered. The pool will continue to function, possibly in a degraded state. action: Wait for the resilver to complete. scan: resilver in progress since Mon Jul 15 12:48:51 2024 51.0T scanned at 0B/s, 36.3T issued at 913M/s, 51.0T total 1.31T resilvered, 71.17% done, 04:41:20 to go config: NAME STATE READ WRITE CKSUM zfs_raidz2_storage DEGRADED 0 0 0 raidz2-0 DEGRADED 0 0 0 /dev/sdas1 ONLINE 0 0 0 replacing-1 DEGRADED 0 0 0 2379613438859127735 UNAVAIL 0 0 0 was /dev/sdo1 /dev/sdar1 ONLINE 0 0 0 (resilvering) /dev/sdaj1 ONLINE 0 0 0 /dev/sdag1 ONLINE 0 0 0 /dev/sdaf1 ONLINE 0 0 0 /dev/sdx1 ONLINE 255 0 0 (resilvering) raidz2-1 ONLINE 0 0 0 /dev/sdk1 ONLINE 0 0 0 /dev/sdj1 ONLINE 0 0 0 /dev/sdb1 ONLINE 0 0 0 /dev/sdam1 ONLINE 0 0 0 /dev/sdaa1 ONLINE 0 0 0 /dev/sde1 ONLINE 0 0 0 raidz2-2 ONLINE 0 0 0 /dev/sdal1 ONLINE 0 0 0 /dev/sdak1 ONLINE 0 0 0 /dev/sdc1 ONLINE 0 0 0 /dev/sdd1 ONLINE 0 0 0 /dev/sdy1 ONLINE 0 0 0 /dev/sdz1 ONLINE 0 0 0 errors: No known data errors Any suggestions? I haven't stopped the resilvering process. Not what to do in this situation. Any suggestions will be greatly appreciated!

ok, the problem is resolved. The primary issue is that part of the docker exists on one of the cache pool A, while other part exists on other cache pool B. This is probably caused by the fact that I stopped the mover while moving from Array to cache pool A, and then performed a manual rsync to copy files from Array to cache pool B, and then set the primary storage as cache pool B. What I've done is performed another rsync between cache pool A to cache pool B to consolidate the file location and restart the docker container, and the message disappaered.

Hi, When I started GitLab-CE docker, I see the error in log continously. Jul 22 12:44:00 Olympus kernel: traps: nginx[7499] trap divide error ip:563a1096dd8b sp:7ffd8166ee90 error:0 in nginx[563a10905000+c1000] If I stop the GitLab-CE docker, the message disappeared. I had similar problem with this docker few weeks ago when I move the Unraid from one physical server to another. I couldn't figure out at that time, but after the recent Unraid update, the issue disappeared and I've left it running the whole time without issue. However, now the issue seems to appear again. Any ideas why all the sudden this issue returned again? Thank you DockerLog.txt

Ok, i see, so I simply specify the disks directly instead of going through /user/ folder. I was thinking that if it go through /user/ folder it will let Unraid do the work of finding the optimal disks. But, after reading your comment, it make sense, because it will end up have multiple copies of the file (the original one on cache and the new one at destination, both will appear under user share). So, in this case, it might be better to just let the mover run if it is going from cache --> array with lots of small files, right?

Hi @cYnIx, It works really well! Now, I have a inverse question for you. After recreating the array, I want to move some of the files (many files) back from Cache --> Array. Instead of using mover to move it slowly, will it be true to use the same command inversely. For example 1) Set the Primary storage of a share from a cache to Array 2) Run `rsync -av --progress --remove-source-files /mnt/cache/share /mnt/user/share` 3) Clean up `find /mnt/cache/share -type d -empty -delete` Will that work? Thank you

Hi, I am trying to move close to 70TB of small files (approximately 20KB - 1MB) from Array (20 disks with 2 parity) to a ZFS with RAIDZ1 (3 groups of 6 drives). I turned on the mover log and I can see it is moving the file slowly. I researched on the forum where it make sense to "linear" the process when it is moving from Cache --> Array because it needs to recalculate the parity, but no one really mentioned situations where I want to move from Array --> Cache with lots of small files. Is there a better way to do this other than waiting for the mover to move each file? Perhaps, maybe it can move multiple files (especially I have 88 cores controller with 512GB of DDR4 ECC memory). Any suggestion on what I can do? Thank you

Hi, I have a ZFS pool of 12 disks running RAIDZ1 with 2 groups of 6 devices configuration. Today, one of the drive is giving warning offline uncorrectable is 368 current pending sector is 368 Although the disk still showing green light, I want to replace this hard-disk since it is a new disk just purchased 2 days ago. I'm using Unraid 6.12.2, I used the new ZFS pool feature to create the pool. My data on this ZFS pool is critical, so I want to know exact step I need to do to remove the hard-drive that's giving warning and replace with the new one and then execute rebuild. I tried to search online, but most of the ZFS article are for pre-6.12 update, which is using a plugin or CLI. Can someone provide me the process so I don't lose all my data due to my inexperience with the new ZFS on Unraid 6.12.x? Thank you

Great, will look into LSI-9300 and SSD with that feature. If I want to get full performance for my 10Gb lan, is there a way to use maybe 24 hard-drive and somehow stripe it and still get some redundency? (This will be used as large & fast "cache", it will be moved to array afterwards. Is there any way to configure the cache to do something similar to RAID5 or RAID6?

Interesting, I saw someone say it works at a certain version, but later it no longer works. Is there a list of HBA that works with SSD trim? I am planning to create a 24-bay SSD DAS connected to the controller.

Hi, I read a lot of posts regarding the SSD trim command does not work over the LSI-92xx card, which was detected as: (Serial Attached SCSI controller: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)). Since Unraid V6.11, the SSD Trim has now become part of the system. Is this issue fixed? Or are we still unable to have SSD over HBA with LSI SAS2008 PCIe to trim properly? Thank you P.S. I have been running Windows Server for over 20+ years, and I only recently entered the Unraid world (about 1 month), and it is awesome!