marzed19 Posted August 23, 2021 Share Posted August 23, 2021 Hello! I recently set ut an UnRAID server with the specifications below, and have struggled for the last week with transfering files to the array. The transfer starts off pretty snappy, but after 1-2 hours it drops from around 80MB/s to below 3MB/s. I have tried disabling parity, connecting the host machine and the server to the same switch with nothing else connected to the switch, and using both Finder and One Commander, but with no luck. The plan is to empty one or more drives onto the server, then add those drives to the array one after another. After all is done, all the drives that have previously been stored on the shelf will be part of a big array containing all the files originally on the drives. There are between 100K and 500K files per drive, and the drives are between 2TB and 8TB. Most of the files are .dmx files, and are between 2MB and 10MB each. I know that lots of small files tend to slow transfers down when compared to fewer, bigger files, but these files aren't THAT small. Chassis: 45Drives Storinator Q30 Controllers: 2x LSI 9305-16i Harddrives: ST8000DM004, ST4000DM004, ST3000DM007 (as of right now...) Motherboard: Asus ROG Strix B460-F Gaming OS: UnRAID Version 6.9.2 Processor: Intel Core i5-10600KF RAM: 4x4GB DDR4 Extra: I am connecting to an SMB share, everything is connected via gigabit ethernet, and the docks for the harddrives being emptied are connected to the host machine via USB 3.0 at least. I know that the drives listed aren't meant for server use, but they will not be spinning most of the time when the server is all set up. Hoping for some useful answers here. Feel free to let me know if there's anything I should add to this post. Cheers! Quote Link to comment
ChatNoir Posted August 23, 2021 Share Posted August 23, 2021 Your diagnostics might show something. Go to Tools / Diagnostics and attach the full zip to your next post. Quote Link to comment
marzed19 Posted August 23, 2021 Author Share Posted August 23, 2021 Thank you for the response! I have attached the diagnostic file. storinator-diagnostics-20210823-1111.zip Quote Link to comment
marzed19 Posted August 23, 2021 Author Share Posted August 23, 2021 UPDATE: It is almost just as slow on Windows 10 as well..... Quote Link to comment
ChatNoir Posted August 23, 2021 Share Posted August 23, 2021 I see plenty of errors around 01:38 Aug 23 01:38:10 Storinator smbd[8648]: [2021/08/23 01:38:10.692320, 0] ../../source3/smbd/open.c:3817(open_file_ntcreate) Aug 23 01:38:10 Storinator smbd[8648]: open_file_ntcreate: Could not get share mode lock for Rebel_06/._.DS_Store Aug 23 01:38:10 Storinator smbd[8648]: [2021/08/23 01:38:10.692351, 0] ../../source3/lib/adouble.c:2102(ad_open_rsrc) Aug 23 01:38:10 Storinator smbd[8648]: ad_open_rsrc: SMB_VFS_CREATE_FILE failed Aug 23 01:38:11 Storinator smbd[8648]: [2021/08/23 01:38:11.947297, 0] ../../source3/smbd/open.c:3817(open_file_ntcreate) Aug 23 01:38:11 Storinator smbd[8648]: open_file_ntcreate: Could not get share mode lock for Rebel_06/Adams_Matkasse/._.DS_Store Aug 23 01:38:11 Storinator smbd[8648]: [2021/08/23 01:38:11.947327, 0] ../../source3/lib/adouble.c:2102(ad_open_rsrc) Aug 23 01:38:11 Storinator smbd[8648]: ad_open_rsrc: SMB_VFS_CREATE_FILE failed And it goes on for 4000 lines like that. Then between 01:49 and 01:53 your ethernet is down Aug 23 01:49:43 Storinator kernel: e1000e 0000:00:1f.6 eth0: NIC Link is Down Aug 23 01:49:43 Storinator kernel: bond0: (slave eth0): link status definitely down, disabling slave Aug 23 01:49:43 Storinator kernel: device eth0 left promiscuous mode Aug 23 01:49:43 Storinator kernel: bond0: now running without any active interface! Aug 23 01:49:43 Storinator kernel: br0: port 1(bond0) entered disabled state Aug 23 01:49:44 Storinator dhcpcd[1824]: br0: carrier lost Aug 23 01:49:44 Storinator avahi-daemon[2304]: Withdrawing address record for 10.0.0.59 on br0. Aug 23 01:49:44 Storinator avahi-daemon[2304]: Leaving mDNS multicast group on interface br0.IPv4 with address 10.0.0.59. Aug 23 01:49:44 Storinator avahi-daemon[2304]: Interface br0.IPv4 no longer relevant for mDNS. Aug 23 01:49:44 Storinator dhcpcd[1824]: br0: deleting route to 10.0.0.0/24 Aug 23 01:49:44 Storinator dhcpcd[1824]: br0: deleting default route via 10.0.0.1 Aug 23 01:49:45 Storinator ntpd[1899]: Deleting interface #3 br0, 10.0.0.59#123, interface stats: received=1154, sent=1154, dropped=0, active_time=255675 secs Aug 23 01:49:45 Storinator ntpd[1899]: 216.239.35.0 local addr 10.0.0.59 -> <null> Aug 23 01:49:45 Storinator ntpd[1899]: 216.239.35.4 local addr 10.0.0.59 -> <null> Aug 23 01:49:45 Storinator ntpd[1899]: 216.239.35.8 local addr 10.0.0.59 -> <null> Aug 23 01:49:45 Storinator ntpd[1899]: 216.239.35.12 local addr 10.0.0.59 -> <null> Aug 23 01:53:36 Storinator kernel: e1000e 0000:00:1f.6 eth0: NIC Link is Up 1000 Mbps Full Duplex, Flow Control: Rx/Tx Aug 23 01:53:36 Storinator dhcpcd[1824]: br0: carrier acquired Aug 23 01:53:36 Storinator kernel: bond0: (slave eth0): link status definitely up, 1000 Mbps full duplex Aug 23 01:53:36 Storinator kernel: bond0: (slave eth0): making interface the new active one Aug 23 01:53:36 Storinator kernel: device eth0 entered promiscuous mode Aug 23 01:53:36 Storinator kernel: bond0: active interface up! Aug 23 01:53:36 Storinator kernel: br0: port 1(bond0) entered blocking state Aug 23 01:53:36 Storinator kernel: br0: port 1(bond0) entered forwarding state Aug 23 01:53:36 Storinator dhcpcd[1824]: br0: rebinding lease of 10.0.0.59 Aug 23 01:53:36 Storinator dhcpcd[1824]: br0: probing address 10.0.0.59/24 Aug 23 01:53:41 Storinator dhcpcd[1824]: br0: leased 10.0.0.59 for 86400 seconds Aug 23 01:53:41 Storinator dhcpcd[1824]: br0: adding route to 10.0.0.0/24 Aug 23 01:53:41 Storinator dhcpcd[1824]: br0: adding default route via 10.0.0.1 Aug 23 01:53:41 Storinator avahi-daemon[2304]: Joining mDNS multicast group on interface br0.IPv4 with address 10.0.0.59. Aug 23 01:53:41 Storinator avahi-daemon[2304]: New relevant interface br0.IPv4 for mDNS. Aug 23 01:53:41 Storinator avahi-daemon[2304]: Registering new address record for 10.0.0.59 on br0.IPv4. Aug 23 01:53:43 Storinator ntpd[1899]: Listen normally on 4 br0 10.0.0.59:123 Aug 23 01:53:43 Storinator ntpd[1899]: new interface(s) found: waking up resolver I do not know much about the first issue, maybe someone can offer suggestions. For the Network, not sure if it is Unraid specific or your network in particular. Quote Link to comment
ChatNoir Posted August 23, 2021 Share Posted August 23, 2021 5 minutes ago, marzed19 said: UPDATE: It is almost just as slow on Windows 10 as well..... The files you are transferring, are they big files or a lot of tiny files ? Quote Link to comment
marzed19 Posted August 23, 2021 Author Share Posted August 23, 2021 (edited) I wrote some information regarding the files I am transferring in the original post When deleting files, I am looking at about 2-3 items per second in both Windows and MacOS Big Sur... Edited August 23, 2021 by marzed19 Quote Link to comment
marzed19 Posted August 23, 2021 Author Share Posted August 23, 2021 Regarding the ethernet issue: The cable got disconnected at some point today, so that shouldn't be an issue Quote Link to comment
marzed19 Posted August 23, 2021 Author Share Posted August 23, 2021 UPDATE: Windows 10 is now acting normally, even when dealing with all the small files that MacOS disliked so strongly. I am now using Windows 10 for the transfer job, and leaving MacOS when it comes to file management. No further help needed for now Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.