Sledgehamma

Spoke too soon..... I didn't change anything and its back to the reduced speeds. What the heck is going on here?

Is there anything specific I need to change in order to get maximum speed with it? I'm using two Seagate IronWolf 530 NVMe SSDs (PCIe 4.0) in raid 0 and only getting around 300MB/s. I tested the same with those two SSDs in separate mode (reading from one and writing to the other one) and I was getting the exact same performance. With these drives I was expecting the speed in the GB/s territory. App data of that Docker is stored on two 510 NVMe SSDs in raid 1.

After a lot of fiddling with the settings I think I have the solution: Settings -> Network Settings -> Network Protocol -> IPv4 + IPv6 I cant believe it.... Will test some more and update the thread accordingly.

@trurl: Did you have timte to look into my logs? Please let me know if you need additional information. Just tried another way: copying from my unRaid NAS to my Qnap NAS and I get the same behaviour (see picture). So its not only writing via network but also reading where I get the bottleneck

I wanted to show a new graph, because the one I posted above made it look like the speeds go up again while in fact it shows three separate copy commands (I aborted them after the speed dropped). That said, the write speeds stayed longer this time. For about 35GB I had full speed and then they dropped to 9MB/s. stormy-diagnostics-20211102-0704.zip //edit: I just tested the speed on a Windows 10 VM (located on two 240GB Ironwolf 510 NMVe SSDs at raid 1) on unRaid and its the same behavior. //edit2: In order to see that its not really an issue with I/O of HDDs I tested transferring via USB 3.0 and I dont have any speed issues on this route. It really seems limited to network.

Here you go. Don't mind the USB reconnecting issue. That was my UPS, disconnecting it didn't help either. stormy-diagnostics-20211101-1929.zip

Alright, so I finally built my new server with decent hardware: ASRock Rack X570D4U-2L2T Ryzen 5600X 2x 32GB ECC RAM 2x 1TB Seagate IronWolf 530 NVMe SSDs 2x Seagate Exos 18TB HDD (no parity right now) latest stable 6.9.2 After I set up everything the way I wanted I started to copy the files (movies, TV shows) from my old Qnap 453A. The problem is that after just a few seconds the speed drops from around 110MB/s to 8MB/s and then even under 1 MB/s. Here a few things I tried with a 50GB movie file without any luck: disabled the NVMe Cache so that it wrights straight to the array used Krusader Docker user rclone from the unRaid server mounted the unRaid share on my Qnap via SMB and FTP activated tunable transferred Windows iso from Macbook, same behavior tried 10Gbit NIC and 1Gbit NIC The thing is when I use NZBGet (Docker) for example I get max Gbit speed for the whole download. I am out of ideas at this point and hope somebody can help me. Maybe its some weird BIOS setting I'm missing?

Alright I got my server and did thee testing. Very strange results as the times are identical. It seems to be some kind of limitation. Any ideas? The hardware shouldn't be a problem as I'm using a Ryzen 5600X with 64GB RAM and two 1GB Seagate IronWolf 530 NVMe SSDs. The file in question was 46gb in size and it took 2:39 minutes, a lot slower than I was expecting.

Any further thoughts on this?

There might be several reasons as to why repurpose the Qnap NAS. -Security. See for example here: https://www.techradar.com/news/qnap-raises-alarm-over-serious-vulnerability-in-nas-devices -Qnap depends on raid for redundancy and therefore all the drive are spinning for read write operations -While you can run Docker on Qnap fine, its clumsy to use and update -Qnap NAS are already build, no need to select the hardware yourself and build it. Just buy it, remove the DOM and you can run unRaid -Typically low power draw

Shop: mindfactory.de valid until: 25.7. link: https://www.mindfactory.de/DAMN#minddeal_394 16TB Exos for 329€, 200 units remaining 18 TB Exos for 399€, 40 units remaining Prices are without shipping. I don’t know whether they ship outside Germany or not. keep in mind that the order is limited to 2 units per order. Great prices considering what’s currently going on (Chia, COVID, floods, …).

Just those two NVMe drives for this purpose.

I'm currently planing my next build and there is just one open question remaining. Relevant hardware would be as follows: AMD Ryzen 3600 or 5600X depending on price and availability ASROck Rack X570D4U-2L2T 2x 1TB Seagate FireCuda 530 (7.300MB/s read, 6.000MB/s write) My specific use case is remuxing (UHD) BDs to mkv with a makeMKV Docker. So the question is whether it's faster to read the full BD from one SSD and write to another one (cache of the array) or having both SSDs in raid 0 so that the Docker will simultaneously read and write from that cache drive. With the first method I will get the maximum read and write speed of that specific drive. I’m not sure whether there will be a bottleneck when there is simultaneous read and write to the SSDs as it’s the case for the raid 0 option. If not then it should be faster and I’m also more flexible in storage capacity. Thanks for any insights!

Thanks, works perfectly

It’s still not on Apple :( any eta for that?

I might have to considering current HDD prices :(

I was super exited until I read that they use PCIe 3.0 Otherwise the GE series with its 35W TDP would be ideal for my next project.

Would a USB DOM work? something like this: https://www.ebay.de/itm/2GB-Innodisk-USB-EDC-Flash-Modul-Vertical-DEUX-02GU51C1S-DOM-Pinheader-10-Pin/313361711768?hash=item48f5d04298:g:Bq4AAOSw~rpf6i-j

I'm thinking about getting it myself. How did your tests go?

Jap, bin auf github. Selber alias wie hier.

Ich könnte auch noch helfen, falls Bedarf besteht.

After investigating some more, here are my findings: Xpenology Docker is basically 3 years old. Not sure if it still works Xpenology as a VM seems to work, but you can't load your unRaid shares directly. You have to mount them via virtual network and the speed is not optimal Nextcloud Docker and external storage: You can directly mount your shares inside the Docker and move files via App or Webgui. So this is the best solution imho. Comes extremely close to apps for Qnap and Synology.

I really don't understand the negativity against this feature. Why shouldn't the solution be pretty or even elegant? Just look at how awesome the current webui of unRaid looks in contrast to a few years. All the suggested solutions (MC, Dolphin, Krusader) are horrible and ancient to use if you ever used Qnap or Synology (even low cost WD offers this). Then there are people saying that unRaid is lightweight. Look at all the features that unRaid added over the years. That's not light anymore, either. But it's awesome that this OS offers so many features. I think the best solution for now is using XPEnology inside a VM (which is definitely anything but lightweight) and then using the webui or the apps for file management. Is anybody using is already for this exact purpose? Would love to hear your experience. I personally don't even need file management inside the webui, apps for tablets and smartphone would be enough.

Not of everything. Just the most important stuff. This is the log: ############################################################################################################################ # # # unRAID Server Preclear of disk ZA20SNEN # # Cycle 1 of 1, partition start on sector 64. # # # # # # Step 1 of 5 - Pre-read verification: [14:49:38 @ 187 MB/s] SUCCESS # # Step 2 of 5 - Zeroing the disk: [14:52:22 @ 186 MB/s] SUCCESS # # Step 3 of 5 - Writing unRAID's Preclear signature: SUCCESS # # Step 4 of 5 - Verifying unRAID's Preclear signature: SUCCESS # # Step 5 of 5 - Post-Read verification: [14:59:28 @ 185 MB/s] SUCCESS # # # # # # # # # # # # # # # ############################################################################################################################ # Cycle elapsed time: 44:41:36 | Total elapsed time: 44:41:36 # ############################################################################################################################ ############################################################################################################################ # # # S.M.A.R.T. Status default # # # # # # ATTRIBUTE INITIAL CYCLE 1 STATUS # # 5-Reallocated_Sector_Ct 0 0 - # # 9-Power_On_Hours 2 47 Up 45 # # 184-End-to-End_Error 0 0 - # # 187-Reported_Uncorrect 0 0 - # # 190-Airflow_Temperature_Cel 31 38 Up 7 # # 197-Current_Pending_Sector 0 0 - # # 198-Offline_Uncorrectable 0 0 - # # 199-UDMA_CRC_Error_Count 0 0 - # # # # # # # # # ############################################################################################################################ # SMART overall-health self-assessment test result: PASSED # ############################################################################################################################ The pre-fail stats worry me, but apparently this is normal for these Seagate drives.... Some more: 1 Raw read error rate 0x000f 084 076 044 Pre-fail Always Never 226590880 3 Spin up time 0x0003 097 097 000 Pre-fail Always Never 0 4 Start stop count 0x0032 100 100 020 Old age Always Never 2 5 Reallocated sector count 0x0033 100 100 010 Pre-fail Always Never 0 7 Seek error rate 0x000f 072 061 045 Pre-fail Always Never 17769826 9 Power on hours 0x0032 100 100 000 Old age Always Never 47 (27 139 0) 10 Spin retry count 0x0013 100 100 097 Pre-fail Always Never 0 12 Power cycle count 0x0032 100 100 020 Old age Always Never 2 184 End-to-end error 0x0032 100 100 099 Old age Always Never 0 187 Reported uncorrect 0x0032 100 100 000 Old age Always Never 0 188 Command timeout 0x0032 100 100 000 Old age Always Never 0 189 High fly writes 0x003a 086 086 000 Old age Always Never 14 190 Airflow temperature cel 0x0022 066 060 040 Old age Always Never 34 (min/max 31/40) 191 G-sense error rate 0x0032 100 100 000 Old age Always Never 1334 192 Power-off retract count 0x0032 100 100 000 Old age Always Never 0 193 Load cycle count 0x0032 100 100 000 Old age Always Never 6 194 Temperature celsius 0x0022 034 040 000 Old age Always Never 34 (0 31 0 0 0) 195 Hardware ECC recovered 0x001a 009 009 000 Old age Always Never 226590880 197 Current pending sector 0x0012 100 100 000 Old age Always Never 0 198 Offline uncorrectable 0x0010 100 100 000 Old age Offline Never 0 199 UDMA CRC error count 0x003e 200 200 000 Old age Always Never 0 200 Multi zone error rate 0x0023 100 100 001 Pre-fail Always Never 0 240 Head flying hours 0x0000 100 253 000 Old age Offline Never 44 (255 171 0) 241 Total lbas written 0x0000 100 253 000 Old age Offline Never 19532877856 242 Total lbas read 0x0000 100 253 000 Old age Offline Never 39065775616

Sorry for my late reply. Thank you very much! My fourth IronWolf is preclearing now. This time I'm using the preclear plugin. Will post results once I get them Here are the SMART reports of my three drives after using them for a few months. They have been on 24/7 and with the purchase of my third drive the setup is Raid5. I hope this is not considered as offtopic.