ashman70 Posted October 18, 2017 Share Posted October 18, 2017 Just curious, my biggest unRAID server with dual parity takes (which is a backup server and runs Plex and a few other dockers) a day and a half to do a parity check and while that really isn't that big of a deal in of itself, I am curious about what others do and think about how often a parity check should be run. I could tolerate running it every two months, is that too long? Am I taking too big a risk by waiting that long? If I dropped down to a single parity drive would it reduce the parity check time by half or more? Quote Link to comment
Zonediver Posted October 18, 2017 Share Posted October 18, 2017 (edited) I do these checks every 3 months because they take a long time and need much energy. It takes around 12 hours with single-parity. If there is something with the Cables or HDDs, i always do a check after fixing all problems. Edited October 18, 2017 by Zonediver Quote Link to comment
BRiT Posted October 19, 2017 Share Posted October 19, 2017 I do parity checks on the following schedule: 1. Before Hardware Upgrades 2. After Hardware Upgrades 3. Before Moving the Server Equipment 4. After Moving the Server Equipment 5. After Graceful powerdowns due to Power Outages 6. Monthly 4 1 1 Quote Link to comment
itimpi Posted October 19, 2017 Share Posted October 19, 2017 2 hours ago, ashman70 said: Just curious, my biggest unRAID server with dual parity takes (which is a backup server and runs Plex and a few other dockers) a day and a half to do a parity check and while that really isn't that big of a deal in of itself, I am curious about what others do and think about how often a parity check should be run. I could tolerate running it every two months, is that too long? Am I taking too big a risk by waiting that long? If I dropped down to a single parity drive would it reduce the parity check time by half or more? How often you run a parity check is really up to you. In theory parity checks are completely optional, but they are seen as a way of getting early visibility of potential problems. in terms of elapsed time it is the size of the largest parity drive that is the key determinant of the time it will take - not whether you have dual or single parity. 1 Quote Link to comment
SSD Posted October 19, 2017 Share Posted October 19, 2017 I am doing parity checks every 2-3 months. Always do one before and after any disk / hardware activity. Between parity checks, I do md5 verification runs, which serve a similar purpose to parity check, but they check for file corruption instead of parity corruption. Quote Link to comment
rvank Posted October 31, 2017 Share Posted October 31, 2017 @SSD Can you explain how you do the md5 verification. The parity check on my unraid machine takes more than 36h to run, so i am looking for an early warning system for problems. The drives now all have auto error correction/bad sector swap, but they need to be 'told' that there is a problem and that can be done by reading everything on the drive. I love Spinrite by Steve Gibson to do drive maintenance with but the current version is to slow to run on the modern drives, waiting for version 6.1 so i can do drive maintenance on my unraid drives. Currently running unraid version 6.3.5 with 8x 4TB data disk and 1x 4TB parity disk Rob Quote Link to comment
bonienl Posted October 31, 2017 Share Posted October 31, 2017 2 minutes ago, rvank said: The parity check on my unraid machine takes more than 36h to run 36 hours with 4TB disks is extremely long, it should be more in the line of 10 to 14 hours. I would say: do some investigation. How are your SMART reports looking? 1 Quote Link to comment
ijuarez Posted October 31, 2017 Share Posted October 31, 2017 25 minutes ago, bonienl said: 36 hours with 4TB disks is extremely long, it should be more in the line of 10 to 14 hours. I would say: do some investigation. How are your SMART reports looking? i second this, i have a 4tb disk and it takes 12 hours 30 minutes Quote Link to comment
rvank Posted October 31, 2017 Share Posted October 31, 2017 Running smart tests on all drives now, will report. Yesterday i got my weekly Array health report back with all OK. I though that the longer parity check was caused by the addition of new data drive. Parity check i ran at oct 2nd was 10h / 109 MB/s Don't have any other parity check reports any more, deleted them. Will archive them from now on to see the trend Report back when smart tests are done Rob Quote Link to comment
JorgeB Posted October 31, 2017 Share Posted October 31, 2017 9 minutes ago, rvank said: I though that the longer parity check was caused by the addition of new data drive. It may be, you could be hitting a bottleneck or some other issue, diagnostics may give a clue. Quote Link to comment
rvank Posted October 31, 2017 Share Posted October 31, 2017 Smart tests all said no errors found. Attached the diagnostic file When i was looking in this file i saw in the Shares section a couple of old and deleted shares, namely: - Disney Movies - Erotic-720 - Movies-1080 - Movies-BR - Movies-SD - MS Progs - Series-RW - Network Trash Folder - Temporary items mediaserver-diagnostics-20171031-1831.zip Quote Link to comment
rvank Posted October 31, 2017 Share Posted October 31, 2017 Last Parity check started to run on sunday oct 29 at 01:00 and i canceled it on monday evening oct 30 at 20:29 Rob Quote Link to comment
JorgeB Posted October 31, 2017 Share Posted October 31, 2017 Nothing really jumps out, you're using a SASLP, not really a good performer but there's only 4 disks there, so not a big bottleneck, there also appears to be disk activity during the checks, make sure you do it once without any activity, disable mover, etc. Also, it's taking longer than expected but not as long as you said: Oct 23 01:00:01 mediaserver kernel: md: recovery thread: check P ... .... Oct 23 22:48:12 mediaserver kernel: md: sync done. time=78490sec Oct 23 22:48:12 mediaserver kernel: md: recovery thread: completion status: 0 So ~22hours And the canceled check was canceled on the same day, not the next: Oct 30 01:00:01 mediaserver kernel: md: recovery thread: check P ... ... Oct 30 20:29:55 mediaserver kernel: md: md_do_sync: got signal, exit... Oct 30 20:29:55 mediaserver kernel: md: recovery thread: completion status: -4 Quote Link to comment
rvank Posted October 31, 2017 Share Posted October 31, 2017 At the time i cancelled the last parity check it was at about 45% if i remember correctly. I will change my backup of the computer and pauze sabnzbd during the parity check. Now i only need a way to pauze radarr and sonarr from scanning during the parity check. Rob. Quote Link to comment
wgstarks Posted October 31, 2017 Share Posted October 31, 2017 I used the user scripts plugin to stop my torrent dockers on parity start and then restart them on parity stop. Discussion starts here. Quote Link to comment
Zonediver Posted October 31, 2017 Share Posted October 31, 2017 3 hours ago, bonienl said: 36 hours with 4TB disks is extremely long, it should be more in the line of 10 to 14 hours. I would say: do some investigation. How are your SMART reports looking? 11,5 hours in my case Quote Link to comment
BRiT Posted October 31, 2017 Share Posted October 31, 2017 7 hours ago, rvank said: The parity check on my unraid machine takes more than 36h to run, so i am looking for an early warning system for problems. Currently running unraid version 6.3.5 with 8x 4TB data disk and 1x 4TB parity disk My Parity checks with 6 4TB HGST drives was easily under 9 hours. Hell, even my mixed 6*4TB+3*8TB Parity Check is half your parity check time. 2017-04-01, 11:43:17 -- 8 hr, 43 min, 16 sec -- 127.4 MB/s = 6 * 4TB HGST 2017-07-01, 21:17:13 -- 18 hr, 17 min, 12 sec -- 121.5 MB/s = 6 * 4TB HGST + 3 * 8TB Seagate Archival 2017-10-24, 10:47:46 -- 15 hr, 37 min, 32 sec -- 142.2 MB/s = 4 * 8TB Seagate Archival Quote Link to comment
Hoopster Posted November 1, 2017 Share Posted November 1, 2017 (edited) 23 hours ago, rvank said: The parity check on my unraid machine takes more than 36h to run, so i am looking for an early warning system for problems. 36 hours on a 4TB parity drive is definitely way too long. It takes less than 16 hours with my 8TB parity drive in my main system and 10.5 hours on my backup system with a 4TB drive. They are both 7200 RPM drives so, if you have 5400 RPM drives it could takes a bit longer; however, not 36 hours. Something else is an issue. Have you tried a different SATA cable or a different motherboard SATA port for the parity drive? Parity check times are not a function of how many data disks you have. All other things being "normal" the size and speed of the parity drive itself and the speed of your slowest disks are the biggest factors in how long the process will take. If other disk or CPU-intensive processes are running at the same time, that will impact speed, but your 36 hours is more than three times longer than it should take with a 4TB parity drive. If SMART reports are all good and you are not seeing errors on any disks that would indicate cabling issues, something else has changed since your 10 hour parity run on Oct. 2. That is more like what it should be with a 4TB parity disk. Edited November 1, 2017 by Hoopster Quote Link to comment
ashman70 Posted November 1, 2017 Author Share Posted November 1, 2017 My dual socket E5645 server with 30 drives and a single H300 took 42hrs to run a parity check in September, that is with two 8TB archive drives for parity. Quote Link to comment
Can0n Posted November 1, 2017 Share Posted November 1, 2017 On 10/31/2017 at 10:58 AM, ijuarez said: i second this, i have a 4tb disk and it takes 12 hours 30 minutes I second it I use 2x8TB drives and takes only about 20hrs sometimes 24hrs. Quote Link to comment
Can0n Posted November 1, 2017 Share Posted November 1, 2017 On 10/18/2017 at 5:26 PM, Zonediver said: I do these checks every 3 months because they take a long time and need much energy. It takes around 12 hours with single-parity. If there is something with the Cables or HDDs, i always do a check after fixing all problems. Hi wondering if you manually check every three months or schedule it via the GUI, im currently set for monthly but would like to change it to every 2 maybe 3 months the gui seems a bit confusing when i set to custom, it appears with Every Day and Every week then pick your months. too me it sounds like it will literally do this every single day in the months i pick Quote Link to comment
Zonediver Posted November 1, 2017 Share Posted November 1, 2017 16 minutes ago, Can0nfan said: Hi wondering if you manually check every three months or schedule it via the GUI, im currently set for monthly but would like to change it to every 2 maybe 3 months the gui seems a bit confusing when i set to custom, it appears with Every Day and Every week then pick your months. too me it sounds like it will literally do this every single day in the months i pick I do it manually Quote Link to comment
Can0n Posted November 1, 2017 Share Posted November 1, 2017 12 minutes ago, Zonediver said: I do it manually I see...I did apply the config I posted and so far it hasnt tried to run parity check. under my current setup I guess I'll have to wait to December to check Devs' what I would like to see is more options under monthly like you can for hourly in the mover. Quote Link to comment
wgstarks Posted November 1, 2017 Share Posted November 1, 2017 15 minutes ago, Can0nfan said: I see...I did apply the config I posted and so far it hasnt tried to run parity check. under my current setup I guess I'll have to wait to December to check Devs' what I would like to see is more options under monthly like you can for hourly in the mover. This would run a check on the first Tuesday of every other month at 0030 hours. What else would you like to customize? 1 Quote Link to comment
Can0n Posted November 1, 2017 Share Posted November 1, 2017 1 minute ago, wgstarks said: This would run a check on the first Tuesday of every other month at 0030 hours. What else would you like to customize? that actually makes more sense now....thanks Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.