Preclear plugin


Recommended Posts

6 hours ago, jedimstr said:


Removed and re-installed from CA.  Here's the installation output:
 


plugin: installing: https://raw.githubusercontent.com/gfjardim/unRAID-plugins/master/plugins/preclear.disk.plg
plugin: downloading https://raw.githubusercontent.com/gfjardim/unRAID-plugins/master/plugins/preclear.disk.plg
plugin: downloading: https://raw.githubusercontent.com/gfjardim/unRAID-plugins/master/plugins/preclear.disk.plg ... done
plugin: downloading: https://raw.githubusercontent.com/gfjardim/unRAID-plugins/master/archive/preclear.disk-2020.01.13.txz ... done
plugin: downloading: https://raw.githubusercontent.com/gfjardim/unRAID-plugins/master/archive/preclear.disk-2020.01.13.md5 ... done
tmux version 3.0a is greater or equal than the installed version (3.0a), installing...

+==============================================================================
| Skipping package tmux-3.0a-x86_64-1 (already installed)
+==============================================================================

libevent version 2.1.11 is greater or equal than the installed version (2.1.11), installing...

+==============================================================================
| Skipping package libevent-2.1.11-x86_64-1 (already installed)
+==============================================================================

utempter version 1.1.6 is lower than the installed version (1.1.6.20191231), aborting...

+==============================================================================
| Installing new package /boot/config/plugins/preclear.disk/preclear.disk-2020.01.13.txz
+==============================================================================

Verifying package preclear.disk-2020.01.13.txz.
Installing package preclear.disk-2020.01.13.txz:
PACKAGE DESCRIPTION:
Package preclear.disk-2020.01.13.txz installed.

-----------------------------------------------------------
preclear.disk has been installed.
Copyright 2015-2020, gfjardim
Version: 2020.01.13
-----------------------------------------------------------

plugin: installed

Updating Support Links

preclear.disk --> http://lime-technology.com/forum/index.php?topic=39985.0

 

 

Thanks. You have another plugin using utempter (probably for screen) and the plugin saw that as a problem. Just issued an upgrade, please tell me if it fix your problem.

Link to comment

I'm trying to clear a few disks and running into a problem. The status shows 'starting...' for a few seconds and then goes right to 'Preclear Finished Successfully'. I get the following in the log...

 

Jan 16 23:43:27 preclear_disk_5VMCHPMH_22837: Command: /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh --cycles 2 --no-prompt /dev/sdg
Jan 16 23:43:27 preclear_disk_5VMCHPMH_22837: Preclear Disk Version: 1.0.8
Jan 16 23:43:28 preclear_disk_5VMCHPMH_22837: S.M.A.R.T. info type: default
Jan 16 23:43:28 preclear_disk_5VMCHPMH_22837: S.M.A.R.T. attrs type: default
Jan 16 23:43:29 preclear_disk_5VMCHPMH_22837: Disk size: 500107862016
Jan 16 23:43:29 preclear_disk_5VMCHPMH_22837: Disk blocks: 976773168
Jan 16 23:43:29 preclear_disk_5VMCHPMH_22837: Blocks (512 byte): 976773168
Jan 16 23:43:29 preclear_disk_5VMCHPMH_22837: Block size: 512
Jan 16 23:43:29 preclear_disk_5VMCHPMH_22837: Start sector: 64
Jan 16 23:43:34 preclear_disk_5VMCHPMH_22837: Pre-Read: dd if=/dev/sdg of=/dev/null bs=2097152 skip=0 count=500107862016 conv=notrunc iflag=nocache,count_bytes,skip_bytes
Jan 16 23:43:35 preclear_disk_5VMCHPMH_22837: /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 1059: 4194304 / (1579239814 - 1579239814) / 1000000 : division by 0 (error token is "(1579239814 - 1579239814) / 1000000 ")

 

 

I tried reinstalling the plugin, but get the same result as noted above. Below is the plugin install log for review...

 

plugin: installing: https://raw.githubusercontent.com/gfjardim/unRAID-plugins/master/plugins/preclear.disk.plg
plugin: downloading https://raw.githubusercontent.com/gfjardim/unRAID-plugins/master/plugins/preclear.disk.plg
plugin: downloading: https://raw.githubusercontent.com/gfjardim/unRAID-plugins/master/plugins/preclear.disk.plg ... done
plugin: downloading: https://raw.githubusercontent.com/gfjardim/unRAID-plugins/master/archive/preclear.disk-2020.01.16a.txz ... done
plugin: downloading: https://raw.githubusercontent.com/gfjardim/unRAID-plugins/master/archive/preclear.disk-2020.01.16a.md5 ... done
tmux version 3.0a is greater or equal than the installed version (3.0a), installing...

+==============================================================================
| Skipping package tmux-3.0a-x86_64-1 (already installed)
+==============================================================================

libevent version 2.1.11 is greater or equal than the installed version (2.1.11), installing...

+==============================================================================
| Skipping package libevent-2.1.11-x86_64-1 (already installed)
+==============================================================================

utempter version 1.1.6 is greater or equal than the installed version (1.1.6), installing...

+==============================================================================
| Skipping package utempter-1.1.6-x86_64-3 (already installed)
+==============================================================================


+==============================================================================
| Installing new package /boot/config/plugins/preclear.disk/preclear.disk-2020.01.16a.txz
+==============================================================================

Verifying package preclear.disk-2020.01.16a.txz.
Installing package preclear.disk-2020.01.16a.txz:
PACKAGE DESCRIPTION:
Package preclear.disk-2020.01.16a.txz installed.

-----------------------------------------------------------
preclear.disk has been installed.
Copyright 2015-2020, gfjardim
Version: 2020.01.16a
-----------------------------------------------------------

plugin: installed

 

 

I'm running Unraid 6.8.1 and also updated Unassigned Devices for good measure(currently at 2020.01.16a). I also installed Unassigned Devices Plus as I saw a message stating that was needed to enable destructive mode.

 

I would try a reboot, but I have a parity sync in progress after doing a new config and want to let that finish.

 

Seems the script is erroring out though. Anyone else running into this issue?

Edited by Alabaster
Added additional info
Link to comment

Alabaster, Im having the same issue.

 

It goes straight to finished.  On the few times I can get it to start the pre read it only runs at 75 MB/s, where before it was running 170-200 MB/s

 

Jan 17 06:12:11 preclear_disk_39524A384C304E43_26725: Command: /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh --notify 2 --frequency 4 --cycles 1 --no-prompt /dev/sda
Jan 17 06:12:11 preclear_disk_39524A384C304E43_26725: Preclear Disk Version: 1.0.8
Jan 17 06:12:11 preclear_disk_39524A384C304E43_26725: S.M.A.R.T. info type: default
Jan 17 06:12:11 preclear_disk_39524A384C304E43_26725: S.M.A.R.T. attrs type: default
Jan 17 06:12:11 preclear_disk_39524A384C304E43_26725: Disk size: 14000519643136
Jan 17 06:12:11 preclear_disk_39524A384C304E43_26725: Disk blocks: 3418095616
Jan 17 06:12:11 preclear_disk_39524A384C304E43_26725: Blocks (512 byte): 27344764928
Jan 17 06:12:11 preclear_disk_39524A384C304E43_26725: Block size: 4096
Jan 17 06:12:11 preclear_disk_39524A384C304E43_26725: Start sector: 512
Jan 17 06:12:14 preclear_disk_39524A384C304E43_26725: Pre-Read: dd if=/dev/sda of=/dev/null bs=2097152 skip=0 count=14000519643136 conv=notrunc iflag=nocache,count_bytes,skip_bytes
Jan 17 06:12:15 preclear_disk_39524A384C304E43_26725: /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 1059: 2097152 / (1579263134 - 1579263134) / 1000000 : division by 0 (error token is "(1579263134 - 1579263134) / 1000000 ")

Edited by andrew82
Link to comment
Is it possible speed calculations are still not correct? 
 
I've updated to latest plugin version - 2020.01.17a
 
I'm preclearing a brand new drive 8TB WD drive and only getting 70MB/s in Step 1:
 
image.png.d3063fd5bd44622327a0f6a37b360b70.png
 
However, same Drive model (different physical drive) I did a few weeks ago (pre-6.8.0/1 upgrade), I was getting 150MB/s.
 
image.png.3a59d1dd4ea0f6c997e6750b432f1a40.png
 
I was getting division by zero error and other problems today but upgraded to latest plugin and restarted.
 
I don't think drive speed calculation is right though.
 
David
 
 
You could try to reboot your server.

Enviado de meu SM-G973F usando o Tapatalk

Link to comment

Really appreciate the hard work on this plugin.  I ran into an issue on two drives I was clearing.  They both got hung up at "Zeroing 99%", been sitting there for a few hours now.  I had 2 additional drives complete without issue all started around at the same time.

 

The last log entries I see from those two drives is below.  Running Unraid 6.8.1 and Preclear Plugin 2020.01.17b

 

 

Jan 22 13:00:34 preclear_disk_R6G9R8HY_32737: Zeroing: dd output: 8000423067648 bytes (8.0 TB, 7.3 TiB) copied, 48210.5 s, 166 MB/s

Jan 22 13:00:34 preclear_disk_R6G9R8HY_32737: dd process hung at 8000425164800, killing....

Jan 22 13:00:34 preclear_disk_R6G9R8HY_32737: Continuing disk write on byte 8000423067648

Jan 22 13:00:34 preclear_disk_R6G9R8HY_32737: Zeroing: dd if=/dev/zero of=/dev/sdd bs=2097152 seek=8000423067648 count=1140154368 conv=notrunc iflag=count_bytes,nocache,fullblock oflag=seek_bytes

Jan 22 13:00:34 preclear_disk_R6G9R8HY_32737: Zeroing: dd pid [1759]

Jan 22 13:01:43 preclear_disk_R6G9R8HY_32737: Zeroing: dd - wrote 8001563222016 of 8001563222016.

 

 

Jan 22 12:52:20 preclear_disk_VLK6324Y_14584: Zeroing: dd output: 3815324+0 records out

Jan 22 12:52:20 preclear_disk_VLK6324Y_14584: Zeroing: dd output: 8001314357248 bytes (8.0 TB, 7.3 TiB) copied, 47930.3 s, 167 MB/s

Jan 22 12:52:20 preclear_disk_VLK6324Y_14584: dd process hung at 8001316454400, killing....

Jan 22 12:52:20 preclear_disk_VLK6324Y_14584: Continuing disk write on byte 8001314357248

Jan 22 12:52:20 preclear_disk_VLK6324Y_14584: Zeroing: dd if=/dev/zero of=/dev/sdf bs=2097152 seek=8001314357248 count=248864768 conv=notrunc iflag=count_bytes,nocache,fullblock oflag=seek_bytes

Jan 22 12:52:20 preclear_disk_VLK6324Y_14584: Zeroing: dd pid [14515]

Jan 22 12:52:22 preclear_disk_VLK6324Y_14584: Zeroing: dd - wrote 8001563222016 of 8001563222016.

 

Link to comment

Hello -

Having same issue of continuous "Zeroing" while pre-clearing a drive(s) - see attached logs.

 

Notes:

- had to pause process and sping down array for network issue. started array and preclear resumed as expected.

- two - 10Tb WD sata drives (internal, not USB)

- both drive preclear operations started at the same time

- watched first drive switch from Zeroing to Post-read (NOTE: first drive initially showed it was starting the Zeroing process again, but then flipped to Post-read and continues to run correctly. Also, noted the following message "unraids signature on the master boot record is valid" when the first Zeroing finished and it started teh Post-read)

- watched second drive finish first Zeroing process and start Zeroing all over again - stopped the process on this drive for now and pending feedback

 

Any further thoughts on this? @gfjardim?

 

Thanks!

Logs.jpg

Preclear_zero_loop.png

Link to comment

I can note that I pre-cleared a 10TB WD RED Pro drive with preclear.disk-2020.01.11a (version 1.0.6) on 6.7.2 without any problems 2 weeks ago.

Jan 11 17:14:46 husky preclear_disk_1EH4Z5MN[8086]: Command: /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh --cycles 1 --no-prompt /dev/sdn
Jan 11 17:14:46 husky preclear_disk_1EH4Z5MN[8086]: Preclear Disk Version: 1.0.6
...
Jan 12 21:32:34 husky preclear_disk_1EH4Z5MN[8086]: Zeroing: progress - 100% zeroed
...
Jan 13 11:44:11 husky preclear_disk_1EH4Z5MN[8086]: Post-Read: progress - 100% verified
Jan 13 11:44:12 husky preclear_disk_1EH4Z5MN[8086]: Post-Read: dd - read 10000831348736 of 10000831348736.
Jan 13 11:44:12 husky preclear_disk_1EH4Z5MN[8086]: Post-Read: dd exit code - 0
Jan 13 11:44:14 husky preclear_disk_1EH4Z5MN[8086]: S.M.A.R.T.: 5    Reallocated_Sector_Ct    0
Jan 13 11:44:14 husky preclear_disk_1EH4Z5MN[8086]: S.M.A.R.T.: 9    Power_On_Hours           42
Jan 13 11:44:14 husky preclear_disk_1EH4Z5MN[8086]: S.M.A.R.T.: 194  Temperature_Celsius      35
Jan 13 11:44:14 husky preclear_disk_1EH4Z5MN[8086]: S.M.A.R.T.: 196  Reallocated_Event_Count  0
Jan 13 11:44:14 husky preclear_disk_1EH4Z5MN[8086]: S.M.A.R.T.: 197  Current_Pending_Sector   0
Jan 13 11:44:14 husky preclear_disk_1EH4Z5MN[8086]: S.M.A.R.T.: 198  Offline_Uncorrectable    0
Jan 13 11:44:14 husky preclear_disk_1EH4Z5MN[8086]: S.M.A.R.T.: 199  UDMA_CRC_Error_Count     0

 

  • Thanks 1
Link to comment

I dunno if you guys resolved it but I mentioned it before but no fix  and last few unraid builds still doesn't work..  how do you fix  preclear  to PREVIEW  

it works for a while  but then  after a while  it looses the option to PREVIEW and only offers a X      if you goto the preclear  it also doesn't  show  it

 

you can see in pic 3-4  on my other server   its still able to preview.. but not on the 14tb drive 

is there something I need to fix alter edit??

so not sure when ill loose the preview of 12TB  on the other server

 

preclear.PNG

preclear2.PNG

preclear3.PNG

preclear4.PNG

Link to comment
20 minutes ago, taalas said:

Is there any way to downgrade this (or other plugins) if it was installed via Community Applications?

Not all plugins support downgrading, but at first glance it appears that Preclear does.  If you download the applicable .txz from https://github.com/gfjardim/unRAID-plugins/tree/master/archive, save it on the flash drive at /config/plugins/preclear.disk/ (or whatever the folder is called), and then edit the .plg at /config/plugins and change the version # within it, it *should* work.  A reboot will be necessary.

 

But, it should also be noted that it is never actually required to preclear any given disk.  Completely up to you and your own comfort level.

  • Thanks 1
Link to comment

Good Day everyone,

 

I just built my first unraid system, trying to learn as much as i can, on forums, manual and youtube and especially this group when other post their problems.

I am tryin to preclear two 10tb HDD that i schucked from amazon. However, one of the drives is stuck at 99% Zero. Can someone assist?

 

I have two 10TB connected and a 860 1TB SSD attached. On the first HDD i started the preclear (JEK6GG5N) and two hrs after i started the preclear on the second disk (2YKB4R2D).

 

The second disk (2YKB4R2D) finished zeroing and post read before the first disk with preclear report. The first disk (JEK6GG5N) is stuck at zeroing 99% @101mb/s. I looked at the log, and saw that there is no line for exit "code" like the line for the second disk eg "Jan 31 11:49:53 preclear_disk_2YKB4R2D_1202: Zeroing: dd exit code - 0"

 

The last line i have for the first disk is "Jan 31 10:28:04 preclear_disk_JEK6GG5N_17552: Zeroing: dd - wrote 10000831348736 of 10000831348736."

I tried pausing the pausing all sessions and resuming but nothing changed.

 

What should i do?

Thanks again in advance to who ever responds :)

My System:

E5-2690V3

Supermicro x10srl-f

64gig of DDR4 ECC RDIMM

TOWER-preclear.disk-20200201-1418.zip

Link to comment
On 1/31/2020 at 8:45 PM, Squid said:

But, it should also be noted that it is never actually required to preclear any given disk.  Completely up to you and your own comfort level.

Yeah, I thought about that. If I only preclear using one pass (I have never done more than one), is there really any advantage for me in preclearing? Or should I just replace my faulty drive and let unRAID rebuild it without a prior preclear?

Link to comment
1 minute ago, taalas said:

Yeah, I thought about that. If I only preclear using one pass (I have never done more than one), is there really any advantage for me in preclearing? Or should I just replace my faulty drive and let unRAID rebuild it without a prior preclear?

Up to your own comfort level.  Many people run it to eliminate the bathtub curve of failures.  Myself, I have never had any issues with hard drives failing prematurely, so I just can't be bothered anymore. 

 

A rebuild followed by a parity check and then looking at the SMART attributes will tell you pretty much anything you need to know.

Link to comment

Personally I view it like test driving a car. Normally it wont change your mind about the confidence level you have in it.. but the rare event it does... it pays for itself. The time and energy/stress related to having your parity drive or something out of commission while you try to get another drive to replace it is just not worth it. *(which is why you should always keep a pre-cleared drive as a spare to reduce that scenario).

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.