Jump to content
gfjardim

Preclear plugin

2435 posts in this topic Last Reply

Recommended Posts

1 minute ago, rctneil said:

 

Ok, Plugin updated and it's started. I'll report back with progress.

 

Thanks so far though!

 

Ok, will wait for your feedback.

Share this post


Link to post
16 minutes ago, gfjardim said:

 

Ok, will wait for your feedback.

 

The status seems to be updating correctly now. Although it has started the post read from the beginning. Oh well.

 

Thanks so much for your help.

 

Kind regards,

Neil

 

 

Share this post


Link to post
17 minutes ago, rctneil said:

 

The status seems to be updating correctly now. Although it has started the post read from the beginning. Oh well.

 

Thanks so much for your help.

 

Kind regards,

Neil

 

 

 

Looking at your logs it got stuck in the beginning of the post read, so resuming from the beginning is the correct behavior.

Edited by gfjardim

Share this post


Link to post

What would anticipate the speeds to be on a USB enclosure for preread? It is USB 3 but only getting like 35MB/sec. I think it’s on a hub though, may be the issue.


Sent from my iPhone using Tapatalk

Share this post


Link to post
23 minutes ago, rxnelson said:

What would anticipate the speeds to be on a USB enclosure for preread? It is USB 3 but only getting like 35MB/sec. I think it’s on a hub though, may be the issue.


Sent from my iPhone using Tapatalk

 

One of my drives:

 

Disk Drive:  Seagate ST2000LM007 - 2TB
Controler:   VIA Technologies, Inc. VL805 USB 3.0 Host Controller (rev 01)
Read speed:  97 MB/s
Write Speed: 99 MB/s

Share this post


Link to post
1 minute ago, gfjardim said:

@rctneil, any news?

 

Finished successfully a couple of hours ago!!!

 

Once again, thanks for your help.

Share this post


Link to post
Just now, rctneil said:

 

Finished successfully a couple of hours ago!!!

 

Once again, thanks for your help.

 

You're quite welcome!

Share this post


Link to post

Had a preclear failure yesterday.  Using standard script.  It stopped (apparently) at the beginning of the Post-read.  The Preclear Status condition was "unRAID's signature on the MBR is valid".  It has been 'stuck' at this state for more than eight hours and probably closer to twelve hours

 

 I have attached all of the pertinent information in the attached files.  The Preclear_Failure.txt file is the current state of the Status Window.

 

EDIT:  I did preclear a Seagate ST3000DM001_1CH166  disk (one of the infamous series) a couple of days ago without a problem.

 

rose-diagnostics-20180831-2208.zip

ROSE-preclear.disk-20180831-2153.zip

Preclear_Failure.txt

Edited by Frank1940

Share this post


Link to post
3 hours ago, Frank1940 said:

Had a preclear failure yesterday.  Using standard script.  It stopped (apparently) at the beginning of the Post-read.  The Preclear Status condition was "unRAID's signature on the MBR is valid".  It has been 'stuck' at this state for more than eight hours and probably closer to twelve hours

Quote

No need to do that. Just stop the preclear, update the plugin and start it again.

I decided to try this and it picked up from where it left off.  It has now completed 1% of the Post Read.  I will report back if/when it finishes.  

Edited by Frank1940

Share this post


Link to post
7 hours ago, Frank1940 said:

I decided to try this and it picked up from where it left off.  It has now completed 1% of the Post Read.  I will report back if/when it finishes.  

The restart of the Preclear did resume and complete successfully.  I am attaching the Preclear zip file and the Diagnostic file that I captured after the test finished to this report for your analysis.  Do you have any thoughts as to why the preclear process hung up?  

 

I feel I must point out that I did not upgrade the Preclear software after the hang occurred as it was already on version 2018.08.27. So the hang did take place with this latest version.  I will also point out that the Seagate ST3000DM001 did preclear successfully a day before The WD Red had issues using this version of the software.

 

If you want me to run any other tests, I am willing to do so.  But I do want to update this server to the ver 6.6-rc1 to see what is really new and great in that release but I will delay for a couple of days before I do it.  

rose-diagnostics-20180901-1750.zip

ROSE-preclear.disk-20180901-1743.zip

Edited by Frank1940

Share this post


Link to post

The recent update to the preclear plugin seems to have broken it for me.

 

I an trying to "erase and clear" 6 disks. Only one of the disks is actually doing something, the others are stuck with message "Starting...".

 

Thoughts?

Share this post


Link to post

I tried that, and having now done it again, they are clearing. However, the 1st disk is clearing at 143MB/s, the other 5 preclear processes are around 10MB/s.

Previously, they all ran at full speed.

 

Share this post


Link to post

@gfjardim  Preclear has failed multiple times on zeroing.  Seems to always hang at 99%.  I stop and resume (starts at 0%) and it will hang again.

 

############################################################################################################################
#                                                                                                                          #
#                                        unRAID Server Preclear of disk ZCH0BYLE                                           #
#                                       Cycle 1 of 1, partition start on sector 64.                                        #
#                                                                                                                          #
#                                                                                                                          #
#   Step 1 of 5 - Pre-read verification:                                                   [95:26:11 @ 34 MB/s] SUCCESS    #
#   Step 2 of 5 - Zeroing in progress:                                                                       (99% Done)    #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#   ** Time elapsed: 88:00:37 | Write speed: 37.9 MB/s | Average speed: 37 MB/s                                            #
#                                                                                                                          #
############################################################################################################################
#                             Cycle elapsed time: 183:26:54 | Total elapsed time: 183:26:55                                #
############################################################################################################################


############################################################################################################################
#                                                                                                                          #
#                                               S.M.A.R.T. Status default                                                  #
#                                                                                                                          #
#                                                                                                                          #
#   ATTRIBUTE                    INITIAL  STATUS                                                                           #
#   5-Reallocated_Sector_Ct      0        -                                                                                #
#   9-Power_On_Hours             1313     -                                                                                #
#   187-Reported_Uncorrect       0        -                                                                                #
#   190-Airflow_Temperature_Cel  32       -                                                                                #
#   197-Current_Pending_Sector   0        -                                                                                #
#   198-Offline_Uncorrectable    0        -                                                                                #
#   199-UDMA_CRC_Error_Count     0        -                                                                                #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
############################################################################################################################
#   SMART overall-health self-assessment test result: PASSED                                                               #
############################################################################################################################

/usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 441: 80388 Killed                  dd if=/dev/zero of=/dev/sda bs=2097
152 seek=2097152 count=12000136527872 conv=notrunc iflag=count_bytes,nocache,fullblock oflag=seek_bytes 2> /tmp/.preclear/sda/dd_output

Log attached

TOWERTEST-preclear.disk-20180903-1259.zip

 

 

Spoke too soon.  It looks like it is marking the zero as complete and moving on on the resume.

 

############################################################################################################################
#                                                                                                                          #
#                                        unRAID Server Preclear of disk ZCH0BYLE                                           #
#                                       Cycle 1 of 1, partition start on sector 64.                                        #
#                                                                                                                          #
#                                                                                                                          #
#   Step 1 of 5 - Pre-read verification:                                                   [95:26:11 @ 34 MB/s] SUCCESS    #
#   Step 2 of 5 - Zeroing the disk:                                                        [88:00:49 @ 37 MB/s] SUCCESS    #
#   Step 3 of 5 - Writing unRAID's Preclear signature:                                                          SUCCESS    #
#   Step 4 of 5 - Verifying unRAID's Preclear signature:                                                        SUCCESS    #
#   Step 5 of 5 - Post-Read in progress:                                                                      (0% Done)    #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#   ** Time elapsed: 0:10:46 | Current speed: 34.4 MB/s | Average speed: 34 MB/s                                           #
#                                                                                                                          #
############################################################################################################################
#                             Cycle elapsed time: 183:37:58 | Total elapsed time: 183:38:00                                #
############################################################################################################################


############################################################################################################################
#                                                                                                                          #
#                                               S.M.A.R.T. Status default                                                  #
#                                                                                                                          #
#                                                                                                                          #
#   ATTRIBUTE                    INITIAL  STATUS                                                                           #
#   5-Reallocated_Sector_Ct      0        -                                                                                #
#   9-Power_On_Hours             1545     -                                                                                #
#   187-Reported_Uncorrect       0        -                                                                                #
#   190-Airflow_Temperature_Cel  25       -                                                                                #
#   197-Current_Pending_Sector   0        -                                                                                #
#   198-Offline_Uncorrectable    0        -                                                                                #
#   199-UDMA_CRC_Error_Count     0        -                                                                                #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
############################################################################################################################
#   SMART overall-health self-assessment test result: PASSED                                                               #
############################################################################################################################

 

Edited by rxnelson
adding info

Share this post


Link to post

Hi!

 

I tried to preclear two 8TB WD Reds and one disk seems to be stuck in the postread:

 

############################################################################################################################
#                                                                                                                          #
#                                         unRAID Server Preclear of disk VAG4N04L                                          #
#                                       Cycle 1 of 1, partition start on sector 64.                                        #
#                                                                                                                          #
#                                                                                                                          #
#   Step 1 of 5 - Pre-read verification:                                                   [27:49:14 @ 79 MB/s] SUCCESS    #
#   Step 2 of 5 - Zeroing the disk:                                                        [22:29:00 @ 98 MB/s] SUCCESS    #
#   Step 3 of 5 - Writing unRAID's Preclear signature:                                                          SUCCESS    #
#   Step 4 of 5 - Verifying unRAID's Preclear signature:                                                        SUCCESS    #
#   Step 5 of 5 - Post-Read in progress ...                                                                                #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
############################################################################################################################
#                              Cycle elapsed time: 50:18:32 | Total elapsed time: 50:18:35                                 #
############################################################################################################################


############################################################################################################################
#                                                                                                                          #
#                                               S.M.A.R.T. Status default                                                  #
#                                                                                                                          #
#                                                                                                                          #
#   ATTRIBUTE                    INITIAL  STATUS                                                                           #
#   5-Reallocated_Sector_Ct      0        -                                                                                #
#   9-Power_On_Hours             106      -                                                                                #
#   194-Temperature_Celsius      37       -                                                                                #
#   196-Reallocated_Event_Count  0        -                                                                                #
#   197-Current_Pending_Sector   0        -                                                                                #
#   198-Offline_Uncorrectable    0        -                                                                                #
#   199-UDMA_CRC_Error_Count     0        -                                                                                #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
############################################################################################################################
#   SMART overall-health self-assessment test result: PASSED                                                               #
############################################################################################################################

 

The other one failed:

 

############################################################################################################################
#                                                                                                                          #
#                                         unRAID Server Preclear of disk VAG54G5L                                          #
#                                       Cycle 1 of 1, partition start on sector 64.                                        #
#                                                                                                                          #
#                                                                                                                          #
#   Step 1 of 5 - Pre-read verification:                                                   [27:48:24 @ 79 MB/s] SUCCESS    #
#   Step 2 of 5 - Zeroing the disk:                                                        [22:29:10 @ 98 MB/s] SUCCESS    #
#   Step 3 of 5 - Writing unRAID's Preclear signature:                                                          SUCCESS    #
#   Step 4 of 5 - Verifying unRAID's Preclear signature:                                                        SUCCESS    #
#   Step 5 of 5 - Post-Read verification:                                                                          FAIL    #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
############################################################################################################################
#                              Cycle elapsed time: 50:46:02 | Total elapsed time: 50:46:04                                 #
############################################################################################################################


############################################################################################################################
#                                                                                                                          #
#                                               S.M.A.R.T. Status default                                                  #
#                                                                                                                          #
#                                                                                                                          #
#   ATTRIBUTE                    INITIAL  STATUS                                                                           #
#   5-Reallocated_Sector_Ct      0        -                                                                                #
#   9-Power_On_Hours             106      -                                                                                #
#   194-Temperature_Celsius      38       -                                                                                #
#   196-Reallocated_Event_Count  0        -                                                                                #
#   197-Current_Pending_Sector   0        -                                                                                #
#   198-Offline_Uncorrectable    0        -                                                                                #
#   199-UDMA_CRC_Error_Count     0        -                                                                                #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
############################################################################################################################
#   SMART overall-health self-assessment test result: PASSED                                                               #
############################################################################################################################

--> FAIL: Post-Read verification failed. Your drive is not zeroed.

 

Any ideas what I should do?

SERVER-preclear.disk-20180904-1759.zip

Share this post


Link to post

Almost 3 effin days WASTED with preclearing.

 

Has anyone ever succeeded with this plugin? Al I'm seeing are problems with this script all over this thread..... 🤬

Share this post


Link to post
18 minutes ago, Evin said:

Almost 3 effin days WASTED with preclearing.

 

Has anyone ever succeeded with this plugin? Al I'm seeing are problems with this script all over this thread..... 🤬

Have you tried just using JoeL's script (or one of the others) from the command line?

Another option would be the disk testing utilities provided by the various manufacturers since the "preclearing" is no longer really necessary.

Edited by wgstarks

Share this post


Link to post

I have an issue with preclear my WD Red 3TB hdd. When I ran this plugin with my other HDDs that worked excellent, but for some reason this drive is stuck on "Starting...". I have tried to restart it and leave it for a few hours, but it's still stuck on "Starting...". I have attached my preclear log.

WALLESERVER-preclear.disk-20180904-1934.zip

Share this post


Link to post
2 hours ago, Evin said:

Almost 3 effin days WASTED with preclearing.

 

Has anyone ever succeeded with this plugin? Al I'm seeing are problems with this script all over this thread..... 🤬

I realize that you are very frustrated but if you really want to help solve the problem(s), you are going to have to provide some more information that might help in solving it.  Specifically, your unRAID Diagnostic file and the preclear log file.  You will find the download button for the latter on the top right of the Preclear plugin page.  

Share this post


Link to post
1 hour ago, Frank1940 said:

I realize that you are very frustrated but if you really want to help solve the problem(s), you are going to have to provide some more information that might help in solving it.  Specifically, your unRAID Diagnostic file and the preclear log file.  You will find the download button for the latter on the top right of the Preclear plugin page.  

Thx for the reply. The preclearfile was linked in the post before, syslog attached now. :)

SERVER-preclear.disk-20180904-1759.zip

Share this post


Link to post
7 hours ago, wgstarks said:

Have you tried just using JoeL's script (or one of the others) from the command line?

Another option would be the disk testing utilities provided by the various manufacturers since the "preclearing" is no longer really necessary.

 

That sounds like a good alternative.  What exactly would that look like? /flash/config/plugins/preclear.disk/preclear_bjp.sh? Asking for a friend.....

 

Share this post


Link to post
31 minutes ago, rxnelson said:

 

That sounds like a good alternative.  What exactly would that look like? /flash/config/plugins/preclear.disk/preclear_bjp.sh? Asking for a friend.....

 

Yes. Run it with screen so that it will continue after you exit.

 

Edit: Actually it's /boot/config/plugins/preclear.disk/preclear_bjp.sh

Edited by wgstarks

Share this post


Link to post
On 9/4/2018 at 8:24 PM, walle said:

I have an issue with preclear my WD Red 3TB hdd. When I ran this plugin with my other HDDs that worked excellent, but for some reason this drive is stuck on "Starting...". I have tried to restart it and leave it for a few hours, but it's still stuck on "Starting...". I have attached my preclear log.

WALLESERVER-preclear.disk-20180904-1934.zip

Does anyone know what the issue can be? Shall I test and install an older version of the plugin and see if that helps? If so, how do I do that?

Here is my diagnostics data.

 

23 hours ago, wgstarks said:

Yes. Run it with screen so that it will continue after you exit.

 

Edit: Actually it's /boot/config/plugins/preclear.disk/preclear_bjp.sh 

 

It seams that doesn't  on my system. Did I miss something?

$ ls -l /boot/config/plugins/preclear.disk/
total 1960
-rwxrwxrwx 1 root root  263640 Sep  4 07:48 libevent-2.1.8-x86_64-1.txz
-rwxrwxrwx 1 root root 1289920 Sep  4 07:48 ncurses-6.1_20180324-x86_64-1.txz
-rwxrwxrwx 1 root root      63 Sep  4 07:48 preclear.disk-2018.08.27.md5
-rwxrwxrwx 1 root root  163992 Sep  4 07:48 preclear.disk-2018.08.27.txz
-rwxrwxrwx 1 root root  244556 Sep  4 07:48 tmux-2.6-x86_64-1.txz
-rwxrwxrwx 1 root root   15624 Sep  4 07:48 utempter-1.1.6-x86_64-2.txz

 

Edited by walle
Removed link to diagnostics data for privacy, problem solved.

Share this post


Link to post
20 minutes ago, walle said:

It seams that doesn't  on my system. Did I miss something?

Look in the first post of this thread at the first and third questions in the Q&A section for the location of the script for downloading.  If you are wondering why the scripts are not installed with the plugin, read that first post very carefully...  (like a lawyer)

Share this post


Link to post

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.