Preclear plugin


Recommended Posts

17 minutes ago, rctneil said:

 

The status seems to be updating correctly now. Although it has started the post read from the beginning. Oh well.

 

Thanks so much for your help.

 

Kind regards,

Neil

 

 

 

Looking at your logs it got stuck in the beginning of the post read, so resuming from the beginning is the correct behavior.

Edited by gfjardim
Link to comment
23 minutes ago, rxnelson said:

What would anticipate the speeds to be on a USB enclosure for preread? It is USB 3 but only getting like 35MB/sec. I think it’s on a hub though, may be the issue.


Sent from my iPhone using Tapatalk

 

One of my drives:

 

Disk Drive:  Seagate ST2000LM007 - 2TB
Controler:   VIA Technologies, Inc. VL805 USB 3.0 Host Controller (rev 01)
Read speed:  97 MB/s
Write Speed: 99 MB/s

Link to comment

Had a preclear failure yesterday.  Using standard script.  It stopped (apparently) at the beginning of the Post-read.  The Preclear Status condition was "unRAID's signature on the MBR is valid".  It has been 'stuck' at this state for more than eight hours and probably closer to twelve hours

 

 I have attached all of the pertinent information in the attached files.  The Preclear_Failure.txt file is the current state of the Status Window.

 

EDIT:  I did preclear a Seagate ST3000DM001_1CH166  disk (one of the infamous series) a couple of days ago without a problem.

 

rose-diagnostics-20180831-2208.zip

ROSE-preclear.disk-20180831-2153.zip

Preclear_Failure.txt

Edited by Frank1940
Link to comment
3 hours ago, Frank1940 said:

Had a preclear failure yesterday.  Using standard script.  It stopped (apparently) at the beginning of the Post-read.  The Preclear Status condition was "unRAID's signature on the MBR is valid".  It has been 'stuck' at this state for more than eight hours and probably closer to twelve hours

Quote

No need to do that. Just stop the preclear, update the plugin and start it again.

I decided to try this and it picked up from where it left off.  It has now completed 1% of the Post Read.  I will report back if/when it finishes.  

Edited by Frank1940
Link to comment
7 hours ago, Frank1940 said:

I decided to try this and it picked up from where it left off.  It has now completed 1% of the Post Read.  I will report back if/when it finishes.  

The restart of the Preclear did resume and complete successfully.  I am attaching the Preclear zip file and the Diagnostic file that I captured after the test finished to this report for your analysis.  Do you have any thoughts as to why the preclear process hung up?  

 

I feel I must point out that I did not upgrade the Preclear software after the hang occurred as it was already on version 2018.08.27. So the hang did take place with this latest version.  I will also point out that the Seagate ST3000DM001 did preclear successfully a day before The WD Red had issues using this version of the software.

 

If you want me to run any other tests, I am willing to do so.  But I do want to update this server to the ver 6.6-rc1 to see what is really new and great in that release but I will delay for a couple of days before I do it.  

rose-diagnostics-20180901-1750.zip

ROSE-preclear.disk-20180901-1743.zip

Edited by Frank1940
Link to comment

@gfjardim  Preclear has failed multiple times on zeroing.  Seems to always hang at 99%.  I stop and resume (starts at 0%) and it will hang again.

 

############################################################################################################################
#                                                                                                                          #
#                                        unRAID Server Preclear of disk ZCH0BYLE                                           #
#                                       Cycle 1 of 1, partition start on sector 64.                                        #
#                                                                                                                          #
#                                                                                                                          #
#   Step 1 of 5 - Pre-read verification:                                                   [95:26:11 @ 34 MB/s] SUCCESS    #
#   Step 2 of 5 - Zeroing in progress:                                                                       (99% Done)    #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#   ** Time elapsed: 88:00:37 | Write speed: 37.9 MB/s | Average speed: 37 MB/s                                            #
#                                                                                                                          #
############################################################################################################################
#                             Cycle elapsed time: 183:26:54 | Total elapsed time: 183:26:55                                #
############################################################################################################################


############################################################################################################################
#                                                                                                                          #
#                                               S.M.A.R.T. Status default                                                  #
#                                                                                                                          #
#                                                                                                                          #
#   ATTRIBUTE                    INITIAL  STATUS                                                                           #
#   5-Reallocated_Sector_Ct      0        -                                                                                #
#   9-Power_On_Hours             1313     -                                                                                #
#   187-Reported_Uncorrect       0        -                                                                                #
#   190-Airflow_Temperature_Cel  32       -                                                                                #
#   197-Current_Pending_Sector   0        -                                                                                #
#   198-Offline_Uncorrectable    0        -                                                                                #
#   199-UDMA_CRC_Error_Count     0        -                                                                                #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
############################################################################################################################
#   SMART overall-health self-assessment test result: PASSED                                                               #
############################################################################################################################

/usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 441: 80388 Killed                  dd if=/dev/zero of=/dev/sda bs=2097
152 seek=2097152 count=12000136527872 conv=notrunc iflag=count_bytes,nocache,fullblock oflag=seek_bytes 2> /tmp/.preclear/sda/dd_output

Log attached

TOWERTEST-preclear.disk-20180903-1259.zip

 

 

Spoke too soon.  It looks like it is marking the zero as complete and moving on on the resume.

 

############################################################################################################################
#                                                                                                                          #
#                                        unRAID Server Preclear of disk ZCH0BYLE                                           #
#                                       Cycle 1 of 1, partition start on sector 64.                                        #
#                                                                                                                          #
#                                                                                                                          #
#   Step 1 of 5 - Pre-read verification:                                                   [95:26:11 @ 34 MB/s] SUCCESS    #
#   Step 2 of 5 - Zeroing the disk:                                                        [88:00:49 @ 37 MB/s] SUCCESS    #
#   Step 3 of 5 - Writing unRAID's Preclear signature:                                                          SUCCESS    #
#   Step 4 of 5 - Verifying unRAID's Preclear signature:                                                        SUCCESS    #
#   Step 5 of 5 - Post-Read in progress:                                                                      (0% Done)    #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#   ** Time elapsed: 0:10:46 | Current speed: 34.4 MB/s | Average speed: 34 MB/s                                           #
#                                                                                                                          #
############################################################################################################################
#                             Cycle elapsed time: 183:37:58 | Total elapsed time: 183:38:00                                #
############################################################################################################################


############################################################################################################################
#                                                                                                                          #
#                                               S.M.A.R.T. Status default                                                  #
#                                                                                                                          #
#                                                                                                                          #
#   ATTRIBUTE                    INITIAL  STATUS                                                                           #
#   5-Reallocated_Sector_Ct      0        -                                                                                #
#   9-Power_On_Hours             1545     -                                                                                #
#   187-Reported_Uncorrect       0        -                                                                                #
#   190-Airflow_Temperature_Cel  25       -                                                                                #
#   197-Current_Pending_Sector   0        -                                                                                #
#   198-Offline_Uncorrectable    0        -                                                                                #
#   199-UDMA_CRC_Error_Count     0        -                                                                                #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
############################################################################################################################
#   SMART overall-health self-assessment test result: PASSED                                                               #
############################################################################################################################

 

Edited by rxnelson
adding info
Link to comment

Hi!

 

I tried to preclear two 8TB WD Reds and one disk seems to be stuck in the postread:

 

############################################################################################################################
#                                                                                                                          #
#                                         unRAID Server Preclear of disk VAG4N04L                                          #
#                                       Cycle 1 of 1, partition start on sector 64.                                        #
#                                                                                                                          #
#                                                                                                                          #
#   Step 1 of 5 - Pre-read verification:                                                   [27:49:14 @ 79 MB/s] SUCCESS    #
#   Step 2 of 5 - Zeroing the disk:                                                        [22:29:00 @ 98 MB/s] SUCCESS    #
#   Step 3 of 5 - Writing unRAID's Preclear signature:                                                          SUCCESS    #
#   Step 4 of 5 - Verifying unRAID's Preclear signature:                                                        SUCCESS    #
#   Step 5 of 5 - Post-Read in progress ...                                                                                #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
############################################################################################################################
#                              Cycle elapsed time: 50:18:32 | Total elapsed time: 50:18:35                                 #
############################################################################################################################


############################################################################################################################
#                                                                                                                          #
#                                               S.M.A.R.T. Status default                                                  #
#                                                                                                                          #
#                                                                                                                          #
#   ATTRIBUTE                    INITIAL  STATUS                                                                           #
#   5-Reallocated_Sector_Ct      0        -                                                                                #
#   9-Power_On_Hours             106      -                                                                                #
#   194-Temperature_Celsius      37       -                                                                                #
#   196-Reallocated_Event_Count  0        -                                                                                #
#   197-Current_Pending_Sector   0        -                                                                                #
#   198-Offline_Uncorrectable    0        -                                                                                #
#   199-UDMA_CRC_Error_Count     0        -                                                                                #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
############################################################################################################################
#   SMART overall-health self-assessment test result: PASSED                                                               #
############################################################################################################################

 

The other one failed:

 

############################################################################################################################
#                                                                                                                          #
#                                         unRAID Server Preclear of disk VAG54G5L                                          #
#                                       Cycle 1 of 1, partition start on sector 64.                                        #
#                                                                                                                          #
#                                                                                                                          #
#   Step 1 of 5 - Pre-read verification:                                                   [27:48:24 @ 79 MB/s] SUCCESS    #
#   Step 2 of 5 - Zeroing the disk:                                                        [22:29:10 @ 98 MB/s] SUCCESS    #
#   Step 3 of 5 - Writing unRAID's Preclear signature:                                                          SUCCESS    #
#   Step 4 of 5 - Verifying unRAID's Preclear signature:                                                        SUCCESS    #
#   Step 5 of 5 - Post-Read verification:                                                                          FAIL    #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
############################################################################################################################
#                              Cycle elapsed time: 50:46:02 | Total elapsed time: 50:46:04                                 #
############################################################################################################################


############################################################################################################################
#                                                                                                                          #
#                                               S.M.A.R.T. Status default                                                  #
#                                                                                                                          #
#                                                                                                                          #
#   ATTRIBUTE                    INITIAL  STATUS                                                                           #
#   5-Reallocated_Sector_Ct      0        -                                                                                #
#   9-Power_On_Hours             106      -                                                                                #
#   194-Temperature_Celsius      38       -                                                                                #
#   196-Reallocated_Event_Count  0        -                                                                                #
#   197-Current_Pending_Sector   0        -                                                                                #
#   198-Offline_Uncorrectable    0        -                                                                                #
#   199-UDMA_CRC_Error_Count     0        -                                                                                #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
#                                                                                                                          #
############################################################################################################################
#   SMART overall-health self-assessment test result: PASSED                                                               #
############################################################################################################################

--> FAIL: Post-Read verification failed. Your drive is not zeroed.

 

Any ideas what I should do?

SERVER-preclear.disk-20180904-1759.zip

Link to comment
18 minutes ago, Evin said:

Almost 3 effin days WASTED with preclearing.

 

Has anyone ever succeeded with this plugin? Al I'm seeing are problems with this script all over this thread..... 🤬

Have you tried just using JoeL's script (or one of the others) from the command line?

Another option would be the disk testing utilities provided by the various manufacturers since the "preclearing" is no longer really necessary.

Edited by wgstarks
Link to comment
2 hours ago, Evin said:

Almost 3 effin days WASTED with preclearing.

 

Has anyone ever succeeded with this plugin? Al I'm seeing are problems with this script all over this thread..... 🤬

I realize that you are very frustrated but if you really want to help solve the problem(s), you are going to have to provide some more information that might help in solving it.  Specifically, your unRAID Diagnostic file and the preclear log file.  You will find the download button for the latter on the top right of the Preclear plugin page.  

Link to comment
1 hour ago, Frank1940 said:

I realize that you are very frustrated but if you really want to help solve the problem(s), you are going to have to provide some more information that might help in solving it.  Specifically, your unRAID Diagnostic file and the preclear log file.  You will find the download button for the latter on the top right of the Preclear plugin page.  

Thx for the reply. The preclearfile was linked in the post before, syslog attached now. :)

SERVER-preclear.disk-20180904-1759.zip

Link to comment
7 hours ago, wgstarks said:

Have you tried just using JoeL's script (or one of the others) from the command line?

Another option would be the disk testing utilities provided by the various manufacturers since the "preclearing" is no longer really necessary.

 

That sounds like a good alternative.  What exactly would that look like? /flash/config/plugins/preclear.disk/preclear_bjp.sh? Asking for a friend.....

 

Link to comment
31 minutes ago, rxnelson said:

 

That sounds like a good alternative.  What exactly would that look like? /flash/config/plugins/preclear.disk/preclear_bjp.sh? Asking for a friend.....

 

Yes. Run it with screen so that it will continue after you exit.

 

Edit: Actually it's /boot/config/plugins/preclear.disk/preclear_bjp.sh

Edited by wgstarks
Link to comment
On 9/4/2018 at 8:24 PM, walle said:

I have an issue with preclear my WD Red 3TB hdd. When I ran this plugin with my other HDDs that worked excellent, but for some reason this drive is stuck on "Starting...". I have tried to restart it and leave it for a few hours, but it's still stuck on "Starting...". I have attached my preclear log.

WALLESERVER-preclear.disk-20180904-1934.zip

Does anyone know what the issue can be? Shall I test and install an older version of the plugin and see if that helps? If so, how do I do that?

Here is my diagnostics data.

 

23 hours ago, wgstarks said:

Yes. Run it with screen so that it will continue after you exit.

 

Edit: Actually it's /boot/config/plugins/preclear.disk/preclear_bjp.sh 

 

It seams that doesn't  on my system. Did I miss something?

$ ls -l /boot/config/plugins/preclear.disk/
total 1960
-rwxrwxrwx 1 root root  263640 Sep  4 07:48 libevent-2.1.8-x86_64-1.txz
-rwxrwxrwx 1 root root 1289920 Sep  4 07:48 ncurses-6.1_20180324-x86_64-1.txz
-rwxrwxrwx 1 root root      63 Sep  4 07:48 preclear.disk-2018.08.27.md5
-rwxrwxrwx 1 root root  163992 Sep  4 07:48 preclear.disk-2018.08.27.txz
-rwxrwxrwx 1 root root  244556 Sep  4 07:48 tmux-2.6-x86_64-1.txz
-rwxrwxrwx 1 root root   15624 Sep  4 07:48 utempter-1.1.6-x86_64-2.txz

 

Edited by walle
Removed link to diagnostics data for privacy, problem solved.
Link to comment
20 minutes ago, walle said:

It seams that doesn't  on my system. Did I miss something?

Look in the first post of this thread at the first and third questions in the Q&A section for the location of the script for downloading.  If you are wondering why the scripts are not installed with the plugin, read that first post very carefully...  (like a lawyer)

Link to comment
Yes. Run it with screen so that it will continue after you exit.
 
Edit: Actually it's /boot/config/plugins/preclear.disk/preclear_bjp.sh



Don’t you have to put sda or something on there to tell it what drive. I’ve seen scripts with what look like switches as well -f I think.


Sent from my iPhone using Tapatalk
Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.