Preclear plugin


Recommended Posts

I attached the drive to SATA port 3 on the motherboard (removing data drive already attached there), and started a PreClear, for 2 cycles (this was early Monday morning, around 5 am).  It finished successfully this morning about 3, so it seems the drive is fine, and the add-on controller is not.  Thanks to you and Omid for pointing me towards that.
The storage controller I'd been attempting to use has only 2 ports, one of which is in use and has been working fine, but I need a port in which to connect the data drive I removed from motherboard SATA 3.  Is it safe to assume I should expect the same problems if I tried plugging the data drive into that second port, and should just purchase a new controller?
Also, what's an HBA (I'm still quite ignorant with much of the terminology, etc)?
Yep, it's the same controller so the odds the other port has problems are not negligible.

HBA is host bus adapter:

In computer hardware, a host controller, host adapter, or host bus adapter (HBA) connects a computer, which acts as the host system, to other network and storage devices.[1] The terms are primarily used to refer to devices for connecting SCSI, Fibre Channel and SATA devices.[2] Devices for connecting to IDE, Ethernet, FireWire, USB and other systems may also be called host adapters.



Enviado de meu SM-G985F usando o Tapatalk



Link to comment
20 hours ago, John_M said:

 

The information you've given doesn't show what's wrong with them. You'd need to look at the full SMART report for that. As to your question, I'd ask how safe is it to use a failed parachute or a failed crash helmet? Better than none, but not much.

Hi John_M,

 

thanks for answering my questions. I'm attaching Smart reports from 2 different HDDs purchased around the same time. One of the drives is where I got that FAIL report, the other seems to be ok even though they were put to production at the same time. I guess on the failed one, Raw Read Error Rate is very high indicating FAIL NOW is the issue, also the Program_Fail_Cnt_Total is quite high. Not sure how important these numbers are. 

 

I agree with your assessment about using failed parachute, luckily one of the drives still survives, so I'm going to put this to use as backup drives and trashed the other one. I've been collecting high density magnet out of trashed HDDs. 

Prolific_ATAPI-6_Bridge_C_012345678900000001A-0-0-20210421-1351 (sdj).txt Prolific_ATAPI-6_Bridge_C_012345678900000001A-0-0-20210421-1345 (sdj).txt

Link to comment

Just ran the latest version of pre-clear on a new drive and it appears to have fixed the problems I was having earlier.  The problem with it failing was fixed in a previous version, but this latest version is configured to only run the zeroing process once and not twice like it had been doing.

 

I generally buy external drives and shuck them before running pre-clear, but someone had mentioned running pre-clear with the enclosure hooked up to a USB port before taking the drive out of the enclosure.  I tried it and so far it's working great.  It seems to be running as fast as when performing a pre-clear on a drive physically installed in the array.  The real plus is that I don't have to shut down the array to install or remove it.  That plus if there's an issue with the drive I won't take a chance of damaging the case when removing it in the event that I need to return it because of a bad drive.  I forget who posted the tip, but kudos for that.

  • Like 1
Link to comment

I've got a new 4TB WD Red drive that I tired pre-clearing.  The process ended as soon as it began with a message saying "Preclear Finished Successfully!" although it looks like the process may still be active (see attached screenshot).  This is my third Preclear attempt.  Same result the previous two times.  Log attached.

 

Is it possible for a new drive to instantly preclear only completing Step 1 of 5?

Capture.JPG

preclear_report_WD-WXA2DA0176EK_2021.04.29_10.40.19.txt

Link to comment

Have I got this correct: If I have a new external hard drive using USB3, and:

 

A)  if it is intended for unassigned devices (not the array), then I would

  1. delete all partitions, then
  2. run preclear if I want a bit of a stress test,
  3. then format (like NTFS).  Then I can shuck it if desired, at my own risk.

B)  if it is intended to be readied to be put into the array, then I would

  1. delete all partitions, then
  2. run preclear if I want a bit of a stress test,
  3. then DO NOT format. 
  4. Then I can shuck it so I can use SATA instead of USB3, at my own risk.
  5. Then add to array.  When adding to array it is automatically "formatted" if needed.

Is the above correct?

 

if it is intended for unassigned devices, which preclear option should I use to stress test: "Verify all the disk", or "erase all the disk" or ?

Thanks.

Edited by xrqp
Link to comment

Seems like the "dd" processes are running niceness of 0 which can slow things down considerably on slower systems and/or when preclearing multiple disks at the same time.

 

Running this on the dd processes seems to make a big difference in system responsiveness:

 

renice -n 20 -p <pid>

 

Would it be possible to have the plugin launch the dd processes using nice?

 

Apologies if this has been suggested before.

 

edit:  Here's a one-liner to set niceness 20 (low cpu priority) on all currently running preclear jobs

 

renice -n 20 -p $(ps aux | grep 'dd if=/dev/' | grep -v grep | awk '{print $2}')

 

edit2: modified to catch preclear read operations too

Edited by jortan
Link to comment
On 5/4/2021 at 7:38 AM, xrqp said:

Have I got this correct: If I have a new external hard drive using USB3, and:

 

A)  if it is intended for unassigned devices (not the array), then I would

  1. delete all partitions, then
  2. run preclear if I want a bit of a stress test,
  3. then format (like NTFS).  Then I can shuck it if desired, at my own risk.

B)  if it is intended to be readied to be put into the array, then I would

  1. delete all partitions, then
  2. run preclear if I want a bit of a stress test,
  3. then DO NOT format. 
  4. Then I can shuck it so I can use SATA instead of USB3, at my own risk.
  5. Then add to array.  When adding to array it is automatically "formatted" if needed.

Is the above correct?

 

if it is intended for unassigned devices, which preclear option should I use to stress test: "Verify all the disk", or "erase all the disk" or ?

Thanks.

You step 1’s are not needed as the preclear process erases any partitions anyway.

  • Like 1
Link to comment

[SOLVED] I waited until the preclears were finished before restarting. Both preclears were successful and after the reboot have been added to the array. As expected after a reboot, my /var/log folder is now only using 1% of available space. Still wish I could figure out why the log was considered full even though I had plenty of available RAM.

 

Start of Original Message:

 

I started a zero-only pass of preclear on two new 16TB drives yesterday evening. When I woke this morning I had a message from Fix Common Problems about an error with my setup. That error is a full /var/log folder.  When I checked the unRAID log, it's being flooded with the following:

 

May 12 04:40:56 AnimNAS preclear_disk_ZL2E3RCH[24492]: tput: unknown terminal "screen"
May 12 04:40:56 AnimNAS preclear_disk_ZL2E3RCH[24492]: tput: unknown terminal "screen"
May 12 04:40:56 AnimNAS preclear_disk_ZL2E3RCH[24492]: tput: unknown terminal "screen"
May 12 04:40:56 AnimNAS preclear_disk_ZL2E3RCH[24492]: tput: unknown terminal "screen"
May 12 04:40:57 AnimNAS preclear_disk_ZL2E3RCH[24492]: tput: unknown terminal "screen"
May 12 04:40:57 AnimNAS preclear_disk_ZL2E3RCH[24492]: tput: unknown terminal "screen"
May 12 04:40:57 AnimNAS preclear_disk_ZL2E3RCH[24492]: tput: unknown terminal "screen"

 

The last log entry was from 4:40:57 this morning when the system declared the log as 100% full. This doesn't make sense as my understanding is that /var/log resides in RAM when unRAID is loaded. I have 64GB of RAM on the server and it's only showing 16% used, but the dashboard tab also shows the Log at 100% full.

 

AnimNAS-LogFull.jpg.62a0e4e171e40ca500a723158545c60a.jpg

 

The preclear is 72% complete on both drives and they're still in their USB enclosures until the zero completes successfully. I know a restart will clear the logs but I haven't done one yet as I'm unsure if pausing the zero runs will survive the reboot? Am I safe to reboot after pausing the zero runs? Any idea why my syslog is full of those errors?

 

TIA for any assistance...

 

Edited by AgentXXL
Solved the issue.
Link to comment
  • 4 weeks later...

I've had more success with other drives on Preclear than this one. Three days in on the zeroing and at only 3%. Thoughts on what is going on?

# # # unRAID Server Preclear of disk 5QG05UME # # Cycle 1 of 1, partition start on sector 64. # # # # # # Step 1 of 4 - Zeroing in progress: (3% Done) #  ** Time elapsed: 93:27:07 | Write speed: 0 MB/s | Average speed: 1 MB/s # # #  # Cycle elapsed time: 95:34:39 | Total elapsed time: 95:34:39 

preclear_disk_5QG05UME_18023.txt

Link to comment
23 hours ago, BlakeB said:

I've had more success with other drives on Preclear than this one. Three days in on the zeroing and at only 3%. Thoughts on what is going on?

# # # unRAID Server Preclear of disk 5QG05UME # # Cycle 1 of 1, partition start on sector 64. # # # # # # Step 1 of 4 - Zeroing in progress: (3% Done) #  ** Time elapsed: 93:27:07 | Write speed: 0 MB/s | Average speed: 1 MB/s # # #  # Cycle elapsed time: 95:34:39 | Total elapsed time: 95:34:39 

preclear_disk_5QG05UME_18023.txt 1.11 kB · 1 download

 

Please send me your diagnostics file (you can PM me if you wish)

Link to comment
22 hours ago, gfjardim said:

 

Please send me your diagnostics file (you can PM me if you wish)

I think the drive was bad. I couldn't even start a pre-read on it. I tried it in another computer last night and same thing. I dropped off the drive for RMA with Newegg this morning. 

Link to comment

every time I tried to preclear my new 4TB disk, I always getting this:

/usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 483: /tmp/.preclear/sde/dd_output: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 476: /tmp/.preclear/sde/dd_output_complete: No such file or directory /usr/local/emhttp/plugins/preclear.disk/script/preclear_disk.sh: line 481: /tmp/.preclear/sde/dd_output_complete: No such file or directory

Link to comment

Hi all,

 

I've got an issue with a disks MBR and i'm not able to format the drive in unassigned devices.  I'm up-to-date with all plugins and unraid etc.  The disk is 12TB and i've managed to format the other drive ok.  I did try a preclear and this also failed.

 

Jun 18 11:32:03 preclear_disk_ZHZ4ALSM_10243: Disk blocks: 23437770752Jun 18 11:32:03 preclear_disk_ZHZ4ALSM_10243: Blocks (512 bytes): 23437770752Jun 18 11:32:03 preclear_disk_ZHZ4ALSM_10243: Block size: 512Jun 18 11:32:03 preclear_disk_ZHZ4ALSM_10243: Start sector: 0Jun 18 11:32:03 preclear_disk_ZHZ4ALSM_10243: verifying unRAID's signature on the MBR ...Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: Signature: failed test 1: MBR signature is not valid, byte 3 [00000] != [00170]Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: array 'sectors'Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 0 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 1 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 2 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 3 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 4 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 5 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 6 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 7 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 8 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 9 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 10 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 11 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 12 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 13 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 14 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 15 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 16 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 17 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 18 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 19 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: 20 -> 00000Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: fail - Unraid preclear signature invalid!Jun 18 11:32:10 preclear_disk_ZHZ4ALSM_10243: error encountered, exiting...

 

How can the MBR signature be rebuilt? I'll do some digging myself, just trying to understand if this is a software bug, or hardware issue.

 

smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.10.28-Unraid] (local build)
Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org

/dev/: Unable to detect device type
Please specify device type with the -d option.

Use smartctl -h to get a usage summary

 

I'm unsure how to specify the device type - never had to do this before...

 

Thanks

 

Edited by Jacko_
Link to comment

This is basically a hardware problem in that the data being written to the mbr sector on the drive by the preclear process is not being read back correctly.  You would expect a borderline sector to be re-mapped by the drives firmware but it appears this is not happening. Unraid will not be able to use a drive if the mbr sector cannot be written and then read reliably.

 

There is a chance that using the use the manufacturer's tools might correct this.  Not sure if there is any other way to achieve this so would be interested to see what others might suggest.

Link to comment
On 6/8/2021 at 2:35 PM, BlakeB said:

I think the drive was bad. I couldn't even start a pre-read on it. I tried it in another computer last night and same thing. I dropped off the drive for RMA with Newegg this morning. 

Confirmed my new drive was bad. The new replacement Precleared normally within a day and the parity was rebuilt in about 26 hours. Awesome. 

Link to comment
  • 1 month later...

This plugin is great, I have 3x18TB on preclear and 3x4TB on erase.

 

I have a general question on erase vs clear:  I understand erase writes over the entire disk with random junk, whilst clear writes a series of bits to the disk that make it ready for unraid to quickly format when you add to the array. 

 

How many erase cycles do you think is necessary for a drive that may have had say a passport photo or something 'private' but not ultra secret?  I am running two erase cycles on the 4TB and I intend to ebay them.  Would you consider this enough?  In my mind, for consumer level a format makes it obfuscated but possible to pick up files and filenames, a single write across everything makes it hard, and two would mean at best you can get metadata without taking it to a forensics lab.   Is this sound or would you prescribe more or less erase cycles?

Edited by spamalam
Link to comment
1 hour ago, spamalam said:

a single write across everything makes it hard, and two would mean at best you can get metadata without taking it to a forensics lab.

Assuming the disk is healthy a single preclear pass will render it safe against anyone up to state actors. Even a forensics lab would need three letter agency backing.

Link to comment
38 minutes ago, JonathanM said:

Writing random junk is ok, but I prefer a normal preclear cycle because it verifies that the entire drive read back zero. I've never investigated whether erase does a proper read back verification of the written bits.

Ah, so the lack of post read could mean that maybe something didn't get overwritten correctly, although unlikely?

 

Nice, thanks for the feedback, I'll do a single clear cycle.  Takes a bit longer but no worries.

Link to comment

Bug Report:
on Unraid 6.9.2 the Array doesn't start after replacing a (pre-attached) disk while preclear is running on another disk (I was waiting about 3 minutes). 
Server was not shut down, only Array was stopped while preclear was running on a non-array-disk.
After stopping preclear (killing process via CLI) the array startet correctly and data-rebuild started correctly.
A manual restart of preclear also was successfull.

Solution suggestion:

Unraid: Unraid should start the array even when a non-array disk is preclearing   AND/OR
Preclear Plugin: should stop work, when array is stopped (or started)

tower-diagnostics-20210819-0926.zip

Link to comment
25 minutes ago, peter76 said:

Bug Report:
on Unraid 6.9.2 the Array doesn't start after replacing a (pre-attached) disk while preclear is running on another disk (I was waiting about 3 minutes). 
Server was not shut down, only Array was stopped while preclear was running on a non-array-disk.
After stopping preclear (killing process via CLI) the array startet correctly and data-rebuild started correctly.
A manual restart of preclear also was successfull.

Solution suggestion:

Unraid: Unraid should start the array even when a non-array disk is preclearing   AND/OR
Preclear Plugin: should stop work, when array is stopped (or started)

tower-diagnostics-20210819-0926.zip 182.68 kB · 0 downloads

 

I think that this is expected behaviour as the pre-clear is preventing an OS level 'sync' operation from completing so Unraid cannot commit the disk change.

 

Since pre-clear is not part of standard Unraid the fix needs to be done at the pre-clear level.  I had a feeling it had a pause/resume option but not used it for a while so could be wrong.

Link to comment
  • 2 weeks later...
5 hours ago, Fuggin said:

Is there a way to see it?

Hey @Fuggin. Giving zero consideration as to why you're not seeing it (as in I don't know enough about it to try debug that) but on mine I also have a Preclear section under the Tools menu, and it shows me log access etc. also so depending on how your Preclear is installed you may have something under there. I happen to be doing a couple of disks myself so screenshots attached to help.

 

 

Screen Shot 2021-08-29 at 08.15.40.png

Screen Shot 2021-08-29 at 08.15.52.png

Link to comment
  • Squid unpinned this topic

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.