Unassigned Devices Preclear - a utility to preclear disks before adding them to the array


dlandon

Recommended Posts

1 hour ago, dlandon said:

On the UI, click on the 'Boot' device label and then the "Syslinux Configuration" tab.  Romove any instances of this text "root=sda" you see, save it, and then reboot.  You should be able to preclear without memory issues.

 

OMG !

You are a life saver. All working now :)

Thanks soo much.

Link to comment
45 minutes ago, dionmunk said:

My question is, how soon should I start seeing logs that something is happening or some kind of indicator that the script has actually started?


From the first post in this thread-

Quote

You can follow the status of preclears in UD, on the UD Preclear page, or by hovering your mouse on the preclear icon in the Unraid footer.


There is also the option available to use the notification options configured in unRAID to send you notifications at intervals which you configure if you enable the notifications option in the preclear popup window. I usually prefer to receive an email at the end of every step and cycle.

Link to comment
19 minutes ago, wgstarks said:


From the first post in this thread-


There is also the option available to use the notification options configured in unRAID to send you notifications at intervals which you configure if you enable the notifications option in the preclear popup window. I usually prefer to receive an email at the end of every step and cycle.

 

@wgstarks I appreciate your response! I ended up letting it sit for over an hour to see if I'd get anything and below is all that showed up in the logs.

 

Apr 3 18:24:55 Preclear script invoked as: /usr/local/emhttp/plugins/unassigned.devices.preclear/scripts/preclear_disk.sh --cycles 1 --no-prompt /dev/sdm
Apr 3 19:33:46 Preclear stopped on all devices
Apr 3 19:33:53 Preclear stopped on device: WD-CA3BXN1K

 

It doesn't look to me like it did anything. Any thoughts on what could be wrong?

Link to comment
  • 3 weeks later...

@dionmunk Was it a broken UI stats or did you solve you problem? 👆

 

I'm having the same problem right now, can't see any status. Just stuck on "Starting...".

Have checked with another browser and it looks the same.

 

image.png.229af84a70d52a0f130586910a8ef778.png

 

I'm just gonna let it be for a day or two. I have set the notification on 25% progress so maybe I get notifications.

Edited by Hogwind
Link to comment

A new 22TB disk, Zeroing is on it's 5th attempt after 4 failed ones. Any reason for that / anything I can do/check?

Preclearing only to test the disk. Destined to be a parity disk.

 

Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 10486367+0 records out
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 21991505526784 bytes (22 TB, 20 TiB) copied, 100595 s, 219 MB/s
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 10487104+0 records in
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 10487104+0 records out
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 21993051127808 bytes (22 TB, 20 TiB) copied, 100607 s, 219 MB/s
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 10487838+0 records in
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 10487838+0 records out
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 21994590437376 bytes (22 TB, 20 TiB) copied, 100619 s, 219 MB/s
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 10488577+0 records in
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 10488577+0 records out
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 21996140232704 bytes (22 TB, 20 TiB) copied, 100631 s, 219 MB/s
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 10489298+0 records in
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 10489298+0 records out
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 21997652279296 bytes (22 TB, 20 TiB) copied, 100643 s, 219 MB/s
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 10490037+0 records in
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 10490037+0 records out
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 21999202074624 bytes (22 TB, 20 TiB) copied, 100655 s, 219 MB/s
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 10490768+0 records in
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 10490768+0 records out
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 22000735092736 bytes (22 TB, 20 TiB) copied, 100667 s, 219 MB/s
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: dd process hung at 22000737189888, killing ...
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Zeroing: zeroing the disk started 4 of 5 retries...
Apr 19 20:11:16 preclear_disk_ZGG46T0A_12945: Continuing disk write on byte 22000735092736
Apr 19 20:19:41 preclear_disk_ZGG46T0A_12945: Zeroing: dd output: 
Apr 19 20:19:41 preclear_disk_ZGG46T0A_12945: dd process hung at 0, killing ...
Apr 19 20:19:41 preclear_disk_ZGG46T0A_12945: Zeroing: zeroing the disk started 5 of 5 retries...
Apr 19 20:19:41 preclear_disk_ZGG46T0A_12945: Zeroing: emptying the MBR.
Apr 20 02:29:32 preclear_disk_ZGG46T0A_12945: Zeroing: progress - 25% zeroed @ 265 MB/s
Apr 20 08:34:41 preclear_disk_ZGG46T0A_12945: Zeroing: progress - 50% zeroed @ 234 MB/s
Apr 20 15:34:20 preclear_disk_ZGG46T0A_12945: Zeroing: progress - 75% zeroed @ 197 MB/s

 

Edited by Gico
Link to comment

Yes always stops somewhere after 22000000000000. Disk is attached to an onboard controller and the MB (Supermicro H12SSL-i ) has another one that seems to be identical. I will try with an HBA card.

Link to comment
18 hours ago, Hogwind said:

 

I'm having the same problem right now, can't see any status. Just stuck on "Starting...".

 

 

Same problem here. I haven't used any type of preclear in years. Today I'm trying it on a brand new 14TB Seagate Mach 2 drive (EXOS 2X14).

 

The preclear log shows only the script invocation and the status just stays on "starting..."

 

This fixed it:

 

  

On 3/9/2024 at 3:32 PM, treos33 said:

I don't know the cause but I was finally able to get started by uninstalling and reinstalling the plugin.

 

 

Edited by Espressomatic
  • Like 1
Link to comment
On 4/20/2024 at 10:07 PM, JonathanM said:

Does it always stop after 20TB? If so, maybe try a different controller? Maybe the one you are currently attached to has a problem with 20+TB.

 

 

Same happens with a different HBA: LSI PCI-E card.
Is there anyway to limit the available disk size to 22000000000000?

I can also try zeroing it on my main machine (the one in my signature).

 

Apr 23 14:23:27 preclear_disk_ZGG46T0A_10952: Zeroing: dd output: 22000449880064 bytes (22 TB, 20 TiB) copied, 98245.7 s, 224 MB/s
Apr 23 14:23:27 preclear_disk_ZGG46T0A_10952: dd process hung at 22000451977216, killing ...
Apr 23 14:23:27 preclear_disk_ZGG46T0A_10952: Zeroing: zeroing the disk started 2 of 5 retries...
Apr 23 14:23:27 preclear_disk_ZGG46T0A_10952: Continuing disk write on byte 22000449880064
Apr 23 14:31:52 preclear_disk_ZGG46T0A_10952: Zeroing: dd output: 
Apr 23 14:31:52 preclear_disk_ZGG46T0A_10952: dd process hung at 0, killing ...
Apr 23 14:31:52 preclear_disk_ZGG46T0A_10952: Zeroing: zeroing the disk started 3 of 5 retries...
Apr 23 14:31:52 preclear_disk_ZGG46T0A_10952: Zeroing: emptying the MBR.

 

Link to comment
3 hours ago, Gico said:

Same happens with a different HBA: LSI PCI-E card.
Is there anyway to limit the available disk size to 22000000000000?

I can also try zeroing it on my main machine (the one in my signature).

 

Apr 23 14:23:27 preclear_disk_ZGG46T0A_10952: Zeroing: dd output: 22000449880064 bytes (22 TB, 20 TiB) copied, 98245.7 s, 224 MB/s
Apr 23 14:23:27 preclear_disk_ZGG46T0A_10952: dd process hung at 22000451977216, killing ...
Apr 23 14:23:27 preclear_disk_ZGG46T0A_10952: Zeroing: zeroing the disk started 2 of 5 retries...
Apr 23 14:23:27 preclear_disk_ZGG46T0A_10952: Continuing disk write on byte 22000449880064
Apr 23 14:31:52 preclear_disk_ZGG46T0A_10952: Zeroing: dd output: 
Apr 23 14:31:52 preclear_disk_ZGG46T0A_10952: dd process hung at 0, killing ...
Apr 23 14:31:52 preclear_disk_ZGG46T0A_10952: Zeroing: zeroing the disk started 3 of 5 retries...
Apr 23 14:31:52 preclear_disk_ZGG46T0A_10952: Zeroing: emptying the MBR.

 

At the end of a disk, the write takes longer and the dd write may time out too soon on a very large disk.  I've already extended the time out, but it might need to be even longer.

  • Thanks 1
Link to comment
3 hours ago, Gico said:

Same happens with a different HBA: LSI PCI-E card.
Is there anyway to limit the available disk size to 22000000000000?

I can also try zeroing it on my main machine (the one in my signature).

Update UD Preclear and see if it solves your issue.

  • Thanks 1
Link to comment

Tmux is no longer working since updating UD Preclear to 2024.04.23 – it produces the following error:

 

tmux: /lib64/libm.so.6: version `GLIBC_2.38' not found (required by tmux)
tmux: /lib64/libc.so.6: version `GLIBC_2.38' not found (required by tmux)

 

Running the command 

/lib64/libc.so.6

shows that version 2.37 is installed, which is obviously a version behind the version mentioned in the error.

 

I'm on version 6.12.8 of Unraid.

Edited by Rozella
Added line to error message
Link to comment

After upgrading UD Preclear to 2024.04.23 when starting a preclear it offers to resume or start new one,

and what ever I select it goes to "starting" mode and stays in that mode.

Uninstalled and reinstalled the plugin and it's the same. Unraid 6.12.6.

While installing I got the following message, which corresponds with @Rozella's post.

"Checking tmux operation...
tmux is not working properly"

Link to comment

I forgot that different versions of tmux require different versions of libc.  The version of libc in Unraid varies by Unraid version, so I have to do a version check to see which version of tmux can be installed for the version of Unraid running.  I can't update libc, because it will break Unraid.

 

It was an easy fix once I remembered what I needed to do.

Link to comment
On 4/23/2024 at 6:40 PM, dlandon said:

Update UD Preclear and see if it solves your issue.

Same. First time it happens below byte 22000000000000.

So if I put the disk in the array as parity, can this be ok? Maybe it's related only to the plugin's zeroing process?

Alternatively if the disk is no good, I'll still will get an error, and then I guess I'll replace it.

 

Apr 25 01:57:41 preclear_disk_ZGG46T0A_10918: Zeroing: dd output: 21998195441664 bytes (22 TB, 20 TiB) copied, 98221.6 s, 224 MB/s
Apr 25 01:57:41 preclear_disk_ZGG46T0A_10918: Zeroing: dd output: 10490310+0 records in
Apr 25 01:57:41 preclear_disk_ZGG46T0A_10918: Zeroing: dd output: 10490310+0 records out
Apr 25 01:57:41 preclear_disk_ZGG46T0A_10918: Zeroing: dd output: 21999774597120 bytes (22 TB, 20 TiB) copied, 98233.6 s, 224 MB/s
Apr 25 01:57:41 preclear_disk_ZGG46T0A_10918: dd process hung at 21999776694272, killing ...
Apr 25 01:57:41 preclear_disk_ZGG46T0A_10918: Zeroing: zeroing the disk started 2 of 5 retries...
Apr 25 01:57:41 preclear_disk_ZGG46T0A_10918: Continuing disk write on byte 21999774597120
Apr 25 02:13:39 preclear_disk_ZGG46T0A_10918: Zeroing: dd output: 
Apr 25 02:13:39 preclear_disk_ZGG46T0A_10918: dd process hung at 0, killing ...
Apr 25 02:13:39 preclear_disk_ZGG46T0A_10918: Zeroing: zeroing the disk started 3 of 5 retries...
Apr 25 02:13:39 preclear_disk_ZGG46T0A_10918: Zeroing: emptying the MBR.
Apr 25 08:01:50 preclear_disk_ZGG46T0A_10918: Zeroing: progress - 25% zeroed @ 270 MB/s

 

Edited by Gico
Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.