Unassigned Devices - Managing Disk Drives and Remote Shares Outside of The Unraid Array

dlandon

By dlandon
in Plugin Support

Recommended Posts

Recommended

Posted by dlandon,

If you are seeing unexplained disk or remote share activity, it may be due to cache dirs caching all folders.  For those of you using the Cache Dirs plugin, you need to specify folders to be included so UD mounted disks and shares do not get included automatically.  This can also apply to pool disks.  It's really the best practice to specify the included folders so you control what is actually being cached.
Recommended by Squid

0 reactions

Go to this post
Recommended

Posted by dlandon,

Major new release of UD: "Where are the switches?"  The "Pass Through", "Read Only", "Automount", and "Share" switches have been moved to a new Edit Settings dialog.  This is also where the script is modified.  This saves some real estate on the UD page and keeps the page refresh smooth. A "Show Partitions" switch has been added to set showing all partitions by specific hard drive device and not generically as before.  The option to show all partitions has been removed from the UD

New layout and features

Recommended by JonathanM

  • Thanks
  • Like

5 reactions

Go to this post
Recommended

Posted by dlandon,

New release of UD.  The changes are: - Add ability to spin down a disk by sdX.  You don't have to spin down disks by name= any more.  This is still available for spinning down a disk from a User Script because you won't know the correct sdX as it changes on reboot. - Add the ability to detach a disk when a UD script is finished using 'rc.unassigned'.  This detaches the disk from Unraid and should provide a potentially safer way to remove a USB device.  Applies to USB disks only. -
Recommended by SpencerJ
  • Upvote
  • Like

2 reactions

Go to this post
Recommended

Posted by dlandon,

There is a new feature in UD to help with plugins that need a mount point folder.  UD now creates a mount folder '/mnt/addons'.  This folder should be used to mount your plugin devices to prevent FCP warnings and keep your mounts separated from UD.  It is recommended you switch to this new folder for your addon and custom mounts.  You are welcome to leave the mounts at '/mnt/disks' or '/mnt/remotes'.  Things will still work, but if you request support for UD issues, you will be asked to remove t

UD is now creating a mount point folder for plugins and addons

Recommended by dlandon

0 reactions

Go to this post
mgutt Veteran

mgutt

Posted
Posted

What is the background of these "busy" error messages?

  

# as you can see I freshly installed UD plugin
# then I created formatted in BTRFS and renamed the nvme to "BACKUP"
# the "mount" button stayed grey and was noch clickable
# logs from this timeframe:

Nov  1 22:19:54 Tower root: plugin: unassigned.devices-plus.plg installed
Nov  1 22:20:52 Tower  ool www[5108]: /usr/local/emhttp/plugins/unassigned.devices/scripts/rc.settings 'save'
Nov  1 22:21:38 Tower unassigned.devices: Format device '/dev/nvme0n1'.
Nov  1 22:21:38 Tower unassigned.devices: Device '/dev/nvme0n1' block size: 1953525168.
Nov  1 22:21:38 Tower unassigned.devices: Clearing partition table of disk '/dev/nvme0n1'.
Nov  1 22:21:38 Tower unassigned.devices: Clear partition result: 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0026684 s, 786 MB/s
Nov  1 22:21:38 Tower unassigned.devices: Reloading disk '/dev/nvme0n1' partition table.
Nov  1 22:21:38 Tower unassigned.devices: Reload partition table result: /dev/nvme0n1:  re-reading partition table
Nov  1 22:21:38 Tower unassigned.devices: Creating Unraid compatible mbr partition on disk '/dev/nvme0n1'.
Nov  1 22:21:38 Tower kernel: nvme0n1: p1
Nov  1 22:21:38 Tower unassigned.devices: Create mbr partition table result: write mbr signature done 
Nov  1 22:21:38 Tower unassigned.devices: Reloading disk '/dev/nvme0n1' partition table.
Nov  1 22:21:38 Tower unassigned.devices: Reload partition table result: BLKRRPART failed: Device or resource busy  /dev/nvme0n1:  re-reading partition table
Nov  1 22:21:38 Tower unassigned.devices: Formatting disk '/dev/nvme0n1' with 'btrfs' filesystem.
Nov  1 22:21:40 Tower kernel: BTRFS: device fsid b49d3b10-00fc-44b2-a143-750c85e16960 devid 1 transid 6 /dev/nvme0n1p1 scanned by mkfs.btrfs (8680)
Nov  1 22:21:43 Tower unassigned.devices: Reloading disk '/dev/nvme0n1' partition table.
Nov  1 22:21:43 Tower kernel: nvme0n1: p1
Nov  1 22:21:43 Tower unassigned.devices: Reload partition table result: /dev/nvme0n1:  re-reading partition table
Nov  1 22:21:55 Tower unassigned.devices: Warning: Cannot change the disk label on device 'nvme0n1p1'.
Nov  1 22:24:23 Tower kernel: BTRFS warning: duplicate device /dev/nvme1n1p1 devid 1 generation 60 scanned by mount (11018)
Nov  1 22:24:46 Tower unassigned.devices: Removing all partitions from disk '/dev/nvme0n1'.
Nov  1 22:24:59 Tower unassigned.devices: Format device '/dev/nvme0n1'.
Nov  1 22:24:59 Tower unassigned.devices: Device '/dev/nvme0n1' block size: 1953525168.
Nov  1 22:24:59 Tower unassigned.devices: Clearing partition table of disk '/dev/nvme0n1'.
Nov  1 22:24:59 Tower unassigned.devices: Clear partition result: 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.00244823 s, 857 MB/s
Nov  1 22:24:59 Tower unassigned.devices: Reloading disk '/dev/nvme0n1' partition table.
Nov  1 22:24:59 Tower unassigned.devices: Reload partition table result: /dev/nvme0n1:  re-reading partition table
Nov  1 22:24:59 Tower unassigned.devices: Creating Unraid compatible mbr partition on disk '/dev/nvme0n1'.
Nov  1 22:24:59 Tower kernel: nvme0n1: p1
Nov  1 22:24:59 Tower unassigned.devices: Create mbr partition table result: write mbr signature done 
Nov  1 22:24:59 Tower unassigned.devices: Reloading disk '/dev/nvme0n1' partition table.
Nov  1 22:24:59 Tower unassigned.devices: Reload partition table result: BLKRRPART failed: Device or resource busy  /dev/nvme0n1:  re-reading partition table
Nov  1 22:24:59 Tower unassigned.devices: Formatting disk '/dev/nvme0n1' with 'btrfs' filesystem.
Nov  1 22:25:00 Tower kernel: BTRFS: device fsid 2785705e-9696-4653-b0ae-efd2037c4464 devid 1 transid 6 /dev/nvme0n1p1 scanned by mkfs.btrfs (11623)
Nov  1 22:25:03 Tower unassigned.devices: Reloading disk '/dev/nvme0n1' partition table.
Nov  1 22:25:03 Tower kernel: nvme0n1: p1
Nov  1 22:25:03 Tower unassigned.devices: Reload partition table result: /dev/nvme0n1:  re-reading partition table


# then I did the following manually:
mkdir /mnt/disks/BACKUP
mount /dev/nvme0n1p1 /mnt/disks/BACKUP/

# logs after that:
Nov  1 22:26:21 Tower kernel: BTRFS info (device nvme0n1p1): using free space tree
Nov  1 22:26:21 Tower kernel: BTRFS info (device nvme0n1p1): has skinny extents
Nov  1 22:26:21 Tower kernel: BTRFS info (device nvme0n1p1): flagging fs with big metadata feature
Nov  1 22:26:21 Tower kernel: BTRFS info (device nvme0n1p1): enabling ssd optimizations
Nov  1 22:26:21 Tower kernel: BTRFS info (device nvme0n1p1): checking UUID tree
Nov  1 22:27:02 Tower kernel: BTRFS info (device nvme0n1p1): using free space tree
Nov  1 22:27:02 Tower kernel: BTRFS info (device nvme0n1p1): has skinny extents
Nov  1 22:27:02 Tower kernel: BTRFS info (device nvme0n1p1): enabling ssd optimizations


# the mount button changed to unmount, but is still greyed out
# I'm able to access the nvme content without problems?!

 

 

Current status:

 

image.png.4b93a94230a72a152a23c6c7d917a79a.png

Link to comment
  • Replies 10.8k
  • Created
  • Last Reply

Top Posters In This Topic

Popular Days

Top Posters In This Topic

Popular Days

Popular Posts

dlandon
dlandon

It's that self healing feature I built into UD.  It just fixes itself.

dlandon
dlandon

New release of UD.  Changes: When changing the mount point (which is also the share name), the mount point is checked for a duplicate of a user share or another UD device.  Samba cannot handle

dlandon
dlandon

Major new release of UD: "Where are the switches?"  The "Pass Through", "Read Only", "Automount", and "Share" switches have been moved to a new Edit Settings dialog.  This is also where the sc

Posted Images

GoChris Explorer

GoChris

Posted
Posted
1 minute ago, dlandon said:

Try booting in safe mode.

I did. That's how I eventually figured out what plugin was causing it. I removed all of them, booted up in regular mode, added a few plugins one at a time with reboots in between. After adding UD it will not boot fully. I hooked up a monitor and the last thing was on screen was something about starting samba, that was it.

Link to comment
ftrees Noob

ftrees

Posted
Posted

What is the limit in number of drives I can use with UAD?  I have 110 working, but plugin is slow to load details in GUI (takes around 30-60seconds).  I attempted to add another 24-bay jbod, and now it seems to be crashing with 100% CPU load, and mount/unmount not working, format not working, unable to change mount points, etc.  Any change hits 100% CPU (on 58 cores) and takes 3+ min to load in gui.  

Link to comment
dlandon Veteran

dlandon

Posted
  • Author
Posted
2 hours ago, ftrees said:

What is the limit in number of drives I can use with UAD?  I have 110 working, but plugin is slow to load details in GUI (takes around 30-60seconds).  I attempted to add another 24-bay jbod, and now it seems to be crashing with 100% CPU load, and mount/unmount not working, format not working, unable to change mount points, etc.  Any change hits 100% CPU (on 58 cores) and takes 3+ min to load in gui.  

UD doesn't have a numeric limit to the number of drives, but there is a practical limit you've surely exceeded.  UD is polling disk drives for status like size, used, and free every three seconds to refresh the display.  UD will not be able to keep up with 110 drives and maintain a responsive GUI as you've seen.

 

Why do you have 110 unassigned drives?  If you have that much storage requirement, you need to build a personal data center.

Link to comment
ftrees Noob

ftrees

Posted
Posted
1 hour ago, dlandon said:

UD doesn't have a numeric limit to the number of drives, but there is a practical limit you've surely exceeded.  UD is polling disk drives for status like size, used, and free every three seconds to refresh the display.  UD will not be able to keep up with 110 drives and maintain a responsive GUI as you've seen.

 

Why do you have 110 unassigned drives?  If you have that much storage requirement, you need to build a personal data center.

Is it possible to change the polling frequency?  I want to set them as permanent disks essentially for Chia farming - I have another Unraid Server for VMs/Plex etc.  Ideally I'd like to keep all of the farming drives on one server using the Machinaris docker - but perhaps I'd be better off to install linux.  Or is there an option to disable the GUI/polling and just manage them as connected disks?

Link to comment
dlandon Veteran

dlandon

Posted
  • Author
Posted
1 hour ago, ftrees said:

Is it possible to change the polling frequency?

I don't think changing the polling frequency is going to help you very much.  The response time will still be pretty bad.  You probably need to look for another solution.  UD was not designed to handle that many disks.

Link to comment
unr41dus3r Apprentice

unr41dus3r

Posted
Posted (edited)

I have an problem with one external USB drive. I cant format it, other USB drives works fine.

I had the problem drive mounted many weeks now and wanted to reformat it. What didnt worked out.

 

When i press format with xfs/btrfs format, it is formatting but afterwards nothing happens and nothing is there to mount. I only can choose again to press format

When i put the drive in another client, nothing is written on the drive / no GPT/MBR or parition.

 

What is working to format: exfat/ntfs/fat32

But only fat32 is mountable, with exfat/ntfs the mount button is greyed out.

 

I already reinstalled the plugin and removed the /boot/configs/plugings/unassigned.devices folder

The drive is working fine on a windows client and i can format without a problem.

Rebootet server already 3 times (reinstalling plugins etc.)

I updated today to the latest unraid version and all plugins up2date

 

In the end i want to format it XFS (encrypted) so the workaround with windows is not possible.

 

Nothing in logs or diagnostics, in syslog everything is fine:

Is it possible to enable a debugging mode or something like that?

 

Plugging in 

Nov  5 23:44:11 hidden kernel: usb 1-1.1: new high-speed USB device number 8 using ehci-pci
Nov  5 23:44:11 hidden kernel: usb-storage 1-1.1:1.0: USB Mass Storage device detected
Nov  5 23:44:11 hidden kernel: scsi host0: usb-storage 1-1.1:1.0
Nov  5 23:44:12 hidden kernel: scsi 0:0:0:0: Direct-Access     WD       My Book 1230     1065 PQ: 0 ANSI: 6
Nov  5 23:44:12 hidden kernel: sd 0:0:0:0: Attached scsi generic sg0 type 0
Nov  5 23:44:12 hidden kernel: sd 0:0:0:0: [sda] Spinning up disk...
Nov  5 23:44:12 hidden kernel: scsi 0:0:0:1: Enclosure         WD       SES Device       1065 PQ: 0 ANSI: 6
Nov  5 23:44:12 hidden kernel: scsi 0:0:0:1: Attached scsi generic sg1 type 13
Nov  5 23:44:23 hidden kernel: ..........ready
Nov  5 23:44:23 hidden kernel: sd 0:0:0:0: [sda] 976746240 4096-byte logical blocks: (4.00 TB/3.64 TiB)
Nov  5 23:44:23 hidden kernel: sd 0:0:0:0: [sda] Write Protect is off
Nov  5 23:44:23 hidden kernel: sd 0:0:0:0: [sda] Mode Sense: 53 00 10 08
Nov  5 23:44:23 hidden kernel: sd 0:0:0:0: [sda] No Caching mode page found
Nov  5 23:44:23 hidden kernel: sd 0:0:0:0: [sda] Assuming drive cache: write through
Nov  5 23:44:23 hidden kernel: sd 0:0:0:0: [sda] Attached SCSI disk
Nov  5 23:46:05 hidden unassigned.devices: Format device '/dev/sda'.

 

XFS Format: 

Nov  5 23:46:05 hidden unassigned.devices: Format device '/dev/sda'.
Nov  5 23:46:05 hidden unassigned.devices: Device '/dev/sda' block size: 7813969920.
Nov  5 23:46:05 hidden unassigned.devices: Clearing partition table of disk '/dev/sda'.
Nov  5 23:46:06 hidden unassigned.devices: Clear partition result: 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.684912 s, 3.1 MB/s
Nov  5 23:46:06 hidden unassigned.devices: Reloading disk '/dev/sda' partition table.
Nov  5 23:46:06 hidden unassigned.devices: Reload partition table result: /dev/sda:  re-reading partition table
Nov  5 23:46:06 hidden unassigned.devices: Creating Unraid compatible gpt partition on disk '/dev/sda'.
Nov  5 23:46:06 hidden unassigned.devices: Create gpt partition table result: Information: Creating fresh partition table; will override earlier problems! 
Nov  5 23:46:06 hidden unassigned.devices: Reloading disk '/dev/sda' partition table.
Nov  5 23:46:06 hidden unassigned.devices: Reload partition table result: /dev/sda:  re-reading partition table
Nov  5 23:46:06 hidden unassigned.devices: Formatting disk '/dev/sda' with 'xfs' filesystem.
Nov  5 23:46:09 hidden unassigned.devices: Reloading disk '/dev/sda' partition table.
Nov  5 23:46:09 hidden unassigned.devices: Reload partition table result: /dev/sda:  re-reading partition table

 

exfat format: 

Nov  5 23:21:19 hidden unassigned.devices: Format device '/dev/sda'.
Nov  5 23:21:19 hidden unassigned.devices: Device '/dev/sda' block size: 7813969920.
Nov  5 23:21:19 hidden unassigned.devices: Clearing partition table of disk '/dev/sda'.
Nov  5 23:21:20 hidden unassigned.devices: Reloading disk '/dev/sda' partition table.
Nov  5 23:21:20 hidden unassigned.devices: Reload partition table result: /dev/sda:  re-reading partition table
Nov  5 23:21:20 hidden unassigned.devices: Creating Unraid compatible gpt partition on disk '/dev/sda'.
Nov  5 23:21:20 hidden unassigned.devices: Reloading disk '/dev/sda' partition table.
Nov  5 23:21:20 hidden unassigned.devices: Reload partition table result: /dev/sda:  re-reading partition table
Nov  5 23:21:20 hidden unassigned.devices: Formatting disk '/dev/sda' with 'xfs' filesystem.
Nov  5 23:21:23 hidden unassigned.devices: Reloading disk '/dev/sda' partition table.
Nov  5 23:21:23 hidden unassigned.devices: Reload partition table result: /dev/sda:  re-reading partition table

 

fat32 format: 

Nov  5 22:49:58 hidden unassigned.devices: Format device '/dev/sda'.
Nov  5 22:49:58 hidden unassigned.devices: Device '/dev/sda' block size: 7813969920.
Nov  5 22:49:58 hidden unassigned.devices: Clearing partition table of disk '/dev/sda'.
Nov  5 22:49:58 hidden unassigned.devices: Reloading disk '/dev/sda' partition table.
Nov  5 22:49:58 hidden unassigned.devices: Reload partition table result: /dev/sda:  re-reading partition table
Nov  5 22:49:58 hidden unassigned.devices: Creating a 'msdos' partition table on disk '/dev/sda'.
Nov  5 22:49:59 hidden unassigned.devices: Formatting disk '/dev/sda' with 'fat32' filesystem.
Nov  5 22:49:59 hidden kernel: sda: sda1
Nov  5 22:50:29 hidden unassigned.devices: Reloading disk '/dev/sda' partition table.
Nov  5 22:50:29 hidden kernel: sda: sda1
Nov  5 22:50:29 hidden unassigned.devices: Reload partition table result: /dev/sda:  re-reading partition table
Nov  5 22:50:44 hidden unassigned.devices: Adding partition 'sda1'...
Nov  5 22:50:44 hidden unassigned.devices: Mounting partition 'sda1' at mountpoint '/mnt/disks/WD-WCC123456'...
Nov  5 22:50:44 hidden unassigned.devices: Mount drive command: /sbin/mount -t 'vfat' -o rw,noatime,nodiratime,nodev,nosuid,iocharset=utf8,umask=000 '/dev/sda1' '/mnt/disks/WD-WCC123456'
Nov  5 22:50:44 hidden kernel: FAT-fs (sda1): utf8 is not a recommended IO charset for FAT filesystems, filesystem will be case sensitive!
Nov  5 22:50:44 hidden unassigned.devices: Successfully mounted 'sda1' on '/mnt/disks/WD-WCC123456'.

 

Edited by unr41dus3r
Link to comment
unr41dus3r Apprentice

unr41dus3r

Posted
Posted
2 hours ago, Kilrah said:

You need to also install UD+ for those

You are right, the UD+ Plugin wasnt installed, because of my testing.

After installting the plugin i can now mount exfat and ntfs.


What still is not working, formatting XFS/BTRFS where it doesnt matter encrypted or not.

I think there is a problem with the mount point, as i know ntfs/exfat/fat32 is using different mount names.

I am using the borg docker to mount the volume and had problems in the past, but mostly because the /mnt/disks/mountname folder was already taken from borg. At the moment borg is not running and no folder in /mnt/disks/mountname

 

Is it possible to set a different mountname for the formatting process?

Is it possible to format the drive with cli? I only want to create a XFS encrypted partition with the unraid passphrase

 

Over the night i did run a preclear, but it didnt solved the xfs/btrfs problem.

 

Formatting with btrfs today:

  

Nov  6 11:52:18 rserver unassigned.devices: Removing all partitions from disk '/dev/sda'.
Nov  6 11:52:44 rserver unassigned.devices: Format device '/dev/sda'.
Nov  6 11:52:44 rserver unassigned.devices: Device '/dev/sda' block size: 7813969920.
Nov  6 11:52:44 rserver unassigned.devices: Clearing partition table of disk '/dev/sda'.
Nov  6 11:52:45 rserver unassigned.devices: Clear partition result: 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.601413 s, 3.5 MB/s
Nov  6 11:52:45 rserver unassigned.devices: Reloading disk '/dev/sda' partition table.
Nov  6 11:52:45 rserver unassigned.devices: Reload partition table result: /dev/sda:  re-reading partition table
Nov  6 11:52:45 rserver unassigned.devices: Creating Unraid compatible gpt partition on disk '/dev/sda'.
Nov  6 11:52:45 rserver unassigned.devices: Create gpt partition table result: Information: Creating fresh partition table; will override earlier problems! 
Nov  6 11:52:45 rserver unassigned.devices: Reloading disk '/dev/sda' partition table.
Nov  6 11:52:45 rserver unassigned.devices: Reload partition table result: /dev/sda:  re-reading partition table
Nov  6 11:52:45 rserver unassigned.devices: Formatting disk '/dev/sda' with 'btrfs' filesystem.
Nov  6 11:52:48 rserver unassigned.devices: Reloading disk '/dev/sda' partition table.
Nov  6 11:52:48 rserver unassigned.devices: Reload partition table result: /dev/sda:  re-reading partition table

 

Link to comment
dlandon Veteran

dlandon

Posted
  • Author
Posted
13 hours ago, unr41dus3r said:

What is working to format: exfat/ntfs/fat32

But only fat32 is mountable, with exfat/ntfs the mount button is greyed out.

You cannot format disks with UD unless UD+ is installed.  Without UD+, the 'Format' button is not active.  How did you format the disk?

 

1 hour ago, unr41dus3r said:

You are right, the UD+ Plugin wasnt installed, because of my testing.

After installting the plugin i can now mount exfat and ntfs.

Ntfs disks can be mounted without UD+.

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
Go to topic listing