Unassigned Devices - Managing Disk Drives and Remote Shares Outside of The Unraid Array


dlandon

5534 posts in this topic Last Reply

Recommended Posts

  • Replies 5.5k
  • Created
  • Last Reply

Top Posters In This Topic

Top Posters In This Topic

Popular Posts

New release of UD.  Changes: When changing the mount point (which is also the share name), the mount point is checked for a duplicate of a user share or another UD device.  Samba cannot handle

While I appreciate your interest in esthetics, there is more to consider than just 'aligning' disk drive mounts: This disk is mounted without a UD script, it is probably better to put it in th

<step on soap box> Keep in mind that the Unraid array disk configuration is static and doesn't change until it is stopped.  UD has to deal with hot plugged disks, devices being dynamically

Posted Images

35 minutes ago, dlandon said:

Unraid 6.9 takes over the disk spin down and any commands you issue for spin down will be removed.

OK, so 15 mins is the minimum then? I have a few external drives that are quite noisy and want them to spin down in 5 mins not 15. Possible?

Link to post
37 minutes ago, mikeyosm said:

OK, so 15 mins is the minimum then? I have a few external drives that are quite noisy and want them to spin down in 5 mins not 15. Possible?

Yes, the minimum is 15.  You can't change that for UD disks.

Link to post
1 hour ago, mikeyosm said:

OK, so 15 mins is the minimum then? I have a few external drives that are quite noisy and want them to spin down in 5 mins not 15. Possible?

Sorry, I just thought of an answer.  Look at the help on the UD page. There is a command you can issue to spin down a disk.  You could add it to the end of your script.

Link to post
9 hours ago, dlandon said:

I'm going to issue a new release today that will implement the change of UUID on an encrypted disk.

 

Excellent, I'l use it with the next swap. And with the current one I have learned a few new things about encrypted drives.

Link to post
16 hours ago, dlandon said:

Sorry, I just thought of an answer.  Look at the help on the UD page. There is a command you can issue to spin down a disk.  You could add it to the end of your script.

yes, hdparm but this doesnt seem to work unless there's another way? Looks like I'm stuck with 15 minutes! Seems a step backwards IMO, was easy using hdparm to set disk spin down time.

Link to post
51 minutes ago, mikeyosm said:

yes, hdparm but this doesnt seem to work unless there's another way? Looks like I'm stuck with 15 minutes! Seems a step backwards IMO, was easy using hdparm to set disk spin down time.

 

Did you look at the help on the UD page?  There is a UD command to do the disk spin down that is respected by Unraid:

'/usr/local/sbin/rc.unassigned spindown devX' - spin down a disk. The devX is the device name in the UD page. If the device name is 'Dev 1', then use dev1 as the device to spin down. SSDs will not spin down.

Just be sure to synch the mount point so all writes are done, then maybe wait a short amount of time, then issue the UD spin down command.

Edited by dlandon
Link to post

@dlandon Just wanted to say thanks again for all the work you do to support and continue development of UD. I've donated previously but in these tough COVID times I suspect donations slow down. I've just sent a few more bucks your way because I can.

 

As an aside (not because I just donated again), I have a small feature request: it would be a nice addition if you could look into support for Apple's APFS filesystem in UD+. In the past Apple made it very difficult for developers to support APFS but I noticed that Ubuntu 20.10 can now read devices with the APFS filesystem. With lots of users jumping on the bandwagon for @SpaceInvaderOne's MacinaBox, it would be a useful addition, even if read-only.

 

Thanks again!

 

 

Link to post
13 hours ago, AgentXXL said:

I have a small feature request: it would be a nice addition if you could look into support for Apple's APFS filesystem in UD+.

I added a package that should allow mounting of APFS.  Update UD+ and see if you can mount an APFS disk.  I do not have any way of testing.

Link to post

POSSIBLE LOSS OF "EXEC" OPTIONS ON MOUNTED SSD

 

not much luck today second time typing this out .. first time didn't post.

 

After my unraid server froze and i had to do a hard reboot and (coincidentally probably) after the last UD update on the 16th, I seem to be having an issue where my plex media server "media scanner" crashes every night around 2 am. Plus i am now having playback errors etc. After talking with the Plex Media guys on their forum and looking at the Plex logs and crash reports. The said it looks like the disk the data is on "is no longer mounted with exec options".  So my question is how can you tell if a mounted disk still has exec options (which i assume to mean execute or executive to allow permission to run what ever process or codec plex needs) and if not how to re-establish them on the disk.  This set up has run with no problem for years so i don't think it would be the set up. Figure probably corruption or error from hard reboot though the disks and parity have all come back ok.

 

Below is the relevent post from the Plex forum:

 

The bigger issue is that wherever the PMS AppData is located it is no longer mounted with exec options. As you are using the 3rd-party unassigned drive plugin, I wonder if something changed recently with it. You could try reaching out on the Unraid forums to see if the issue is known there and can be resolved with another mount option.

 

Jan 17, 2021 02:01:30.588 [0x14c561ecd700] INFO - CodecManager: obtaining EAE

Jan 17, 2021 02:01:31.392 [0x14c561ecd700] ERROR - Unzip: could not set executable bit on output file

Jan 17, 2021 02:01:31.392 [0x14c561ecd700] ERROR - CodecManager: failed to extract zip

 

The other thing you could do is upgrade to Unraid 6.9 RC2 and move your unassigned drive to be a second cache pool and then set Plex to be on that. It would function in the same way as the unassigned drives plugin, but would be mounted and handled by Unraid itself.

The core issue here is that ffmpeg and Plex require the ability to “execute” codecs, specifically EAE (Easy Audio Encoder) as this handles Dolby TrueHD/EAC3 decoding and encoding.

 

Any ideas?

 

Edit: did i post this in a manner that wasn't acceptable? Or is this something that is so obvious to everyone else it doesn't warrant a response? I see nothing that indicates where i could have removed or where to reapply execute privileges  for the PLEX SSD mounted in UD. Is this something that can be found and fixed to your knowledge or do i just have to rebuild from scratch?

Edited by jlruss9777
hoping for a response.
Link to post
On 12/27/2020 at 11:38 PM, dlandon said:

"Where are the switches?"  The "Pass Through", "Read Only", "Automount", and "Share" switches have been moved to a new Edit Settings dialog.  This is also where the script is modified.  This saves some real estate on the UD page and keeps the page refresh smooth.

 

I dislike this, because in 1 of 100 cases the title tag of the settings icon does not appear:

1376767794_2021-01-1913_06_37.png.49748fa27a4fe397b9c3a6be940d736d.png

 

This is not related to your code. Instead its a general issue for all title tags on all websites and valid for all browsers. Example ("Quote" is not displayed):

1896073243_2021-01-1913_07_55.png.999310688492e5399acd306b2752cea3.png

 

And as I used the buttons often, I now need to open settings on every entry. To fasten this process I open the settings links in multiple tabs, but finally its annoying.

 

 

Maybe you even think about a "live update disable" or "live intervall in seconds" option. Its ok for me refreshing the page manually instead of loading the complete 40 kB HTML table every 3 seconds:

975951114_2021-01-1914_08_18.png.059727dd6997665fdc22276b9de8f551.png

 

I mean this is 50 MByte/s per hour. Not funny while using a VPN through my mobile data plan.

 

Maybe its possible to load the complete table only on first request and update the cells like it is done for the rest of the page.

Link to post
6 hours ago, mgutt said:

 

I dislike this, because in 1 of 100 cases the title tag of the settings icon does not appear:

What is it you don't like?

 

6 hours ago, mgutt said:

And as I used the buttons often, I now need to open settings on every entry. To fasten this process I open the settings links in multiple tabs, but finally its annoying.

You change the switches that often?  Why?

 

6 hours ago, mgutt said:

I mean this is 50 MByte/s per hour. Not funny while using a VPN through my mobile data plan.

Maybe you shouldn't be doing this on a mobile device, or get a better data plan.

 

6 hours ago, mgutt said:

Maybe its possible to load the complete table only on first request and update the cells like it is done for the rest of the page.

Not worth the effort for very little gain.  The UD page refreshes the same way as the array disk pages.

 

The refresh is to keep the remote shares online status up to date, to refresh the GUI so it reflects the proper server online status for remote shares, and the disk status like preclearing and scripts running for physical disks.

 

I worked very hard to get the refresh working so the GUI would show the correct status of UD devices, and now it appears you are wanting to go back.  I'm really not too keen on doing that, even as an option.

Link to post
On 1/18/2021 at 4:11 AM, dlandon said:

I added a package that should allow mounting of APFS.  Update UD+ and see if you can mount an APFS disk.  I do not have any way of testing.

 

Sorry, was under the weather yesterday so didn't get a chance to test, but WOW, amazingly fast response to add it! Kudos!

 

I just grabbed one of my APFS formatted 'ready to boot' backup drives to try. It's in a USB 3.0 enclosure and when I first plugged it into the system UD/UD+ didn't see it at all. I rebooted the unRAID system and this time it showed up.

 

Alas no joy yet.... since it was a bootable disk it has 2 partitions, EFI and the main one for OS/data. When I try mounting, UD will only mount the EFI partition which is vfat. If I try expanding the partition list and click on the Mount button for the APFS partition it fails. This disk wasn't current anyhow so I decided to try and remove the EFI partition. UD was able to do that with no issues. Alas even with just the single APFS partition, it still won't mount.

 

I went through the syslog and each time it was attached and a mount attempted I get this:

 

Quote

Jan 19 14:58:41 AnimDL kernel: sd 1:0:0:0: [sdb] Attached SCSI disk
Jan 19 14:58:41 AnimDL rc.diskinfo[10308]: SIGHUP received, forcing refresh of disks info.
Jan 19 14:58:42 AnimDL unassigned.devices: Disk with serial 'HGST_HTS721010A9E630_JR10006P2MH50F', mountpoint 'HGST_HTS721010A9E630_JR10006P2MH50F' is not set to auto mount.
Jan 19 14:58:50 AnimDL unassigned.devices: Adding disk '/dev/sdb2'...
Jan 19 14:58:50 AnimDL unassigned.devices: Mount drive command: /sbin/mount -t apfs -o rw,auto,async,noatime,nodiratime '/dev/sdb2' '/mnt/disks/HGST_HTS721010A9E630_JR10006P2MH50F'
Jan 19 14:58:50 AnimDL unassigned.devices: Mount of '/dev/sdb2' failed. Error message: mount: /mnt/disks/HGST_HTS721010A9E630_JR10006P2MH50F: unknown filesystem type 'apfs'.
Jan 19 14:58:50 AnimDL unassigned.devices: Partition 'HGST_HTS721010A9E630_JR10006P2MH50F' cannot be mounted.

 

I did verify that the newest version of UD+ was installed:

 

Quote

unassigned.devices-plus

2021.01.21

Add: libfsapfs package to support apfs file systems.

 

Any thoughts or things you want me to try? Thanks!

 

Link to post
15 minutes ago, AgentXXL said:

Any thoughts or things you want me to try? Thanks!

Sounds like the package I put in UD+ was not the right one.  Slackware packages are a bit hard to find.  Let me do some research.

Link to post
7 minutes ago, dlandon said:

Sounds like the package I put in UD+ was not the right one.  Slackware packages are a bit hard to find.  Let me do some research.

 

No rush at all... I was reminded by some users from another discussion that since most of us pass a dedicated USB hub through to the VM, setting UD to passthrough for APFS devices should let the Mac VM see them with no issue. I'll have to try that but there's still the occasional case where it might be useful to have UD+ be able to mount the partition(s).

Link to post

Sometimes when I tried to copy files from Synology to unraid by smb, I found a lot of Unraid kernel unexpected logs in syslog. Is it some kind of compatibility issue?

Jan 24 01:56:58 Unraid kernel: tun: unexpected GSO type: 0x0, gso_size 1448, hdr_len 1514
Jan 24 01:56:58 Unraid kernel: tun: c0 07 00 00 01 00 34 00 00 00 22 00 10 00 00 00  ......4...".....
Jan 24 01:56:58 Unraid kernel: tun: 66 61 76 6f 72 69 74 65 20 20 20 20 20 20 20 20  favorite        
Jan 24 01:56:58 Unraid kernel: tun: 20 20 42 4f 4f 4c 45 41 4e 20 20 4e 4f 54 20 4e    BOOLEAN  NOT N
Jan 24 01:56:58 Unraid kernel: tun: 55 4c 4c 0a 29 2d 09 06 17 41 1b 01 00 69 6e 64  ULL.)-...A...ind
Jan 24 01:56:58 Unraid kernel: tun: unexpected GSO type: 0x0, gso_size 1448, hdr_len 1514
Jan 24 01:56:58 Unraid kernel: tun: c0 07 00 00 01 00 34 00 00 00 22 00 10 00 00 00  ......4...".....
Jan 24 01:56:58 Unraid kernel: tun: 05 00 0a 00 00 00 00 00 b8 00 00 00 a3 27 06 00  .............'..
Jan 24 01:56:58 Unraid kernel: tun: 00 00 00 00 12 70 00 00 c3 cb 4b f4 16 32 43 b9  .....p....K..2C.
Jan 24 01:56:58 Unraid kernel: tun: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
Jan 24 01:56:58 Unraid kernel: tun: unexpected GSO type: 0x0, gso_size 1448, hdr_len 1514
Jan 24 01:56:58 Unraid kernel: tun: c0 07 00 00 01 00 34 00 00 00 22 00 10 00 00 00  ......4...".....
Jan 24 01:56:58 Unraid kernel: tun: 6e 65 63 74 69 6f 6e 3a 20 6b 65 65 70 2d 61 6c  nection: keep-al
Jan 24 01:56:58 Unraid kernel: tun: 69 76 65 0d 0a 43 6f 6e 74 65 6e 74 2d 4c 65 6e  ive..Content-Len
Jan 24 01:56:58 Unraid kernel: tun: 67 74 68 3a 20 34 30 0d 0a 41 63 63 65 70 74 3a  gth: 40..Accept:
Jan 24 01:56:58 Unraid kernel: tun: unexpected GSO type: 0x0, gso_size 1448, hdr_len 1514
Jan 24 01:56:58 Unraid kernel: tun: c0 07 00 00 01 00 34 00 00 00 22 00 10 00 00 00  ......4...".....
Jan 24 01:56:58 Unraid kernel: tun: 32 43 6e 75 6c 6c 25 32 43 6e 75 6c 6c 25 32 43  2Cnull%2Cnull%2C
Jan 24 01:56:58 Unraid kernel: tun: 6e 75 6c 6c 25 32 43 6e 75 6c 6c 25 35 44 3b 20  null%2Cnull%5D; 
Jan 24 01:56:58 Unraid kernel: tun: 63 61 5f 66 69 6c 74 65 72 3d 74 72 61 6e 73 6d  ca_filter=transm
Jan 24 01:56:58 Unraid kernel: tun: unexpected GSO type: 0x0, gso_size 1448, hdr_len 1514
Jan 24 01:56:58 Unraid kernel: tun: c0 07 00 00 01 00 34 00 00 00 22 00 10 00 00 00  ......4...".....
Jan 24 01:56:58 Unraid kernel: tun: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
Jan 24 01:56:58 Unraid kernel: tun: 00 00 00 00 01 bb 0e f2 d5 6d 75 eb 2e 9d 50 18  .........mu...P.
Jan 24 01:56:58 Unraid kernel: tun: 20 11 14 f4 00 00 17 03 03 00 29 00 00 00 00 00   .........).....
Jan 24 01:57:52 Unraid kernel: tun: unexpected GSO type: 0x0, gso_size 35, hdr_len 89
Jan 24 01:57:52 Unraid kernel: tun: 40 02 00 00 00 00 00 00 00 00 00 00 00 00 00 00  @...............
Jan 24 01:57:52 Unraid kernel: tun: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
Jan 24 01:57:52 Unraid kernel: tun: 00 00 00 00 6e 00 66 00 00 00 00 00 00 00 fe 53  ....n.f........S
Jan 24 01:57:52 Unraid kernel: tun: 4d 42 40 00 01 00 00 00 00 00 06 00 03 00 05 00  MB@.............

 

syslog.7z

Link to post
5 hours ago, Beermedlar said:

Sometimes when I tried to copy files from Synology to unraid by smb, I found a lot of Unraid kernel unexpected logs in syslog. Is it some kind of compatibility issue?

No.  See here and read the release notes;

https://forums.unraid.net/bug-reports/prereleases/unraid-os-version-690-beta25-available-r990/page/9/?tab=comments#comment-10413&searchlight=1

Link to post
On 1/19/2021 at 7:32 PM, dlandon said:

I worked very hard to get the refresh working so the GUI would show the correct status of UD devices

 

It looks a lot neater, making much better use of the limited space, and your efforts are much appreciated. The change took a little while to get used to but it's very worthwhile, in my opinion. I can't believe that anyone needs to change the switches often so it makes sense to move them to a secondary page.

 

On 1/19/2021 at 1:18 PM, mgutt said:

This is not related to your code. Instead its a general issue for all title tags on all websites and valid for all browsers. Example ("Quote" is not displayed):

 

The tool-tips all work fine with my browser/OS combination (macOS/Firefox). Move the mouse pointer over an icon and it changes to a hand with a pointing finger. After one second the tool-tip appears and stays there until I move the pointer away from the icon. This avoids the need to click the icon just to check the position of the switches.

 

ScreenGrab.png.f60da0db74b357f9cb6a408a3fe68d27.png

 

Link to post
15 minutes ago, John_M said:

After one second the tool-tip appears and stays there until I move the pointer away from the icon

 

Look at my screenshots. It's a random behaviour of each browser. And waiting is not intuitive and does not work for touch-only devices.

Link to post

Running into a somewhat strange situation... when I put my two drives in my DAS, udev cannot distinguish between any of my drives even though they have unique serials.

 

# udevadm info --query=all --name=/dev/sdb | grep -i serial
E: ID_SERIAL=Samsung_SSD_850_EVO_500G_202006054D01-0:1
E: ID_SERIAL_SHORT=202006054D01

# udevadm info --query=all --name=/dev/sda | grep -i serial
E: ID_SERIAL=Samsung_SSD_850_EVO_500G_202006054D01-0:0
E: ID_SERIAL_SHORT=202006054D01

 

However, hdparm -I correctly identifies the disks uniquely:

# hdparm -I /dev/sda | grep -i serial
        Serial Number:      S3PTNF0JXXXXXX0
# hdparm -I /dev/sdb | grep -i serial
        Serial Number:      S3PTNF0JXXXXXX1

image.thumb.png.da274e195f0820dc23c005703d732574.png

 

 

This makes it really difficult to use unassigned devices, as it seems to try and automount drives on top of one another.
Any help would be greatly appreciated!

 

It looks like a similar issue exists in unRAID itself with the serial not showing up correctly, but unRAID is still correctly able to distinguish between them using the -0:N suffixes.

 

---

 

Edit:

I've solved this. The bug is with the JMicron enclosure. (ID 152d:0567 JMicron Technology Corp.)

https://github.com/systemd/systemd/issues/2362#issuecomment-178079214

https://github.com/harendra-kumar/systemd/commit/75feb52379f80c3df354b85d1df3274fdde5fccd

 

I rebuilt `ata_id` and replaced `/lib/udev/ata_id` and now it successfully passes the serials through!

 

Edited by genecc
Sharing the solution
Link to post
1 hour ago, mgutt said:

Look at my screenshots. It's a random behaviour of each browser. And waiting is not intuitive and does not work for touch-only devices.

 

I don't expect different browsers to behave identically, so I was surprised to find that Firefox, Chrome, Brave and Safari (the four browsers I have installed) actually do behave identically in this respect. I think the slight delay before the tool-tip appears is to avoid the mess of flashing pop-ups that would otherwise appear while moving the mouse pointer around. I find it very easy: just hover the pointer over the gears icon for a second and the state of the switches is revealed. I can't speak for other operating systems (I'd be surprised if Windows was very different in this respect) or tablets/phones, which have a different user interface due to the lack of an on-screen pointer. Tool-tips work for me on this site, too. Here's an example to compare with yours:

 

Screenshot.png.dc8af811557e1b260eb498447adfb782.png

 

Link to post

Newbie... Reading the thread scares me... so many people smarter than I...

 

I can't mount an encrypted drive for some reason (unRAID 6.8.3 with Unassigned Devices "plugin" [i.e not the default that appears]). It never asks for "the" password when I try to mount it. It's a junk drive and I keep "blowing it up" and trying again, with every new version of Unassigned Devices.

 

What am I missing?

 

6.

Link to post

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.