Jump to content

ShadowLeague

Members
 View Profile  See their activity

  • Posts

    42

  • Joined

  • Last visited

 Content Type 

Posts posted by ShadowLeague

    [Plugin] Appdata.Backup

    in Plugin Support

    Posted

    I just shared my logs: 455bd7c3-90a9-4842-a521-de24a1645f7d

    Looks like the backup acknowledges to exclude backing up /mnt, but a few lines later it's calculating /mnt's backup. I ended up cancelling the scheduled backup since it was taking several hours; causing its backup to be hundreds of GB in size.

    [Plugin] Appdata.Backup

    in Plugin Support

    Posted · Edited by ShadowLeague
    new info

    Update 2: After adding directories to an excluded folders/files, the backup completed much faster. I overlooked the 'per container' settings option when I configured the app. But, unless I'm misunderstanding the external volume options, I shouldn't have to do this if `save external volumes` is set to `no`.

     

    Update: I just found the "per container" settings and Plex did have /mnt/user/ listed but external volumes are NOT selected for backup. I'm going to add /mnt/user/ to the exclude list and start the backup process. I'll update this post and share my findings.

     

    Hello,

    I've noticed that my backups are now exponentially bigger. For example, the folder for Plex is roughly 350GB and its backup is over 3TB. I didn't have compression enabled at the time... I have since enabled it and the current backup is still bigger than the folder itself (and still growing and running 2+ hours). I'm on unRAID 6.12.3

    docker container location is /mnt/user/appdata

    constant disk writes even when docker isn't running. iotop help

    in General Support

    Posted · Edited by ShadowLeague
    new info

    TLDR: I didn't review the settings closely. appdata backup was backing up media folders (arrrgh)

     

    Update: I believe this is related to the new backup plugin. Backups with the new plugin are 10x their original size. Their last modified time appears to line up what I observed prior to me doing a restart.

     

    I'm trying to determine what is writing files to my disk and what are the files.

     

    Could be my paranoia but better safe than sorry

    someone suggested running iotop to see what's going on with my server, and here's the output. I'm green to the command... but seeing the ?unavailable? with root running it is concerning (til someone says otherwise).

     

    In the interim, I'm trying to stop the array but I'm getting the "try unmounting user shares" message.

      

    10:38:52 16601 be/4 root     4278.03 K/s 1432.38 K/s  ?unavailable?  shfs /mnt/user -disks 4095 -o default_permissions,allow_other,noatime -o remember=0
10:38:52 20940 be/4 root     1222.29 K/s 2043.52 K/s  ?unavailable?  shfs /mnt/user -disks 4095 -o default_permissions,allow_other,noatime -o remember=0
10:38:52 10885 be/4 root     3055.74 K/s 1623.36 K/s  ?unavailable?  shfs /mnt/user -disks 4095 -o default_permissions,allow_other,noatime -o remember=0
10:38:52 10886 be/4 root     1833.44 K/s 1661.56 K/s  ?unavailable?  shfs /mnt/user -disks 4095 -o default_permissions,allow_other,noatime -o remember=0
10:38:52 10923 be/4 root     3666.88 K/s 1585.16 K/s  ?unavailable?  shfs /mnt/user -disks 4095 -o default_permissions,allow_other,noatime -o remember=0
10:38:52 27495 be/4 root     1222.29 K/s 1890.74 K/s  ?unavailable?  shfs /mnt/user -disks 4095 -o default_permissions,allow_other,noatime -o remember=0
10:38:52 25824 be/4 root      611.15 K/s 2024.43 K/s  ?unavailable?  shfs /mnt/user -disks 4095 -o default_permissions,allow_other,noatime -o remember=0

     

    upgrade to 6.12.3 + ZFS cache for docker = sluggish apps

    in Docker Engine

    Posted

    I converted my cache pool to btrfs with Raid0 and Plex and other app UIs running from this pool are back to being responsive. 
    Someone on reddit mentioned specifying the docker image (and not the folder location) helped with their issue. At this point, I'm happy with the performance and I don't think it's worth further testing. I did keep my second cache pool as zfs and don't have any issues with it.

    upgrade to 6.12.3 + ZFS cache for docker = sluggish apps

    in Docker Engine

    Posted

    Might have made progress:

     

    • Deleting docker apps and re-adding them didn't help
    • Deleted the docker.img file and downloaded a fresh copy
      • reinstalled docker apps via community apps plugin (thank to the author(s) for this)
      • so far, the lag experienced in Plex is gone, but more testing to follow

    Maybe the old btrfs settings were causing an issue? I also just specified an image folder and not a docker image... not sure if that made a difference.

    upgrade to 6.12.3 + ZFS cache for docker = sluggish apps

    in Docker Engine

    Posted · Edited by ShadowLeague
    added additional information on Plex experience

    Greetings,

     

    I made the jump from 6.11.5 to 6.12.3. After the upgrade, I converted my two cache pools to zfs. The cache pool running my docker containers use two NVMe drives in a raid0 (yep - I know the risk and make backups :) ) Since converting this to a zfs cache pool, my containers seem to be a bit sluggish. For example, Plex spins when I try to Navigate from my TV library to recommended TV items, or just times out altogether. I've observed WebUI timeouts with SABnzbd. Troubleshooting steps:

    • restart unRAID
    • stop/start docker (ver 20.10.24)
    • in Docker, switch from macvlan to ipvlan
    • FYI, Docker info still shows the filesystem as btrfs
    • in Plex, refreshed metadata
    • ensured appdata folder sits on the zfs cache pool, and no secondary storage is defined. 

     

    While my system isn't new, it isn't starving for resources (I think). I have two E5-2600's v3 with 64GB of ECC Ram. If I look at the unRAID dashboard for RAM, ZFS is taking about 8GB, and Docker is steady at 41% utilization. 

     

    Is there anything else I can try? Is there a step I have missed?

    [Support] Djoss - HandBrake

    in Docker Containers

    Posted

    5 minutes ago, supawiz6991 said:

    What does your docker container settings for handbrake look like? 
    Also, when you click on handbrake there is a logs option. Click the logs option and then rename the video. Watch the logs window and see what handbrake reports.

    Also, looking at the ls -l listing ..those files don't seem to have a file extension on them (.iso, .mkv, .mp4). You might need to change this docker option: 

    Automatic Video Converter: Non-Video File Action:

    container settings are in the screenshots.

     

    Handbrake didn't do anything when I renamed an ISO file. The remaining stuff in the watch folder are more folders, so I suspect that might be why nothing is happening. So, I dragged a movie file to the root of the 'Watch' folder and I got a bunch of these:

      

    
(ghb:1218): dconf-WARNING **: 17:03:09.882: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:09.894: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:09.908: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:09.923: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:09.941: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:09.957: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:09.975: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:09.990: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:10.007: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:10.024: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:10.041: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:10.063: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:10.073: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:10.090: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:10.107: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:10.124: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:10.367: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:14.385: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:14.403: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:14.421: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:14.546: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

(ghb:1218): dconf-WARNING **: 17:03:14.547: failed to commit changes to dconf: Failed to execute child process ?dbus-launch? (No such file or directory)

     

    1.png

    2.png

    [Support] Djoss - HandBrake

    in Docker Containers

    Posted

    Hello, I'm having difficulty having stuff auto converted from the 'Watch' folder. The watch folder sees the content, but nothing happens. The user and group are set the same as other Docker containers. 

    docker exec HandBrake ls -l /watch
total 46018432
drwxr-xr-x 1 app users         102 Jul 15 21:18 Blade.II.2002.1080p.BluRay.Remux.AVC.DTS-HD.MA.7.1-playBD
-rw-rw-r-- 1 app users 47122874368 Apr 26  2016 Deadpool (2016).iso
drwxr-xr-x 1 app users          72 Jul 16 10:50 Deadpool.2016.COMPLETE.BLURAY-CBGB
drwxr-xr-x 1 app users         496 Jul 15 18:55 Die.Hard.1988.2160p.UHD.BluRay.X265-IAMABLE-xpost
drwxr-xr-x 1 app users         146 Jul 15 21:33 The.Bourne.Supremacy.2004.2160p.UHD.BluRay.Remux.HDR.HEVC.DTS-X-EPSiLON
drwxr-xr-x 1 app users         154 Jul 15 21:39 The.Bourne.Ultimatum.2007.UHD.BluRay.2160p.DTS-X.7.1.HEVC.REMUX-FraMeSToR

    Watch directory input as: /mnt/user/Downloads/completed/4k/auto/

    If I use the GUI, I can access that folder and manually start the conversion.

    can't copy to usb drive with Krusader

    in General Support

    Posted · Edited by ShadowLeague
    included unRAID version

    When I plug a usb external drive, unRAID picks a mount point that doesn't give Krusader write access, so I can't copy files from the array to the external drive. But I'm not sure how to change the mount point, or if there's something else I need to do. In the attached pic, it's always mounting to "seagateusb," and I'm thinking it should be mounted to the ST14XXXXX mount point. Version 6.9.2 of unRAID

    partition listing.png

    unclean shutdowns, docker apps losing settings (solved)

    in General Support

    Posted · Edited by ShadowLeague
    fixed appdata pool by selecting one cache pool, then selecting the desired cache pool.

    1 hour ago, trurl said:

    You have no pool named "cache", but appdata share has some files on "cache". So you must have one or more of your containers specifying /mnt/cache/appdata. This results in /mnt/cache/appdata being created, but since there is no storage there that path is in rootfs (RAM).

    I've gone through the above and all of the docker containers are now pointing to /mnt/cache_nvme/appdata/"container name". This is what I wanted, but clearly didn't have the containers setup properly. With this setup, can I safely run the CA Backup / Restore plugin? The source was  setup for the incorrect path; i'm guessing I'm ok to change the source path to the correct path and run the restore?

     

     

    unclean shutdowns, docker apps losing settings (solved)

    in General Support

    Posted · Edited by ShadowLeague
    solved

    Hello!

    Upon moving from one server to a newer one, I noticed a few docker apps didn't seem to retain some config settings. I did the restore via the "community app Backup / Restore Appdata plugin. Upon its completion, I noticed in the resture status UI that some files could not be restored as it complained of not having enough space. This is strange since the cache pool app data is using has more than enough storage (as well as the array, if anything needed to be written there as well). I also noticed the array was offline, and in the webUI, I kept seeing the array was bouncing between online and undefined. As the backup/restore plugin suggested, I did a reboot and unRAID detected an unclean restart, so a parity check has started. Once again, a few of my docker apps did not retain their settings. Looking for some assistance on the issue - diag zip attached

     

    Unable to boot into GUI Mode

    in General Support

    Posted

    On 10/24/2021 at 8:31 AM, RifleJock said:

    Looks like I still have this problem as well...

    I had thought it was just my hardware, seen with UEFI and Legacy, I've tried every CSM variation in my bios, even trying older and newer bios's.

    Asus z10pe-d16 ws.

    Board ended up dying a while back, and I ended up upgrading to the Asus PRO WS wrx80e SAGE SE WIFI, this uses a similar IPMI and BMC setup as the previous board, both used an ASPEED (VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 41)) This one being a newer revision.

    Not sure what I'm missing. I hadn't tried other modes, but I suspect that CSM usage and legacy boot will allow the gui to work once again. (version 6.9.2)

    cryzen-diagnostics-20211022-0913.zip 82.72 kB · 0 downloads cryzen-diagnostics-20211024-1119.zip 121.31 kB · 0 downloads

    How's that wrx80e working for you? Any issues?

×
×
  • Create New...