Paff
-
Posts
8 -
Joined
-
Last visited
Content Type
Profiles
Forums
Downloads
Store
Gallery
Bug Reports
Documentation
Landing
Posts posted by Paff
-
-
13 hours ago, ich777 said:
RadeonTOP or GPU Statistics?
RadeonTOP does by default nothing other than modprobing your amdgpu, GPU Statistics also does nothing by default if you haven't configured it.
Pretty sure, if you are binding a card to VFIO the host basically can't "see/use" it, it reserved for use in VMs so there is no point anyways if you install any of the two plugins because it is bound to VFIO.
I really can't imagine that now you have a higher power draw because of this, because as said the two plugins even can't access your GPU.
Please try a restart after the parity check finished, maybe shut down the system completely, wait a bit and then turn it back on.
Interesting. I use a GTX 1050TI for transcoding purposes. So I had GPU statistics active a long time before. I was just interested if I could get statistics the same way. So I just downloaded the PlugIn (even if GPU was bind to VFIO). Afterwards I could suprisingly select the AMD GPU in the GPU Statistics App. Did that afterwards it broke. Hmmm probably it reset the BIOS or something on crash? I dont know. I will try to find a solution, when Parity is done. Its a really weird behavior. Thanks again!
BR
Paff -
7 hours ago, ich777 said:
Are you really sure that this was the cause of the issue?
Have you yet tried to issue:
radeontop
from a Unraid terminal and see what the output is?
No definitely not.
Do you have bound the card to VFIO?
I would strongly recommend that you wait for the parity check to finish and then see what the real power consumption is.
Always post your Diagnostics with such issues like that, I really can't tell much without them and the above things are all assumptions...
Hey ich777,
first of all thank you for your support. Iam pretty sure, because it more or less crashed directly after I installed the plugin. I now wait for the check to be finished, then I will try your suggestions. A little scared to crash the system again.
Sorry, I should have attached directly the diagnostics. The card is bound to VFIO. Did this be the root of the cause?
Thanks again for the support.
BR
Paff
-
Hi everyone,
Ive got a problem. I installed the Radeon-TOP Plugin. Checked the GPU Statistic app and could select the GPU (AMD 6950XT). A minute later my whole system crashed and restarted. Now my system needs round about 30W more then before. Cannot restart because of an ongoing parity check. The parity check couldnt complete because of the crash. Does removing the plugin and restarting the system bring back my old power consumption? Or did it brick my card now? Or do I need to also remove some code from a file? I can still use the card in a VM (settings not changed, same Bios) like I did before. But still also idleing doesnt lower the consumption it stays around the same. Want my old consumption back.
Thanks in Advance.
BR
-
10 hours ago, Kaizac said:
I run 64GB ram and have 30% constantly used. Doesn't mean you also need that, but 16GB is not a lot. You have to remember that while doing playback all the chunks are stored in your RAM if you are not using VFS cache. And if you have Plex also transcoding in RAM it will also consume. So I would lower the chunk sizes in both upload as mount scripts.
This is an issue you should not have when you followed the instructions. You are missing files because you are not using mergerfs. For me files don't dissapear ever, because it doesn't matter if the files move from local to cloud.
The only thing I changed was the name of the mountcheck file. I changed it, because I have several servers that access it with the same .config and thought, that there will be no problems then. So I changed the name. I just changed it at the noted places. Otherwise everything is as in the standard start script.
Maybe I have not seen a connection here:RcloneMountLocation="$RcloneMountShare/$RcloneRemoteName" # Location for rclone mount
LocalFilesLocation="$LocalFilesShare/$RcloneRemoteName" # Location for local files to be merged with rclone mount
MergerFSMountLocation="$MergerfsMountShare/$RcloneRemoteName" # Rclone data folder location####### create directories for rclone mount and mergerfs mounts #######
mkdir -p /mnt/user/appdata/other/rclone/remotes/$RcloneRemoteName # for script files
mkdir -p $RcloneCacheShare/cache/$RcloneRemoteName # for cache files
if [[ $LocalFilesShare == 'ignore' ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Not creating local folders as requested."
LocalFilesLocation="/tmp/$RcloneRemoteName"
eval mkdir -p $LocalFilesLocation
else
echo "$(date "+%d.%m.%Y %T") INFO: Creating local folders."
eval mkdir -p $LocalFilesLocation/"$MountFolders"
fi
mkdir -p $RcloneMountLocationif [[ $MergerfsMountShare == 'ignore' ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Not creating MergerFS folders as requested."
else
echo "$(date "+%d.%m.%Y %T") INFO: Creating MergerFS folders."
mkdir -p $MergerFSMountLocation
fi
####### Check if script is already running #######
echo "$(date "+%d.%m.%Y %T") INFO: *** Starting mount of remote ${RcloneRemoteName}"
echo "$(date "+%d.%m.%Y %T") INFO: Checking if this script is already running."
if [[ -f "/mnt/user/appdata/other/rclone/remotes/$RcloneRemoteName/mount_running" ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Exiting script as already running."
exit
else
echo "$(date "+%d.%m.%Y %T") INFO: Script not running - proceeding."
touch /mnt/user/appdata/other/rclone/remotes/$RcloneRemoteName/mount_running
fi####### Checking have connectivity #######
echo "$(date "+%d.%m.%Y %T") INFO: *** Checking if online"
ping -q -c2 google.com > /dev/null # -q quiet, -c number of pings to perform
if [ $? -eq 0 ]; then # ping returns exit status 0 if successful
echo "$(date "+%d.%m.%Y %T") PASSED: *** Internet online"
else
echo "$(date "+%d.%m.%Y %T") FAIL: *** No connectivity. Will try again on next run"
rm /mnt/user/appdata/other/rclone/remotes/$RcloneRemoteName/mount_running
exit
fi####### Create Rclone Mount #######
# Check If Rclone Mount Already Created
if [[ -f "$RcloneMountLocation/mountcheckserverIT" ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Success ${RcloneRemoteName} remote is already mounted."
else
echo "$(date "+%d.%m.%Y %T") INFO: Mount not running. Will now mount ${RcloneRemoteName} remote."
# Creating mountcheckserverIT file in case it doesn't already exist
echo "$(date "+%d.%m.%Y %T") INFO: Recreating mountcheckserverIT file for ${RcloneRemoteName} remote."
touch mountcheckserverIT
rclone copy mountcheckserverIT $RcloneRemoteName: -vv --no-traverse
# Check bind option
if [[ $CreateBindMount == 'Y' ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: *** Checking if IP address ${RCloneMountIP} already created for remote ${RcloneRemoteName}"
ping -q -c2 $RCloneMountIP > /dev/null # -q quiet, -c number of pings to perform
if [ $? -eq 0 ]; then # ping returns exit status 0 if successful
echo "$(date "+%d.%m.%Y %T") INFO: *** IP address ${RCloneMountIP} already created for remote ${RcloneRemoteName}"
else
echo "$(date "+%d.%m.%Y %T") INFO: *** Creating IP address ${RCloneMountIP} for remote ${RcloneRemoteName}"
ip addr add $RCloneMountIP/24 dev $NetworkAdapter label $NetworkAdapter:$VirtualIPNumber
fi
echo "$(date "+%d.%m.%Y %T") INFO: *** Created bind mount ${RCloneMountIP} for remote ${RcloneRemoteName}"
else
RCloneMountIP=""
echo "$(date "+%d.%m.%Y %T") INFO: *** Creating mount for remote ${RcloneRemoteName}"
fi
# create rclone mount
rclone mount \
$Command1 $Command2 $Command3 $Command4 $Command5 $Command6 $Command7 $Command8 \
--allow-other \
--umask 022 \
--uid 99 \
--gid 100 \
--dir-cache-time $RcloneMountDirCacheTime \
--attr-timeout $RcloneMountDirCacheTime \
--log-level INFO \
--poll-interval 10s \
--cache-dir=$RcloneCacheShare/cache/$RcloneRemoteName \
--drive-pacer-min-sleep 10ms \
--drive-pacer-burst 1000 \
--vfs-cache-mode full \
--vfs-cache-max-size $RcloneCacheMaxSize \
--vfs-cache-max-age $RcloneCacheMaxAge \
--vfs-read-ahead 1G \
--bind=$RCloneMountIP \
$RcloneRemoteName: $RcloneMountLocation &# Check if Mount Successful
echo "$(date "+%d.%m.%Y %T") INFO: sleeping for 5 seconds"
# slight pause to give mount time to finalise
sleep 5
echo "$(date "+%d.%m.%Y %T") INFO: continuing..."
if [[ -f "$RcloneMountLocation/mountcheckserverIT" ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Successful mount of ${RcloneRemoteName} mount."
else
echo "$(date "+%d.%m.%Y %T") CRITICAL: ${RcloneRemoteName} mount failed - please check for problems. Stopping dockers"
docker stop $DockerStart
rm /mnt/user/appdata/other/rclone/remotes/$RcloneRemoteName/mount_running
exit
fi
fi####### Start MergerFS Mount #######
if [[ $MergerfsMountShare == 'ignore' ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Not creating mergerfs mount as requested."
else
if [[ -f "$MergerFSMountLocation/mountcheckserverIT" ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Check successful, ${RcloneRemoteName} mergerfs mount in place."
else
# check if mergerfs already installed
if [[ -f "/bin/mergerfs" ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Mergerfs already installed, proceeding to create mergerfs mount"
else
# Build mergerfs binary
echo "$(date "+%d.%m.%Y %T") INFO: Mergerfs not installed - installing now."
mkdir -p /mnt/user/appdata/other/rclone/mergerfs
docker run -v /mnt/user/appdata/other/rclone/mergerfs:/build --rm trapexit/mergerfs-static-build
mv /mnt/user/appdata/other/rclone/mergerfs/mergerfs /bin
# check if mergerfs install successful
echo "$(date "+%d.%m.%Y %T") INFO: *sleeping for 5 seconds"
sleep 5
if [[ -f "/bin/mergerfs" ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Mergerfs installed successfully, proceeding to create mergerfs mount."
else
echo "$(date "+%d.%m.%Y %T") ERROR: Mergerfs not installed successfully. Please check for errors. Exiting."
rm /mnt/user/appdata/other/rclone/remotes/$RcloneRemoteName/mount_running
exit
fi
fi
# Create mergerfs mount
echo "$(date "+%d.%m.%Y %T") INFO: Creating ${RcloneRemoteName} mergerfs mount."
# Extra Mergerfs folders
if [[ $LocalFilesShare2 != 'ignore' ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Adding ${LocalFilesShare2} to ${RcloneRemoteName} mergerfs mount."
LocalFilesShare2=":$LocalFilesShare2"
else
LocalFilesShare2=""
fi
if [[ $LocalFilesShare3 != 'ignore' ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Adding ${LocalFilesShare3} to ${RcloneRemoteName} mergerfs mount."
LocalFilesShare3=":$LocalFilesShare3"
else
LocalFilesShare3=""
fi
if [[ $LocalFilesShare4 != 'ignore' ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Adding ${LocalFilesShare4} to ${RcloneRemoteName} mergerfs mount."
LocalFilesShare4=":$LocalFilesShare4"
else
LocalFilesShare4=""
fi
# make sure mergerfs mount point is empty
mv $MergerFSMountLocation $LocalFilesLocation
mkdir -p $MergerFSMountLocation
# mergerfs mount command
mergerfs $LocalFilesLocation:$RcloneMountLocation$LocalFilesShare2$LocalFilesShare3$LocalFilesShare4 $MergerFSMountLocation -o rw,async_read=false,use_ino,allow_other,func.getattr=newest,category.action=all,category.create=ff,cache.files=partial,dropcacheonclose=true
# check if mergerfs mount successful
echo "$(date "+%d.%m.%Y %T") INFO: Checking if ${RcloneRemoteName} mergerfs mount created."
if [[ -f "$MergerFSMountLocation/mountcheckserverIT" ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: Check successful, ${RcloneRemoteName} mergerfs mount created."
else
echo "$(date "+%d.%m.%Y %T") CRITICAL: ${RcloneRemoteName} mergerfs mount failed. Stopping dockers."
docker stop $DockerStart
rm /mnt/user/appdata/other/rclone/remotes/$RcloneRemoteName/mount_running
exit
fi
fi
fi####### Starting Dockers That Need Mergerfs Mount To Work Properly #######
# only start dockers once
if [[ -f "/mnt/user/appdata/other/rclone/remotes/$RcloneRemoteName/dockers_started" ]]; then
echo "$(date "+%d.%m.%Y %T") INFO: dockers already started."
else
# Check CA Appdata plugin not backing up or restoring
if [ -f "/tmp/ca.backup2/tempFiles/backupInProgress" ] || [ -f "/tmp/ca.backup2/tempFiles/restoreInProgress" ] ; then
echo "$(date "+%d.%m.%Y %T") INFO: Appdata Backup plugin running - not starting dockers."
else
touch /mnt/user/appdata/other/rclone/remotes/$RcloneRemoteName/dockers_started
echo "$(date "+%d.%m.%Y %T") INFO: Starting dockers."
docker start $DockerStart
fi
firm /mnt/user/appdata/other/rclone/remotes/$RcloneRemoteName/mount_running
echo "$(date "+%d.%m.%Y %T") INFO: Script complete"exit
Would it be a problem to have the same mountcheck file created with several servers uploading media? If not I would then just move back to the original filename, if this would be the problem.
Thanks in advance.
BR Paff
-
Hi all, I would be interested to know how the rclone mount is updated. I have the problem that I always have to restart the server to see the current files. Since after files are uploaded, they are deleted locally and thus unavailable until I restart the server. Do you use a routine once a week? Which updates the RClone mount? Thanks in advance for your help.
BR Paff
-
22 minutes ago, Paff said:
Hello all together, and thanks first of all for this great manual and the work on this topic.
I tried to install the script as well, but run into problems. Everything seems to work, but when I try to upload the data (from local or mergefs drive it doesnt matter) it will start a process and then deletes everything. Nothing will be uploaded or moved. Just deleted.
Script location: /tmp/user.scripts/tmpScripts/RCLONE Upload Script/script
Note that closing this window will abort the execution of this script
16.08.2022 15:34:20 INFO: *** Rclone move selected. Files will be moved from /mnt/user/local/drivecrypted for drivecrypted ***
16.08.2022 15:34:20 INFO: *** Starting rclone_upload script for drivecrypted ***
16.08.2022 15:34:20 INFO: Script not running - proceeding.
16.08.2022 15:34:20 INFO: Checking if rclone installed successfully.
16.08.2022 15:34:20 INFO: rclone installed successfully - proceeding with upload.
16.08.2022 15:34:20 INFO: Uploading using upload remote drivecrypted
16.08.2022 15:34:20 INFO: *** Using rclone move - will add --delete-empty-src-dirs to upload.
2022/08/16 15:34:20 INFO : Starting bandwidth limiter at 30Mi Byte/s
2022/08/16 15:34:20 INFO : Starting transaction limiter: max 8 transactions/s with burst 1
2022/08/16 15:34:20 DEBUG : --min-age 15m0s to 2022-08-16 15:19:20.331489773 +0200 CEST m=-899.967578627
2022/08/16 15:34:20 DEBUG : rclone: Version "v1.59.1" starting with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone/.rclone.conf" "move" "/mnt/user/local/drivecrypted" "drivecrypted:" "--user-agent=drivecrypted" "-vv" "--buffer-size" "512M" "--drive-chunk-size" "512M" "--tpslimit" "8" "--checkers" "8" "--transfers" "4" "--order-by" "modtime,ascending" "--min-age" "15m" "--exclude" "downloads/**" "--exclude" "*fuse_hidden*" "--exclude" "*_HIDDEN" "--exclude" ".recycle**" "--exclude" ".Recycle.Bin/**" "--exclude" "*.backup~*" "--exclude" "*.partial~*" "--drive-stop-on-upload-limit" "--bwlimit" "01:00,off 08:00,30M 16:00,30M" "--bind=" "--delete-empty-src-dirs"]
2022/08/16 15:34:20 DEBUG : Creating backend with remote "/mnt/user/local/drivecrypted"
2022/08/16 15:34:20 DEBUG : Using config file from "/boot/config/plugins/rclone/.rclone.conf"
2022/08/16 15:34:20 DEBUG : Creating backend with remote "drivecrypted:"
2022/08/16 15:34:20 DEBUG : Creating backend with remote "drivecrypt"
2022/08/16 15:34:20 DEBUG : fs cache: renaming cache item "drivecrypt" to be canonical "/drivecrypt"
2022/08/16 15:34:20 DEBUG : downloads: Excluded
2022/08/16 15:34:20 DEBUG : Encrypted drive 'drivecrypted:': Waiting for checks to finish
2022/08/16 15:34:20 DEBUG : Encrypted drive 'drivecrypted:': Waiting for transfers to finish
2022/08/16 15:34:22 DEBUG : movies/Dolby_City_Redux_Lossless-thedigitaltheater.mkv: md5 = 91056f9150b7523bdc784e0da01cd411 OK
2022/08/16 15:34:22 INFO : movies/Dolby_City_Redux_Lossless-thedigitaltheater.mkv: Copied (new)
2022/08/16 15:34:22 INFO : movies/Dolby_City_Redux_Lossless-thedigitaltheater.mkv: Deleted
2022/08/16 15:34:22 INFO : folder1: Removing directory
2022/08/16 15:34:22 INFO : folder2: Removing directory
2022/08/16 15:34:22 INFO : folder3: Removing directory
2022/08/16 15:34:22 INFO : folder4: Removing directory
2022/08/16 15:34:22 INFO : folder5: Removing directory
2022/08/16 15:34:22 INFO : folder6: Removing directory
2022/08/16 15:34:22 DEBUG : Local file system at /mnt/user/local/drivecrypted: deleted 6 directories
2022/08/16 15:34:22 INFO :
Transferred: 53.330 MiB / 53.330 MiB, 100%, 32.537 MiB/s, ETA 0s
Checks: 2 / 2, 100%
Deleted: 1 (files), 6 (dirs)
Renamed: 1
Transferred: 1 / 1, 100%
Elapsed time: 1.9s
2022/08/16 15:34:22 DEBUG : 7 go routines active
16.08.2022 15:34:22 INFO: Not utilising service accounts.
16.08.2022 15:34:22 INFO: Script completeI cannot spot the failure. Did someone else have similar problems? Thanks in advance.
Got it fixed. My config was wrong. Sometimes it can be easy. Forgot in the config crypt section the : remote" ->:crypt"
Hope that helps when someone has the same hicups.
Thanks!
BR
-
Hello all together, and thanks first of all for this great manual and the work on this topic.
I tried to install the script as well, but run into problems. Everything seems to work, but when I try to upload the data (from local or mergefs drive it doesnt matter) it will start a process and then deletes everything. Nothing will be uploaded or moved. Just deleted.
Script location: /tmp/user.scripts/tmpScripts/RCLONE Upload Script/script
Note that closing this window will abort the execution of this script
16.08.2022 15:34:20 INFO: *** Rclone move selected. Files will be moved from /mnt/user/local/drivecrypted for drivecrypted ***
16.08.2022 15:34:20 INFO: *** Starting rclone_upload script for drivecrypted ***
16.08.2022 15:34:20 INFO: Script not running - proceeding.
16.08.2022 15:34:20 INFO: Checking if rclone installed successfully.
16.08.2022 15:34:20 INFO: rclone installed successfully - proceeding with upload.
16.08.2022 15:34:20 INFO: Uploading using upload remote drivecrypted
16.08.2022 15:34:20 INFO: *** Using rclone move - will add --delete-empty-src-dirs to upload.
2022/08/16 15:34:20 INFO : Starting bandwidth limiter at 30Mi Byte/s
2022/08/16 15:34:20 INFO : Starting transaction limiter: max 8 transactions/s with burst 1
2022/08/16 15:34:20 DEBUG : --min-age 15m0s to 2022-08-16 15:19:20.331489773 +0200 CEST m=-899.967578627
2022/08/16 15:34:20 DEBUG : rclone: Version "v1.59.1" starting with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone/.rclone.conf" "move" "/mnt/user/local/drivecrypted" "drivecrypted:" "--user-agent=drivecrypted" "-vv" "--buffer-size" "512M" "--drive-chunk-size" "512M" "--tpslimit" "8" "--checkers" "8" "--transfers" "4" "--order-by" "modtime,ascending" "--min-age" "15m" "--exclude" "downloads/**" "--exclude" "*fuse_hidden*" "--exclude" "*_HIDDEN" "--exclude" ".recycle**" "--exclude" ".Recycle.Bin/**" "--exclude" "*.backup~*" "--exclude" "*.partial~*" "--drive-stop-on-upload-limit" "--bwlimit" "01:00,off 08:00,30M 16:00,30M" "--bind=" "--delete-empty-src-dirs"]
2022/08/16 15:34:20 DEBUG : Creating backend with remote "/mnt/user/local/drivecrypted"
2022/08/16 15:34:20 DEBUG : Using config file from "/boot/config/plugins/rclone/.rclone.conf"
2022/08/16 15:34:20 DEBUG : Creating backend with remote "drivecrypted:"
2022/08/16 15:34:20 DEBUG : Creating backend with remote "drivecrypt"
2022/08/16 15:34:20 DEBUG : fs cache: renaming cache item "drivecrypt" to be canonical "/drivecrypt"
2022/08/16 15:34:20 DEBUG : downloads: Excluded
2022/08/16 15:34:20 DEBUG : Encrypted drive 'drivecrypted:': Waiting for checks to finish
2022/08/16 15:34:20 DEBUG : Encrypted drive 'drivecrypted:': Waiting for transfers to finish
2022/08/16 15:34:22 DEBUG : movies/Dolby_City_Redux_Lossless-thedigitaltheater.mkv: md5 = 91056f9150b7523bdc784e0da01cd411 OK
2022/08/16 15:34:22 INFO : movies/Dolby_City_Redux_Lossless-thedigitaltheater.mkv: Copied (new)
2022/08/16 15:34:22 INFO : movies/Dolby_City_Redux_Lossless-thedigitaltheater.mkv: Deleted
2022/08/16 15:34:22 INFO : folder1: Removing directory
2022/08/16 15:34:22 INFO : folder2: Removing directory
2022/08/16 15:34:22 INFO : folder3: Removing directory
2022/08/16 15:34:22 INFO : folder4: Removing directory
2022/08/16 15:34:22 INFO : folder5: Removing directory
2022/08/16 15:34:22 INFO : folder6: Removing directory
2022/08/16 15:34:22 DEBUG : Local file system at /mnt/user/local/drivecrypted: deleted 6 directories
2022/08/16 15:34:22 INFO :
Transferred: 53.330 MiB / 53.330 MiB, 100%, 32.537 MiB/s, ETA 0s
Checks: 2 / 2, 100%
Deleted: 1 (files), 6 (dirs)
Renamed: 1
Transferred: 1 / 1, 100%
Elapsed time: 1.9s
2022/08/16 15:34:22 DEBUG : 7 go routines active
16.08.2022 15:34:22 INFO: Not utilising service accounts.
16.08.2022 15:34:22 INFO: Script completeI cannot spot the failure. Did someone else have similar problems? Thanks in advance.
Jellyfin Icon :: Could Not Download Icon
in General Support
Posted
Hey DirtyDarell, which Repo did you use now? I use jellyfin/jellyfin worked for quite a long time. But rann into similar issue. Did you still use the original jellyfin repository? The original one is also not listed under Apps anymore. Thanks in advance.
BR Paff