KeyBoardDabbler

Hoping some of the more expired users can give me some input for my new build. This will be my 2nd unraid build. It's more aimed at serving personal data and work related projects to test locally. The build will have its own array to provide parity protection aswell as remote backups. The idea of this is to have high I/O, NVME cache drives. I am on a 8/8Gbps connection and 10gb local network. From my understanding "cache-prefer" & "cache-yes" do the oposite when the mover runs. I guess i want to use "cache-yes" but this is only good for write speed improvements and once the mover runs the data is removed from cache. I would like my data to stay on cache for read/ write performance as the array drives would easily be the bottleneck. So do i need to look at using "only" on selected shares and create some type of script to copy the directories over to the array periodically?

I would like to deploy a second UNRAID server for sole purpose to use as a 3rd backup to my main and cloud storage. This build will have a p3700 2tb nvme for the cache to make use of the 10gbe. The server wont be running 24/7, hopefully make use of WOL and will not run any extra services as far as i have thought. Any suggestions on a low cost CPU (due to server being down majority of the time), what sort of benchmarks am i looking at. i can put togeather a E3-1220L build for $200 if this is enough for the data encryption. Maybe a atom supermicro combo but i would need enough pci slot for a sas controller and 10gbe card. thanks for reading.

Should i run a parity check before replacing the parity disk. These are the last two recent scans Date Duration Speed Status Errors 2021-08-03, 07:31:34 1 day, 7 hr, 53 min, 29 sec 52.3 MB/s OK 2687 2021-07-26, 19:50:51 12 hr, 2 min, 10 sec 138.5 MB/s OK 6588 Is it a case of following this guide when installing the new parity disk.

I am hoping some of you more experienced people can assit with my next steps. I feel my array is not to healthy, i also have had the tick option enabled to "Write corrections to parity" which i have now read i shouldnt have done. I did noticed the bad sector count but after two power cuts recently i got notified of more issues. If i need to replace the disks is a rebuild possible, should i backup some data first incase it fails? What order should i resolve the issues? I have two spare drives ready to go. thanks htpc-unraid-diagnostics-20210804-1455.zip

I am running on version: beta 29, possible something broke in recent update around 25 maybe. Should i report this as a bug? Everything is working now pointed to a user share but nzbget does not like the change. I have notice a big difference in my speeds... I was hoping to eventually move (sonarr, nzbget ect) off my unraid server and onto a nuc, that i have spare. Do you know if this would be a option with the mergerfs mount or would i run into the same issues. So basically my "LocalFilesShare" would point to the nuc running on the network. something like LocalFilesShare="//192.168.1.10/seedbox/downloads"??

Looks like you got it right, changing LocalFilesShare to /mnt/user/local has cleared the error from the logs. I will test the uploading tomorrow as i have work early in the morning. Makes me feel a little better that it wasn't something i changed by mistake, after trying to figure it out for the last week. Any idea why for this has been working, now all of a sudden stopped? Also i thought it was best practice to download to a unassigned device to prevent unnecessary read/writes on the array.

i am still having troubling trying to resolve the error in my logs upon mergerfs mounting, I previously had everything running smoothly, but since the above issue started, playback has been poor, as well as not being able to use the upload scripts as i believe my mergerfs is wrong in some way. Upon mount, i have noticed a "mount_mergerfs" folder is being created in my LocalFilesShare. This didnt use to happen. Files are not being stored in the LocalFilesShare (awaiting the upload script to move them to the relative tdrive_upload share) Instead it seems i find the files have been moved into the relative /mount_rclone without the upload script running. Previously in my LocalFilesShare downloaded files would be LocalFilesShare/tv_shows, upload script would upload to tdrive_upload/tv_shows. Lastly the mover would run. I have since started fresh by re editing the mount script in hope i missed something, this is not the case..

I start to see the error once the mergerfs command finishes mounting i think, I also have been recently moving alot of files around so i will check to see if i have any dupes as per the link you provided. I will report back. thanks

if i delete a file from my mount_mergerfs folder, i see the change in my google drive within afew seconds. Check the folder activity on the right side. Also you can "rename" a file locally, then see which encrypted name changes in your drive. Then rename it back or delete knowing you have identified the correct file/folder

My logs are being filled every second with the below line. Not to sure where to go next. cheers htpc-unraid-diagnostics-20200916-1522.zip

Hi all, My unraid logs are being filled with the below error, every second. The one file i can recall changing last was the rclone config credential. All files in my mergerfs mount are viewable but error when trying to open.

I have a strange issue when trying to move/ copy files into a folder within my mount_mergerfs dir. via windows i get the error "0x8007003A". error "5" via krusader and fails the transfer. Some files transfer and some don't into that dir. The ones that fail are able to move into other dir within the mount_mergerfs share. ***edit** for now it is working. i will report back if the fault persists again.

I think you was correct, this change has got me to the finish line. Things are running really good. I have a lot to rearrange now. very grateful for the help and all the work you have put into this project. I do not have any issue moving tdrive > tdrive share but i am running into permission error when trying to move files out of gdrive > tdrive. sa group has been added to the members on all drives. Status has been set to "manage" and "enabled" migration in settings. The main difference is gdrive uses the client_id, client_secret & token whereas tdrive uses service_account_file because it can not be used with the gdrive. Either way i have both users added as members ect.

Ahhh that explains it, it did throw me off a little bit.. Now that i have everything setup the /mount_merger folder layout is perfectly fine. I have everything setup and ran through the process, almost there but... I am now struggling with the last part, server side moving. I have tried various folders to move but they all error. I am most certain i have identified the correct encrypted folder names.

I am back again 🙃 can you please explain how have you have managed to get the following folder structure? I get the following error whenever i try to mount more than one tdrive in the same $RcloneMountLocation. Once the script finishes only the first mounted tdrive shows. I have no trouble mounting them like the below but it is not very clean to navigate

I have since tried with the correct path but still not showing any of the files in my drive. the mount script has created the subfolders but when i navigate into /gdrive_media_vfs it is empty. UPDATE after a reboot of my server everything is now normal and operating??

I am just using file explorer on windows and ubuntu and navigating to the network share like normal. Nothing shows when using krusader though either.

Thankyou for explaining the steps, i am going to take another attempt. First i need to get at least 1 mount working using the mergerFS way. Just attempting to mount my original gdrive. Everything seem ok but no files are showing in /mount_unionfs/gdrive_media_vfs. Revert back to my unionfs mount script and everything works as expected.

That is making more sense to me now. Although i am still slightly confused with the setup still. If you are moving all files to one tdrive, to then move into their correct tdrive, does that mean there is a point where plex would not see the file? Because you point a plex library to the MergerFSMountLocation, and lets say TV shows are in tdrive2. You initially upload to tdrive1. Also in my first Upload Script would i just change "RcloneUploadRemoteName" to my tdrive i am initially sending my files to before being moved server side.

I am a long time user, i am still running the original scripts with unionFS, never had a issue and still running. I do however also have all my data located in gdrive. So i have decide to make the switch to mergerFS at the same time as relocating and setting up some "shared drives" for each library utilizing the extra service accounts. 1. When editing the rclone config, do i set multiple sections like so for each share; 2. I then need to edit the mount script to suit, i take it i will need to create Multiple mounts with one merger and upload script? Referring to another previous post I found. " for each of those I created a mount script instance where I do NOT create a mergerfs mount " So i would duplicate and edit the below section in the mount script for each of my shares that i want mounted. # create rclone mount rclone mount \ --allow-other \ --buffer-size 256M \ --dir-cache-time 720h \ --drive-chunk-size 512M \ --log-level INFO \ --vfs-read-chunk-size 128M \ --vfs-read-chunk-size-limit off \ --vfs-cache-mode writes \ --bind=$RCloneMountIP \ $tdrive_media_vfs: /mnt/user/mount_rclone/google_vfs & # Check if Mount Successful echo "$(date "+%d.%m.%Y %T") INFO: sleeping for 5 seconds" # slight pause to give mount time to finalise sleep 5 echo "$(date "+%d.%m.%Y %T") INFO: continuing..." if [[ -f "$RcloneMountLocation/mountcheck" ]]; then echo "$(date "+%d.%m.%Y %T") INFO: Successful mount of ${RcloneRemoteName} mount." else echo "$(date "+%d.%m.%Y %T") CRITICAL: ${RcloneRemoteName} mount failed - please check for problems. Stopping dockers" docker stop $DockerStart rm /mnt/user/appdata/other/rclone/remotes/$RcloneRemoteName/mount_running exit fi fi I am also not following steps 4 & 5. Why run a second upload script in step 5 to move files from the same folders you did in step 4... regards

@DZMM My mistake, i had typo on the remote name. The mount script finished this time with no issues. I have noticed the folder structure is not right though, It mounts to "mount_unionfs\gdrive_media_vfs" instead of "mount_unionfs\google_vfs" I have tried running the unmount script but the gdrive seems to be still mounted as a can still access all my files.

thankyou for the advice.... I ran the unmount script and got a little further this time with the mount script but it still failed.

0.96.4 mount script still failed to mount.

I did notice that double slash but i was not sure as it matched the GitHub repo. I updated the scripts, unmounted old my old unionfs and tried to run the new script once again. no errors but nothing got mounted as unionfs and rclone folder is empty. I ran the umount script, tried mounting once again with the same error coming up.

I have been using the original scripts without issues, i decided to try mergerfs today but i cant get the new script to mount. I believe i made the correct changers to match my local setup.