axeman

Not sure if it's relevant, but the latest version of ESXi allow booting from flash. You can remove a layer of complexity.

Anyone else getting dropouts on the MergerFS mount? My mount seemed to have gone down last night. When I try to re-run the mount script, all I see in the logs is: 28.12.2020 13:54:08 INFO: Creating local folders. 28.12.2020 13:54:08 INFO: Creating MergerFS folders. Rebooting helps, but it goes down again fairly quickly. Started happening last night .

hmm the only thing that I did before it happened was move some files around. my local share had a /videos/TV_Classics and a /videos/cloud_Videos/TV_Classics I moved the entire folder (using a Windows machine) from /local/Videos/ to /local/cloud_Videos That was basically the last thing I did (re-parent the directory). a quick reboot fixed it - just curious if the reparenting did it.

Strangely - my array went down after an upload finished. Tried to run the upload script again and am getting this now:

Yeah, it's live. I just tried watching a show, and Emby must've updated the .nfo file, because log shows similar (upload script hasn't been run since a reboot). Maybe smaller files that are already in the rclone cache get upload directly? When I copy a large (new) file to the mergerFs mount, it does exactly as expected. The file goes to the corresponding folder on the "local" share. I'll test some more in a few hours.

Interstingly - it looks like mergerFS files aren't going to the "local" but are being uploaded directly... Seeing lots of these from a Sonarr refresh.

Hi there! Is there a way to control the order of execution on the "at Array First Start?" I have three scripts that I'd like two to run BEFORE the third one runs. Does it go by the script name or by what's in the #name variable? or something else?

Yes - excellent observation. I see the mergerfs github shows some activity from 5 days ago on fuse.c - maybe there was a breaking change? MergerFS gets installed at each array reboot right?

something is definitely going on ... even after a reboot, it came back. I'm in the middle of an upload on my paltry 400Mbit down/40Mbit up connection.... so definitely not hitting the quota - even though I do have service accounts. wonder if this is related to the stuff that happened last week w. google... maybe they are putting in some other sort of throttling?

I got the same "Transport endpoint is not connected" error last night as I was uploading. Rebooting fixed it. Funny thing was, I saw a lot of symmetrical read/writes on the flash drive.

My entire array went and borked itself last night/this morning. one of my ARRs was doing a massive update at the same time as Emby's library scan. Not sure if this was all related, but I stopped everything, manually deleted the rclone_cache, and restarted UnRaid. Everything seems OK again.

None of the above - more so that I can have a protected share that the kiddos can't see.

Okay - final dumb question - I want to completely separate out my adult tv shows so that it's not on the same mount. Can I have another merger fs mount, and corresponding upload script? Or will the conflict with each other?

DOH! SORRY. i thought it was a whole different script.

Hi - can you share that mount script with the merger FS parts striped out? is it just this part? # create rclone mount rclone mount \ $Command1 $Command2 $Command3 $Command4 $Command5 $Command6 $Command7 $Command8 \ --allow-other \ --dir-cache-time $RcloneMountDirCacheTime \ --log-level INFO \ --poll-interval 15s \ --cache-dir=$RcloneCacheShare/cache/$RcloneRemoteName \ --vfs-cache-mode full \ --vfs-cache-max-size $RcloneCacheMaxSize \ --vfs-cache-max-age $RcloneCacheMaxAge \ --bind=$RCloneMountIP \ $RcloneRemoteName: $RcloneMountLocation &

That's just from your command - you should see that your array has now stopped.

This is a bit crude - but i run this in terminal: ps -ef | grep /mnt/user for each pid that comes up, i do this: kill <pid> Someone can probably script a better way to do it and run at array stop, but for now that's what i've been doing.

So even with this - Windows cannot seem to write to the share via SMB. Googled it, and seems like sharing an rclone vfs mount can work with some modifications. Don't know that I have the know how to do that. I'm grateful for your time - going through it like this with me. I may have to go back to merger fs.

Thanks - I will try that. Didn't know it was possible. Incidentally, do you know where /mnt/disks/some_dir is physically located? like does it go on Cache drive? or is it in memory/ram?

This might be a me thing - since I need the rclone mounts available to my Windows machines, I have it in /mnt/user . If I try to copy a file into unioned mount from inside of UnRaid via MC, it works exactly as you'd want... the file goes right to the local share. However, if I do the same from a windows machine - it fails. Interestingly this doesn't seem to be problem on an Android device (using SolidExplorer). Nor does it happen with the @DZMM mergerfs based scripts.

So I'm having trouble creating files on the union location. It's strange because I if I go directly to the media_vfs mount, I can create files. But can't on the media one. I even tried installing the unassigned devices and updated the paths to /disks/ instead of /user/ .. What could I be doing wrong? Thanks for your time. Edit : this shows up on the script log: /test2.txt: WriteFileHandle: Can't open for write without O_TRUNC on existing file without --vfs-cache-mode >= writes /test2.txt: WriteFileHandle: Can't open for write without O_TRUNC on existing file without --vfs-cache-mode >= writes an rclone forum post said to set the cache mode ... but I see we are already doing that on the mount script. It seems to happen regardless of the :nc modifier.

Thanks! where'd you get the info on what to put for the WSD options? Strangely my array was fine - but started doing this after I started using rclone - i thought it was related to my NIC. but seems to be OK when I use IP address.

Thanks I noticed that - but don't really understand the difference. I thought perhaps you just typed it as an example of your script.

sorry if this is a dumb question (maybe my imagination isn't working) ... but isn't that /media the mount where your union is? So would rclone know where the "local" version is? Or does it basically traverse the entire folder to see if there's differences between crypt:files and /mnt/user/media/files ?

whoa - that's nice indeed. I like the service account rotation - but maybe not needed given my upload bandwidth is 40mbit anyway.