Jump to content

DZMM

Members
  • Posts

    2,801
  • Joined

  • Last visited

  • Days Won

    9

Everything posted by DZMM

  1. When you say any docker, do you mean Krusader? Best practice is to start dockers after mounting.
  2. lol I'd literally just grabbed the laptop to research seedboxes as I'd just had that idea!
  3. Thanks I'll look again as I couldn't see any with HDDs and SSDs, just one or the other. I'm worried browsing will be slow from a HDD - but I guess you can't have it all.
  4. Can anyone recommend a good, cheap dedicated server provider? I'm probably going to be moving home again and it's looking like I'll only get 110 upload at best, which will make running my Plex server on my machine very hard unless I do a lot of transcoding. I've looked at Hetzner's auctions, but most of their boxes are SSD only and I need a HDD to hold torrents that are seeding.
  5. No - just make sure that the mount is running before starting dockers - in the docker settings set any docker that could add files to the mount, or go haywire if the mount files aren't available (e.g. plex) to not auto start.
  6. Something is in the folder that is stopping mergerfs creating a mount Whatever docker you are using is creating a file(s) in the mount location - don't start dockers that add files to the mount outside the script!
  7. Why did you delete the logs from your post? It's hard to help you without logs. Luckily, the logs are in the email alert I got. If you look at the logs it says, error mergerfs mountpoint not empty. Look at the mergerfs file location and delete or move whatever files are there and then run the script again.
  8. you can use any rclone mount command - https://rclone.org/commands/rclone_mount/
  9. it's best to create new rclone remotes for the server side move i.e. don't use the ones you use for daily usage to avoid any API/transfer 24hr bans Edit: Another way is to use teamdrives and just move within gdrive on the web. Quick but any changes made might take a time to be seen by rclone, whereas the method above captures the new paths straightaway
  10. No need for a script as long as your mounts have server_side_across_configs = true: [gdrive] type = drive client_id = xxxxxxxxxxxx client_secret = xxxxxxx scope = drive server_side_across_configs = true Actual command: rclone move gdrive1:Path_to_source_folder gdrive2:Path_to_destination_folder You can pick and choose some typical arguments: rclone move gdrive1:Path_to_source_folder gdrive2:Path_to_destination_folder --user-agent="transfer" \ -vv \ --buffer-size 512M \ --drive-chunk-size 512M \ --tpslimit 8 \ --checkers 8 \ --transfers 4 \ --order-by modtime,ascending \ --exclude *fuse_hidden* \ --exclude *_HIDDEN \ --exclude .recycle** \ --exclude .Recycle.Bin/** \ --exclude *.backup~* \ --exclude *.partial~* \ --drive-stop-on-upload-limit \ --delete-empty-src-dirs It all happens server side so mega fast. If you hit the 750GB/day limit, just run daily or create a service account rotation if you can't wait.
  11. Back then I was in a Gigaclear area and I was loving my 1000/1000 service. Now I only get 360/180, which is adequate. Now if you're really lucky, there are some providers in the UK who are offering 10000/10000 - one day we'll all get speeds like that!
  12. If you're using SAs you don't need APIs. If you're not, then unique client IDs is recommended
  13. Sorry I don't really understand python and I think I fluked completing this step as I didn't really understand what I was doing! Hopefully someone else can help. Or, have you tried asking the autorclone author?
  14. Multiple mounts, one upload and one tidy-up script. @watchmeexplode5 did some testing and performance gets worse as you get closer to the 400k mark, so you'll need to do something like below soon: 1. My folder structure looks something like this: mount_mergerfs/tdrive_vfs/movies mount_mergerfs/tdrive_vfs/music mount_mergerfs/tdrive_vfs/uhd mount_mergerfs/tdrive_vfs/tv_adults mount_mergerfs/tdrive_vfs/tv_kids 2. I created separate tdrives / rclone mounts for some of the bigger folders e.g. mount_rclone/tdrive_vfs/movies mount_rclone/tdrive_vfs/music mount_rclone/tdrive_vfs/uhd mount_rclone/tdrive_vfs/adults_tv for each of those I created a mount script instance where I do NOT create a mergerfs mount 3. I mount each in turn and for the final main mount add the extra tdrive rclone mounts as extra mergerfs folders: ############################################################### ###################### mount tdrive ######################### ############################################################### # REQUIRED SETTINGS RcloneRemoteName="tdrive_vfs" RcloneMountShare="/mnt/user/mount_rclone" LocalFilesShare="/mnt/user/local" MergerfsMountShare="/mnt/user/mount_mergerfs" # OPTIONAL SETTINGS # Add extra paths to mergerfs mount in addition to LocalFilesShare LocalFilesShare2="/mnt/user/mount_rclone/music" LocalFilesShare3="/mnt/user/mount_rclone/uhd" LocalFilesShare4="/mnt/user/mount_rclone/adults_tv" 4. Run the single upload script - everything initially gets moved from /mnt/user/local/tdrive_vfs to the tdrive_vfs teamdrive 5. Overnight I run another script to move files from the folders that are in tdrive_vfs: to the correct teamdrive. You have to work out the encrypted folder names for this to work. Because rclone is moving the files, the mergerfs mount gets updated i.e. it looks to plex etc like they haven't moved #!/bin/bash rclone move tdrive:crypt/music_tdrive_encrypted_folder_name gdrive:crypt/music_tdrive_encrypted_folder_name \ --user-agent="transfer" \ -vv \ --buffer-size 512M \ --drive-chunk-size 512M \ --tpslimit 8 \ --checkers 8 \ --transfers 4 \ --order-by modtime,ascending \ --exclude *fuse_hidden* \ --exclude *_HIDDEN \ --exclude .recycle** \ --exclude .Recycle.Bin/** \ --exclude *.backup~* \ --exclude *.partial~* \ --drive-stop-on-upload-limit \ --delete-empty-src-dirs rclone move tdrive:crypt/tv_tdrive_encrypted_folder_name tdrive_t_adults:crypt/tv_tdrive_encrypted_folder_name \ --user-agent="transfer" \ -vv \ --buffer-size 512M \ --drive-chunk-size 512M \ --tpslimit 8 \ --checkers 8 \ --transfers 4 \ --order-by modtime,ascending \ --exclude *fuse_hidden* \ --exclude *_HIDDEN \ --exclude .recycle** \ --exclude .Recycle.Bin/** \ --exclude *.backup~* \ --exclude *.partial~* \ --drive-stop-on-upload-limit \ --delete-empty-src-dirs rclone move tdrive:crypt/uhd_tdrive_encrypted_folder_name tdrive_uhd:crypt/uhd_tdrive_encrypted_folder_name \ --user-agent="transfer" \ -vv \ --buffer-size 512M \ --drive-chunk-size 512M \ --tpslimit 8 \ --checkers 8 \ --transfers 4 \ --order-by modtime,ascending \ --exclude *fuse_hidden* \ --exclude *_HIDDEN \ --exclude .recycle** \ --exclude .Recycle.Bin/** \ --exclude *.backup~* \ --exclude *.partial~* \ --drive-stop-on-upload-limit \ --delete-empty-src-dirs exit
  15. MountFolders=\{"downloads/complete,downloads/intermediate,downloads/seeds,movies,tv"\} # comma separated list of folders to create within the mount I guess it fails if you only add one folder. just create folder manually in your mergerfs mount.
  16. Probably not up to date. There are comments on the new scripts which make moving easy - just: 1. make sure you haven't got any rclone activity going on - stop old scripts, uploads and any dockers using the mount 2. setup new paths - but /mount_unionfs etc as your mergerfs mount paths etc if that's what you have setup now. Be careful to put your existing paths in 3. choose other script options 4. run scripts and if all ok, launch dockers
  17. What folders are in /mnt/disks/Plex ? I've got mergerfs mounts that include UD and they work fine.
  18. Set /mnt/disks/Plex as your local location in the mount and upload scripts
  19. The new mergerfs based scripts do this and much more...
×
×
  • Create New...