DZMM

The leak is getting quite bad - I'm having to restart a couple of times a day to avoid problems. I'm probably going to have to write a quick script to do hourly in case I forget

@Kaizac you might need to create another teamdrive/upload script for your backup. My backup just took my main teamdrive over 400k files (prob all the little plex files and my photo album backup), so I've just created a new teamdrive just for my backup separate from my media teamdrive

- 4 scripts one for each API + unique client ID (each run against one of movies_adults, movies_kids & backup; movies_uhd and tv_shows), all running every hour. On average, 3 of 4 of the scripts are running at any given time because of the backlog.

I'm hoping someone can help. I want to create a post-processing script that is run by radarr/sonarr that moves successfully imported files from directory1 to directory2. Does anyone know how to do this? Thanks

I moved about 70TB in 24 hours i.e. more than the 10TB outgoing limit, so internal google transfers don't count towards the outbound transfer quota. I'm not sure how you'd automate keeping teamdrives in sync though. I think something went wrong with your setup e.g. something downloading to analyse in the background, or something trying to connect too fast. have you checked the API console to see if there are any clues?

why do you want to sync TDs? I'm running with just one with 4 user uploads and it's going well with no issues at all so far after nearly 2 days running

I think that's just the wording for --delete-empty-src-dirs which isn't great - rather than saying 'directory not emptyting, I'm not doing anything' the command does this. Have you looked in the directories listed to verify it's not a problem?

Ive never had an API ban - what happens? If you've uploaded too much, playback isn't affected

it's not needed if you've placed the mount in /mnt/user/........................

it was probably restarting plex in the act of changing to slave that fixed your problem as per my suggestion, not changing to slave.

How many mounts do you have? I just have one rclone team drive mount and 1 for unionfs - you only need to mount the team drive once. I ditched rc as it only helps populate the dir-cache a little bit faster after mounting, but it was causing problems with remounts that I couldn't be bothered to work out as the benefits are small. Yes, a 5-10s sleep after each mount helps avoid any problems. I'm doing ok with 4 my uploads to one team drive for about 40 hours so far - I've done way more than 750GB to the one TD, and more than 750GB/account so I think you're problems are probably because of your bad mounts.

sometimes I have a very rare error if I've been changing the mounts a lot, which you have in your initial setup. In plex, go to your library settings and browse (not add) to where one of your movies is e..g mount_unionfs/movies/avengers (2012???). If you can't browse to the folder in plex but you can in windows/krusader then restart the plex docker - for some reasons if you unmount/mount unionfs sometimes while plex, radarr, sonarr etc are running they can't see the folders. It's why in my script dockers are started after the mounts are running.

Plex behaves exactly the same as it would for a local folder - that's the whole point of the setup.

@Kaizac Thanks - I've moved all my files to one team drive with 4 uploads running for over a day now with no problems - each upload using a unique google account and different client credentials. My backlog will be gone today, which is great. For anyone else wanting to try this, this is how my rclone config looks. Because the TEAM_DRIVE_ID, PASSWORD_1 and PASSWORD_2 is the same all uploads go the same team drive and then I mount one of the vfs remotes, team_drive1_vfs, and add it to my unionfs mount: [team_drive1] type = drive client_id = client_id_google_1 client_secret = client_secret_google_1 scope = drive team_drive1 = TEAM_DRIVE_ID token = token1 [team_drive1_vfs] type = crypt remote = team_drive1:crypt filename_encryption = standard directory_name_encryption = true password = PASSWORD_1 password2 = PASSWORD_2 [team_drive2] type = drive client_id = client_id_google_2 client_secret = client_secret_google_2 scope = drive team_drive1 = TEAM_DRIVE_ID token = token2 [team_drive2_vfs] type = crypt remote = team_drive2:crypt filename_encryption = standard directory_name_encryption = true password = PASSWORD_1 password2 = PASSWORD_2 [team_drive3] type = drive client_id = client_id_google_3 client_secret = client_secret_google_3 scope = drive team_drive1 = TEAM_DRIVE_ID token = token3 [team_drive3_vfs] type = crypt remote = team_drive3:crypt filename_encryption = standard directory_name_encryption = true password = PASSWORD_1 password2 = PASSWORD_2 [team_drive4] type = drive client_id = client_id_google_4 client_secret = client_secret_google_4 scope = drive team_drive1 = TEAM_DRIVE_ID token = token4 [team_drive4_vfs] type = crypt remote = team_drive4:crypt filename_encryption = standard directory_name_encryption = true password = PASSWORD_1 password2 = PASSWORD_2

run scan library files in plex. In library settings also disable create video thumbnails, as plex will download the whole uploaded file. Many people say disable 'perform extensive media analysis' in Extras as it causes API bans, but I've not had any problems and because I run a local server I don't want to waste upload bandwidth if the Plex transcoding brain doesn't have all the data.

yes it is - you have to tell plex there's something new via 'Connect' in radarr or sonarr. Otherwise, Plex does a periodic scan on whatever frequency you've set

I think it was quite fast - just slow with the small files. After first run it does blocks so it's fast thereafter

5MB/s locally or 5MB/s upload to google? The upload to G is a normal rclone sync, so speed depends on the type of file e.g. lots of photos are slower

yep docker. Free version doesn't come with compression but it does block level backups so it's very efficient after the first backup.

I just use the free version to backup to my local folder that then gets encrypted when stored on google. Until last week I was using Crashplan for a few weeks, but it only managed to upload about 400GB in about 4 months....Duplicati I used for about 2 days and it started throwing up errors - made me lose confidence in it as a backup solution. CB did my local backup run really quickly that's now synced to gdrive. I did a quick fag packet calculation before I started switching to one teamdrive and I'm ok. I don't upload anything other than the media files - I'm not sure what value the nfo and srt files are to Plex etc, especially now that Plex's subtitles are getting better (99.99% of my content is in English anyway)??

lol that's insane. I might have to share servers with you to get some inspiration to beef up my library 🙂 @Spladge are you using multiple uploads to 1 or more teamdrives, or have you just been running one upload for a very long time? @Kaizac I'm moving a few TBs at a time and going very slow so I don't get duplicate folders. My slow method is to move from the old TD/gdrive to a 'move' folder on the destination teamdrive and then move the folders to the right folders within the mount using putty/windows

Thanks - I'm going to give one teamdrive another go.

thanks - I can't find the my.cnf file??

yes it does. You only need this if you are adding files to the mount on a different server to the one plex is running on e.g. @Spladge I believe has mounted rclone on a remote server and Plex is running on his local server, where he's also mounted rclone @Stupifier got it working - there's also plex_rcs