Wavey

/usr/lib/plexmediaserver/Resources/Python/lib/python2.7/difflib.py:437: UnicodeWarning: Unicode equal comparison failed to convert both arguments to Unicode - interpreting them as being unequal a[besti+bestsize] == b[bestj+bestsize]: /usr/lib/plexmediaserver/Resources/Python/lib/python2.7/difflib.py:433: UnicodeWarning: Unicode equal comparison failed to convert both arguments to Unicode - interpreting them as being unequal a[besti-1] == b[bestj-1]: running 1.22.1.4228 I'm getting the warning above usually during scans I see one other person with the issue below and of course no help from plex forum. has anyone else seen this? @luigi408 did you ever fix this? https://forums.plex.tv/t/unicodewarning-errors-while-updating-library-metadata/545011/4

Question: So want to write a script that runs at the stopping of Array that copies a file I keep in the /tmp folder over to cache then move it back at start of the array. I am just moving a folder with 3-4gb database+blob from tmp to cache then back at the stopping and starting of the array for a docker and want to know if it would give me enough time to do that. Why: I'm doing this because I'm testing putting my plex database in /tmp to run it on ram. The problem is I don't want to lose it at shutdown so I figured I'd run a copy script that moved it at array shutdown and then moved it back at start up and put a delay on my plex docker starting. This is a testing situation because I am getting busy db errors. Before we dive into this and people tell me how to fix that, trust me I've tried, trust me. Its currently running on an NVME, still busy, ran multiple optimize, dumps etc...nothing works and apparently its the fact that the DB is so big (2.2GB) and sqlite3 isn't the best for it. It's been years of me trying to stop it and I ran across a few people who dropped it into ram and it solved their problem so I'm trying to do the same. I'm also aware that if its a dirty shutdown I'll lose it but its backed up every 3 days so I wouldn't lose much.

It did and it works! thanks a ton I'm just waiting for Lidarr to scan in my library since yesterday...ha. Hopefully it can handle the requests. I also noticed it grabbed explicit versions which is great, will it automatically grab explicit if there are two options? i'd rather not get a bunch of clean stuff unless thats how its supposed to be.

my cache writes dropped by 75%, thanks for the information!

@randomninjaatk Hey great job but I have a few questions. 1. Are the instructions on github meant for Unraid as well? - I ask this because there are references to a config file, unraid doesn't make one I'd have to go get it from your github and I wanted to make sure that was the right thing to do. - Also how is the .bash being run? Unraid wipes everything at restart so the only way that I can think of to run the script is using using scripts. 2. I don't use Beets, can I just bypass stuff having to do with beets or is it required? 3. If I only want Lidarr to use Deemix do I have to set up any other search or indexers in Lidarr? Can I just add artists and have the script run it? 4. PathtoDLClient, how do i set a path to deemix when its a docker? setting it to mnt/user/appdata/deemix is nothing Essentially all I want is Lidarr to use Deemix as search/downloader and I'm assuming this is it but it's a tad bit complicated, sorry I'm not the best at this. I might just start again one day and go through step by step.

Thanks! I'll give it a try.

Hehe, cow and butter. Yeah I'll give it a try, redo the cache using spaceinvaders method and go from there. Thanks!

@StevenDWhat is that output you are using to monitor the amount of writes?

Ah ok at least I know they should be there. Yeah my cache is getting about 80-100TB a month written to it. It's 1 years old and is at 755TB written to it, soooooo yeah. I have a second unraid system that the cache is 4.5 years old that has about 65TB written to it. Both have Plex installed, commented this because from other posts I've noticed this is a culprit so it's probably not in my case.

As I was trouble shooting my Terabytes of writes to my Cache drive the consensus has been to not use BTRFS as the filesystem on the cache. I also changed a few dockers to Linuxserver versions (plex, radarr, sonarr, etc... anything that can be linuxserver is linuxserver). No encrypted devices either. I switched everything to XFS but I still see btrfs "kworkers" doing things. Is this normal? I'm also still seeing a ton of writes from loop2. I mostly troubleshot this on Reddit where everyone who switched to XFS saw a crazy number of writes go way down. I'm just trying to see did I do this properly. Below is a snapshot of my iotop showing all those workers. Total DISK READ : 22.29 M/s | Total DISK WRITE : 214.80 M/s Actual DISK READ: 25.52 M/s | Actual DISK WRITE: 227.95 M/s TID PRIO USER DISK READ DISK WRITE SWAPIN IO> COMMAND 20004 be/4 root 0.00 B/s 13.07 K/s 0.00 % 19.09 % [kworker/u65:14+btrfs-endio-write] 17469 be/4 root 0.00 B/s 39.20 K/s 0.00 % 16.76 % [kworker/u65:6+btrfs-endio-write] 1957 be/4 root 0.00 B/s 13.07 K/s 0.00 % 14.39 % [kworker/u65:12+btrfs-endio-write] 10390 be/0 root 9.40 M/s 114.31 M/s 0.00 % 10.95 % [loop2] 28072 be/4 root 13.07 K/s 509.64 K/s 0.00 % 8.69 % [kworker/u64:1-btrfs-submit] 30178 be/4 nobody 4.90 M/s 721.98 K/s 0.00 % 2.78 % Plex Transcoder -codec:0 hevc -~-4ed1-b8d9-7f2e8280d292/progress 21217 be/4 root 382.23 K/s 1450.50 K/s 0.00 % 2.54 % [kworker/u64:0-btrfs-submit] 19173 be/4 nobody 13.07 K/s 75.62 M/s 0.00 % 2.27 % mono --debug Radarr.exe -nobrowser -data=/config 19174 be/4 nobody 3.27 K/s 19.16 M/s 0.00 % 1.94 % mono --debug Radarr.exe -nobrowser -data=/config 18640 be/4 root 189.48 K/s 875.53 K/s 0.00 % 1.75 % [kworker/u64:2-btrfs-submit] 15556 be/4 root 13.07 K/s 104.54 K/s 0.00 % 1.64 % [kworker/u66:10-btrfs-worker] 16391 be/4 nobody 1950.34 K/s 0.00 B/s 0.00 % 0.71 % mono --debug Radarr.exe -nobrowser -data=/config [Finalizer] 1386 be/4 root 225.42 K/s 16.33 K/s 0.00 % 0.62 % shfs /mnt/user -disks 16777215 ~time,allow_other -o remember=330 16390 be/4 nobody 793.86 K/s 0.00 B/s 0.00 % 0.34 % mono --debug Radarr.exe -nobrowser -data=/config [SGen worker] 1726 be/4 root 13.07 K/s 65.34 K/s 0.00 % 0.20 % [kworker/u66:0-btrfs-worker] 19172 be/4 nobody 26.14 K/s 39.20 K/s 0.00 % 0.13 % mono --debug Radarr.exe -nobrowser -data=/config 13439 be/4 root 13.07 K/s 52.27 K/s 0.00 % 0.11 % [kworker/u66:9-btrfs-worker] 17662 be/4 nobody 836.33 K/s 0.00 B/s 0.00 % 0.11 % Plex Media Server 1395 be/4 root 437.76 K/s 0.00 B/s 0.00 % 0.10 % shfs /mnt/user -disks 16777215 ~time,allow_other -o remember=330 1392 be/4 root 339.76 K/s 13.07 K/s 0.00 % 0.08 % shfs /mnt/user -disks 16777215 ~time,allow_other -o remember=330 17663 be/4 nobody 166.61 K/s 0.00 B/s 0.00 % 0.07 % Plex Media Server 24303 be/4 nobody 568.44 K/s 13.07 K/s 0.00 % 0.07 % python3 /app/tautulli/Tautulli.py --datadir /config 5316 be/4 root 52.27 K/s 182.95 K/s 0.00 % 0.07 % [kworker/u66:4-flush-btrfs-1] 18465 be/4 nobody 55.54 K/s 0.00 B/s 0.00 % 0.06 % mono --debug Sonarr.exe -nobrow~ -data=/config [Thread Pool Wor] 11290 be/4 root 0.00 B/s 13.07 K/s 0.00 % 0.05 % [kworker/u65:8+btrfs-endio-write] 7998 be/4 nobody 55.54 K/s 0.00 B/s 0.00 % 0.05 % mono --debug Sonarr.exe -nobrow~ -data=/config [Thread Pool Wor] 13188 be/4 root 26.14 K/s 91.47 K/s 0.00 % 0.05 % [kworker/u66:7-flush-btrfs-1] 8008 be/4 nobody 45.74 K/s 0.00 B/s 0.00 % 0.04 % mono --debug Sonarr.exe -nobrow~ -data=/config [Thread Pool Wor] 13076 be/4 nobody 104.54 K/s 0.00 B/s 0.00 % 0.04 % mono --debug Sonarr.exe -nobrow~ -data=/config [Thread Pool Wor] 1387 be/4 root 238.48 K/s 22.87 K/s 0.00 % 0.04 % shfs /mnt/user -disks 16777215 ~time,allow_other -o remember=330 32016 be/4 root 13.07 K/s 104.54 K/s 0.00 % 0.04 % [kworker/u66:24-btrfs-endio-write] 8010 be/4 nobody 179.68 K/s 0.00 B/s 0.00 % 0.04 % mono --debug Sonarr.exe -nobrow~ -data=/config [Thread Pool Wor] 1303 be/4 root 117.61 K/s 6.53 K/s 0.00 % 0.04 % shfs /mnt/user -disks 16777215 ~time,allow_other -o remember=330 18187 be/4 root 0.00 B/s 26.14 K/s 0.00 % 0.04 % [kworker/u65:7+btrfs-endio-write] 8013 be/4 nobody 19.60 K/s 0.00 B/s 0.00 % 0.04 % mono --debug Sonarr.exe -nobrow~ -data=/config [Thread Pool Wor]

I know this is an old post but could you tell me the steps you took to get plexapi installed and working so it doesn't get lost on reboot? I can't seem to find instructions and python scripts + Unraid = No bueno for me

Of course it's up as soon as I post this, jeez I have perfect timing...my bad.

Squid I know you responded in my other thread but nothing was made clear as to whats going on with CA. Githubstatus.com shows that everything is OK. Is there any way to tell if CA is OK? Its been 4 hours and I can't install any new dockers. If it's already installed, I can remove it and re-add it no problem. So right now on my second server if I uninstall a docker then reinstall it its fine. If I try to update or install a new docker it times out. This wouldn't be a huge problem if I didn't happen to change my cache drive this morning on my main server and literally have no dockers installed right now on my main server. Don't want to bug anyone but my main server hosts a lot of stuff for my family and its just a little frustrating.

Apr 21 13:13:01 MIKESDESKTOP rc.docker: 2b2bbdb7100ea23c468d67d495ee24f2da8081935eb16299621acb198ebe224c Apr 21 14:01:41 MIKESDESKTOP nginx: 2020/04/21 14:01:41 [error] 7054#7054: *6025 upstream timed out (110: Connection timed out) while reading upstream, client: 192.168.1.242, server: , request: "POST /Docker/AddContainer?xmlTemplate=user%3A%2Fboot%2Fconfig%2Fplugins%2FdockerMan%2Ftemplates-user%2Fmy-plex.xml&rmTemplate= HTTP/1.1", upstream: "fastcgi://unix:/var/run/php5-fpm.sock:", host: "192.168.1.62", referrer: "http://192.168.1.62/Docker/AddContainer?xmlTemplate=user%3A%2Fboot%2Fconfig%2Fplugins%2FdockerMan%2Ftemplates-user%2Fmy-plex.xml&rmTemplate=" Just as a quick check, does this look like something on my side? Or is there a way around this? I am seeing the linuxserver.io and other sites loading fine I just don't know why I can't install a 131mb docker.

Thanks, I see that its up now but I'm still having issues with dockers slowly being installed on both my unraid machines. Is that a separate issue?