tucansam

Right. So I don't know if this is sonarr, or sab, so I'll start here. Let me preface this by say that, aside from regular updates when I notice a new software version, there has been *zero* configuration change to my setup for over six months. When I first (finally) got everything running smoothly, everything ran perfectly. Over time, things slowly degrade, despite *zero* config changes, and I'm at a point now where I need help. What is happening: A show exists in sonarr, and its directory exists on my server, and it is 100% up to date, every episode is downloaded, in either 480 or 720p or 1080p. Looking at sab's download log, I'll see a particular episode will be downloaded for said show, two or three times. Usually I'll have to obfuscated version, an SDTV version, and a 720 or 1080 version. All downloaded. But when I check the actual show's directory, the file(s) sab downloaded are not there. When I check sab's working directory, for complete and incomplete downloads, the files aren't there either. But hovering over sab's download log shows a very clear path (to the working directory) for where it placed the file. So multiple versions of the same (existing) episodes are downloading, and then disappearing. And if there is only an SDTV version of the show on the server, and sab says it downloaded a 720 or 1080 version, that show is not there.

Any updates?

Cool, thanks. I won't be dumping my preclear machine anytime soon

But the array is still down a disk, obviously. So is the preclear + rebuild process just seamless now, but the array is at risk for the same period of time? Or is preclear sped up now, and the rebuild process begins much faster? I am 100% not putting any disk in my array that isn't already precleared one or two times in another system.... Has this changed?

Hang on. What happens when I plug a new disk into my server? I have an older unraid system sitting in the garage collecting dust that I use to preclear disks. Does 6.4.x handle this differently now?

What?

I am confused by sonarr's behavior and I'm wondering if anyone can clarify. If I go to the "Wanted" tab, I have 403 pages of missing episodes. If I click "Search All Missing," sonarr spends a while queueing up several dozen pages in sab. After a day or two, sab is done, and a ton of episodes are downloaded, most successful. But, sonarr still has 403 pages of missing episodes, although none are the ones sab just downloaded, ie, sonarr gets the message that a download was successful.

File names are too long? SAB is pausing most/all downloads. Been happening for a couple of days, sometimes when I press "play" to un-pause, it kicks back up, last few hours its been stopping right away with the red pause icon. SAB threads on various other forums indicate possibly that filenames are too long, disk space issues, etc. My disk has plenty of space, and I just ran SMART tests, its fine. Errors I am getting is: 2017-12-05 16:06:10 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.004 2017-12-05 16:07:55 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.005 2017-12-05 16:09:39 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.007 2017-12-05 16:09:50 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.008 2017-12-05 16:10:00 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.006 2017-12-05 16:10:01 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.009 2017-12-05 16:10:02 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.010 2017-12-05 16:10:02 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.011 2017-12-05 16:10:03 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.012 2017-12-05 16:10:04 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.013 2017-12-05 16:10:04 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.015 2017-12-05 16:10:05 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.014 2017-12-05 16:10:06 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.016 2017-12-05 16:10:06 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.017 2017-12-05 16:10:07 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.019 2017-12-05 16:10:08 ERROR Disk error on creating file /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/Law.and.Order.s01e09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV.mp4.020 2017-12-05 16:10:08 ERROR Loading /downloads/incomplete/Law.and.Order.S01E09.Indifference.PROPER.DVD-S1D3-CCE10-x264-DEV/__ADMIN__/SABnzbd_nzf__qf8xh failed 2017-12-05 16:10:08 WARNING Article DB empty SABnzbd_nzf__qf8xh: 2017-12-05 16:10:08 ERROR Error importing 2017-12-05 16:12:14 ERROR Disk error on creating file /downloads/incomplete/The.Practice.S08E20.DVDRip.X264-SPRiNTER/the.practice.s08e20.dvdrip.x264-sprinter.sample.mkv This was literally working up until a day ago, when I did a massive search for missing eps and now SAB has a hundred or so pages of stuff its trying to grab. Any other suggestions? I've never had long filenames be an issue before, not sure its the problem now.

Can this be used to backup one unraid server to another? I'd love to be able to take a couple of the shares on my primary server, encrypt them, and drop them on my secondary unraid server once a month. Disregrad..... testing it now.

I deleted the plug-in. Problem solved.

Is it normal for the system to be completely unresponsive during a backup? Right now the main unraid UI will not load, ssh'ing into the system means 10-15 seconds of wait time before I see a prompt, sysload is 13/13/13, all commands from the shell are slow/hang, 'ps -aux > /mnt/user/bob/ps.aux.10.2.17" has been working for over ten minutes, the server is not visible on the network, files and shares are unavailable..... htop won't load at all, top displays the first screen the freezes (no updates), sysload is now 15+ across the board, rsync (x3) and unrraid are the processes using the most CPU. I can't even get a read on i/o, system is running like an 8088. -- root@ffs2:~# ps -Ao user,uid,comm,pid,pcpu,tty --sort=-pcpu | head -n 6 USER UID COMMAND PID %CPU TT root 0 unraidd 18972 1.4 ? root 0 mdrecoveryd 18608 0.5 ? root 0 rsync 27779 0.5 ? root 0 rsync 27780 0.5 ? root 0 rsync 27781 0.4 ? root@ffs2:~# -- login as: root [email protected]'s password: Last login: Mon Oct 2 06:09:10 2017 from 192.168.0.51 Linux 4.9.30-unRAID. root@ffs2:~# iostat -c Linux 4.9.30-unRAID (ffs2) 10/02/2017 _x86_64_ (4 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 1.12 0.39 0.93 0.54 0.00 97.03 root@ffs2:~# iostat -d Linux 4.9.30-unRAID (ffs2) 10/02/2017 _x86_64_ (4 CPU) Device: tps kB_read/s kB_wrtn/s kB_read kB_wrtn loop0 1.13 4.49 270.81 18255720 1101094532 sda 0.01 0.47 0.01 1910116 38352 sdb 4.22 1930.20 0.02 7848087954 86480 sdc 4.44 1966.14 15.41 7994186038 62667384 sdd 10.05 2046.40 1938.02 8320543902 7879879916 sde 4.22 1929.01 0.04 7843253710 169012 sdf 5.76 2933.25 14.64 11926427510 59515132 sdg 4.30 43.41 2370.89 176521033 9639881435 sdh 0.88 71.96 176.82 292564905 718934752 sdi 8.94 4231.88 382.08 17206559638 1553528652 sdj 6.37 3132.00 241.21 12734516378 980759664 sdk 8.51 3868.15 0.00 15727639522 9776 sdl 4.28 1937.88 0.02 7879293706 94884 sdm 4.23 1932.66 2.17 7858055862 8835484 sdn 4.20 1929.04 0.01 7843352342 32708 sdo 3.12 1443.96 0.02 5871056118 76604 sdp 8.40 3862.24 0.00 15703619642 19768 sdq 8.42 3855.84 0.01 15677601186 30960 sdr 9.67 4082.29 98.62 16598321798 400998084 md1 1.01 121.30 9.89 493217926 40221989 md2 0.11 11.95 0.00 48603403 13734 md3 0.17 17.86 0.00 72634829 4883 md4 1.19 133.39 98.62 542338732 400976865 md5 0.04 2.29 2.17 9308474 8825273 md6 0.02 0.84 0.01 3408013 24923 md7 0.08 5.55 0.01 22577745 23366 md8 0.01 0.29 0.02 1160884 67654 md9 0.09 9.66 0.02 39291547 85629 md10 0.03 1.99 0.02 8095153 74658 md11 0.23 22.53 15.41 91616252 62655428 md12 0.04 0.78 0.04 3188537 155432 md13 0.49 1.65 241.16 6707814 980539053 md14 0.49 29.31 14.59 119189684 59339054 root@ffs2:~# uptime 06:31:54 up 47 days, 1:26, 1 user, load average: 17.00, 17.00, 16.57 root@ffs2:~# -- now 'iostat -x 1' is reporting this: avg-cpu: %user %nice %system %iowait %steal %idle 0.00 0.00 0.25 0.00 0.00 99.75 Device: rrqm/s wrqm/s r/s w/s rkB/s wkB/s avgrq-sz avgqu-sz await r_await w_await svctm %util loop0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sda 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdb 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdc 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdd 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sde 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdf 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdg 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdh 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdi 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdj 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdk 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdl 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdm 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdn 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdp 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdq 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 sdr 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 md1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 md2 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 md3 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 md4 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 md5 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 md6 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 md7 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 md8 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 md9 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 md10 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 md11 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 md12 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 md13 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 md14 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 but system is still unresponsive.

FWIW, I also get the "this file no longer exists" when deleting -- from Windows -- on any share. It happens A LOT, but appears random, in that it doesn't happen every time. Perhaps this is a samba issue? Or a recycle bin issue? Although I think it was happening before I started using the recycle bin. I still haven't tried to delete my backup sets, don't want to lock up my server and initiate a parity check.

I must say now that I'm afraid to delete my old backup files. I have about two months' worth (weekly) and was going to delete some old stuff, but this whole server lockup issue seems to be more and more common. Anyone figure out what's going on?

Does anyone know if there is someone working on a plugin, docker, or the like, for unraid, that uses something like RRDtool and cacti to monitor network traffic and devices? That would be awesome.

Would anyone care to comment on this power supply? https://www.newegg.com/Product/Product.aspx?Item=N82E16817151188 Seasonic FOCUS Plus Series SSR-850FX 850W Would be for a 19-spinner, 1-ssd, i5 (xeon in the future) with two LSI controllers and a PCIe NIC. Enough power? Enough oomph on the 12v rail? I understand this is the "lower end" Seasonic model. I don't want to end up with the equivalent to the "CX" series from Corsair. Failing that, I am also looking at the Seasonic Platinum, Flagship, and Corsair RMx series. Trying to stay below $150. Comments on the latter welcome as well of course. Thanks.

Thanks Johnnie. How does that work? Is it automatic, or are there utilities to download and run?

Is btrfs "stable" enough (everyone keeps using the word "experimental") to use on all array member disks? Does it have any protection against bit-rot? New server, wondering what filesystem to choose. Are the benefits vs xfs worth considering? Thanks.

Right. But why did that rm command complete so quickly vs. the initial rm command that moved everything to the recycle bin?

I had a Plex folder still living on my array in /mnt/user/appdata. It had 5,000,000 files and directories in it. Took about 90 minutes to delete with rm -rf Saw that it was moved to the Recycle Bin. Emptied it, that took less than a minute. How exactly does the Recycle Bin work in this specific case?

Gang, I have my 'appdata' folder split between two SSDs, /mnt/disks/ssdplex/appdata is dedicated to plex, and /mnt/disks/ssddocker/appdata is dedicated to everything else. Two separate SSDs. I also have a separate spinner for sab downloading and unpacking, /mnt/disks/wd500 Can I still use this plugin to backup the two SSDs, and perhaps even the wd500?

THANK YOU guys, I appreciate it. I will make the changes mentioned above and see what you have to say about my config. Pics attached.

Hopefully I'm on the right track with this. These are the "my-APPNAME.xml" files for sab and sonarr from /boot/config/plugins/dockerMan/templates-user And the config.xml from sonarr and .ini from sab sonarr.config.xml sab.config.xml config.xml.from.sonarr.txt sabnzbd.ini

I'm sorry, but I don't know what any of that stuff is. There is a "config.xml" in my sonarr directory, but its only got a few lines. There is none in my sab directory, unless you mean the sab.ini file For Docker templates, is that just a screen shot of the config options when I click "Edit" on the icons under the docker tab? Sorry for my ignorance.

I am still seeing tons of duplicate downloads, same/different directory names. etc. This has been going on since I moved from a standalone sab/sickbeard machine to a docker (sab and sonarr). I don't know if this is a sab or sonarr problem, and I have exhausted all methods I know for troubleshooting. I am tempted to scrap the docker and go back to a separate machine. Initially my old file server (also unraid) still housed all of my media, and my current (docker-enabled) unraid server was running plex to serve it up from the old server. As of yesterday I have migrated all media to the new server, and now docker/sab/sonarr/plex/media all lives on one system. I began to do my weekly cleanup of my media stash, consolidating directories with similar names, removing duplicate episodes (there are always tons), etc. Specifically, here is one case, but it is essentially what happens with all shows: - Browse a show folder, finding "tv_shows/Show (2015)", "tv_shows/Show 2015", and "tv_shows/Show". Cuss loudly, beat keyboard. Go into Sonarr and confirm that "tv_shows/Show (2015)" is the correct folder. Look in all three folders and find lots of duplicate episodes, some with very different file names, some with simply ".1.mkv", ".2.mkv", ".3.mkv" appended to the filename (exact same file, exact same author, exact same file size). Cuss and pound keyboard some more. - Delete dupes, move all media to the correct "tv_shows/Show (2015)" folder, delete now empty dupe directories. - Wonder endlessly why sonarr is not downloading missing episodes, go in and confirm the show is "monitored" and do automatic search for all missing episodes. - Happily watch sab start to queue all missing episodes, leave it unattended for a while. - Come back, look at show folder, find "tv_shows/Show (2015)", "tv_shows/Show 2015", and "tv_shows/Show" again. And duplicate episodes. Again. - Cuss and pound keyboard. - Post in this thread for help. I have no idea, like I said, if this is sonarr or sab causing all this nonsense, and when folks as me "is sab handling renaming" or something along those lines, I have no idea. I copied the settings from my old (standalone server) sab settings because they worked. Sickbeard worked perfectly with all this, and I used it in a docker for a while, and never had this issue, until I switched to sonarr, because development on sb stopped and Sickrage wasn't any better. But every time I post in the sonarr docker container support thread, people's responses seem to indicate this is a sab issue. But this all started with sonarr, so I'm not so sure. If this belongs in the sonarr thread instead, forgive me and I'll move it. In the meantime, if anyone has any ideas, I'm all ears. Oh one more thing... I unchecked the "download propers" checkbox in sonarr, yet I still get huge 1080p files downloaded for shows where 720 or 1080p episodes already exist, just with smaller file sizes. In fact, I have a whole stack of DVDs and Blurays for 80s TV shows that I copied up to the server using MakeMKV, full awesome uncompressed copies, and now I have 100% duplicates that were downloaded (yet sonarr saw all the original episodes from the discs before deciding to download duplicates). I am slowly going through them one by one to check them as "unmonitored" hoping this will help. As is stands now I have nearly a terabyte of duplicate episodes, and I only made it to the "N's" in show titles..... I also have a ton of files with names like "lk1j28fajiw3jlkjaskldjf09ajwpasjd09fj.mkv" which I know is obfuscated, and I still have no idea what that is or what is means, or what show and episode it is, etc. Most of the time when I watch one, it turns out its a dupe of something I already have. This is complete insanity and after months of this I'm at my wit's end. At this point the time I am spending trying to maintain my media library by hand is worth more than spending some money and building a separate server to start from scratch and return to my non-docker days. I'm not blaming unraid, there is obviously a config problem somewhere.

I realize this probably isn't the proper thread for asking this, so forgive me... I just went to Xeoma's website, and its more costly than Blue Iris, plus I have to *buy* updates after a period of time? OK.... Is it really better than Blue Iris?