tmchow

Members
  • Posts

    441
  • Joined

  • Last visited

Everything posted by tmchow

  1. I'm familiar with hard links and in my question to fully automate all my torrents and usenet for media, many of the apps have options for hard links which makes sense to reduce actual disk usage. Normally if I was dealing with a single large disk, i understand how this works. However, with Unraid I'm worried about potential weirdness. For example, for torrents, I keep them on a single disk location (/mnt/disk3/torrents/seeds/) to prevent all disks from spinning while seeding (aka limiting only disk 3 to be spinning). I have Deluge setup to move to different folders within /mnt/disk3/torrens/seeds/ based on labels --- e.g. /mtn/disk3/torrents/seeds/movies vs. /mtn/disk3/torrents/seeds/tv. Couchpotato is in the picture and it's currently watching that folder, and then copying the file the proper movies user share (/mnt/user/media-movies/movies/) which is set to be able to distributed across all my disks in the array (4 disks). I have it setup to not use hard links. I am trying to setup Sonarr now, and started thinking about how this should work. Sonarr will monitor torrent sites, queue to deluge and it has a setting for "Use Hardlinks instead of Copy", which I have disabled as well. So my question is that since torrents are downloaded to a single disk (disk3), how do hardlinks work? My assumption is that it won't work well since the torrent seeds only live on disk3, but the array is meant to be spread across all four disks. My thought is that these media files will NEVER be split across the 4 disks and only live on disk3. is this correct? If not, where is my thinking wrong? How can I better set this up?
  2. Stupid config problem, got it working for monitoring. Duh. For deluge TV torrents, I can get the files to /data-final/tv, but want something to monitor that folder to move into the correct folder for TV. I'll start another thread for it since this thread is largely solved by my stupidity
  3. Got OpenVPN-AS installed yesterday and started the webGUI. I stopped the docker this morning as I wasn't set with config and didn't want it running for no reason. I got home tonight, restarted it and it can't seem to start. It dies after it tries to pull files for update. here is snippet of last lines from docker log: Get:26 http://mirrors.accretive-networks.net trusty/restricted amd64 Packages [16.0 kB] Get:27 http://mirrors.accretive-networks.net trusty/multiverse amd64 Packages [169 kB] Get:28 http://mirrors.accretive-networks.net trusty/main amd64 Packages [1,743 kB] Get:29 http://mirrors.accretive-networks.net trusty/restricted amd64 Packages [16.0 kB] Get:30 http://mirrors.accretive-networks.net trusty/universe amd64 Packages [5,859 kB] Hit http://mirrors.accretive-networks.net trusty/universe Sources [7,926 kB] Hit http://mirrors.accretive-networks.net trusty/multiverse Sources [211 kB] Err http://mirrors.accretive-networks.net trusty/main amd64 Packages 406 Not Acceptable Err http://mirrors.accretive-networks.net trusty/restricted amd64 Packages 406 Not Acceptable Err http://mirrors.accretive-networks.net trusty/universe Sources 406 Not Acceptable Err http://mirrors.accretive-networks.net trusty/multiverse Sources 406 Not Acceptable
  4. Still having these problems and no idea how to fix it. It's amazing how slow a delete and copy is.
  5. Thanks, can't believe I Missed that. One weird thing is that the torrent file is named "file.torrent". I'm guessing subsequent torrents downloaded will have a problem since they use the same filename. Even if they don't, and for some reason it's incremented, I dislike this since I don't know which torrent file is which. Not sure if this is due to Deluge, or the Remote Torrent Adder chrome extension. I've verified the private torrent site I'm downloading from doesn't have the torrent file named file.torrent. It's in the format of stuff like "SomeMovie.2016.x264.torrent". Update: Figured out the problem was the "Remote Torrent Adder" extension, which always used file.torrent filename. I switched to the DelugeSiphon plugin and the original filename was passed through.
  6. Movies are correctly put in /data-final/movies, so looks like my config of the label handling is right. First problem is that the .torrent file is always named "file.torrent" and put in /data-final/. Right directory, but useless filename. I would've expected it to have the original name (e.g. SomeMovie.2016.x264.foo.bar.torrent) which I see if I was to download the torrent directly on my windows desktop. How do I get the original .torrent file name so there's no stomping on successive downloads? Update: Figured out the problem was the "Remote Torrent Adder" extension, which always used file.torrent filename. I switched to the DelugeSiphon plugin and the original filename was passed through. Second problem is that I can't get the movie to /mnt/user/media-movies/movies, without affecting the seeding. Couchpotato is finding the files in /data-final/movies, and moving it to the user share for movies. I really want Couchpotato to not move it, and instead just copy it with the new name so my seeding is unaffected. Update: Found solution! Couchpotato settings has an option for move/copy/link, and default is "move". Now this leaves this last question I had in my original post about how to get NZBGet and Sonarr to work properly. Do I use NZBGet categories to specify to move it into the proper folder (mnt/user/media-tv/tv/) or do I have NZBGet put it into a generic completed downloaded folder (e.g. /mnt/user/downloads-completed), and let Sonarr monitor that folder and do the moving and renaming? I currently have "Completed Downloaded handling" enabled in Sonarr for NZBGet.
  7. None yet that I can tell, perhaps it's just me being paranoid. i don't like the idea that unraid is expecting all the folders and files to be owned by "nobody" by then there rogue files in the shares as "steve". Like I said, maybe I'm being too paranoid, but I've been bit by folder permission issues so many times on my last Windows Server box (that this unraid box is replacing), I'm being ultra cautious. The way I see it, there's no downside to forcing "nobody" as the owner.
  8. Goals: 1. Want to use my Windows desktop like I do today to browse private torrent sites and initiate downloads. This is for both TV and Movies. 2. Instead of downloading them locally on my Windows PC and copying to Unraid, I want all the downloading to happen on the unraid botx. 3. Furthermore, after downloads are done, I want to put them them on a single disk in the array for seeding, but get "automation" to happen to place it in the proper media What I have working so far: 1. Automated TV Show downloads with Sonarr and NZBGet: Sonarr and NZBGet are both running (dockers) and work together. Sonarr monitors shows and can download automatically using NZBget, shows get moved to the right TV folders (/mnt/user/media-tv/tv/<show>). This also works for manually selected shows within Sonarr. 2. Manual downloads from Windows desktop: I have the nzbget-chrome extension running on my Windows desktop machine, which can queue to NZBGet on my unraid server and correctly downloads. I'm using the NZBGet category settings to correctly move completed downlaods to the right movie/tv folders. 3. Deluge installed, can download torrents: I have Deluge installed in a docker on unraid and it can download torrents seemingly fine. I'm able to also queue them up from my Windows desktop using the Remote Torrent Adder chrome extension. These are my mappings: I have these Deluge settings. Note that I have 2 labels setup ("tv" and "movies") with move settings to get the tv/movie files into the right places in my user shares: What I don't have working / Questions: Verifying the correct understanding of all the apps Is this understanding correct of each app? I'm pretty certain it is, but want to verify. Deluge: Torrent client NZBGet: Usenet download client Sonarr: Watches for TV shows on torrent sites or usenet, integrates with NZBget to do the downloads. Also can rename files. Couchpotato: Same as Sonarr, but for Movies Complete e2e automation for Torrents, ending with couchpotato and plex As mentioned above, I have Deluge working to download torrents, but the e2e workflow isn't quite there. I'm using labels to get some automation using 2 labels (tv, movies) as mentioned and shown above). It seems like something is off because torrents don't end up in the right places that I expect them to, and sometimes the torrents seam to totally disappear. My goal is to have a separate are (/mnt/disk3/torrents/seeds) where I'm seeding torrents for the minimum time the trackers need me to, while still getting the final movie/tv show into the place where it belongs on my user shares (with cleaned up filenames and in the right folder structure). I also in the end want to have deluge be a catching point for various torrents to get downloaded, then route them to the right place. I then want Couchpotato to scan for changes, then do it's magic and notify plex so it can update the library. Am I doing too much with deluge and should rely on couchpotato more to do the moving? What's wrong with my setup? Best way to handle manual download case (Windows PC-->Unraid NZBget)? For #2 above, is using NZBGet categories the right way to handle manual downloads I kick off from my desktop PC (vs. the unraid server automatically kicking it off Sonarr-->NZBget)? When I kick a download off manually, it will copy the file to the right location, but Sonarr isn't involved in any way so my shows aren't renamed correctly. I have to go into Sonarr to invoke the file renamer. It only takes a few clicks but it's a manual step I want to avoid. I'm thinking something like Windows PC-->Unraid NZBGet-->copy to right user share-->notifies Sonarr which kicks off renamer. Is this even possible? Note: I could avoid this case by always using the Sonarr webUI to kick off the downloads, but I'm trying to handle all possible cases.
  9. the answer to that, is wherever you have configured it to store them :-), if you havent configured it then i think it doesnt store them at all, but you can tell it to do this, its all in the webui config. I have these configurations set: Looking at /mnt/cache/appdata/deluge and /mnt/cache/downloads/deluge/, no .torrent files are there.
  10. Perfect, this solution worked. Just tested it by copying a small text file into one user share where the wrong permissions were being applied before. I'm puzzled why this isn't the default config out of the box.
  11. FYI, Linuxserver successfully downloads now. Just switched from LimeTech to Linuxserver using these instructions: http://lime-technology.com/forum/index.php?topic=41609.msg394769#msg394769
  12. Just attached diagnostics to my original post. Sorry about that. This delay isn't second, it's more like minutes, so don't think it's disk spinup.
  13. I'm copying media frequently from my Windows desktop PC to my unraid box. Things like Torrents and Usenet are done on my desktop PC (not sure if I'll bother migrating this to be something that only lives on my unraid box). Prior to unraid, I had a Windows server that I would copy over the network all the time. That box acted as my Plex Server and NAS, and things worked really well. However, what I discovered is a permission issue with Unraid. Limetech's Plex docker runs as "nobody", but when I copy over files from my windows box, the owner user is "steve" (assume "steve" is my windows user account name). Ditto if I create directories. I can easily fix this by running newperms, but don't want to have to keep doing that. I don't want permissions to be mucked up in confusing state between "nobody" and "users". What is the best practice here? Surely I can't be the only one in this boat?
  14. I have my Unraid box all setup and everything seems to be working fine, except for when I try to manage content through network shares from my Windows 10 desktop PC. When I'm SSH'd into the Unraid box, copying files around and deleting is no problem locally. From my Windows 10 desktop PC, it's painfully slow to interact with the Unraid shares. If I try to delete a movie, windows will show the deletion dialog and it can take several minutes before anything happens. Ditto with copying. Sometimes it'll give me a timeout error and not do anything. Here is the most common example, where I'm just copying some files over from a torrents directory on my windows PC to the corresponding TV user share on Unraid: Just took above screenshot now when I reproduced the problem, and it sits there for nearly 2 minutes before doing anything. After that, it will either start copying, or give me an error timing out like this: If I hit "Try again" it usually works, and immediately starts copying the files. I only have 1 PC in the house so not sure if this will repro on another machine, but given nothing seems to be wrong or slow locally while interaction with the user shares on /mnt/user, I'm guessing this is some incompat with windows? I tried searching but couldn't find anything recent and refuse to believe this is just an isolated case for me. tower-diagnostics-20160326-2020.zip
  15. I got mine working too by just using LimeTech's. I really want to switch to Linuxserver to get plexpass and easier updating, and it seems that switching between Limetech and Linuxserver are the easiest variatns to switch between because they do the permissioning automatically. The thing your post solves for me is my lack of remote access. I've been tearing my hair our for hours trying to figure out why it doesn't work and I have jumbo frames enabled! Disabled it and remote access worked. Thank you!
  16. Are you able to able any other dockers? Is your server connected to the internet? have you tried pinging google to make sure? I can definitely install other dockers. This happens with only the linuxserver dockers (at least the ones I've tried: Plex and nzbget)
  17. Are you able to able any other dockers? Is your server connected to the internet? have you tried pinging google to make sure? I can definitely install other dockers. This happens with only the linuxserver dockers (at least the ones I've tried: Plex and nzbget)
  18. Are you able to able any other dockers? Is your server connected to the internet? have you tried pinging google to make sure? I can definitely install other dockers. This happens with only the linuxserver dockers (at least the ones I've tried: Plex and nzbget)
  19. Super basic question, but where does Deluge store the .torrent files that are active? I got it installed in a docker and able to queue torrents for download successfully through the "Remote Torrent Adder" chrome extension. However, I have no idea where the .torrent file actually is stored?
  20. Almost complete. Now that you have rebuilt your parity drive you need to check it to make sure it was built correctly. Assuming you didn't mean that above. When I re-enabled the drive, it took 9-10hours. Isn't that equivalent to a "check"? No it just recreated the parity. You can tell for sure by looking at the GUI. You should see on the main tab in the GUI either "Last checked on ..." if the check has been run or "Parity check not run" or close to that I don't have any servers in that state currently to give you exact wording I'm going from memory. Thanks! Didn't realize that. Just kicked off check now.
  21. Almost complete. Now that you have rebuilt your parity drive you need to check it to make sure it was built correctly. Assuming you didn't mean that above. When I re-enabled the drive, it took 9-10hours. Isn't that equivalent to a "check"?
  22. Still getting the error today 3/24 @ 10:33AM PST. IMAGE ID [3ae61bd06450]: Pulling image (latest) from linuxserver/plex. Pulling image (latest) from linuxserver/plex, endpoint: https://registry-1.docker.io/v1/. Pulling dependent layers. IMAGE ID [f7eef3e8d2a5]: Pulling metadata. Error pulling dependent layers. IMAGE ID [3ae61bd06450]: Error pulling image (latest) from linuxserver/plex, endpoint: https://registry-1.docker.io/v1/, HTTP code 400. Error pulling image (latest) from linuxserver/plex, HTTP code 400. TOTAL DATA PULLED: 0 B Then IMAGE ID [3ae61bd06450]: Pulling image (latest) from linuxserver/plex. Pulling image (latest) from linuxserver/plex, endpoint: https://registry-1.docker.io/v1/. Pulling dependent layers. IMAGE ID [f7eef3e8d2a5]: Pulling metadata. Error pulling dependent layers. IMAGE ID [3ae61bd06450]: Error pulling image (latest) from linuxserver/plex, endpoint: https://registry-1.docker.io/v1/, HTTP code 400. Error pulling image (latest) from linuxserver/plex, HTTP code 400. TOTAL DATA PULLED: 0 B
  23. Finally got the data all copied over after 3 days using rsync on the unraid box. Painful part was reenabling parity and waiting 10 hours for it complete but at least I'm done now