Help with a few issues


gellux

Recommended Posts

Please don't hate me. This is written as a rant but I just could really use some help.

 

I’m not massively technical and this has plagued me in getting advice before, so please either be patient with me or if I’m too stupid for you, please just don’t bother replying. I’ve tried these forums before for the individual issues and reddit, as well as help from a friend that I’d rather not bother anymore with my silly issues! The thing is, either someone helps me and things have worked out great, or they open another new can of worms, or just doesn't work and we sort of shrug our shoulders and it's left there. When i follow spaceinvader's videos, there's always somewhere that doesn't work as his does, and there's no troubleshooting or even a suggestion that things don't go the way his did, so I just have to stop there.

 

As an intro, I researched building my own NAS, graduating from a Seagate 3TB Personal Cloud to a Raspberry Pi with attached disks, before researching and building my own little server. I used pcpartpicker and built a computer for the first time. The case was too loud so I changed it, and things were okay. I’d link to a PCPP completed build but i get an unknown error on it for some reason. I’ve ended up with a 36TB array (12TB parity) that I love.

Parts list
[hide]MSI B450M Mortar Titanium Arctic
AMD Ryzen 5 1600
2x8GB Corsair Vengeance White RAM (going for the all-white theme)
I have a stupid little GPU that I can’t actually tell if I ever needed, though I could never get the GUI to show before I bought it, so.
WD 12TB
2x WD 10TB
2x WD Red 8TB
500GB m.2
LSI SAS board
[/hide]

 

Now, I’ve always had little snags which have resulted in little odds and ends being unfinished and I wanted to branch out and find somewhere I can try to either get more help or advice. I essentially run Plex and qBittorrent. I wanted initially to run a lot of things such as Calibre/Ubooquity/COPS comic reading app, Jdownloader/youtube-dl subscriptions etc, a Pihole if possible, and a VPN.

VPN/qbittorrent
[hide]The latest issue I’ve been dealing with is the VPN, which, I think, links to a current new qbittorrent issue. I signed up for PIA so I could route qbt through it. I’d been running linuxserver’s container, but downloaded the binhex-vpn container for it. I followed spaceinvaderone’s tutorial. As it stands currently, I have the binhex container which produces an “Unauthorized” page when I try to load the WebUI. Perhaps it attains to sharing the same ports as the OG container, so I changed them. No avail. As spaceinvader doesn’t seem to troubleshoot, I’m at a loss as how to proceed.
Simultaneously, or coincidentally (I’m not sure), the OG qbittorrent now does not add any new torrents. This has happened since creating the new binhex container. I stopped the binhex and restarted but this hasn’t corrected it. I thought I'd got around it by adding the torrent file to my /watch folder, but while that does add it to qbittorrent, when force rechecking, it does not recognise the files, even when i've downloaded it elsewhere, put the file in the correct folder etc. Force recheck has never worked for me with qbittorrent.
I downloaded the PIA chrome extension but haven’t installed the VPN on my laptop as I’m unsure if I have to? I guess I do use firefox, too.
I had initially wanted to be able to access the entire server via a VPN if necessary, ie to pause downloads if someone was home, but as it stands, that won’t be possible.

My last venture trying to set up a VPN to cover the entire server has potentially left my wifi insecure. I was following a spaceinvaderone tutorial into setting up a VPN, but when he goes into his router settings, mine, Sky, didn’t have some settings regarding port forwarding that his did, and so it was half done. I wasn’t sure how to proceed and months, maybe a year later, I’ve changed nothing, and so have potentially left my internet vulnerable.
[/hide]

 

Plex
[hide]Plex is working okay these days, once I changed the settings to always transcode to a low quality 1080p. Before then, the buffering or transcoding would just crash the app on my TV. Things seemed to work okay on laptop, but perhaps that was transcoding automatically. I’d like to watch in higher quality but I’m not sure whether the problem is CPU, GPU, RAM, Plex, TV, connection or what. It was infuriating as we’d sit down to watch a movie and it would stop 5 minutes in and crash the whole app. At times, Plex was totally unusable at all, it simply wouldn’t load. Really I’d just like to watch things at the quality I download them at, which is primarily 1080p Remuxes.
[/hide]

 

youtube
[hide]youtube-dl. I want to “back-up” hate5six’s videos and DaiTanFilms. These are live punk gigs. youtube-dl never worked for me, for seemingly no reason, so I tried Jdownloader2 which downloaded hundreds of GBs for a while until it stopped. I’m now onto using youtube-dl-material which I think works. There are often new videos in the folders, though seems some get missed, but I don’t want to mess it up. However, the Plex folders are pointed at the folder I created with Jdownloader2 which is right next to the one youtube-dl-material created. Can i just move the youtube-dl-material videos over or will they re-download? I don’t even know if it’s downloaded ones I previously grabbed with JD or maybe only new ones. Don’t know if there’s a gap in videos. We’re talking hundreds of videos though, so.

I’ve been using youtube-dl-server to create a little folder of Official Music Videos, which I enjoy on shuffle recreating watching Kerrang/Scuzz/MTV when I was younger. this works quite well with a basic GUI where I choose “Best Video” and it downloads and then I move it to my /officialmusicvideos folder. However, it just stops. There is nothing I can do to make it work again. The container itself works, it just ignores my input. I’m about 600+ videos in, all manually entered, it’s as if it exhausted itself but… I want to keep using these youtube containers but they all just break and I don’t know how to fix them.
[/hide]

 

 

All of these issues, while may seem small to you, have stopped me from proceeding with other ideas and stuff in the past, so while I had bigger ideas for the server and storage, I’ve just resorted to using Plex and torrents, sometimes using FileZilla to download from my seedbox (now that qbt won’t add). As much as I’d like help to fix these things, I’d also like to try to learn and add more suggestions to my box.

I have about 5TB left and need to grab another HDD but unsure these days which to grab. Perhaps stay with the WD theme, and perhaps a 14TB or even 18TB and replace the parity whilst aiming for longevity, as the others can be upgraded up to that, as you all know. However, I get nervous due to the 3.3V pin issue and I don’t like the fact that my HDDs have a bit of tape stuck in there forever.

I’m sorry this turned out more like a rant, but I’m incredibly grateful if you read even one section and especially if you can help me, or fine-tune my system. I feel like I’m missing out on the experience (and speeds, maybe) that others enjoy and just want to join in the fun and show my partner all the cool things we can do/watch/listen to haha.

 

Thanks very much

tower-diagnostics-20210122-2333.zip

Link to comment
1 hour ago, gellux said:

a rant

Not at all. Just several things that should probably be dealt with separately. You can go directly to the correct support thread for any of your dockers by clicking on its icon and selecting Support.

 

Looking at your diagnostics it seems you have done a pretty good job of getting the overall system setup correctly. Just a few things I noticed:

Jan 21 04:40:03 Tower root: Fix Common Problems: Warning: Share Transcode set to cache-only, but files / folders exist on the array
Jan 21 04:40:03 Tower root: Fix Common Problems: Warning: Share completed set to not use the cache, but files / folders exist on the cache drive

Mover ignores cache-only and cache-no shares, so you will have to change that setting on those shares to get them moved.

 

Also, your system share has files on the array instead of all on cache as it should be. And mover can't move open files so if Docker and/or VM Manager are enabled mover can't move those to cache.

 

You can see how much of each disk each share is using by clicking Compute... for the share.

 

Some general advice which you may already know.

 

Parity is not a backup. You must always keep another copy of everything important and irreplaceable. Plenty of more common ways to lose data besides a failed disk.

 

And make sure you have setup Notifications to alert you immediately by email or other agent as soon as a problem is detected.

Link to comment
1 hour ago, trurl said:

Not at all. Just several things that should probably be dealt with separately. You can go directly to the correct support thread for any of your dockers by clicking on its icon and selecting Support.

thanks. even just your reply has lifted my spirits regarding it. it just compounds and makes me feel stupid, plus when i post a query somewhere and people see they're dealing with an idiot they lose interest haha. and i suppose why i would like someone to help me in general rather than separate people helping with separate issues. sometimes i feel like they're all like part of a chain of one issue. 

 

2 hours ago, trurl said:

 

 

Looking at your diagnostics it seems you have done a pretty good job of getting the overall system setup correctly. Just a few things I noticed:


Jan 21 04:40:03 Tower root: Fix Common Problems: Warning: Share Transcode set to cache-only, but files / folders exist on the array
Jan 21 04:40:03 Tower root: Fix Common Problems: Warning: Share completed set to not use the cache, but files / folders exist on the cache drive

Mover ignores cache-only and cache-no shares, so you will have to change that setting on those shares to get them moved.

 

Also, your system share has files on the array instead of all on cache as it should be. And mover can't move open files so if Docker and/or VM Manager are enabled mover can't move those to cache.

these things i've done but the alert is still always there. i worry that i've ended up with too many shares due to spaceinvader videos where he sets up a docker and instead of reusing a share i've done exactly like him and made a new one, ie i have a downloads share and a completed and i don't even know what watched is for.

 

2 hours ago, trurl said:

Some general advice which you may already know.

 

Parity is not a backup. You must always keep another copy of everything important and irreplaceable. Plenty of more common ways to lose data besides a failed disk.

 

that is definitely something i need to look into, though with my lack of ability, i've been put off. i should look into backblaze, perhaps? do they just sync to your array?

 

 

thanks very much for your reply. even just a reply, like i said, has helped me feel a little better about it. i suspect i've messed up in trying to set up a VPN with binhex-qbittorrentvpn and it could have coincidentally messed up qbittorrent linuxserver and plex.

Link to comment
4 hours ago, gellux said:

these things i've done but the alert is still always there.

 

Jan 21 04:40:03 Tower root: Fix Common Problems: Warning: Share Transcode set to cache-only, but files / folders exist on the array
Jan 21 04:40:03 Tower root: Fix Common Problems: Warning: Share completed set to not use the cache, but files / folders exist on the cache drive

Your diagnostics shows me that your Transcode share is set to cache-only. You have to set it to cache-prefer to get those files on the array moved back to cache. And your diagnostics shows me that your completed share is set to cache-no. You have to set it to cache-yes to get those files on cache moved to the array.

Link to comment
1 hour ago, trurl said:

 


Jan 21 04:40:03 Tower root: Fix Common Problems: Warning: Share Transcode set to cache-only, but files / folders exist on the array
Jan 21 04:40:03 Tower root: Fix Common Problems: Warning: Share completed set to not use the cache, but files / folders exist on the cache drive

Your diagnostics shows me that your Transcode share is set to cache-only. You have to set it to cache-prefer to get those files on the array moved back to cache. And your diagnostics shows me that your completed share is set to cache-no. You have to set it to cache-yes to get those files on cache moved to the array.

i'm sure i've either done this before, or they've changed or something. every so often when this problem arises someone says to switch them. but like i said i'm not even sure what the completed share is for, really. i wanted downloads to go to the dwnld share first then when completed, move to the array. so. i guess i need to see which containers are using completed and change that.

 

as for Transcode, is there a way to speed up or make transcoding better? Plex used to be horrendous for me before i changed the default setting to play a low quality 1080p, rather than the remuxes i download.

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.