sonofdbn

Members
  • Posts

    332
  • Joined

  • Last visited

Everything posted by sonofdbn

  1. OK, I thought parity checking involved only reading data and checking that against the parity. But in any case I realised that the read/write stats are cumulative; after clearing the level of activity is much lower. But surely something is wrong with my setup. I'm 9 hours and 7 GB into parity checking, average speed is 226KB/s and estimated finish is in 402 days' time!
  2. Benson, thanks for the suggestion. I've started a parity check: it's S..L..O..W: I'm getting a speed of around 210KB/s (see attachment Parity_check.png). This compares with my parity check one month ago where the speed was 285 MB/s (see attachment Parity_check_previous.png). Now, I must admit I don't believe the previous speed, but it got me to thinking about my dual parity. (Just saw the RFS question: no, I'm using XFS on all data drives, and no single drive has less than 140GB free.) I've been running dual parity drives for a while, both 4TB. Shortly before the previous parity check, I changed one of the parity drives to an 8TB drive, and I'm reasonably sure the recent parity check was after the new parity drive was installed. So possibly the parity speed calculation was actually using 8TB when in fact there was only 4TB of parity being checked. (And the screenshot for the current parity check shows that Total size to be 8TB.) So "real" speed was perhaps half, which is still not bad, but more realistic. So I'm wondering whether there's a problem caused by having two different sized parity drives. Is unRAID trying to do something extra because of the different sizes? I'm leaving the parity check running for now because I can't think of what else to do. From the Main tab in the GUI I noticed that there are a lot of writes being made to the parity drives. Not sure why that would be the case during a parity check. I have no dockers or VMs running, except for CrashPlan which is paused. I have the Dynamix File Integrity plugin, but that is set to not start any checks while parity checking is being done. In the hope that someone can help, I've also uploaded the latest diagnostics, downloaded while the parity check was running. tower-diagnostics-20170626-1026.zip
  3. Not sure how to check read speed. How would I go about doing that? I'd rather not do a parity check now - or is there some other array check that can be done?
  4. I'm only initiating the move from my Windows PC. The files themselves are already on the array, so the network should not be a big issue (I believe). No VMs are running, no dockers running except CrashPlan, which is paused. But OK, let's check this out: I'm now using MC, same files from one user share to another. After a few minutes, MC is reporting a speed of 1.5MB/s. (I don't think it's because doing it via Windows is faster; I think it's because the array is becoming increasingly unresponsive.)
  5. Trurl, thanks for the suggestion. I hadn't thought about the impact of having to spin up the drives. BUT: I didn't want to exaggerate the slowness or writing, so I stated 30MB/s based on what I had remembered. So as a test I'm now moving 28GB of files of 20 TV episodes from one user share to another - so everything is on the array, no network. I'm using Windows to do the move and looking at the progress window after about 10 minutes, the speed never reaches even 3MB/s. I suppose there is some Windows interaction overhead, but even so, this is very slow.
  6. My unRAID array seems to have slowed down markedly over the last few weeks. Copy speeds are rarely over 30MB/s and sometimes down to under 1MB/s using MC (and this is copying within the array, not across a network). I always thought I had found a reason (Windows PC backing up to the array, Plex docker doing some indexing/updating, CrashPlan docker doing backup, etc.) but I'm not seeing any consistent cause. I've also tried stopping the various dockers, but write/read is still very slow. I have 6 data disks (mostly 4TB) and 2 parity drives. I have a flashed Perc H310 which has been working fine. CPU is a Xeon D-1541 on a Supermicro X10SDV-TLN4F motherboard (but I use only gigabit ethernet) with 32GB RAM. I upgraded to 6.3.5 today, but the array is just as slow. I think I must have something setup incorrectly, so I thought I would see if anyone could help out here. I've attached the diagnostics file. tower-diagnostics-20170623-2259.zip
  7. I'm having the same problem. Anyone know how to get back the transfer status?
  8. I saw from the Web UI that a new version of PMS was available, although it said "Please install manually". I'd read somewhere that the docker installs PMS updates automatically when it restarts, so I went ahead and restarted, after which I couldn't get to the Web UI. After a few restarts and searching around, I checked the Plex log from the unRAID GUI Docker tab and saw that the log ended with a message about trying to install the latest version. I tried restarting and waiting a few minutes, but the log never seemed to go beyond that message. In the end I deleted the VERSION variable, and now PMS is working as before. Anyone else having a problem with the update? On the other hand, it's not impossible that I borked something...
  9. For anyone still following this thread... Emby was sort of OK, but doesn't automatically generate folder thumbnails in all situations, and there's nothing in the photo/video thumbnails to distinguish between photos and videos. I took a brief pass at Tonido, but the sharing wasn't quite what I wanted (and it seemed to leave Tonido .db files in every folder). It seems interesting for other use cases, but not for what I wanted to do. So I thought, why not just go back to using Synology's Photo Station? It's not particularly well-documented, but although the Photo Station Uploader gives the impression that it converts uploaded photos and videos, it actually generates thumbnails and alternative resolution videos in addition to uploading the originals. One nice touch is that it can be set to ignore duplicates, but the downside is that there's no logging, so you can end up with empty folders because (correctly) the files are duplicated elsewhere, but if you need to know where those files are, you have to find them yourself. The other downside is that sometimes it thinks files are duplicates when they aren't. For example, if there are two different files named DSC0057.jpg in different folders, it seems to think they are the same, and there doesn't seem to be a way of fixing this. The other downside is that the thumbnail/video generation takes a while and ties up the uploading PC. An alternative is to simply copy the photo/video files into the right folder and let the NAS do the thumbnail/video generating. Unfortunately with my DS414, the CPU is quite limited, so this takes a huge amount of time compared with using the uploading software on a PC (which is already quite slow). Part of my original objection to using Photo Station was that this meant having to keep another copy of my photos/videos on the DS414, but the positive angle is that I can think of unRAID as keeping the backup copy of the files. While I was waiting for Photo Station Uploader to finish another batch of files, I idly googled Plex again and found a forum thread where it was mentioned in passing that Plex does in fact now handle photos and videos in the same folder. (I couldn't find any reference to this in the Plex documentation.) And it turns out that this is in fact the case, and it works beautifully. I installed the Plex docker on unRAID and set up a library of photos and videos very quickly. (To be fair, the unRAID CPU is much faster than the DS414 one, and also I think Plex is not generating videos in alternative resolutions.) I need to do a little more playing around with Android clients, but for now Plex seems like a good solution.
  10. Well, after a little more hunting around, it seems that Emby might work. I saw in the Wiki for Emby that there is a content type called "Unset (mixed content)", but it turns out that this is not photos and videos, but perhaps TV shows and movies (based on some quick and not definitive googling). Just as I was about to give up on Emby, I noticed that in the content type options there was one for "Home videos & photos". A quick test showed that it seemed to work as expected, and now it's trundling through my photo/video files. Let's see how that turns out.
  11. Before I resuscitated my unRAID server, I got a Synology DS414, which has a package called Photo Station. This lets users browse photos AND videos stored on the Syno, using IOS and Android apps. It works beautifully with my folder structure, because I usually take photos and videos on my camera and import them into folders that are named by date plus descriptor. So, for example, the family knows that 2016-12-20 Holiday has the holiday photos and videos from that date, and they can easily browse there via a Syno app (DS Photo) and see the photos or videos, and the thumbnails are shown quickly, so it's quite a smooth experience. (However, the uploading part is clunky, but my guess is that this is in part to generate the thumbnails while uploading, so it doesn't have to be done on the fly.) I now have my photos/videos on the unRAID server, and would love to have similar capabilities without having to copy everything across to the Syno. I thought at first that the Plex would work, but a) it seems it can't handle folders with both photos and videos and b) even just browsing photos is for some reason quite slow, with some people speculating that this is because of thumbnail generation. So my question is whether there's anything I can run on unRAID that will give me similar functionality. I've read some of the comments on these forums on Photoshow, Piwigo, Lychee and possibly others, but they seem to handle only photos. Any suggestions?
  12. OK, problem solved: I was using Chrome as the browser. I switched to Edge and the cursor was there. Apparently Firefox can also be used: https://lime-technology.com/forum/index.php?topic=44708.0
  13. I'm trying to install a VM for the first time. It's a Windows 10 VM and although I eventually got it more or less done, I have a problem with the QEMU window that opens when I click on VNC Remote on the VM dropdown. Whenever I move the cursor over the QEMU window it disappears, so I have to use keyboard input to do the install, which is a pain. I'm running the install from my Windows 10 desktop, and there is nothing attached to the unRAID box in terms of mouse or keyboard, and there's no GPU passthrough. The keyboard input is coming from my desktop keyboard, but my desktop mouse cursor is not showing up. In the gear wheel settings icon in the top right of the QEMU window, there is an option for local cursor, but I'm unable to select that (or any of the other check boxes). How can I get the cursor to show up in the QEMU window?
  14. I had the same problem using the downloaded Windows 10 iso, but I typed "exit", which took me to the BIOS and I selected the EFI DVD Rom drive (or something like that - it was the first boot option) and the install started.
  15. In the end I went with a Corsair RM650X. One thing that I hadn't thought about was the number of SATA connectors that provided on the cables. There are 3 cables x 3 connectors, so I'm just OK for 5 data disks, 2 parity and in future 2 SSDs for cache/VM. But because of cable routing, it would have been nice to have another cable for more flexibility. I could do something with splitters or molex-to-SATA connectors, but the tidier solution would have been another SATA power cable. I was tempted to grab one of many (unlabelled) old cables from old PSUs that all seem pretty similar, but fortunately I read the thread here: http://lime-technology.com/forum/index.php?topic=53341.0. Looking back, I realise now that smaller PSUs may well be more efficient (in terms of power provided to power needed), but they often come with fewer SATA connectors. How do other users connect their drives to the PSUs once they exceed the connectors provided with the PSU cables? I've read reports of poor quality splitters - are there any recommended brands?
  16. Yes, it's been done before, though different Qnap model. https://lime-technology.com/forum/index.php?topic=50432.msg484485#msg484485
  17. Thanks for the advice; didn't know about this possible TRIM issue.
  18. I am planning on moving my unRAID to a Supermicro X10SDV motherboard and install a flashed Dell Perc H310 controller card. The mb is limited to 6 SATA connections, while the H310, which will sit in a PCIE 3.0 x 16 slot, will support 8 SATA drives. I'm intending to have 2 parity disks, 5 data disks and perhaps 2 SSDs for a cache pool. Will it make any difference whether I connect disks to the mb or the H310? My main objective is to minimise the time for parity checks. So, for example, would it be better to share the hard drives between onboard SATA and the H310, or to have, say, all the hard drives on the H310? Or would it not make any difference? Is there anything else I should consider when allocating the drives and SSDs to the onboard SATA and the H310?
  19. Thanks, that gives me some reassurance. Thanks. I have your various helpful posts to thank (blame?) for choosing this hardware (ECC, Passmarks, comparing Xeons, etc.)
  20. I'm finally upgrading my unRAID machine. The current one is running 6.19 and I'd like to upgrade to 6.2 (mainly for dual parity). I'm debating whether I should upgrade to 6.2 first and then migrate to the new machine, or shift everything to the new machine first (and make sure it's working) before upgrading. Currently I have 6 hard disks on a Supermicro C2SEA running a Pentium E6300. The new machine will be a Supermicro X10SDV-TLN4F with onboard Xeon D-1541 and a Dell Perc H310. If I upgrade first, I can't add dual parity because I have no more SATA ports, but at least I'll know that 6.2 is OK on the current setup. If I move to the new machine first, the potential problem is that if there is any hitch with upgrading, I might not know if it's a hardware or software issue. I'm tempted to move first, because the hardware is quite mainstream and it shouldn't be a problem (touch wood) getting 6.19 and then 6.20 working on it. Any thoughts on this?
  21. I'm finally close to upgrading my unRAID setup to a Supermicro X10SDV-TLN4F with 32GB ECC RAM. The board is limited to 6 SATA slots, so I'm planning on getting a Perc H310 controller, and in total using 7 hard disks and 1 or 2 SSDs. No GPU (no spare slot anyway, after the Perc). I'm guessing a 450W PSU would be enough? Unfortunately I'm not in the USA and I can't get many 450W PSUs that are Gold rated. I'm looking at a Seasonic G-450 (5 year warranty) or Corsair RM650i (10 year warranty). Although 650W is probably much more than I need, unfortunately the only bad PSU I've had to replace was the most expensive one I've bought so far, a Seasonic X-Series, so I'm tempted to look at another brand. Yes, I'm probably just unfortunate, but still... Any suggestions/comments would be appreciated.
  22. (I love unRAID, but the documentation.... ) Since I couldn't find any alternative I rebooted and I'm going through a parity check. FWIW, I'm on 6.19 and the Main screen shows webGui v2016.03.04.
  23. Since powerdown doesn't seem to be, well, powering down, I thought I should look at the Wiki for guidance at http://lime-technology.com/wiki/index.php/Console#To_cleanly_Stop_the_array_from_the_command_line. Seemed straightforward enough, but failed at the first command. Wiki says: /root/samba stop My console replies: -bash: /root/samba: No such file or directory After some digging around, there IS a samba command in /usr/sbin but I don't know whether I should use that. I'm at the outer limits of my linux abilities here, and my googling only shows that there are about a zillion versions of linux out there.
  24. This is the webGUI problem being discussed here: https://lime-technology.com/forum/index.php?topic=51891.0
  25. I've found that I can still get to the command line via telnet using the IP address, and "top" shows that there's still something doing on, but I have no idea whether the array is shutting down or restarting or something else. User "nobody" has a Time+ entry of 70:44.49, and command is privoxy.sh - I'm guessing this means the array hasn't shutdown yet?