Alex.vision

OK, Round two. I made the suggested changes from above; I also changed out my Marvell based HBA to an LSI model. I also upgraded to version 6.8.2 with the same results. I had thought the problem might have been solved, but the past week and a half my server really struggles to maintain any uptime. It locks up constantly, but I think I finally managed to get a log file that might help. In my last attempt to fix my problem myself, I erased my flash drive and started over, importing just a few settings from the old one. I thought maybe something on it was causing problems. Apparently not. I’m uploading to log files, one mid lockup and one after I hard reset the system. I can see a bunch of information starting on line 2810, but I don’t know enough about Linux to say if it really is bug or what not. I really hope this is something I can fix. alex.vision (crash) media-syslog-20200227-0511.zip alex.vision (next boot) media-syslog-20200227-1636.zip

Well it has been a few days, and I have been walking on eggshells when it comes to running my server. It seems that either turning off the ram overclock or changing the Power Supply Idle Control seems to have remedied my random reboot issue. Thank you @johnnie.black and @Squid for the troubleshooting help. I have 2 days and 16 hours of uptime, which is way better than it has been in the past. I still have docker disabled but i'll work things back in one step at a time. A functioning system minus a few features is way better than no system at all. Thanks for the help!!

jonnie.black Thanks for the help, I'll change the ram settings and look for the power setting when I get done with work. I would have done it this morning but I wanted to let memtest run for a good 24 hours. Could you tell me where that Ram chart came from? I guess I thought that because it was 3600 speed ram it wasnt really overclocked, even though I had to use XMP or DOCP. I think I remember the old days when it said 2667, 3200(OC), 3600(OC) on the box. I'll do some googling on the "typical current idle" too. Thanks

Ah ok. Ill Reboot and start a Memtest Cycle

Hello fellow UnRaiders, Issue My machine locks up randomly, never running for more than 2 or 3 days. I had originally thought it was related to my pi-hole docker, it seemed to produce the problem more frequently when I was running docker. However, with that disabled my machine still crashes. I can’t ping the system or reach any share. When I had the GUI enabled it would be completely frozen at the login screen. A few times I had been logged into the system and was running htop full screen, it would also be frozen, requiring a hard reset. System stability is so bad, I can start the computer in the morning and within a few hours it has locked up. Machine Specs MB: ASUS Prime X470-Pro (Bios Version 5406) CPU: AMD Ryzen 5 3600X (Stock speeds) (Stock Cooler) Ram: G.SKILL Ripjaws V Series 16GB (2 x 8GB) 288-Pin DDR4 SDRAM DDR4 3600 PSU: CORSAIR RM Series, RM850, 850 Watt HBA: AOC-SAS2LP-MV8 (I know it’s a Marvell based card; I’m swapping it for another LSI I have) External Das Card: LSI SAS 9212-4I4E Single Connected to 16 Bay Das. Drives: 22 8TB Data Drives, 1 8TB Parity and 1 8TB Cache Drive, mostly Seagate, some Western Digital. GPU: Gigabyte Video Card Graphics Cards GV-R523D3-1GL REV2.0 Attempted Fixes Ran in safe mode, no plugins, disabled docker, disabled VM’s. Disabled HT in bios. Disabled any extra mb ports, like serial and floppy support. Ran without the array started. I have run in GUI mode, GUI Safemode, no GUI and headless. I have run fix common problems, and other than the complaint about the Marvell, all seems well. No obvious issues. I haven't been able to run Memtest86 on this new board, for some reason it won't launch, it instantly reboots after I select it in the UnRaid boot menu. Unraid Versions I don’t keep the best records of the versions which work and which have problems. I can't remember what version I was on when this problem started after I built the thing. I do know I’m currently on 6.8.2 as of today, I was on 6.7.2 and worked my way up through each RC version up to 6.8.2 now. On each version I had crashes, but I just today went to 6.8.2 so it may or may not last. If (when) I crash on 6.8.2 I will post that current syslog too. Final Thoughts I’m attaching two photos of what displays on my monitor when the system locks up. I’m also attaching 2 diagnostic files, 1 from just after rebooting from a lockup (6.8.1). The second one is after my update to 6.8.2, I'm not expecting either log to have any big revelations, I think the photos of the screen might lead me in a better direction, if I knew what they meant. I'm at a complete loss here, and would love if someone could help me diagnose my problem. Alex.Vision Log 6.8.1 post Crash 1.zip Alex.Vision Log 6.8.2.zip

Oh, ok. Ouch, these 8TB take a while, but I guess that's the cost of doing business with large drives. Thanks for the help, it is greatly appreciated. Now I have to figure out why the thing crashed in the first place. On to the next mission....

I guess I missed the part about it being a different log. My wife set down my dinner right as I was typing this up, so steak and potatoes made me read a bit faster than usual. I knew I was going to miss something, I so rarely have issues, that when one comes around I lose basic sense and become "that guy who can't rtfm". I've attached the log you requested. MEDIA-preclear.disk-20181009-0749.zip

I'm experiencing a slight problem with gfjardim's preclear plugin. I was right in the middle of a 3 cycle run of preclears on 2x 8TB drives when my server locked up and the webUI and the local GUI were completely frozen. I was forced to hard reset the server. After coming on line and restarting my array, I was able to resume both preclear runs. One of them began running right from where it left off. The second drive seems to be stuck at "starting", but nothing is happening. That was over 12 hours ago. I left it overnight and while I was at work just in case. The preclear log for that run seems to be stuck at " Type Yes to proceed:" I'm running unRaid 6.5.2 Preclear Ver 2018.09.20 I know there are updates to both, I was right in the middle of clearing these drives, so I didn't want to change anything and have to start the process over. Any thoughts on what I can do to get this preclear to resume from where it left off, or do I need to start over? Can I update the preclear plugin while running a preclear on a drive? My first reaction was that I better not. Thanks for any help. syslog.txt

I'm not sure if anyone noticed but the picture you uploaded of your Asus router shows you using 4-6MB/s. If your camera traffic really is only that much, and is traveling over the router, than its hardly any traffic at all. I may be missing something but it sounds like a different issue. I have a few cameras on my network and I have their settings turned down quite a bit so they use almost no traffic. If your bit rate and fps are low enough then you can mitigate the camera bandwidth. I would take a top down view of your network segments, specifically the wiring of file server to the backup server, server to media player and cameras to DVD computer. If any of these run on the same cable or the same switch fed from the same cable you could run into issues. I just finished transferring about 80TB of data from my Unraid server through my network to my backup computer at the other end. All while streaming videos on my and my wife's computer. I have a single cable going to my server room switch and all that traffic from all of my clients travels down one wire. So I should have experienced something similar I would think. I'm wondering if it was not a network traffic issue but a potential disk io problem. Perhaps the media you were streaming was on one of the drives being hampered by the file transfer. Curious to find a solution. I'm late to this party if your already ordering new network cards but I felt obligated to discuss some of the basic things I saw. But it is past my bed time so maybe I'm seeing things that aren't there. Sent from my iPhone using Tapatalk

If I'm understanding the problem correctly, your difficulty is that the default name for the diagnostic file is something like tower(date.string).zip and you have to many to easily sort when trying to help someone. If that's correct why not just suggest that people rename the diagnostics file when they upload it. Perhaps adding their forum user name to the beginning of the file name. The diagnostic file could also be generated with a random name. Then when you have a bunch in your downloads folder they could be someone easier to search for. At work we use number strings at the end of files to make searching for stuff easier. Something like (4070.86). While not as easily read by the human eye while scrolling it is super easy to search for in a couple of seconds. There should be a balance between changes the user can make to help people diagnose their system, but also still be easy for noobs to handle. While changing the server name is fairly easy, the wiki and most forum members refer to "Tower" when helping which could be somewhat confusing. Just a few thought. Sent from my iPhone using Tapatalk

Just out of curiosity is their a noise limit on your system you want to hit? That's an expensive case if you don't need the noise damping. You didn't list that as a requirement so I figured I'd ask to see if you might be able to sacrifice on a cheaper but noisier case.

It will be a separate system. I will most likely plug in the 10 new drives periodically into my main desktop, use Drive Pool to mount all the drives as one large single disk, then use beyond compare (on my windows desktop) to sync the two systems. If the drives were not external I would just make another unRaid server, yet since they are, managing which drive has what data on it could become an issues. Right now I'm just trying copy all of my data to new drives, with having three disks down on my unRaid box it means I don't have any protection against other drive failures, so I'm backing it all up as fast as I can. Once that's finished I'm going to pull my three bad drives (all of which are the exact same models) plus one other disk of the same make. Im going to try and swap the control board to see if I can access the data, it could be that the bad back plane only smoked the control boards to the disks, not the disks themselves. If I can recover that data, then I will be super happy. Ill replace those three drives with new ones, reinitialize my array with the new disks, and bring it back online. At that point with my array back online and protected, I may void the warranty and pull my new 10 8TB drives out of their enclosures and put them in a new server box running unRaid, and run it as a backup that way. Super long and convoluted method perhaps, but its what I came up with as the best option I had. Right now I am still preclearing half of new drives @ 131 hours each, while also copying the first 8 array disk to the new external ones. I've been kicking myself this whole time, why didn't I move all of my hardware into this case, test it, THEN plug in the disks. My mistake of rushing through things my have cost me 12TB of files. Wont be making that mistake again.

The 10 new 8TB drives are part of a separate build. I've needed to build an actual backup server for a while, but it's hard to do when you want to back up 80ish TB's of data. The best deal I could find on HDD was for 10 external USB drives. So despite the headache of that it was worth $20-30 less per drive to go that route. I'll use something like Drive Pool to map them all together then use beyond compare to sync them with my array. Sent from my iPhone using Tapatalk Edit: can't quote proper portion on my phone Edit: there we go

86TB array with dual parity. Using 20 4TB disks and 1 6TB disk. 1 2TB Cache drive. Though I will say that I just lost three drives due to a Norco backplane failure so I'm down 12TB. I just purchased 10 8TB drives to make a backup though. Sent from my iPhone using Tapatalk

Recently I swapped out my Supermicro MB and i3 540 for something will the little more power. I bough an Asrock x99 extreme6 and an Intel e5 2670v3 ES with 24GB of ram. I completed the swap of parts and added an extra AMD R7700 for graphics. Took forever to find a USB port that was recognized for booting, but finally I was able to get the system to boot properly. At this time I also upgraded from unRaid 6.2-rc4 to 6.2 and everything seemed to be fine. I started this upgrade because my old CPU was struggling to preclear 2 new 6TB drives, so I thought the extra CPU power would be a good thing. Got everything updated in the plugins department and went to town preclearing the new drives. I went to sleep that night and when I woke up my server was frozen. I have done some investigation after this went on for multiple days both while preclearing and while the server was idle. I finally got fed up with the issues and ran memtest, which apparently I forgot to run months ago when I got the hardware. My No1 ram stick was really bad. I pulled it and went down to 2 8GB sticks. I found the memory issues last night, so after booting back up I started preclearing 2 more 6TB drives. This morning I woke up and checked the status, unRaid was unresponsive. I didn't get a chance to check anything until just now after work. I have attached a screenshot of what was on my monitor at the time, as well as the diagnostics file. I know hardware problems can be tricky to diagnose, but I am wondering if its something I may have set up incorrectly in the UEFI. I have an odd setup where I have 12 drives inside the case with 8 hooked up to a Supermicro AOC-SAS2LP-MV8 and four on the MB sata ports. I have an additional 15 drives plugged into a DAS unit running to an internal Lsi Sas 9212-4I4E card. Nothing about the HBA's/Drive layout has changed since the MB swap, so I don't think its the issue, but I am willing to investigate as much as I can. Any Ideas? UnRaid Box Unraid 6.2 ° Asus x99 extreme6 ° Intel E52670v3ES ° 16GB Patriot DDR4 ° Corsair 850 PSU ° 6TB Toshiba Parity 1 ° 4TB Seagate Parity 2 ° 18 4TB Data drives XFS ° 2 6TB and 4 2TB drives in UA Devices ° 1TB Cache Drive ° AMD R7700 GPU ° No Dockers running at time but installed ° No VM's running at time but installed Anything I forgot? PS - I have fix common problems, one error regarding placement of my docker image, I just haven't gotten around to moving it yet. Sorry for the rotation on the photo, I didn't catch that at upload Update 1: Server has been running for 5 hours now, I found a post from RobJ about enableing troubleshooting mode in the Fix Common Problems plugin, so I turned that on. Guess that should have been one of my first steps. With that running I have restarted both preclears on my free 6TB drives. Hopefully I will be able to add more information tomorrow after work. tower-diagnostics-20161003-1621.zip

Forget WM, does it report your CPU as running at 6.3GHz? Wow that's a nice overclock [emoji1] Sent from my iPhone using Tapatalk

Hmm, I have no experience an airport router I only have Windows computers and Unraid. In my case though using SMB when my internet is down (which is frequent) I can still reach my SMB shares. I can't think of any reason why your router would behave differently. I'm at a loss for where to go from here, you may need assistance from someone with a more mixed network, the only iDevice I have is my iPhone. Sent from my iPhone using Tapatalk

Normally I would think that local DNS records should be cached in your router and having internet should have no effect on local DNS queries. It may be that the DNS functionality of your router becomes borked if there is no internet but I have never experienced that with my router. I have dsl and a modem router combo from Netgear, your modem may be different and that may affect your results. Any local DNS query should be recognized as internal by you router and forwarded properly without Internet. You could try pulling your internet manually then test your connections to your Unraid box via ping. I would pig your router ip along with your Unraid box. Do you use any static ip addresses for your internal network? Maybe without internet your routers dhcp settings are disabled, never seen that but I guess it could be possible. -Alex Sent from my iPhone using Tapatalk

I run Server 2012 R2 with the essentials role at home to test and play with. It uses a nice user friendly GUI to do a lot of the management of client computers and users. I'd give that a try as an intermediate step to running the full blown Server 2012R2. You will still have to configure DNS and DHCP manually if you want them (highly suggest at least DNS if using Active Directory). There are some limitations to essentials but I think it's definitely worth it to try installing that role first. Makes it easy to manage users, client computer backups and updates. Plus has a great anywhere access feature that works well if you don't have a static ip. You can get an address like mysite.remotewebaccess.com that you can log into. That site configures RDP settings so you can RDP into any computer you want without opening a bunch of ports on the firewall you have to remember. Any questions feel free to PM me if you want, I run multiple server 2012r2's at home and have reached my end and am now moving to Zentyal as my next DIY project. Sent from my iPhone using Tapatalk

Gotcha. Like I said I don't know a whole lot about Unraid dockers vs regular docker. I'm in no rush, just some added management fetures in the newer version I was hoping to get access to. Thanks for the help. Sent from my iPhone using Tapatalk

Version 6.19 and only happens with my one unassigned drive using the plugin. What is the File System of the drive in Unassigned Devices? I have a mixture of XFS and NTFS drives and have experienced issues with my NTFS drives and old ACL's (access control list) on the drive. I have also seen issues where the permissions in the Windows credential manager prevent me from opening drives via //tower but not //IP.address. So every now and then I go into the credential manager and delete all of my unRaid stored credentials and reboot my computer. Just a thought.

I've tried searching for this information on both google and the unraid forums but I could not find what I needed. How can I update this version of MySQL. According to the MySQL workbench I'm currently running 5.5.49-0ubunti0.14.04.1, is there any way to upgrade to 5.7.14? When I click check for updates it claims it's up to date, is that because this isn't the official MySQL docker and therefore does not have the same update path? I deleted the entire docker once already and tried to install it as a new docker container, yet it still had the same version number, I thought I remembered an issue with unraid Pre 6.2 having issues with updating. Currently im running UnRaid 6.2.0-rc2. I have RC3 at home and have the exact same issue with this docker. I guess I just don't know a whole lot about the whole docker on UnRaid yet.

I'm in a similar boat as you. I have 15 4TB drives that are at about 97% full. I just added two new drives and wish to move some data around. Unfortunately as far as I'm aware there is no way to re balance data to those drives. So I have been logging in to my server via ssh and moving it manually in midnight commander. It's slow but at least it works. A word of caution though, if you go this route and do it manually do not copy from a disk to a share. You must copy from disk to disk otherwise you will corrupt your data. In my case all of my top level shares can use any disk so I just copy from /disk1/media/movies/hd/files-to-be-moved to /diskx/media/movies/hd/destination. Though d pending on your folder structure you may have to create some folders manually if they are several layers deep. I don't know of any automatic way though, it's all manual. In my case it's really a pain when your working with 17 disks. Though I would ask why you want to move them. If your disks use xfs than I don't think there is a performance issue with very full drives like RieserFS has. Just my two cents. Sent from my iPhone using Tapatalk

If it was doing it before with your other components than it would have to be your PSU. I doubt your case is causing the issue after all. [emoji3] All kidding aside the only components you didn't replace (I'm assuming) are the hdd's, the flash drive, the psu and the case. Easy thing to try, change your flash drive for another one to test it for a bit. But it's probably your power supply. I don't know about load testing your psu, I would just swap it for a new one. Sent from my iPhone using Tapatalk

Please please please. I'm very interested in knowing too. Me too would be very interested! So your engineering sample supports vt-d? i was worried after reading what JustJoshin said that some early es chips have vt-d disabled. I have a e5 2690 v3 es base 2.4 all core turbo 2.9 on its way at the moment hope to have it by the weekend OK, here are my results of testing "gamming scenarios" on my system. Here is the official info on the non ES version http://ark.intel.com/products/81709/Intel-Xeon-Processor-E5-2670-v3-30M-Cache-2_30-GHz. On the ark site note it says base frequency of 2.3GHz, Max Turbo frequency 3.1GHz. My actual testing on my ES shows 2.2GHz - 2.61GHz. CPU-Z shows 2.20GHz specification, but by changing the Processor Power Management (Windows 10) I was able to keep it at 2.5GHz. OK continuing with the specs I have 24GBs DDR4 on an ASRock Extream6 x99 mb with a 120gb ssd. I have a AMD R9-380 and a GeForce 210. The GeForce is not being used at the moment but it is plugged in the MB. The R9-380 is driving a 40" Phillips 4k display at 60Hz via the Display Port. I am attaching several pictures (Via imgurhttp://imgur.com/a/KGc6u) with this post so you can see the information. Im not into bench marking very much so I just used the basics that I had. I ran Unigine Heaven at 1080p Windowed (just to see what would happen, in my experience this requires more cpu/gpu than full screen). FPS was 68.6, Score: 1727 ( I don't know if that's good or bad) Min FPS 8.6 (ouch) Max was 135.8 (yay). I thought it looked great (oh I might mention I didn't check to see if Vsync was on, I found it on when playing GTA-V), it wasn't flawless like it is on my main system (5960x, 64GB ram, 2 R9-Fury's in crossfire, with a 950 Pro M.2 NVME, 2 850 Evo's and 2 WD Red 8TB @4K) but it still looked great. If your familiar with the unigine benchmark then you will understand the following reference, the only time it really had trouble was in the first few scenes when it transitioned to the night versions. It stuttered slightly in the beginning of this section but evened out quickly. I think this was the section that caused the 8.6fps low. Ok so with the benchmark out of the way, how did it perform in an actual game? I wanted to run several games that in my opinion stress the system, however I couldn't make up my mind on where to start. I popped Crysis, Crysis 2, Far Cry 4, and GTA-v on a thumb drive to start. That's when I realized I only had a 120GB ssd as my only drive. So I transferred over GTA-V and completely filled the drive. I ran GTA-V on my older computer (AMD FX-8350, 16GB Corsair Vengeance DDR3, 1 R9-280 and three 27" 1080p displays) and that was my main system until the new 5960x I just built. So I was confident that I would be able to compare the two experiences. So I cranked the settings in GTA-V way higher than my R9-280 could do and let her rip. Man was it bad (btw GTA-V warned me as soon as I started the game that the processor was below the minimum threshold for the game and I could experience performance issues). At first I thought it was the slow processor, to be honest I wasn't expecting it to be great, but we all know how most games use the GPU more than the CPU. So I decided to look at the graphics settings. Low and behold this is when I found Vsync was on. I disabled that and everything smoothed out immediate. Buttery smooth. I think that most of today's games need much more GPU power than CPU, I think this chips low frequency is not really a problem when in game. Starting the game and loading the scenes took longer than I remember, that might be the SSD though, I haven't bench marked that at all so it could be the bottle neck. Once in game though I had no issues (other than trying to drive with the keyboard). I went through the first 2 missions, drove around the city, shot some people, ran from the cops, the usual. I had no stuttering when traveling very fast from one area to the next, (I had small issues on my 8350 system in the past when going really fast from one end of the city to the other). All in all I would say this should be able to handle games quite nicely. Provided you had another video card I could easily see you running 2 gaming computers off this chip. I didn't see the cores use hardly anything. So running a 1080p windowed game on a 4k monitor, no problem. I'm posting my game settings too so you can see I had many of the settings cranked. Moving on to VT-D. This one was a bit harder to discover. I know its enabled in the bios, but I don't know if that means the MB hardware is capable when using a VT-D cpu. I found a program called SecurAble which supposedly tells you if you have VT-D. I attached a screenshot of that as well. It says Yes for HW Virtualization but that may just be VT-x. So I'm still not 100% on that one. If any of you know a definitive way of checking let me know, because this info isn't exactly on Ark. In conclusion I would say in my case using the 2670v3 which is fairly slow, I experienced no real issues in gaming. I can continue to test this, but to be honest I'm still more interested in playing with my new 5960x rig, this 2670 is kind of on the back burner for me, but I'm willing to keep looking into it if anyone wants. I think a game like Crysis (1-2-3 I have them all) might use the CPU more but i don't know for sure. I have many other games on steam so if you want me to check ask me the name of a game and I might have it to try.