hansolo77

Thanks.. at least I know it's not causing any direct issues. To fix duplicated files, do I just use something like Krusader to erase the copies, or is there another tool I should use? Also, should I wait until this non-correcting scan is done before I attempt it?

I did a little bit of log checking. The NIC that is throwing up logs is ETH1.. that corresponds to the 10G NIC I have. It looks like the log is just indicating when my other PC turns on, and the link is established. I don't think that would have any impact on things. I know my original post for this was about the hang ups during reboot, but I think I have a bigger problem on my hands with this parity issue. Should I create a new thread to support that, or is this one still ok? I wonder if it would be a good idea to just remove the parity drives from the array, then re-add them so the parity is just completely rebuilt. I've not done anything with the array in days, so it's not like I've got anything recent to lose. Something else I noticed was back when I started using Unbalance to scatter files off a drive that was full. After all that was done, and this parity trouble started creeping up, I did a "Fix Common Problems" extended scan. It reported that there are actually a lot of duplicated files on multiple drives. Might that be why the parity is struggling?

Check completed with 12219 sync corrections. Running non-correcting check now.. kyber-diagnostics-20210430-0845.zip

I had hoped to one day do a PCIe passthrough to allow my Windows 10 VM to be a gaming setup so I could stream with something like Moonlight to my Pi, etc. I've NEVER set it up actually, because I was under the impression my video card (nVidia Quadro P2200) wouldn't provide much 3D capability. The only other passthrough I've ever set up was a USB port so I could quickly attach a flash drive and dump some files onto the Windows VM. I do have multiple NICs.. the motherboard has 2 - rj45 and wifi. The wifi is disabled in bios. The other NIC I have is a dedicated 10G card that is direct attached between the server and another computer, but the other computer never works right with the NIC unless I disable/re-enable the NIC. That card isn't being passed through either. I just checked my VM config for Windows 10 (the only VM installed ATM) and it doesn't have anything set as a passthrough. So I will try your suggestion of the `iommu=pt`. That makes a little sense. I think I have my scheduled monthly checks set to auto correct though. Maybe I should disable that. I'll let it finish the current correcting scan, then tomorrow I'll do another non-correcting scan. Thanks for the help guys. Hopefully this will all get sorted out.

So what your saying is.. I should stop this check (which says "Sync errors corrected: xxxx") because it's correcting the errors, and restart another check that's NON-Correcting? That seems unhelpful to me. If it's correcting errors, then that means there ARE errors right? Doing a non-correcting scan would just say there are errors and I need to run another scan that IS correcting. Maybe I'm just confused here, it's been a long day. I just don't see what the benefit on a non-correcting scan is. As it is right now, I'm at 75.4% completed... 20-hours in, 6 hours to go, and I now have 6189 sync errors corrected. I suspected the nzbget docker before @codefauxpointed it out, so I've actually had all of my dockers disabled except for PLEX. I don't know what that problem is, but none of my docker's are on the array.. they're on a dedicated unassigned device. But nzbget does interact with the array.. so I've disabled it. PLEX is also on it's own dedicated unassigned device, but it should only be reading media from the array, not creating new files, etc. I even think the DVR is set to use the plex drive and not the array, although I could be wrong on that. I can complete disable it as well if you think that's a potential relation to the problem.

Damn! It just shot up to 1300. Like 2 minutes later - 5510.

Here's the current diagnostics. The parity check is still running. It was at 6 sync errors, then i was looking over the syslog in the diagnostics zip to see if I saw anything that might be a culprit. While doing that, it looks like it had another sync correction, so I'll just add that line here: Apr 29 20:42:09 Kyber kernel: md: recovery thread: P corrected, sector=16930232816 It's too bad the log doesn't indicate what drive that sector is on. Would help identify if the errors are all being detected on the same drive or not. kyber-diagnostics-20210429-2036.zip Also.. I checked Drive 13's Smart error history, and it doesn't show anything... "No Errors Logged"

About to come home. Only 6 sync errors so far. I checked the drives smart status on break. Disk 13 has some reallocated sectors but I don’t know how long ago it was, it’s an old drive and the warranty is expired on it. It could be c-states, does that relate to sleep? I had tried to use sleep once but turned it off a while ago, long before this. Should I stop the parity check and post the diagnosis now or wait till it’s done. It’s about 68%. Here’s a quick screenshot from my phone of their status.

Thanks for the responses. I’m at work now but when I get home I’ll repost diagnostic logs. All of the drives are showing good smart data, at least sense I last looked. I also looked again this morning before leaving and saw that the speed is back where I’m used to seeing.

I'm really struggling now. I've been running parity checks day and night (literally, it takes like 1.5 days). Every time I run it, I get sync errors. The first time I had this problem was after using Unbalance to scatter some folders off a drive that was 100% full. After the transfer, I started a parity check. It returned over 18k sync errors. So I rebooted (always a good troubleshooting step with computers right?). Thats when I started this thread, because the reboot failed to shutdown. Once back up, it's been running another parity check. When I last checked it, I had about 8 hours to go, and almost 12k sync errors again. I left to go visit my brother, then came home. The server was unresponsive, the "My Servers" tab in the forums showed it was offline. I turned on the display connected to my server, and all I had a black screen. So...something crashed? I forced a reboot with the power switch again. Rebooted, and it's doing another Parity check.. this time though, it's reading at like 35-40 MB/s compared to the 150-180 MB/s I'm used to seeing. UHG what is going on? I paused the check, thinking I could reboot "safely" and resume it. Well I just rebooted, successfully, and when it came back up all I see is the popup that the last parity check finished successfully but with errors. It also said there was no log or something to display the errors.. and that's it. What should I do now? I'm tempted to start another parity check. I want to make sure my data is safe. I just don't understand what's happened. Would really appreciate some expert advice.

The last 3 times I've done a reboot, the system hangs and is unable to complete the process. I'm forced to perform a hard power off with the power button. My monitor attached to the server displaying the syslog shows it doing the process and creating the log zip. After that, it gets stuck with a stop error. I will attempt to capture a photo of it next time. I'm just curious if anybody has had any issues of late? It seems like I've had this problem ever since I installed the new "My Servers" plugin to the UnRaid host and my server, but I'm not sure if it's something else going on. Would appreciate some assistance if possible. Attached are the most recent captured logs. kyber-diagnostics-20210427-1935.zip

Nice build! Looks a lot like mine does (without the fancy LEDs ^_^). I'm not sure what all that other stuff is, or if I need it. I'm guessing a lot of it is home automation/security camera type stuff. I don't have a house, but I'll be looking to add that to my setup if/when. Kinda sucks you went with the 2x10tb drives for Parity, same as me with 12's. The 18's are coming down in price now lol! Ya know.. stimulus just came out.. I'm actually spending mine of putting a dent in my car payment.. only about $4k left. Check this site out, if you like shucking (I sure do now that I know about it lol) https://shucks.top/

I have that plugin but it seems too complicated to use correctly. I've read some horror stories from people losing data, etc. I'm ok with it as long as it's not a problem. It just looks off, and understanding what High-Level is supposed to do, then seeing what it actually does, is really confusing.

I'm still pretty stable. Things have changed in the way Unraid handles the P2200 nVidia drivers, and the OTA TV tuner drivers, but "so far" everything is running smooth. I do have all 3 pcie slots filled, with the 10g nic, drive controller, and the OTA Tv Tuner. I'm a bit bummed about the 10g nic. Seems like Windows doesn't like the drivers for it. I had it installed on my Windows Server computer when I was transferring all the data to the new server, and it was working fine. Then when that was done I moved it over to my daily machine that was running Windows 7. It was finicky at first to get the drivers to install but then it started working fine. A month or so ago my Windows 7 machine took a nose dive. Not sure what happened but I needed to reinstall Windows. I went with Windows 10, since it's the latest one and I've got literally no experience with it. Ever since then, this 10g Nic has been nothing but trouble. It causes Windows to become completely unstable, random crashes, and a dead screen requiring me to drain the power supply capacitors (turn the computer on from a cold boot with the power supply unplugged) (it forces the motherboard to "restart" rather than "wake up" the computer when it's locked up). I figured out it was the NIC, because every time I would boot the system back up the Device Manager showed Windows had disabled it. So I just keep it disabled. Enable it when I need it, then disable it again. Like I said, I'm bummed it doesn't work all the time like it did on Windows 7. I kept all the original driver installation files from before and all the hardware is still the same, but it just doesn't work. Anyway, I'm very pleased with this build. I might have a new problem I don't know how to address. I've tried using Google and found a few threads here and on reddit about it. I've started replacing my older 4-8tb drives with shucked 12tb drives. I've got about 8 of them now. One of the drives though is now sitting at 100% usage, while I still have like 3 of the 12tb drives not even used yet. It's very confusing because I have all my shares configured to use High-Water, which should use a drive to 50% then start using another drive, etc, until all drives are there then it'll start doing 75%, etc. As it sits now, I have a bunch of 12's that are pushing 80-90%, one that is 100%, a few that are 0%, and a bunch of 4-8tb drives that are still sitting empty. I don't understand it. But everything I've read said to just let unRAID handle it, so that's what I've been doing. Any tips or pointers on that? I've included a screenshot of my situation. The newest drives are coming from the bottom up, replacing the lowest capacity drives first.

From what I've researched, having your VM on the array is actually slower. Putting it on the cache and setting it as "Cache Only" is the usual best suggestion I've seen. However, in my case I have it on it's own SSD (which is an NVME, not a 2.5-inch), and have that mapped through Unassigned Devices. I thought maybe the system had detected something like new hardware or something since the problem appeared right after updating Unraid. Like maybe the drivers for the VM are different so Windows was choking somewhere. Strangely enough, I let it run overnight and the next day it was back to running as fast as it should have been. So maybe my thoughts were somewhat accurate and Windows was processing some driver update. I'm definitely going to continue monitoring it, because it was extremely odd.

Hey everybody! I've been running a Windows 10 VM on my Unraid server for a year or so and haven't had any problems. Earlier today I upgraded Unraid server to 6.9.1 (it was on 6.9.0 rc, so was overdue). Now that I've done that, I've noticed my VM is running extremely slow. I'm not sure what could have changed, unless there was something in the upgrade that is adversely affecting it. I run the VM on a dedicated SSD which is no where near full. I've made no changes to the VM since the upgrade (like adjusting the CPU/RAM/etc); everything is exactly as it was. When I'm using Remote Desktop and connect, everything seems so slow and sluggish. I'll click on something, and there is a definite 3-5 second pause before I see the reaction. If I open the task manager, I do see a rather large chunk of memory (25-30%) being used with a programmed called "Antimalware Service Executable" although I don't understand why that would cause things to be crawling. Something else I've noticed a lot of is the connection just seems to drop. I'll be clicking on things and nothing at all happens, close and reopen the connection and everything was doing as expected but it never sent the information across the connection. As for my Remote Desktop connection, everything is wired, and I'm local (sitting less than 3 feet from server), and nothing has changed since it was working before. For troubleshooting, I have shutdown and restarted the VM 3 times, and I've also gone in and did a reboot and then also a shutdown/wait/reboot of the Unraid just to be sure. Would really appreciate it if anybody out there has experience with this and could help me. Thanks!

I think I got it. Looks like it was just stuck on the display of the log. I closed the window and saw the docker had stopped, and the log said it was completed. I will try the "new" method, with the stock beta35 and the plugins. If that doesn't work I'll use this new build it made. I don't need anything special other than Nvidia and DVB, both for Plex.

Hey ya'll, just had a couple of questions. I'm trying to build my new beta image for the first time (I've been downloading the prebuilt ones so far). I'm currently on the latest beta30 and trying to get to beta35. Since this is my first time using the docker, I'm a little lost. I have it setup with the correct 'beta35' flag in the settings, and it is going through the process I believe. But it looks like it might be stuck at "CC [M] drivers/net/ethernet/emulex/benet/be_cmds.o". At least that's where it's at in the live log. It's been on that line for like 15 minutes. Is this normal? Also, I was thinking about just cancelling the build process and just download the prebuilt again. But when I came here, I saw that the OP had been changed to say a prebuilt image won't be made. I'm not in the loop. What's changed? It sounds like I don't need anything special now, and I can just install the default base beta from Unraid and then install some plugins? I need a version of Unraid that has both the nVidia and DVB tuner support. Can somebody clue me in? Thanks!

I have a problem. Last night, PLEX was updated. The Docker container wasn't updated till today. I installed it just fine. PLEX runs on an nvme designated as an Unassigned Device. After I updated the Docker this morning, I found that Unraid had also updated to 6.9.0beta30. After I installed the update and rebooted, I no longer have the Unassigned Devices section in my "Main" tab of Unraid. However, if I go to the "Dashboard" tab, it does display that section along with the drives. But, it doesn't indicate my partitions on those drives. So in a sense, it's not really working. PLEX is unable to start because of it's location on one of the Unassigned Devices partitions. Any ideas? ====== UPDATE ====== The problem is not related to the version of Unraid. I just down graded back to 6.9.0beta29 and the problem is still there. I think it's the Plugin. Can I reinstall it without losing the information about my partitions? ====== UPDATE ====== It worked. I took the leap of faith and uninstalled/reinstalled it. Seems to be working now. Must have been a settings corruption somewhere.

Old server SSD to new server nvme brought in a steady 400-450MB/s. I think that's the best I'll be able to get. But honestly, my largest SSD on my old server is only 120gb. The nvme drives are 1tb. I have like 180tb of data to transfer. After filling up the old server SSD 7-8 times to get the nvme filled up once, it took like 3-4 hours to dump that data off the nvme and onto the array. Could have been because I was using it at the time though. But still, using cache is just not an option when moving data like this. I'm gonna have to just live with it going from old server spinners to new server spinners directly until it's all done. At least I'm getting that same steady 85-120MB/s speed.

Yeah I've been doing lots of Google, discord, and youtube. I think my speeds are probably average then from what I'm seeing. I expected to see a solid line of speed, but instead I'm seeing a mountain range of highs and lows. Last night I tried transferring just my movies starting with "A". It's 350gb and was saying it would take 3 hours to complete. When I watched it transfer, it would start out ok, like 700MB/s, then drop down to almost 0, then go up to 30MB/s just to drop down to 4 again then shoot up to 120. It's just all over the place. Like I said, I expected to see a steady throughput, not all over the place. I've seen videos where people were getting a solid 1GB/s throughput. But, I understand that they're going from ramdisk to ramdisk in those videos. I'm ok not having that. It's the randomness of speed though that's got me confused thinking something's not right. But seeing that you were getting 80-110MB/s makes me feel more confident that things are working as they should. My problem must be because of Window Server and the DrivePool software and the fact that the data is moving off of spinning drives rather than SSD's. Tonight I'm going to try copying my "B" movies to an SSD first before transferring them over to the new server, and see if speeds are better.

I've actually not had any stability issues at all. System has been on non-stop for multiple days on end. I've had to reboot it to install the 10gb NIC, but other than that, everything is running great. Now I just wish I could get my transfer speeds higher, much like you suggested that I'd not be able to saturate it. I should be able to maintain the speed though, I'm experiencing drop outs and max around 128MB/s. Still working on the settings and stuff.

Yeah I know full saturation isn't going to happen. Classic hard drives have a limit of speed, and my controllers are only 6GB/s. But it's still gonna be faster in the long run while transferring from one to the other. As for the future, my main PC uses only SSDs and a Ramdisk. So transferring files between it and the new server should be a lot better than what I'm currently getting. Yeah I've learned the hard way doing 1GB speeds, about the cache and not using it. I even disabled my parity to see if I could inch out any extra bandwith. Although, using the NVMe 1tb PRO drives will be a LOT faster. It'll probably just take LONGER though because I'd either have to wait for the "end-of-day" Mover schedule, or force a manual move, which defeats the whole purpose. I'm just hoping I get a decent enough speed to make it worth the cost. Thanks for the feedback on my build! So far it's working well. I got the NIC's in the mail today but won't get the cables until tomorrow (figures). But I'm off the next 2 days so I'll be able to play with this a lot more soon.

I still have to install it, so I don't know if it's any different. On my current Windows Server build, all I had to do was plug it in, connect an antenna to it, and run the driver package that comes with it (downloaded from the card's manufacturer website). Once that's done, you use PLEX (requires PLEX PASS) and go into the "Live TV & DVR", it should find your card and start configuring it to use. It will prompt for what TV service you have (antenna/cable) and then start scanning for channels. You then enable/disable the ones you want and you're good to go. If you're using Cable, you need a special card (at least for my service) that supports the digital DRM capabilities. Some cable companies offer a rental fee and can give you a compatible card/device if you want. Ours does offer one but they want a lot more money for it than it was worth. We have cable tv, but I never watch anything on it, mostly just local broadcast networks (ABC, CBS, NBC, FOX, PBS). Those are all available in my area free over the air, just need an antenna, and the tuner card does the rest. The card I have I think is out of service now, it's a Hauppauge WinTV-HVR-2250. Found it on Amazon. The box came with all the accessories, though I never used them. The remote was nice when I was running Window Media Center. Going forward though, I think I want to upgrade it to a Hauppauge WinTV-quadHD or maybe an HDHomeRun. The problem is that I have to keep the server ON (not asleep) to get recordings to happen. They have an HDHomeRun Scribe which comes with a built in DVR Hard Drive so I wouldn't need to be always on, but I've not been able to find out if PLEX can access it or not. Seems like even more user friendly devices like Roku and FireStick can't. Bummer. I've not had any problems with my server running at that speed. It's the base speed of the RAM, no overclocking. Linking from the motherboard's spec sheet: https://www.msi.com/Motherboard/MEG-X570-UNIFY/Specification DDR4 Memory - 1866/ 2133/ 2400/ 2667/ 2800/2933 /3000 /3066 /3200 /3466 /3600 /3733 /3866 /4000 /4133 /4266 /4400 /4533 /4600 /4733 /4800 /5000+ Mhz by JEDEC and A-XMP OC MODE I'm pretty sure they wouldn't even give a list of speeds like that if it couldn't support it, and none of the Zen3 chips advertise those clocks. But, 3200 seems like a base rated speed to begin with anyway. Also, there have been a lot of threads on the internet about "Ryzen 3900x 3600 RAM". In most cases, it looks like 3600mhz is actually the sweet spot, comparing cost vs performance. Even AMD recommended. Have a look here: https://forums.tomshardware.com/threads/best-memory-for-3900x-ddr4-3600.3497584/ But yeah, I guess it would depend on what you get. Maybe I've just been lucky with mine. When I first installed it, it wanted to run at 3200mhz, and was fine for a long time (36 hours online, give or take). Then I started adjusting fan speeds and realized it wasn't running at the base clock the RAM was set for, so I just enabled XMP and it automatically set to 3600. I'm not going to overclock either. Seems people start having issues with their systems AFTER they do that. So far, I've been running at the 3600mhz clock for about 4 days and haven't had a single problem.

I see you went with a hard drive caddy for your 10tb. I'm guess that's your parity, it's where I put mine. Interesting to see a similar build to mind but have it look different. My NVME cards get pretty hot too.. I was just as nervous. But, they do seem to be operating just fine. I thought the fan was supposed to blow air over them, but I guess that fan only runs when the PCI controller chips get hot. You can make it run though (as a test, just go into your BIOS and the monitor screen, just press 'F' to make everything full power). Curious, what are the 2 cards besides the HBA? I think one is probably graphics, but it looks pretty tiny (don't really need much I guess). The other looks like an old internal 56k dialup modem (could you imagine!). Also, it looks like you were able to get the motherboard 8-pin power without needing a splitter. The PDU has enough connectors on mine to do that, but the length of the cables were too short so I had to use the splitter to extend it. I've got pictures on my phone of my build prior to adding the 10G NIC and he new fan.. care to see? Lighting is pretty bad, I was using my phone. My 2 parity drives, 12tb each. I only wish SATA cables provided in the motherboard box were a little longer. I've got them both kinda pulled up on the very corner edge of the motherboard here. The power to the drives is a right-angle 2-way splitter, where I've attached a 3-way splitter to the molex lead left over. I have the 3-way because I plan on attaching some extra SSD's in the future that won't be part of the array. I have all the wires tidied up as best I could slid up under the drives and pulled back behind the 2 caddie's mounting screws. A better view of the entire motherboard and expansion slots. The 2 exhaust fans I've got their power pulled up together and route them down to the bottom of the case and plugged into the system fan headers below the last PCIe-16x slot. Everything is nice and neat (so far). My fan wall. Truth is, after I took this picture I discovered I couldn't get the lid to close down because the weather stripping was too tall. It's 3 layers thick. So I had to take the top layer off. My original thought here was that I could push the lid down to make the fit so tight it wouldn't let any air through. Turns out I couldn't even get the lid down if I sat on it (I didn't, but you get the idea). I had trouble getting it to stay down though, because the stripping comes in a roll, and it kept wanting to curl up. I ended up just using some more zip ties in the top 2 corners to hold down the edges. It works, but there is a little air gap now. So far, no bad results. Also, I saw your pictures... you'll want to put some tape on the vent holes on the outside of the case to prevent the fans from sucking in air that's not going over the drives... they were there for when the case is full with drives so the old fans don't choke. I've not heard of anybody having that happen with Noctua fans though. This is a horribly lit image of my expansion slots. I actually took the picture horizontally, and rotated it horizontally on my computer before uploading it, but for some reason it stayed vertical. lol So yeah, that's the (oops) P220, without needing additional power. Also is the HBA. Not pictured (haven't done them yet) is the PCIe1x digital tuner card and the 10GB NIC I ordered. Once that's installed, I'll be full on cards. Not really anything else I'd need/want. Perhaps someday in the future I'll replace the HBA with one that has an external port so I can daisy chain another JBOD case. Or I think I'll have open slots on the back to just use an external plate and route the existing 2nd SAS cable to it. Not really sure I could need anything else. I've seen some things like an SSD hotswap caddy you can put in an open plate slot, that might be cool. Here's a shot of the "between" area. Fan wall on the left, drive bays on the right, with drive bay #5 (top left, starts with 0 bottom left) filled with my first 12tb data drive. I've actually just added 2 more 12tb drives yesterday that are preclearing right now. They're WD EasyStore shucked drives. I've never done the shucking before, but I'll definitely be doing it going forward. Each of these Seagate 12tb drives were like $370 each. The 2 WD drives were like $400 total. But anyway, back to the "between". As it is right now, the cables aren't zip tied or moved out of the way. They're just jumbled up. I'm trying to research to see if anything can be done about it. The front panel to motherboard cable is pretty long and it's just kinda taking up space, as is the extension cable I had to add to the one fan to help it reach the motherboard. I thought about maybe laying down a bunch of electrical tape, or a thin piece of cardboard/stock, to "smush" everything down to the bottom of the case, but that might actually prevent airflow from the bottom 4 drives. I think I'll leave it as it is right now. Last "bonus" picture. I took this when I was trying to set up my fans for the fan wall. I wanted them to all be the same. Since I had a really hard time with my mouse (it's weird, moving around really slow, but if I increase the speed it's WAY fast.. works fine in Unraid GUI though), I didn't want to have to keep going back and forth between the fans to check the settings. I've actually tweaked this setting more since I took the picture, so this is truly just a "bonus" and isn't representative of my final settings.