Logs still look clear. Are any of the moved videos corrupted?

1 minute ago, SelfSD said:

Logs still look clear. Are any of the moved videos corrupted?

 

Not right now, usually, they're corrupted after 12-24 hours. Especially new episodes that are grabbed and downloaded through sickbeard/sab tonight will be come corrupted at some point tomorrow. That's usually the rotation path since Monday, March 12th.

The corruption definitely happens when the file is moved from the cache to the array if the videos are fine now.

As you found out in this post:

 

On 3/21/2018 at 4:22 AM, gigga45 said:

Interesting. I copy the file of an episode of a TV Show to my desktop. The file on my desktop is fine, but the one in the disk 3 is corrupted.

 

So it seems like one of your dockers causes the corrupted videos. The reason it happens over night is because your mover is set to move the files at 03:40 AM.

 

Next up you'll have to find out which docker is causing it.

1. Turn on one docker,
2. Wait for it to start,
3.  Put a known good video on the share,
4. Run the mover manually,
5. Check if the video is corrupted.

Repeat this by turning on one more docker until the video gets corrupted after it has been moved to the array. Once the video gets corrupted, stop the last docker you started and try once more to double check if it is that docker container.

 

If you find out which docker is causing it, I will have to send you over to that docker's support page as I don't know how to diagnose a docker issue.

In order to rule out whether mover is the problem, temporarily change its schedule so that it won’t run in the next 24 hours (this assumes you have enough space on the cache disk to do this).

 

Then see if the files are getting corrupted .... if they are still getting corrupted then it would rule out mover as the cause.

 

Then manually run mover and check again.

 

Finally put mover back on its usual schedule.

 

 

 

I just did what you both asked. The newly downloaded files from tonight are not corrupted at all, not yet at least. I don't think the mover is the cause...

Edited March 22, 20188 yr by gigga45

I'm doing an experiment for the next 24 hours. I'm turning off all my dockers except plex media server, no-IP, and MariaDB to see if the newly downloaded videos are still corrupted. I will update you guys on the result tomorrow to see if this is cause by any of these dockers or not.

Edited March 22, 20188 yr by gigga45

So after turning everything off last night except those 3 dockers, my new downloaded files are still corrupted overnight which ruled out all of (binhex, sickbeard, sabnzbd, plexpy, and nextcloud). So what could be the issue then? The Plex media server itself or my drive??

 

 

This seems to be a silent file corruption issue. Can anyone please help me?

Not that I think it could be the cause (because it would usually result in corrupt file systems and other problems), but have you run the memtest from the boot menu to check you haven’t got some bad memory (I didn’t see any mention of it when I skimmed over this thread) that only gets used as a buffer when large files are being copied?

 

have you tested if the files get corrupted if the  system is in left in safe mode when there are new files, with ALL plugins, dockers and VMs turned off (this would then give you a baseline from which to continue investigation)?    Leaving some running just because you think they could not be the cause is not a good idea in this sort of trouble shooting.

 

 

So I turned all my dockers for 24 hours and leave it in safe mode. The files seem to be fine, none was corrupted. What do you mean when you refer to VMs?

4 minutes ago, gigga45 said:

So I turned all my dockers for 24 hours and leave it in safe mode. The files seem to be fine, none was corrupted. What do you mean when you refer to VMs?

Now boot normal instead of safe mode, but keep all your dockers OFF, and see if the corruption happens. If it does, then investigate your plugins. If it's still fine, start ONE of your dockers, and leave it running long enough to rule it out as being the cause. Continue until you find which piece is causing it. VMs are Virtual Machines, if you didn't have any set up, you don't need to worry about it.

1 hour ago, jonathanm said:

Now boot normal instead of safe mode, but keep all your dockers OFF, and see if the corruption happens. If it does, then investigate your plugins. If it's still fine, start ONE of your dockers, and leave it running long enough to rule it out as being the cause. Continue until you find which piece is causing it. VMs are Virtual Machines, if you didn't have any set up, you don't need to worry about it.

Investigate my plugins? How do I turn my plugins off? Is there an option to do that?

1 hour ago, gigga45 said:

Investigate my plugins? How do I turn my plugins off? Is there an option to do that?

If it is your plugins, you will need to uninstall them, one at a time if you want. Which plugins are you running?

On 3/22/2018 at 2:19 AM, gigga45 said:

I'm doing an experiment for the next 24 hours. I'm turning off all my dockers except plex media server, no-IP, and MariaDB to see if the newly downloaded videos are still corrupted. I will update you guys on the result tomorrow to see if this is cause by any of these dockers or not.

 

So last night I turned every single docker off except Plex Media Server itself, I found many files corrupted just now. So it’s most likely the Plex Media Server docker/plug-in. What do I do now?

On 3/23/2018 at 3:47 AM, remotevisitor said:

have you run the memtest from the boot menu to check you haven’t got some bad memory (I didn’t see any mention of it when I skimmed over this thread) that only gets used as a buffer when large files are being copied?

^this

 

If only to rule it out.

22 hours ago, jonathanm said:

If it is your plugins, you will need to uninstall them, one at a time if you want. Which plugins are you running?

 

But you replied with a screenshot of your dockers.

 

1 hour ago, gigga45 said:

So it’s most likely the Plex Media Server docker/plug-in.

 

which suggests some confusion as to what is a docker and what is a plugin. You are running Plex as a docker. Which plugins are you running?

 

48 minutes ago, John_M said:

 

But you replied with a screenshot of your dockers.

 

 

which suggests some confusion as to what is a docker and what is a plugin. You are running Plex as a docker. Which plugins are you running?

 

 

These are all my plugins.

Edited March 28, 20188 yr by gigga45

2 hours ago, trurl said:

^this

 

If only to rule it out.

What are the steps to run the memtest from the boot menu?

4 hours ago, gigga45 said:

What are the steps to run the memtest from the boot menu?

When the boot menu appears select memtest and let it run overnight or until it fails.

 

You will need a keyboard and monitor attached. If that is difficult let us know. There is a way to change the default boot selection.

4 hours ago, trurl said:

When the boot menu appears select memtest and let it run overnight or until it fails.

 

You will need a keyboard and monitor attached. If that is difficult let us know. There is a way to change the default boot selection.

I have no monitor or a keyboard. I only have just a laptop and separate tower of my server.

16 minutes ago, gigga45 said:

I have no monitor or a keyboard. I only have just a laptop and separate tower of my server.

 

Hmmmm.    Without a monitor attached to the unRaid system I’m not sure how you see the progress/results of running memtest from the boot menu.   Maybe someone else has had experience of running memtest headless can tell us.

8 hours ago, remotevisitor said:

 

Hmmmm.    Without a monitor attached to the unRaid system I’m not sure how you see the progress/results of running memtest from the boot menu.   Maybe someone else has had experience of running memtest headless can tell us.

 

Sorry, that's right, unless maybe you have IPMI on that motherboard. Or if it has HDMI you could put it on a tv nearby.

 

Have you never had it attached to a monitor even when you were first setting it up?

3 minutes ago, trurl said:

Have you never had it attached to a monitor even when you were first setting it up?

 

I can't imagine how you ever set up the BIOS to make it boot from the unRAID flash device. It must have just worked with the default settings, which is very lucky considering the struggle that some people seem to have.