Ascii227

Hi, I use Unraid as a backup server. Every night I run rsync to backup files from other servers to unraid. This has been working fine for years. Recently, rsync has started freezing and crashing the array every night. There is high load and IOWait in top, but low cpu usage. I cannot see any errors on disks. Rsync processes go into D state and never wake up. The array cannot be stopped, it hangs on 'Sync Filesystems...' forever. Soft reboot and powerdown do nothing. A hard reset is the only way I have been able to get out of this. I can see from lsof and ps that the rsync process is stuck waiting in some IO, but I cant figure out exactly what, or how to resolve it. Could somebody cleverer than I please take a look at my diagnostics and suggest what I could try to track this error down and make stop rsync from stalling? Thankyou very much. vault-diagnostics-20240426-0935.zip

Hi, My server has been up and running fine for years. Today it is down. Please help! Clicking around the UI is slow, and 50% of the time gives me this error message in the browser: Warning: shell_exec(): Unable to execute 'logger error: '/webGui/include/DeviceList.php': missing csrf_token' in /usr/local/emhttp/plugins/dynamix/include/local_prepend.php on line 18 I went to the syslog and it has been throwing this error every 5 mins for the last 2 weeks: Sep 14 12:45:06 Server_name ntfs-3g[26405]: Failed to read vcn 0x0: Input/output error Sep 14 12:45:06 Server_name kernel: Buffer I/O error on dev sdt1, logical block 36, async page read Sep 14 12:50:06 Server_name ntfs-3g[26405]: ntfs_attr_pread_i: ntfs_pread failed: Input/output error Sep 14 12:50:06 Server_name ntfs-3g[26405]: Failed to read vcn 0x0: Input/output error Then last night it started throwing this error every 5 mins: Sep 18 01:50:29 Server_name emhttpd: Pro key detected, GUID: ***REDACTED*** FILE: /boot/config/Pro.key Sep 18 01:50:54 Server_name emhttpd: Unregistered - flash device error (ENOFLASH7) Sep 18 01:56:22 Server_name emhttpd: Unregistered - flash device blacklisted (EBLACKLISTED2) and now all I am getting in the logs is this over and over: Sep 18 14:24:50 Server_name emhttpd: read SMART /dev/sdf Sep 18 14:24:50 Server_name emhttpd: error: device_read_smart, 7977: Cannot allocate memory (12): device_spinup: stream did not open: sdf and Sep 18 14:17:57 Server_name php-fpm[5669]: [ERROR] fork() failed: Resource temporarily unavailable (11) I have tried exporting diagnostics but the server just hangs. My basic knowledge is suggesting that my flash drive is toast, but I dont want to go down that route without some confirmation from somebody who knows a bit more Any help or guidance on how to troubleshoot or fix this issue is much appreciated. Thanks in advance!

Im sorry that you seem to have taken it this way. Due to the way both unraid and dockers have developed over time, the standard way now advised in all tutorials and youtube videos to get these systems set up is to use automated setup scripts and plugins. Unfortunately in depth documentation or even signposts to the correct locations of the docs have not kept up with this pattern and remain on developer centric sites such as github. As Squid himself has said, he foresaw this as a potential issue and specifically developed a feature in his app store to combat it. If you look at my post history you will see I have spent quite some time researching how to use unraid properly, and never just whined and asked for people to solve the problems for me. All I suggested was that on the first post of this thread you mention that the readme and all potential troubleshooting info can be found on the github page. No spoonfeeding necessary, just a simple signpost to where the docs are so people can find them. Considering this thread is the official support for this docker and system I think thats quite a constructive suggestion, and not really one that requires a condescending reply about how little I am doing to help myself.

Thanks for the calm and considered responses from you guys. I appreciate that documentation is hard to keep updated in many different locations, I was just pointing out that the signposting to it in this instance is a little expectant of the user to assume to go to the docker hub or github repo. Squids feature in CA looks awesome, this would have nailed my issue with tag confusion upfront before it even appeared

If you want to go down this path of pointing out where I should have looked then thats fine, but I did check the first post of this thread several times and had no reason to go to the github link as I had no interest in the code and already had a path of downloading the docker directly from the community apps. If you want to avoid other people making these same mistakes may I suggest you make it much more obvious everywhere that the readme and possible troubleshooting options are all on the github site and to check that first before posting. Better still copy and pasting the entire readme into the first post would be even better as the thread is listed as the place to get support, not the github repo.

Fair enough. When I created the docker from the template in community apps the tag field was prefilled with latest, so I assumed that was default and I was doing the right thing by leaving it like that. I have just been through the linuxserver.io docker image info in the unraid community apps plugin and there is no mention of tags whatsoever. The only reference I can find is in the template overview where it states 'VERSION Set to either latest,public or a specific version e.g. "1.2.7.2987-1bef33a"' Nothing to implicate that latest is a beta build and public should be used for stability. For users like me who are just installing the Docker straight through community apps there is little in the way of explanations as to what the differnt tags mean. In fact in all my weeks posting in the forums this is first I have ever heard of the public tag. I have now changed the tag in my docker to public and all is well. Apologies for polluting this issue with misunderstanding the tag system.

No offence, but I really dont think this is much help. Its not like I am manually trying to upgrade to some bleeding edge beta version. As soon as I fire up the standard plex docker the logs show 'Attempting to upgrade to 1.15' and then all the trouble begins. Only by reverting to an old version of the docker am I able to get anything working. Me too, which is why I am using all the default settings on the docker and just letting it do its thing. It is attempting the upgrading to 1.15 on its own and causing me to not be able to watch anything. Just for info, here is the plex docker log from the first time I install and run it directly from the app store. As you can see, I am doing nothing. The docker is doing everything itself the first time it starts up from a fresh install. ------------------------------------- _ () | | ___ _ __ | | / __| | | / \ | | \__ \ | | | () | |_| |___/ |_| \__/ Brought to you by linuxserver.io We gratefully accept donations at: https://www.linuxserver.io/donate/ ------------------------------------- GID/UID ------------------------------------- User uid: 99 User gid: 100 ------------------------------------- [cont-init.d] 10-adduser: exited 0. [cont-init.d] 40-chown-files: executing... [cont-init.d] 40-chown-files: exited 0. [cont-init.d] 50-gid-video: executing... [cont-init.d] 50-gid-video: exited 0. [cont-init.d] 60-plex-update: executing... Atempting to upgrade to: 1.15.0.659-9311f93fd 2019-02-20 07:46:24 URL:https://downloads.plex.tv/plex-media-server-new/1.15.0.659-9311f93fd/debian/plexmediaserver_1.15.0.659-9311f93fd_amd64.deb [81547030/81547030] -> "/tmp/plexmediaserver_1.15.0.659-9311f93fd_amd64.deb" [1] 2019-02-20 07:46:24 URL:https://downloads.plex.tv/plex-media-server-new/1.15.0.659-9311f93fd/debian/plexmediaserver_1.15.0.659-9311f93fd_amd64.deb [81547030/81547030] -> "/tmp/plexmediaserver_1.15.0.659-9311f93fd_amd64.deb" [1] (Reading database ... 10486 files and directories currently installed.) Preparing to unpack .../plexmediaserver_1.15.0.659-9311f93fd_amd64.deb ... (Reading database ... 10486 files and directories currently installed.) Preparing to unpack .../plexmediaserver_1.15.0.659-9311f93fd_amd64.deb ... Unpacking plexmediaserver (1.15.0.659-9311f93fd) over (1.14.1.5488-cc260c476) ... Setting up plexmediaserver (1.15.0.659-9311f93fd) ... Setting up plexmediaserver (1.15.0.659-9311f93fd) ... Installing new version of config file /etc/init/plexmediaserver.conf ... Processing triggers for libc-bin (2.27-3ubuntu1) ... [cont-init.d] 60-plex-update: exited 0. [cont-init.d] done. [services.d] starting services Starting Plex Media Server. [services.d] done.

I deleted my codec folder from the location you specified then watched as plex redownloaded the required codecs for every file I pressed play on, but still failed to play them all with the same error as before. I took gacpacs advice as it seems the last thing I can possibly do. So I deleted the docker and image, and reinstalled from the community apps plugin. Remapped and scanned all my library files. After all that I get exactly the same results, nothing plays with a transcoder crash error. Changing the docker tag back to 168 (PMS 1.14.1) and restarting the docker makes everything play fine again. Im hoping this at least rules out anything to do with my unraid setup. I did manage to find an mp4 file in my library which will direct play just fine in latest/1.15, but as soon as I try to convert or transcode it I get the same error. I guess I will just sit on tag 168 forever, its not causing me any issues to stay there so as gacpac inferred - if its not broke dont fix it! EDIT: I noticed from poking in the codec folder that the two versions of plex (1.14.1 and 1.15.0) Seem to be keeping their codecs in differently named folders. Could be nothing, but could mean something to someone: 1.15.0 stores them in codecs/a22632d-2034-linux-x86_64 1.14.1 stores them in codecs/531e313-1328-linux-ubuntu-x86_64

Thanks very much for such a comprehensive list of steps! A couple of differences in my usage though. I never use subtitles and only ever use the web client, never any apps or players. Also I am unable to p[lay anything both locally and remotely. The only thing I can see to try is to delete my codecs folder and see if plex redownloads the correct ones. I will give this a go and report back. Thanks again.

Thanks, thats good to know. Saves me trying it round both ways all the time. I think my problem may go deeper than this. Unchecking the 'Use hardware acceleration' box in the Plex server settings, and I still get exactly the same error. Other peopel are seeing sporadic errors on certain files or no issues at all, whilst I cannot play anything from my library regardless of the filetype or transcoding method. I just cant see why this would be such a stark difference between the two docker versions for me. PMS 1.14.1 plays everything no problem, whereas version 1.15 plays nothing at all. As nobody else seems to be sharing my symptoms, could anybody point to a place in the logs where I might be able to start diagnosing this? Im happy to do the digging and troubleshoting myself, but plex has such a plethora of log files its difficult to know where to begin or what to look for! Thanks very much.

No but this is all good troubleshooting info, thankyou. Are you using the '--device=/dev/dri:/dev/dri' switch in the extra parameters field for the docker?

I was hoping this was the issue but no luck : Unfortunately Plex specifically state that they dont support hw transcoding through a docker image, and so they wont touch this with a barge pole. Is anybody seeing this issue who isnt using a docker image? (Not much chance in this thread I know but worth asking!)

Thanks for confirming. Now that I look in the logs I see the upgrade error for tag 168. I will have a sift through the plex forums to see if anybody else is posting any similar issues with 1.15. Please do post back if you find any more info.

Thankyou for the advice, I have done a forced update several times now. I always have advanced mode on, but dont have any orphaned docker images. LATEST tag on the plex docker is giving me transcoder crash errors trying to play anything, just switching it back to 168 and restarting the docker makes everything play fine. I am a plexpass subscriber, will this have anything to do with it? Mind you I wouldnt have hardware transcoding available to me if I wasnt! Is there anything else I can try? Thanks again EDIT: Adding my plex docker logs after forcing an update on LATEST tag, just incase it helps. ------------------------------------- _ () | | ___ _ __ | | / __| | | / \ | | \__ \ | | | () | |_| |___/ |_| \__/ Brought to you by linuxserver.io We gratefully accept donations at: https://www.linuxserver.io/donate/ ------------------------------------- GID/UID ------------------------------------- User uid: 99 User gid: 100 ------------------------------------- [cont-init.d] 10-adduser: exited 0. [cont-init.d] 40-chown-files: executing... [cont-init.d] 40-chown-files: exited 0. [cont-init.d] 50-gid-video: executing... [cont-init.d] 50-gid-video: exited 0. [cont-init.d] 60-plex-update: executing... Atempting to upgrade to: 1.15.0.659-9311f93fd 2019-02-17 08:19:09 URL:https://downloads.plex.tv/plex-media-server-new/1.15.0.659-9311f93fd/debian/plexmediaserver_1.15.0.659-9311f93fd_amd64.deb [81547030/81547030] -> "/tmp/plexmediaserver_1.15.0.659-9311f93fd_amd64.deb" [1] (Reading database ... 10486 files and directories currently installed.) Preparing to unpack .../plexmediaserver_1.15.0.659-9311f93fd_amd64.deb ... (Reading database ... 10486 files and directories currently installed.) Preparing to unpack .../plexmediaserver_1.15.0.659-9311f93fd_amd64.deb ... Unpacking plexmediaserver (1.15.0.659-9311f93fd) over (1.14.1.5488-cc260c476) ... Setting up plexmediaserver (1.15.0.659-9311f93fd) ... Installing new version of config file /etc/init/plexmediaserver.conf ... Processing triggers for libc-bin (2.27-3ubuntu1) ... [cont-init.d] 60-plex-update: exited 0. [cont-init.d] done. [services.d] starting services [services.d] done. Starting Plex Media Server.

Apologies for getting this wrong, but still having the same issue after forcing the latest update. i am able to browse around my library, but still trying to play anything results in the transcoder process crash error. Again, if i revert to tag 168 everything works fine again. is there any info i can retrieve from my system to help pinppint why this might be? Thanks very much.