MikaelTarquin Posted July 26, 2021 Share Posted July 26, 2021 I just encountered this issue. At the same time, multiple Dockers refuse to load, and I have 2 uncorrectable errors on a brand new 2TB SSD cache. Attached are my diagnostics. Here's a copy of the recent log. Jul 26 02:54:50 NNC root: plugin: running: /boot/config/plugins/dynamix.my.servers/dynamix.unraid.net.txz Jul 26 02:54:51 NNC root: plugin: creating: /boot/config/plugins/dynamix.my.servers/unraid-api.tgz - downloading from URL https://unraid-dl.sfo2.cdn.digitaloceanspaces.com/unraid-api/unraid-api-2.23.2.tgz Jul 26 02:54:57 NNC root: plugin: running: anonymous Jul 26 02:54:58 NNC root: plugin: running: anonymous Jul 26 02:54:59 NNC root: plugin: running: anonymous Jul 26 02:55:02 NNC root: plugin: creating: /boot/config/plugins/dynamix.my.servers/libvirt.node - downloading from URL https://unraid-dl.sfo2.cdn.digitaloceanspaces.com/unraid-api/libvirt.node Jul 26 02:55:04 NNC root: plugin: running: anonymous Jul 26 02:55:04 NNC root: plugin: creating: /boot/config/plugins/dynamix.system.temp/dynamix.system.temp.txz - downloading from URL https://raw.githubusercontent.com/bergware/dynamix/master/archive/dynamix.system.temp.txz Jul 26 02:55:06 NNC root: plugin: checking: /boot/config/plugins/dynamix.system.temp/dynamix.system.temp.txz - MD5 Jul 26 02:55:06 NNC root: plugin: running: /boot/config/plugins/dynamix.system.temp/dynamix.system.temp.txz Jul 26 02:55:06 NNC root: plugin: running: anonymous Jul 26 02:55:06 NNC root: Starting unraid-api v2.23.2 Jul 26 02:55:06 NNC root: Connecting to the "production" environment. Jul 26 02:55:08 NNC root: plugin: running: anonymous Jul 26 02:55:08 NNC root: plugin: running: anonymous Jul 26 02:55:08 NNC root: plugin: creating: /boot/config/plugins/community.applications/community.applications-2021.07.24-x86_64-1.txz - downloading from URL https://raw.githubusercontent.com/Squidly271/community.applications/master/archive/community.applications-2021.07.24-x86_64-1.txz Jul 26 02:55:08 NNC root: plugin: checking: /boot/config/plugins/community.applications/community.applications-2021.07.24-x86_64-1.txz - MD5 Jul 26 02:55:08 NNC root: plugin: running: /boot/config/plugins/community.applications/community.applications-2021.07.24-x86_64-1.txz Jul 26 02:55:08 NNC root: Daemonizing process. Jul 26 02:55:08 NNC root: Daemonized successfully! Jul 26 02:55:08 NNC flash_backup: adding task: /usr/local/emhttp/plugins/dynamix.my.servers/scripts/UpdateFlashBackup.php update Jul 26 02:55:09 NNC root: plugin: running: anonymous Jul 26 02:55:09 NNC root: plugin: running: anonymous Jul 26 02:55:09 NNC root: plugin: running: anonymous Jul 26 02:55:09 NNC root: plugin: creating: /boot/config/plugins/ca.update.applications/ca.update.applications-2021.07.19-x86_64-1.txz - downloading from URL https://raw.githubusercontent.com/Squidly271/ca.update.applications/master/archive/ca.update.applications-2021.07.19-x86_64-1.txz Jul 26 02:55:09 NNC root: plugin: checking: /boot/config/plugins/ca.update.applications/ca.update.applications-2021.07.19-x86_64-1.txz - MD5 Jul 26 02:55:09 NNC root: plugin: running: /boot/config/plugins/ca.update.applications/ca.update.applications-2021.07.19-x86_64-1.txz Jul 26 02:55:09 NNC root: plugin: running: anonymous Jul 26 02:56:03 NNC root: Fix Common Problems Version 2021.05.03 Jul 26 02:56:07 NNC root: Fix Common Problems: Warning: Docker application openvpn-as has moderator comments listed Jul 26 02:57:56 NNC ool www[902]: /usr/local/emhttp/plugins/dynamix/scripts/btrfs_scrub 'start' '/var/lib/docker' '' Jul 26 02:57:56 NNC kernel: BTRFS info (device sde1): scrub: started on devid 1 Jul 26 02:59:49 NNC kernel: BTRFS warning (device sde1): checksum error at logical 43328684032 on dev /dev/sde1, physical 43328684032, root 5, inode 9392254, offset 0, length 4096, links 1 (path: appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/Movies/3/83438a0636fb68cb11177e21109aa852b8da507.bundle/Contents/com.plexapp.agents.imdb/posters/2b543ef4e80169114c84e6fd534d6783fc2afa01) Jul 26 02:59:49 NNC kernel: BTRFS error (device sde1): bdev /dev/sde1 errs: wr 0, rd 0, flush 0, corrupt 1, gen 0 Jul 26 02:59:49 NNC kernel: BTRFS error (device sde1): unable to fixup (regular) error at logical 43328684032 on dev /dev/sde1 Jul 26 02:59:49 NNC kernel: BTRFS warning (device sde1): checksum error at logical 43328688128 on dev /dev/sde1, physical 43328688128, root 5, inode 9392254, offset 4096, length 697, links 1 (path: appdata/PlexMediaServer/Library/Application Support/Plex Media Server/Metadata/Movies/3/83438a0636fb68cb11177e21109aa852b8da507.bundle/Contents/com.plexapp.agents.imdb/posters/2b543ef4e80169114c84e6fd534d6783fc2afa01) Jul 26 02:59:49 NNC kernel: BTRFS error (device sde1): bdev /dev/sde1 errs: wr 0, rd 0, flush 0, corrupt 2, gen 0 Jul 26 02:59:49 NNC kernel: BTRFS error (device sde1): unable to fixup (regular) error at logical 43328688128 on dev /dev/sde1 Jul 26 03:07:13 NNC kernel: BTRFS info (device sde1): scrub: finished on devid 1 with status: 0 nnc-diagnostics-20210726-1012.zip Quote Link to comment
JorgeB Posted July 26, 2021 Share Posted July 26, 2021 15 minutes ago, MikaelTarquin said: checksum error at logical 43328684032 Those are checksum errors, and usually indicate a hardware problem, like bad RAM or another hardware issue. Quote Link to comment
MikaelTarquin Posted July 26, 2021 Share Posted July 26, 2021 Darn, I thought the hardware issues were behind me when I replaced the cache drive. Things have been working so well for about 2 months, and now I'm right back in there. I rebooted just now and things are at least working again, but I'm fully expecting things to crash again soon. I feel like a broken record at this point, but I don't know what else could be bad. It's ECC RAM in a T630 PowerEdge, I can't imagine something like the mobo or CPUs are failing. And no SATA cables to worry about, either. Quote Link to comment
Jazza159 Posted January 21, 2022 Share Posted January 21, 2022 G'day all, I'm having a similar issues and any assistance would be greatly appreciated! I logged into the web GUI this evening and found that all my shares had dissapeared. I had not changed anything on the server and was accessing files on windows all afternoon. The most recent config change was installing a docker container (Dashboard) earlier this morning however shares were still accesable on the network after installation. Things I've tried so far: reboot Fix common problems (nothing detected) (then reboot) removing net statistics docker (then reboot) removing dashboard docker start mover operation and let it complete disable docker (then reboot) disable tunable (support Hard Links): (then reboot) NFS is already disabled. I saw others said the shares appeared and then dissapeared. In my case they never appear after a reboot. I've disabled add blockers and also tried logging onto the web ui from a few different devices just incase. I'm able to view that files are still on my disks (2 x 4tb drives and 512gb ssd for cache) through the web gui and It also looks like files are there as I can list in the terminal. Docker containers also seem to be accessing files no worries, I'm currently streaming content from my media share on plex, even thought I cant access it via SMB on the network. I've attatched my config, again, if anyone has any suggestions I would be very greatfull! tower-diagnostics-20220121-2147.zip Quote Link to comment
Squid Posted January 21, 2022 Share Posted January 21, 2022 What error (if any) are you seeing when attempting to access? I assuming you're attempting to access the files by going to \\tower (or \\tower.local) Can you do it via \\192.168.20.101 (or at \\192.168.122.1) Quote Link to comment
Jazza159 Posted January 21, 2022 Share Posted January 21, 2022 Hey @Squid thanks for getting back to me! Shares do not show at all in unraid GUI and when I try and add a new one it is instantly deleted 10 hours ago, Squid said: I assuming you're attempting to access the files by going to \\tower (or \\tower.local) Can you do it via \\192.168.20.101 (or at \\192.168.122.1) I have been using \\192.168.20.101\share name. I tried your suggestions just then to see if it made any difference, no luck. Here is an example of the diag when attempting to connect to an location that was already mapped on a windows 10 machine. I have been succesfully connected on the same machine for the past month or so. Can't see the shares on any other of my devices either. Thanks! Jared Quote Link to comment
Jazza159 Posted January 22, 2022 Share Posted January 22, 2022 I had a backup from the start of the month when everything was working, I created a new flash drive and booted to it. Still no shares... Drives show no errors in the main tab of the GUI 🤔 Quote Link to comment
Squid Posted January 23, 2022 Share Posted January 23, 2022 Can you try booting into safe mode from the boot menu on the server. Any change? Does the user you've been using on Windows match the user you've created on the server? You could also clear your credentials in Windows ( https://rc.dartmouth.edu/index.php/hrf_faq/how-do-i-clear-cached-credentials-netidpassword-in-windows-10/ ), as Windows has a number of very annoying "features" that NAS users a lot of pain (not just with Unraid) There is also this thread that has some more information ( and @Frank1940 is an expert on Windows connection issues ) https://forums.unraid.net/topic/89452-windows-issues-with-unraid/ Quote Link to comment
Jazza159 Posted January 23, 2022 Share Posted January 23, 2022 Thanks for your reply! It's currently running headless so I rebooted into safe mode with GUI using the flash drive Syslinux settings. In safe mode behaviour is the same, no shares show in gui and I can't access any on the network.Thanks for the support for Windows!I have also tried connecting with a Ubuntu machine and on IOS/Android with no success, all of which worked fine before the shares dissapeared from the GUI Sent from my SM-G975F using Tapatalk Quote Link to comment
Squid Posted January 23, 2022 Share Posted January 23, 2022 Something is weird. What is the output (via the terminal button) of ls -ail /mnt/ and ls -ail /mnt/user Can you also stop the array and to to Global Share Settings and make a change (any change) - Apply it and then revert it Quote Link to comment
Jazza159 Posted January 24, 2022 Share Posted January 24, 2022 Agreed 😅 Here is the output of the list command from the terminal: 14 hours ago, Squid said: Can you also stop the array and to to Global Share Settings and make a change (any change) - Apply it and then revert it I tried the above. No change in share status in GUI, can't connect on other devices. Quote Link to comment
Jazza159 Posted January 26, 2022 Share Posted January 26, 2022 Thought it might be worth mentioning that I can download files off disk one through the Main tab > View. Not sure if it helps in troubleshooting at all but good for me as I can get stuff off without taking the disk out. Quote Link to comment
Squid Posted January 26, 2022 Share Posted January 26, 2022 Your permissions seem strange on /mnt (write access, but no read access) Disable Docker in Settings - Docker, Disable VM's in Settings - VM Settings, and reboot into safe mode Quote Link to comment
Jazza159 Posted January 27, 2022 Share Posted January 27, 2022 43 minutes ago, Squid said: Disable Docker in Settings - Docker, Disable VM's in Settings - VM Settings, and reboot into safe mode Done! Same behaviour, shares are not showing in GUI and if I try to create new ones they disappear immediately. I did notice "Starting Services" Shows in the bottom left and does not dissapear when in safe mode (waited 10 mins) I ran those previous commands again incase anything is different. Look the same to me with docker/vm's offline. Would there be any merit in trying a chmod command in the terminal and changing permissions or is that crazy 😂 Cheers! Quote Link to comment
Jazza159 Posted January 28, 2022 Share Posted January 28, 2022 I tried running the New Permissions tool and rebooting. No change in behaviour and permissions on /mnt look the same to me. Quote Link to comment
Squid Posted January 28, 2022 Share Posted January 28, 2022 Unfortunately, I'm out of ideas here. Anyone else have any suggestions? Quote Link to comment
Jazza159 Posted January 28, 2022 Share Posted January 28, 2022 Thanks again for your help squid!Do you think it's worth trying a fresh unraid install?I think I can get restore home assistant from a backup and my dockers shouldn't cause me too much trouble to setup again Sent from my SM-G975F using Tapatalk Quote Link to comment
JorgeB Posted January 28, 2022 Share Posted January 28, 2022 /mnt/user permission are wrong, type: chmod 777 /mnt/user then post output of ls -ail /mnt 1 Quote Link to comment
Jazza159 Posted January 28, 2022 Share Posted January 28, 2022 total 16 886 drwxr-xr-x 6 root root 120 Jan 28 13:27 ./ 1 drwxr-xr-x 20 root root 460 Jan 28 13:35 ../ 256 drwxrwxrwx 1 nobody users 68 Jan 28 13:37 cache/ 128 drwxrwxrwx 9 nobody users 132 Jan 28 13:37 disk1/ 648799821318062208 drwxrwxrwx 1 nobody users 132 Jan 28 13:37 user/ 648799821318062208 drwxrwxrwx 1 nobody users 132 Jan 28 13:37 user0/ Hey JorgeB, There is the output Great news! Shares show in the GUI! Rebooting now to see if I can access on the network! P.s Is there any 'danger' in leaving /mnt as 777? Quote Link to comment
JorgeB Posted January 28, 2022 Share Posted January 28, 2022 3 minutes ago, Jazza159 said: P.s Is there any 'danger' in leaving /mnt as 777? No, that's how it should be, something you did/ran changed that. 1 Quote Link to comment
Jazza159 Posted January 28, 2022 Share Posted January 28, 2022 1 minute ago, JorgeB said: No, that's how it should be, something you did/ran changed that. Good to know! Not sure what changed it but will be very careful in future! More good news!!!! After a reboot I can now access shares on the network. Thank you so much for your help @Squid and @JorgeB I am very great full for your time and expertise! Quote Link to comment
demechman Posted April 21, 2022 Share Posted April 21, 2022 I just had this happen when I was modifying some settings on a single share. Everything dropped off the GUI, i did a reboot and everything came back. for now..... Quote Link to comment
Squid Posted April 21, 2022 Share Posted April 21, 2022 3 minutes ago, demechman said: I just had this happen when I was modifying some settings on a single share. Everything dropped off the GUI, i did a reboot and everything came back. for now..... If it ever happens again, post diagnostics before rebooting if possible. Quote Link to comment
wallywhatever Posted May 25, 2022 Share Posted May 25, 2022 On 4/21/2022 at 10:36 AM, Squid said: If it ever happens again, post diagnostics before rebooting if possible. I just had it happen after adding a share. Stopping/starting the array brought it back. Oddly, when the array started my normally unshared disks were shared. I attached diagnostics. neptune-diagnostics-20220524-2328.zip Quote Link to comment
Squid Posted May 25, 2022 Share Posted May 25, 2022 Run the check filesystem against disk 1 Quote Link to comment
.thumb.png.ed0372c380338d2d6431998de55d80ed.png)
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.