January 28, 201610 yr Hello, Over the last 3 days, my server (Ver 6.1.7) has crashed 3 times and uptime is now about 24 hours before it crashes. SMART status on all disks including Parity is green, which I assume means they're good. This is an older server built about 2011, and has been working fine for years. I am unsure if the USB Flash drive is bad, if the motherboard is bad, or generally what else could be dying. Have not been able to find anything in the forums that would address diagnosing an old server. Attached is the latest SYSLOG and the diagnostics file. Any help is appreciated. Thanks, Jan 28 16:04:50 Tower avahi-daemon[5366]: Successfully called chroot(). Jan 28 16:04:50 Tower avahi-daemon[5366]: Successfully dropped remaining capabilities. Jan 28 16:04:50 Tower avahi-daemon[5366]: Loading service file /services/sftp-ssh.service. Jan 28 16:04:50 Tower avahi-daemon[5366]: Loading service file /services/smb.service. Jan 28 16:04:50 Tower avahi-daemon[5366]: Loading service file /services/ssh.service. Jan 28 16:04:50 Tower avahi-daemon[5366]: Joining mDNS multicast group on interface eth0.IPv4 with address 192.168.2.67. Jan 28 16:04:50 Tower avahi-daemon[5366]: New relevant interface eth0.IPv4 for mDNS. Jan 28 16:04:50 Tower avahi-daemon[5366]: Network interface enumeration completed. Jan 28 16:04:50 Tower avahi-daemon[5366]: Registering new address record for 192.168.2.67 on eth0.IPv4. Jan 28 16:04:50 Tower avahi-daemon[5366]: Registering HINFO record with values 'X86_64'/'LINUX'. Jan 28 16:04:50 Tower emhttp: shcmd (38): /etc/rc.d/rc.avahidnsconfd start |& logger Jan 28 16:04:50 Tower logger: Starting Avahi mDNS/DNS-SD DNS Server Configuration Daemon: /usr/sbin/avahi-dnsconfd -D Jan 28 16:04:50 Tower avahi-dnsconfd[5375]: Successfully connected to Avahi daemon. Jan 28 16:04:50 Tower emhttp: Starting Docker... Jan 28 16:04:50 Tower logger: Not starting Docker: no image file defined Jan 28 16:04:51 Tower avahi-daemon[5366]: Server startup complete. Host name is Tower.local. Local service cookie is 3954287376. Jan 28 16:04:52 Tower avahi-daemon[5366]: Service "Tower" (/services/ssh.service) successfully established. Jan 28 16:04:52 Tower avahi-daemon[5366]: Service "Tower" (/services/smb.service) successfully established. Jan 28 16:04:52 Tower avahi-daemon[5366]: Service "Tower" (/services/sftp-ssh.service) successfully established. Jan 28 16:06:28 Tower kernel: mdcmd (40): spinup 0 Jan 28 16:06:28 Tower kernel: mdcmd (41): spinup 1 Jan 28 16:06:28 Tower kernel: mdcmd (42): spinup 2 Jan 28 16:06:28 Tower kernel: mdcmd (43): spinup 3 Jan 28 16:06:28 Tower kernel: mdcmd (44): spinup 4 Jan 28 16:06:28 Tower emhttp: Spinning up all drives... Jan 28 16:06:47 Tower emhttp: shcmd (39): :>/etc/samba/smb-shares.conf Jan 28 16:06:47 Tower emhttp: shcmd (40): cp /etc/exports- /etc/exports Jan 28 16:06:47 Tower avahi-daemon[5366]: Files changed, reloading. Jan 28 16:06:47 Tower emhttp: Restart SMB... Jan 28 16:06:47 Tower emhttp: shcmd (41): killall -HUP smbd Jan 28 16:06:47 Tower emhttp: shcmd (42): smbcontrol smbd close-share 'flash' Jan 28 16:06:47 Tower emhttp: shcmd (43): cp /etc/avahi/services/smb.service- /etc/avahi/services/smb.service Jan 28 16:06:47 Tower avahi-daemon[5366]: Files changed, reloading. Jan 28 16:06:47 Tower avahi-daemon[5366]: Service group file /services/smb.service changed, reloading. Jan 28 16:06:47 Tower emhttp: shcmd (44): pidof rpc.mountd &> /dev/null Jan 28 16:06:47 Tower emhttp: Start NFS... Jan 28 16:06:47 Tower emhttp: shcmd (45): /etc/rc.d/rc.nfsd start |& logger Jan 28 16:06:47 Tower emhttp: shcmd (46): /etc/rc.d/rc.atalk status Jan 28 16:06:48 Tower avahi-daemon[5366]: Service "Tower" (/services/smb.service) successfully established. tower-diagnostics-20160128-1640.zip
January 29, 201610 yr Author Honestly, I don't know. The server is running without a monitor. It does not reboot, that has to be done manually, nor is the computer shut down. The server management page becomes unresponsive, and the network share drops off the network. The power has to be shut off/on before it can be rebooted. Thinking about this more systematically, the computer requires two hard power cycles to boot back up from the USB flash drive. Perhaps the power supply is bad? I frankly have no idea. Thanks for replying.
January 29, 201610 yr can you connect monitor to computer and see what messages are displayed during boot up? i think it might be a power supply problem.
January 29, 201610 yr It does not reboot, that has to be done manually, nor is the computer shut down. The server management page becomes unresponsive, and the network share drops off the network. ssh?
January 29, 201610 yr Memtest would also be a good place to start, if you can connect a monitor. It should be able to run for 24 hours+ with 0 errors.
February 5, 201610 yr Author I attached a monitor, and booted up in safe mode. The system reported corruption on one of the disk. I immediately took the array offline. Since this is an older drive, I'd rather just replace it the drive than try to repair and recover files. From my understanding of how UnRaid works, I should be able to simply: 1 - Remove the corrupted drive 2- restart the array 3 - Unraid will see that there is a new drive, and rebuild the contents of the drive from parity drive Is that correct? Is there any benefit to trying to repair the drive. Still not sure if this is why the entire system was crashing and becoming unresposnsive, but all the suggestions have been helpful Thanks log follows ===================== Feb 5 06:44:50 Tower emhttp: shcmd (190): udevadm settle Feb 5 06:44:50 Tower emhttp: Hitachi_HDS721010CLA332_JP2921HQ200Z2A (sda) 976762584 Feb 5 06:44:50 Tower emhttp: ST2000DL003-9VT166_5YD781ZC (sdb) 1953514584 Feb 5 06:44:50 Tower emhttp: SAMSUNG_HD203WI_S1UYJ1CZ405241 (sdc) 1953514584 Feb 5 06:44:50 Tower emhttp: Hitachi_HDS721010CLA332_JP2921HQ1WWNWA (sdd) 976762584 Feb 5 06:44:50 Tower emhttp: TOSHIBA_DT01ACA200_23JESDVXS (sde) 1953514584 Feb 5 06:44:50 Tower emhttp: array slots: 24 Feb 5 06:44:50 Tower emhttp: cache slots: 1 Feb 5 06:44:50 Tower kernel: mdcmd (1): import 0 8,16 1953514552 ST2000DL003-9VT166_5YD781ZC Feb 5 06:44:50 Tower kernel: md: import disk0: [8,16] (sdb) ST2000DL003-9VT166_5YD781ZC size: 1953514552 Feb 5 06:44:50 Tower kernel: mdcmd (2): import 1 8,0 976762552 Hitachi_HDS721010CLA332_JP2921HQ200Z2A Feb 5 06:44:50 Tower kernel: md: import disk1: [8,0] (sda) Hitachi_HDS721010CLA332_JP2921HQ200Z2A size: 976762552 Feb 5 06:44:50 Tower kernel: mdcmd (3): import 2 8,32 1953514552 SAMSUNG_HD203WI_S1UYJ1CZ405241 Feb 5 06:44:50 Tower kernel: md: import disk2: [8,32] (sdc) SAMSUNG_HD203WI_S1UYJ1CZ405241 size: 1953514552 Feb 5 06:44:50 Tower kernel: mdcmd (4): import 3 8,48 976762552 Hitachi_HDS721010CLA332_JP2921HQ1WWNWA Feb 5 06:44:50 Tower kernel: md: import disk3: [8,48] (sdd) Hitachi_HDS721010CLA332_JP2921HQ1WWNWA size: 976762552 Feb 5 06:44:50 Tower kernel: mdcmd (5): import 4 8,64 1953514552 TOSHIBA_DT01ACA200_23JESDVXS Feb 5 06:44:50 Tower kernel: md: import disk4: [8,64] (sde) TOSHIBA_DT01ACA200_23JESDVXS size: 1953514552 Feb 5 06:44:50 Tower kernel: mdcmd (6): import 5 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (7): import 6 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (: import 7 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (9): import 8 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (10): import 9 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (11): import 10 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (12): import 11 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (13): import 12 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (14): import 13 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (15): import 14 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (16): import 15 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (17): import 16 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (18): import 17 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (19): import 18 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (20): import 19 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (21): import 20 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (22): import 21 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (23): import 22 0,0 Feb 5 06:44:50 Tower kernel: mdcmd (24): import 23 0,0 Feb 5 06:44:50 Tower emhttp: import 24 cache device: no device Feb 5 06:44:50 Tower emhttp: import flash device: sdf Feb 5 06:45:35 Tower emhttp: shcmd (191): rmmod md-mod |& logger Feb 5 06:45:35 Tower kernel: md: unRAID driver removed Feb 5 06:45:35 Tower emhttp: shcmd (192): modprobe md-mod super=/boot/config/super.dat slots=24 |& logger Feb 5 06:45:35 Tower kernel: md: unRAID driver 2.5.3 installed Feb 5 06:45:35 Tower emhttp: get_message: /boot/config/._Plus.key (-4) Feb 5 06:45:35 Tower emhttp: Plus key detected, GUID: 05DC-C75D-7F00-57D7425C7A68 FILE: /boot/config/Plus.key Feb 5 06:45:35 Tower emhttp: Device inventory: Feb 5 06:45:35 Tower emhttp: shcmd (193): udevadm settle Feb 5 06:45:35 Tower emhttp: Hitachi_HDS721010CLA332_JP2921HQ200Z2A (sda) 976762584 Feb 5 06:45:35 Tower emhttp: ST2000DL003-9VT166_5YD781ZC (sdb) 1953514584 Feb 5 06:45:35 Tower emhttp: SAMSUNG_HD203WI_S1UYJ1CZ405241 (sdc) 1953514584 Feb 5 06:45:35 Tower emhttp: Hitachi_HDS721010CLA332_JP2921HQ1WWNWA (sdd) 976762584 Feb 5 06:45:35 Tower emhttp: TOSHIBA_DT01ACA200_23JESDVXS (sde) 1953514584 Feb 5 06:45:35 Tower emhttp: array slots: 24 Feb 5 06:45:35 Tower emhttp: cache slots: 1 Feb 5 06:45:35 Tower kernel: mdcmd (1): import 0 8,16 1953514552 ST2000DL003-9VT166_5YD781ZC Feb 5 06:45:35 Tower kernel: md: import disk0: [8,16] (sdb) ST2000DL003-9VT166_5YD781ZC size: 1953514552 Feb 5 06:45:35 Tower kernel: mdcmd (2): import 1 8,0 976762552 Hitachi_HDS721010CLA332_JP2921HQ200Z2A Feb 5 06:45:35 Tower kernel: md: import disk1: [8,0] (sda) Hitachi_HDS721010CLA332_JP2921HQ200Z2A size: 976762552 Feb 5 06:45:35 Tower kernel: mdcmd (3): import 2 8,32 1953514552 SAMSUNG_HD203WI_S1UYJ1CZ405241 Feb 5 06:45:35 Tower kernel: md: import disk2: [8,32] (sdc) SAMSUNG_HD203WI_S1UYJ1CZ405241 size: 1953514552 Feb 5 06:45:35 Tower kernel: mdcmd (4): import 3 8,48 976762552 Hitachi_HDS721010CLA332_JP2921HQ1WWNWA Feb 5 06:45:35 Tower kernel: md: import disk3: [8,48] (sdd) Hitachi_HDS721010CLA332_JP2921HQ1WWNWA size: 976762552 Feb 5 06:45:35 Tower emhttp: import 24 cache device: no device Feb 5 06:45:35 Tower kernel: mdcmd (5): import 4 8,64 1953514552 TOSHIBA_DT01ACA200_23JESDVXS Feb 5 06:45:35 Tower kernel: md: import disk4: [8,64] (sde) TOSHIBA_DT01ACA200_23JESDVXS size: 1953514552 Feb 5 06:45:35 Tower kernel: mdcmd (6): import 5 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (7): import 6 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (: import 7 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (9): import 8 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (10): import 9 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (11): import 10 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (12): import 11 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (13): import 12 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (14): import 13 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (15): import 14 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (16): import 15 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (17): import 16 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (18): import 17 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (19): import 18 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (20): import 19 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (21): import 20 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (22): import 21 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (23): import 22 0,0 Feb 5 06:45:35 Tower kernel: mdcmd (24): import 23 0,0 Feb 5 06:45:35 Tower emhttp: import flash device: sdf Feb 5 06:45:41 Tower emhttp: shcmd (194): rmmod md-mod |& logger Feb 5 06:45:41 Tower kernel: md: unRAID driver removed Feb 5 06:45:41 Tower emhttp: shcmd (195): modprobe md-mod super=/boot/config/super.dat slots=24 |& logger Feb 5 06:45:41 Tower kernel: md: unRAID driver 2.5.3 installed Feb 5 06:45:41 Tower emhttp: get_message: /boot/config/._Plus.key (-4) Feb 5 06:45:41 Tower emhttp: Plus key detected, GUID: 05DC-C75D-7F00-57D7425C7A68 FILE: /boot/config/Plus.key Feb 5 06:45:41 Tower emhttp: Device inventory: Feb 5 06:45:41 Tower emhttp: shcmd (196): udevadm settle Feb 5 06:45:41 Tower emhttp: Hitachi_HDS721010CLA332_JP2921HQ200Z2A (sda) 976762584 Feb 5 06:45:41 Tower emhttp: ST2000DL003-9VT166_5YD781ZC (sdb) 1953514584 Feb 5 06:45:41 Tower emhttp: SAMSUNG_HD203WI_S1UYJ1CZ405241 (sdc) 1953514584 Feb 5 06:45:41 Tower emhttp: Hitachi_HDS721010CLA332_JP2921HQ1WWNWA (sdd) 976762584 Feb 5 06:45:41 Tower emhttp: TOSHIBA_DT01ACA200_23JESDVXS (sde) 1953514584 Feb 5 06:45:41 Tower emhttp: array slots: 24 Feb 5 06:45:41 Tower emhttp: cache slots: 1 Feb 5 06:45:41 Tower kernel: mdcmd (1): import 0 8,16 1953514552 ST2000DL003-9VT166_5YD781ZC Feb 5 06:45:41 Tower kernel: md: import disk0: [8,16] (sdb) ST2000DL003-9VT166_5YD781ZC size: 1953514552 Feb 5 06:45:41 Tower kernel: mdcmd (2): import 1 8,0 976762552 Hitachi_HDS721010CLA332_JP2921HQ200Z2A Feb 5 06:45:41 Tower kernel: md: import disk1: [8,0] (sda) Hitachi_HDS721010CLA332_JP2921HQ200Z2A size: 976762552 Feb 5 06:45:41 Tower kernel: mdcmd (3): import 2 8,32 1953514552 SAMSUNG_HD203WI_S1UYJ1CZ405241 Feb 5 06:45:41 Tower kernel: md: import disk2: [8,32] (sdc) SAMSUNG_HD203WI_S1UYJ1CZ405241 size: 1953514552 Feb 5 06:45:41 Tower kernel: mdcmd (4): import 3 8,48 976762552 Hitachi_HDS721010CLA332_JP2921HQ1WWNWA Feb 5 06:45:41 Tower kernel: md: import disk3: [8,48] (sdd) Hitachi_HDS721010CLA332_JP2921HQ1WWNWA size: 976762552 Feb 5 06:45:41 Tower kernel: mdcmd (5): import 4 8,64 1953514552 TOSHIBA_DT01ACA200_23JESDVXS Feb 5 06:45:41 Tower kernel: md: import disk4: [8,64] (sde) TOSHIBA_DT01ACA200_23JESDVXS size: 1953514552 Feb 5 06:45:41 Tower kernel: mdcmd (6): import 5 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (7): import 6 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (: import 7 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (9): import 8 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (10): import 9 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (11): import 10 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (12): import 11 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (13): import 12 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (14): import 13 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (15): import 14 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (16): import 15 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (17): import 16 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (18): import 17 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (19): import 18 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (20): import 19 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (21): import 20 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (22): import 21 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (23): import 22 0,0 Feb 5 06:45:41 Tower kernel: mdcmd (24): import 23 0,0 Feb 5 06:45:41 Tower emhttp: import 24 cache device: no device Feb 5 06:45:41 Tower emhttp: import flash device: sdf Feb 5 06:45:55 Tower emhttp: shcmd (197): rmmod md-mod |& logger Feb 5 06:45:55 Tower kernel: md: unRAID driver removed Feb 5 06:45:55 Tower emhttp: shcmd (198): modprobe md-mod super=/boot/config/super.dat slots=24 |& logger Feb 5 06:45:55 Tower kernel: md: unRAID driver 2.5.3 installed Feb 5 06:45:55 Tower emhttp: get_message: /boot/config/._Plus.key (-4) Feb 5 06:45:55 Tower emhttp: Plus key detected, GUID: 05DC-C75D-7F00-57D7425C7A68 FILE: /boot/config/Plus.key Feb 5 06:45:55 Tower emhttp: Device inventory: Feb 5 06:45:55 Tower emhttp: shcmd (199): udevadm settle Feb 5 06:45:55 Tower emhttp: Hitachi_HDS721010CLA332_JP2921HQ200Z2A (sda) 976762584 Feb 5 06:45:55 Tower emhttp: ST2000DL003-9VT166_5YD781ZC (sdb) 1953514584 Feb 5 06:45:55 Tower emhttp: SAMSUNG_HD203WI_S1UYJ1CZ405241 (sdc) 1953514584 Feb 5 06:45:55 Tower emhttp: Hitachi_HDS721010CLA332_JP2921HQ1WWNWA (sdd) 976762584 Feb 5 06:45:55 Tower emhttp: TOSHIBA_DT01ACA200_23JESDVXS (sde) 1953514584 Feb 5 06:45:55 Tower emhttp: array slots: 24 Feb 5 06:45:55 Tower emhttp: cache slots: 1 Feb 5 06:45:55 Tower kernel: mdcmd (1): import 0 8,16 1953514552 ST2000DL003-9VT166_5YD781ZC Feb 5 06:45:55 Tower kernel: md: import disk0: [8,16] (sdb) ST2000DL003-9VT166_5YD781ZC size: 1953514552 Feb 5 06:45:55 Tower kernel: mdcmd (2): import 1 8,0 976762552 Hitachi_HDS721010CLA332_JP2921HQ200Z2A Feb 5 06:45:55 Tower kernel: md: import disk1: [8,0] (sda) Hitachi_HDS721010CLA332_JP2921HQ200Z2A size: 976762552 Feb 5 06:45:55 Tower kernel: mdcmd (3): import 2 8,32 1953514552 SAMSUNG_HD203WI_S1UYJ1CZ405241 Feb 5 06:45:55 Tower kernel: md: import disk2: [8,32] (sdc) SAMSUNG_HD203WI_S1UYJ1CZ405241 size: 1953514552 Feb 5 06:45:55 Tower kernel: mdcmd (4): import 3 8,48 976762552 Hitachi_HDS721010CLA332_JP2921HQ1WWNWA Feb 5 06:45:55 Tower kernel: md: import disk3: [8,48] (sdd) Hitachi_HDS721010CLA332_JP2921HQ1WWNWA size: 976762552 Feb 5 06:45:55 Tower kernel: mdcmd (5): import 4 8,64 1953514552 TOSHIBA_DT01ACA200_23JESDVXS Feb 5 06:45:55 Tower kernel: md: import disk4: [8,64] (sde) TOSHIBA_DT01ACA200_23JESDVXS size: 1953514552 Feb 5 06:45:55 Tower kernel: mdcmd (6): import 5 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (7): import 6 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (: import 7 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (9): import 8 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (10): import 9 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (11): import 10 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (12): import 11 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (13): import 12 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (14): import 13 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (15): import 14 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (16): import 15 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (17): import 16 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (18): import 17 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (19): import 18 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (20): import 19 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (21): import 20 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (22): import 21 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (23): import 22 0,0 Feb 5 06:45:55 Tower kernel: mdcmd (24): import 23 0,0 Feb 5 06:45:55 Tower emhttp: import 24 cache device: no device Feb 5 06:45:55 Tower emhttp: import flash device: sdf Feb 5 06:45:58 Tower emhttp: shcmd (200): rmmod md-mod |& logger Feb 5 06:45:58 Tower kernel: md: unRAID driver removed Feb 5 06:45:58 Tower emhttp: shcmd (201): modprobe md-mod super=/boot/config/super.dat slots=24 |& logger Feb 5 06:45:58 Tower kernel: md: unRAID driver 2.5.3 installed Feb 5 06:45:58 Tower emhttp: get_message: /boot/config/._Plus.key (-4) Feb 5 06:45:58 Tower emhttp: Plus key detected, GUID: 05DC-C75D-7F00-57D7425C7A68 FILE: /boot/config/Plus.key Feb 5 06:45:58 Tower emhttp: Device inventory: Feb 5 06:45:58 Tower emhttp: shcmd (202): udevadm settle Feb 5 06:45:58 Tower emhttp: Hitachi_HDS721010CLA332_JP2921HQ200Z2A (sda) 976762584 Feb 5 06:45:58 Tower emhttp: ST2000DL003-9VT166_5YD781ZC (sdb) 1953514584 Feb 5 06:45:58 Tower emhttp: SAMSUNG_HD203WI_S1UYJ1CZ405241 (sdc) 1953514584 Feb 5 06:45:58 Tower emhttp: Hitachi_HDS721010CLA332_JP2921HQ1WWNWA (sdd) 976762584 Feb 5 06:45:58 Tower emhttp: TOSHIBA_DT01ACA200_23JESDVXS (sde) 1953514584 Feb 5 06:45:58 Tower emhttp: array slots: 24 Feb 5 06:45:58 Tower emhttp: cache slots: 1 Feb 5 06:45:58 Tower kernel: mdcmd (1): import 0 8,16 1953514552 ST2000DL003-9VT166_5YD781ZC Feb 5 06:45:58 Tower kernel: md: import disk0: [8,16] (sdb) ST2000DL003-9VT166_5YD781ZC size: 1953514552 Feb 5 06:45:58 Tower kernel: mdcmd (2): import 1 8,0 976762552 Hitachi_HDS721010CLA332_JP2921HQ200Z2A Feb 5 06:45:58 Tower kernel: md: import disk1: [8,0] (sda) Hitachi_HDS721010CLA332_JP2921HQ200Z2A size: 976762552 Feb 5 06:45:58 Tower kernel: mdcmd (3): import 2 8,32 1953514552 SAMSUNG_HD203WI_S1UYJ1CZ405241 Feb 5 06:45:58 Tower kernel: md: import disk2: [8,32] (sdc) SAMSUNG_HD203WI_S1UYJ1CZ405241 size: 1953514552 Feb 5 06:45:58 Tower kernel: mdcmd (4): import 3 8,48 976762552 Hitachi_HDS721010CLA332_JP2921HQ1WWNWA Feb 5 06:45:58 Tower kernel: md: import disk3: [8,48] (sdd) Hitachi_HDS721010CLA332_JP2921HQ1WWNWA size: 976762552 Feb 5 06:45:58 Tower kernel: mdcmd (5): import 4 8,64 1953514552 TOSHIBA_DT01ACA200_23JESDVXS Feb 5 06:45:58 Tower kernel: md: import disk4: [8,64] (sde) TOSHIBA_DT01ACA200_23JESDVXS size: 1953514552 Feb 5 06:45:58 Tower kernel: mdcmd (6): import 5 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (7): import 6 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (: import 7 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (9): import 8 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (10): import 9 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (11): import 10 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (12): import 11 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (13): import 12 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (14): import 13 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (15): import 14 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (16): import 15 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (17): import 16 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (18): import 17 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (19): import 18 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (20): import 19 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (21): import 20 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (22): import 21 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (23): import 22 0,0 Feb 5 06:45:58 Tower kernel: mdcmd (24): import 23 0,0 Feb 5 06:45:58 Tower emhttp: import 24 cache device: no device Feb 5 06:45:58 Tower emhttp: import flash device: sdf Feb 5 06:45:59 Tower emhttp: shcmd (203): rmmod md-mod |& logger Feb 5 06:45:59 Tower kernel: md: unRAID driver removed Feb 5 06:45:59 Tower emhttp: shcmd (204): modprobe md-mod super=/boot/config/super.dat slots=24 |& logger Feb 5 06:45:59 Tower kernel: md: unRAID driver 2.5.3 installed Feb 5 06:45:59 Tower emhttp: get_message: /boot/config/._Plus.key (-4) Feb 5 06:45:59 Tower emhttp: Plus key detected, GUID: 05DC-C75D-7F00-57D7425C7A68 FILE: /boot/config/Plus.key Feb 5 06:45:59 Tower emhttp: Device inventory: Feb 5 06:45:59 Tower emhttp: shcmd (205): udevadm settle Feb 5 06:45:59 Tower emhttp: Hitachi_HDS721010CLA332_JP2921HQ200Z2A (sda) 976762584 Feb 5 06:45:59 Tower emhttp: ST2000DL003-9VT166_5YD781ZC (sdb) 1953514584 Feb 5 06:45:59 Tower emhttp: SAMSUNG_HD203WI_S1UYJ1CZ405241 (sdc) 1953514584 Feb 5 06:45:59 Tower emhttp: Hitachi_HDS721010CLA332_JP2921HQ1WWNWA (sdd) 976762584 Feb 5 06:45:59 Tower emhttp: TOSHIBA_DT01ACA200_23JESDVXS (sde) 1953514584 Feb 5 06:45:59 Tower emhttp: array slots: 24 Feb 5 06:45:59 Tower emhttp: cache slots: 1 Feb 5 06:45:59 Tower kernel: mdcmd (1): import 0 8,16 1953514552 ST2000DL003-9VT166_5YD781ZC Feb 5 06:45:59 Tower kernel: md: import disk0: [8,16] (sdb) ST2000DL003-9VT166_5YD781ZC size: 1953514552 Feb 5 06:45:59 Tower kernel: mdcmd (2): import 1 8,0 976762552 Hitachi_HDS721010CLA332_JP2921HQ200Z2A Feb 5 06:45:59 Tower kernel: md: import disk1: [8,0] (sda) Hitachi_HDS721010CLA332_JP2921HQ200Z2A size: 976762552 Feb 5 06:45:59 Tower kernel: mdcmd (3): import 2 8,32 1953514552 SAMSUNG_HD203WI_S1UYJ1CZ405241 Feb 5 06:45:59 Tower kernel: md: import disk2: [8,32] (sdc) SAMSUNG_HD203WI_S1UYJ1CZ405241 size: 1953514552 Feb 5 06:45:59 Tower kernel: mdcmd (4): import 3 8,48 976762552 Hitachi_HDS721010CLA332_JP2921HQ1WWNWA Feb 5 06:45:59 Tower kernel: md: import disk3: [8,48] (sdd) Hitachi_HDS721010CLA332_JP2921HQ1WWNWA size: 976762552 Feb 5 06:45:59 Tower kernel: mdcmd (5): import 4 8,64 1953514552 TOSHIBA_DT01ACA200_23JESDVXS Feb 5 06:45:59 Tower kernel: md: import disk4: [8,64] (sde) TOSHIBA_DT01ACA200_23JESDVXS size: 1953514552 Feb 5 06:45:59 Tower kernel: mdcmd (6): import 5 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (7): import 6 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (: import 7 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (9): import 8 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (10): import 9 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (11): import 10 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (12): import 11 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (13): import 12 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (14): import 13 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (15): import 14 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (16): import 15 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (17): import 16 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (18): import 17 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (19): import 18 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (20): import 19 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (21): import 20 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (22): import 21 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (23): import 22 0,0 Feb 5 06:45:59 Tower kernel: mdcmd (24): import 23 0,0 Feb 5 06:45:59 Tower emhttp: import 24 cache device: no device Feb 5 06:45:59 Tower emhttp: import flash device: sdf tower-diagnostics-20160205-0646.zip
February 5, 201610 yr Community Expert Did you try a memtest? If it is a corrupt filesystem rebuilding from parity probably won't help.
February 5, 201610 yr Community Expert Like trurl pointed out, rebuilding won't fix file system corruption, SMART for all your disks looks fine, corruption was probably caused by the server crashing, if you haven't yet you should run memtest for a few passes and if there are no errors repair fs on disk4. https://lime-technology.com/wiki/index.php/Check_Disk_Filesystems#Drives_formatted_with_XFS
February 6, 201610 yr Author I replaced both memory sticks (since I already had case open) and ran the memtest for 12 hours. No errors on the new memory. I'm repairing the file system now. Thanks
Archived
This topic is now archived and is closed to further replies.