Well i guess i spoke to soon,..... when i try to add my new 20tb drive for parity disk, The Disk #1 drops out or disk #2 reports errors. This goes away if remove the parity drive. The 20tb shows under unassigned devices without issue , so after new sata controller, new higher out power supply, and cables it allowed me to add the 5th drive but now i cant add a 6th drive, im really stumped now, i attached everything i can think of hoping the problem is found
5 added drives after new power supply
adding 20tb as parity, then created new config, but this time i checked the box that said Parity was already Valid and no errors
all disk added no errors
Started Parity sync , has errors and shows a new 16tb drive in unassigned devices that matches the number of disk#5 and has errors
this is the syslog, all errors were in red,
text error warn system array login
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=18960
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=18968
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=18976
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=18984
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=18992
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19000
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19008
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19016
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19024
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19032
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19040
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19048
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19056
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19064
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19072
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19080
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19088
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19096
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19104
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19112
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19120
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19128
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19136
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19144
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19152
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19160
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19168
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19176
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19184
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19192
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19200
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19208
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19216
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19224
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19232
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19240
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19248
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19256
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19264
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19272
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19280
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19288
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19296
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19304
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19312
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19320
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19328
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19336
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19344
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19352
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19360
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19368
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19376
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19384
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19392
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19400
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19408
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19416
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19424
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19432
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19400
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19408
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19416
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19424
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19432
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19440
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: disk5 write error, sector=19448
Mar 14 15:21:03 Colossus-Mark-2 kernel: md: recovery thread: exit status: -4
Mar 14 15:21:03 Colossus-Mark-2 kernel: mpt3sas_cm0: log_info(0x31110e03): originator(PL), code(0x11), sub_code(0x0e03)
Mar 14 15:21:03 Colossus-Mark-2 kernel: mpt3sas_cm0: log_info(0x31110e03): originator(PL), code(0x11), sub_code(0x0e03)
Mar 14 15:21:03 Colossus-Mark-2 kernel: sd 11:0:4:0: [sdi] tag#3273 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s
Mar 14 15:21:03 Colossus-Mark-2 kernel: sd 11:0:4:0: [sdi] tag#3273 CDB: opcode=0x88 88 00 00 00 00 00 00 00 00 78 00 00 00 08 00 00
Mar 14 15:21:03 Colossus-Mark-2 kernel: I/O error, dev sdi, sector 120 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0
Mar 14 15:21:03 Colossus-Mark-2 unassigned.devices: Disk with ID 'OOS16000G_0000GDBV (sdb)' is not set to auto mount.
Mar 14 15:21:03 Colossus-Mark-2 unassigned.devices: Disk with ID 'OOS16000G_0000GDBV (sdc)' is not set to auto mount.
Mar 14 15:21:03 Colossus-Mark-2 unassigned.devices: Disk with ID 'WDC_WD101EFAX-68LDBN0_VCGL80EP (sdj)' is not set to auto mount.
Mar 14 15:21:03 Colossus-Mark-2 unassigned.devices: Disk with ID 'OOS16000G_0000GDBV (sdl)' is not set to auto mount.
Mar 14 15:21:03 Colossus-Mark-2 kernel: sd 11:0:4:0: Power-on or device reset occurred
Mar 14 15:21:03 Colossus-Mark-2 emhttpd: error: hotplug_devices, 1730: No medium found (123): Error: tagged device OOS16000G_0000GDBV was (sdg) is now (sdl)
Mar 14 15:21:03 Colossus-Mark-2 emhttpd: read SMART /dev/sdl
Mar 14 15:21:03 Colossus-Mark-2 kernel: emhttpd[6434]: segfault at 674 ip 0000559e173189d4 sp 00007ffce179a5a0 error 4 in emhttpd[559e17306000+21000]
Mar 14 15:21:03 Colossus-Mark-2 kernel: Code: 8e 27 01 00 48 89 45 f8 48 8d 05 72 27 01 00 48 89 45 f0 e9 79 01 00 00 8b 45 ec 89 c7 e8 89 b1 ff ff 48 89 45 d8 48 8b 45 d8 <8b> 80 74 06 00 00 85 c0 0f 94 c0 0f b6 c0 89 45 d4 48 8b 45 e0 48
Mar 14 15:21:04 Colossus-Mark-2 kernel: mpt3sas_cm0: log_info(0x31110e03): originator(PL), code(0x11), sub_code(0x0e03)
Mar 14 15:21:04 Colossus-Mark-2 kernel: sd 11:0:4:0: Power-on or device reset occurred
Mar 14 15:21:04 Colossus-Mark-2 kernel: mpt3sas_cm0: log_info(0x31110e03): originator(PL), code(0x11), sub_code(0x0e03)
Mar 14 15:21:05 Colossus-Mark-2 kernel: sd 11:0:4:0: Power-on or device reset occurred
Mar 14 15:21:05 Colossus-Mark-2 kernel: mpt3sas_cm0: log_info(0x31110e03): originator(PL), code(0x11), sub_code(0x0e03)
Mar 14 15:21:06 Colossus-Mark-2 kernel: sd 11:0:4:0: Power-on or device reset occurred
Mar 14 15:21:06 Colossus-Mark-2 kernel: mpt3sas_cm0: log_info(0x31110e03): originator(PL), code(0x11), sub_code(0x0e03)
Mar 14 15:21:06 Colossus-Mark-2 kernel: sd 11:0:4:0: Power-on or device reset occurred
Mar 14 15:21:24 Colossus-Mark-2 flash_backup: adding task: /usr/local/emhttp/plugins/dynamix.my.servers/scripts/UpdateFlashBackup update
Mar 14 15:30:00 Colossus-Mark-2 unassigned.devices: Removing configuration 'WDC_WD80EFZX-68UW8N0_R6GK332Y'.
Mar 14 15:30:04 Colossus-Mark-2 unassigned.devices: Removing configuration 'ST16000NM001G-2KK103_ZL214Y01'.
Mar 14 15:30:08 Colossus-Mark-2 unassigned.devices: Removing configuration 'ST16000NM001G-2KK103_ZL23E5CT'.
Mar 14 15:30:24 Colossus-Mark-2 flash_backup: adding task: /usr/local/emhttp/plugins/dynamix.my.servers/scripts/UpdateFlashBackup update
during shutdown
Mar 14 15:43:10 Colossus-Mark-2 nginx: 2023/03/14 15:43:10 [error] 6814#6814: *30229 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 192.168.1.184, server: , request: "POST /update.htm HTTP/1.1", upstream: "http://unix:/var/run/emhttpd.socket/update.htm", host: "192.168.1.33", referrer: "http://192.168.1.33/Main"
Mar 14 15:44:59 Colossus-Mark-2 shutdown[32577]: shutting down for system reboot
Mar 14 15:44:59 Colossus-Mark-2 init: Switching to runlevel: 6
Mar 14 15:44:59 Colossus-Mark-2 flash_backup: stop watching for file changes
Mar 14 15:44:59 Colossus-Mark-2 init: Trying to re-exec init
Mar 14 15:46:31 Colossus-Mark-2 root: Status of all loop devices
Mar 14 15:46:31 Colossus-Mark-2 root: /dev/loop1: [2049]:11 (/boot/bzmodules)
Mar 14 15:46:31 Colossus-Mark-2 root: /dev/loop2: [2097]:1073741961 (/mnt/docker-pool/system/docker/docker.img)
Mar 14 15:46:31 Colossus-Mark-2 root: /dev/loop0: [2049]:9 (/boot/bzfirmware)
Mar 14 15:46:31 Colossus-Mark-2 root: /dev/loop3: [2097]:2149437262 (/mnt/docker-pool/system/libvirt/libvirt.img)
Mar 14 15:46:31 Colossus-Mark-2 root: Active pids left on /mnt/*
Mar 14 15:46:31 Colossus-Mark-2 root: USER PID ACCESS COMMAND
Mar 14 15:46:31 Colossus-Mark-2 root: /mnt/addons: root kernel mount /mnt/addons
Mar 14 15:46:31 Colossus-Mark-2 root: /mnt/disk1: root kernel mount /mnt/disk1
Mar 14 15:46:31 Colossus-Mark-2 root: /mnt/disk2: root kernel mount /mnt/disk2
Mar 14 15:46:31 Colossus-Mark-2 root: /mnt/disk3: root kernel mount /mnt/disk3
Mar 14 15:46:31 Colossus-Mark-2 root: /mnt/disk4: root kernel mount /mnt/disk4
Mar 14 15:46:31 Colossus-Mark-2 root: /mnt/disk5: root kernel mount /mnt/disk5
Mar 14 15:46:31 Colossus-Mark-2 root: /mnt/disks: root kernel mount /mnt/disks
Mar 14 15:46:31 Colossus-Mark-2 root: /mnt/docker-pool: root kernel mount /mnt/docker-pool
Mar 14 15:46:31 Colossus-Mark-2 root: /mnt/remotes: root kernel mount /mnt/remotes
Mar 14 15:46:31 Colossus-Mark-2 root: /mnt/rootshare: root kernel mount /mnt/rootshare
Mar 14 15:46:31 Colossus-Mark-2 root: /mnt/user: root kernel mount /mnt/user
Mar 14 15:46:31 Colossus-Mark-2 root: /mnt/user0: root kernel mount /mnt/user0
Mar 14 15:46:31 Colossus-Mark-2 root: Active pids left on /dev/md*
Mar 14 15:46:31 Colossus-Mark-2 root: USER PID ACCESS COMMAND
Mar 14 15:46:31 Colossus-Mark-2 root: /dev/md1: root kernel mount /mnt/disk1
Mar 14 15:46:31 Colossus-Mark-2 root: /dev/md2: root kernel mount /mnt/disk2
Mar 14 15:46:31 Colossus-Mark-2 root: /dev/md3: root kernel mount /mnt/disk3
Mar 14 15:46:31 Colossus-Mark-2 root: /dev/md4: root kernel mount /mnt/disk4
Mar 14 15:46:31 Colossus-Mark-2 root: /dev/md5: root kernel mount /mnt/disk5
Mar 14 15:46:31 Colossus-Mark-2 root: Generating diagnostics...
Mar 14 15:46:42 Colossus-Mark-2 unraid-api[7197]: 👋 Farewell. UNRAID API shutting down!
Mar 14 15:46:54 Colossus-Mark-2 avahi-daemon[32868]: Got SIGTERM, quitting.
Mar 14 15:46:54 Colossus-Mark-2 avahi-dnsconfd[32879]: read(): EOF
Mar 14 15:46:54 Colossus-Mark-2 avahi-daemon[32868]: Leaving mDNS multicast group on interface vethe82a48c.IPv6 with address fe80::b4f3:4fff:fed1:2b6d.
Mar 14 15:46:54 Colossus-Mark-2 avahi-daemon[32868]: Leaving mDNS multicast group on interface docker0.IPv6 with address fe80::42:f1ff:feb4:a653.
Mar 14 15:46:54 Colossus-Mark-2 avahi-daemon[32868]: Leaving mDNS multicast group on interface docker0.IPv4 with address 172.17.0.1.
Mar 14 15:46:54 Colossus-Mark-2 avahi-daemon[32868]: Leaving mDNS multicast group on interface br0.IPv4 with address 192.168.1.33.
Mar 14 15:46:54 Colossus-Mark-2 avahi-daemon[32868]: Leaving mDNS multicast group on interface lo.IPv6 with address ::1.
Mar 14 15:46:54 Colossus-Mark-2 avahi-daemon[32868]: Leaving mDNS multicast group on interface lo.IPv4 with address 127.0.0.1.
Mar 14 15:46:54 Colossus-Mark-2 avahi-daemon[32868]: avahi-daemon 0.8 exiting.
Mar 14 15:46:54 Colossus-Mark-2 wsdd2[32834]: 'Terminated' signal received.
Mar 14 15:46:54 Colossus-Mark-2 winbindd[32840]: [2023/03/14 15:46:54.138920, 0] ../../source3/winbindd/winbindd_dual.c:1957(winbindd_sig_term_handler)
Mar 14 15:46:54 Colossus-Mark-2 winbindd[32840]: Got sig[15] terminate (is_parent=0)
Mar 14 15:46:54 Colossus-Mark-2 wsdd2[32834]: terminating.
Mar 14 15:46:54 Colossus-Mark-2 winbindd[32837]: [2023/03/14 15:46:54.139018, 0] ../../source3/winbindd/winbindd_dual.c:1957(winbindd_sig_term_handler)
Mar 14 15:46:54 Colossus-Mark-2 winbindd[32837]: Got sig[15] terminate (is_parent=1)
Mar 14 15:46:54 Colossus-Mark-2 winbindd[34527]: [2023/03/14 15:46:54.139941, 0] ../../source3/winbindd/winbindd_dual.c:1957(winbindd_sig_term_handler)
Mar 14 15:46:54 Colossus-Mark-2 winbindd[34527]: Got sig[15] terminate (is_parent=0)
Mar 14 15:46:54 Colossus-Mark-2 rpc.mountd[25821]: Caught signal 15, un-registering and exiting.
Mar 14 15:46:55 Colossus-Mark-2 kernel: nfsd: last server has exited, flushing export cache
Mar 14 15:46:55 Colossus-Mark-2 ntpd[1971]: ntpd exiting on signal 1 (Hangup)
Mar 14 15:46:55 Colossus-Mark-2 ntpd[1971]: 127.127.1.0 local addr 127.0.0.1 -> <null>
Mar 14 15:46:55 Colossus-Mark-2 ntpd[1971]: 216.239.35.0 local addr 192.168.1.33 -> <null>
Mar 14 15:46:55 Colossus-Mark-2 ntpd[1971]: 216.239.35.4 local addr 192.168.1.33 -> <null>
Mar 14 15:46:55 Colossus-Mark-2 ntpd[1971]: 216.239.35.8 local addr 192.168.1.33 -> <null>
Mar 14 15:46:55 Colossus-Mark-2 ntpd[1971]: 216.239.35.12 local addr 192.168.1.33 -> <null>
Mar 14 15:46:55 Colossus-Mark-2 rc.inet1: dhcpcd -q -k -4 br0
Mar 14 15:46:55 Colossus-Mark-2 dhcpcd[34664]: sending signal ALRM to pid 1831
Mar 14 15:46:55 Colossus-Mark-2 dhcpcd[34664]: waiting for pid 1831 to exit
Mar 14 15:46:55 Colossus-Mark-2 dhcpcd[1832]: received SIGALRM, releasing
Mar 14 15:46:55 Colossus-Mark-2 dhcpcd[1832]: br0: removing interface
after reboot
after removing parity drive and doing a new config, started the array and data disk are back to normal
i attached diagnostics before taking the array off line and doing a reboot, i have to reboot the system to stop the parity process, The pause and stop buttons don't seem to work:
colossus-mark-2-diagnostics-erros with parity
i attached another after reboot and all drives are normal but no parity
colossus-mark-2-diagnostics-afterreboot noParity
colossus-mark-2-diagnostics-erros with parity.zip
colossus-mark-2-diagnostics-afterreboot noParity.zip