DigitalLF

"sdi" from the log is the 2 month old drive. I have a new LSI 9400 on the way but it's at least 3-4 weeks out from China. All-Messages-search-result-1.csv

I just setup a graylog and giving that a try. my array was not working due to me loosing two drives two days ago and only running the UD preclear script on a new drive..

Is there anything here that could tell me what made unraid kernel panic? I run unraid in latest Proxmox and the motherboard/cpu/ram is about 12 years but i suspect the HBA. Would a external syslog help me figure out more? What would be your next step?

Cleaned the chassi and added two more power cables for the backplane. This did nothing. Same errors. So either my HBA is going bad my HBA don't like the drives The cables are going bad yet again after just a year.. The motherboard is going bad. It's 11 years old.. But I really don't think it's none of that.. The rest of the drives work fine over the same cables and same backplane. What else can it be? Incompatibility?

It's connected to a Gooxi RMC4124-BPE-12G backplane and from it two "SFF-8643 -> SFF-8643" cables to a Supermicro 3008 HBA with latest firmware. I did however change the cables less then a year ago. My suspicion right now is "power draw" so i will try to add extra Molex cables and see if that helps..

Did not work. Tried it two times and it states abort by host. or something like that.. Did a RMA on that drive and just now got a new one and i get the same errors.

Hi! i got myself a new drive but directly when i start doing a preclean it FLOODS errors in the logs. Jul 2 22:37:32 unRAID kernel: sd 4:0:0:0: [sdc] tag#538 CDB: opcode=0x88 88 00 00 00 00 00 03 fc 70 60 00 00 08 00 00 00 Jul 2 22:37:32 unRAID kernel: I/O error, dev sdc, sector 66867264 op 0x0:(READ) flags 0x84700 phys_seg 128 prio class 3 Jul 2 22:37:32 unRAID kernel: I/O error, dev sdc, sector 66875488 op 0x0:(READ) flags 0x84700 phys_seg 128 prio class 3 Jul 2 22:37:32 unRAID kernel: sd 4:0:0:0: [sdc] tag#426 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:32 unRAID kernel: sd 4:0:0:0: [sdc] tag#426 CDB: opcode=0x88 88 00 00 00 00 00 03 fc e4 a8 00 00 04 00 00 00 Jul 2 22:37:32 unRAID kernel: I/O error, dev sdc, sector 66905256 op 0x0:(READ) flags 0x80700 phys_seg 128 prio class 3 Jul 2 22:37:32 unRAID kernel: sd 4:0:0:0: [sdc] tag#407 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:32 unRAID kernel: sd 4:0:0:0: [sdc] tag#407 CDB: opcode=0x88 88 00 00 00 00 00 03 fc d4 40 00 00 04 00 00 00 Jul 2 22:37:32 unRAID kernel: I/O error, dev sdc, sector 66901056 op 0x0:(READ) flags 0x80700 phys_seg 128 prio class 3 Jul 2 22:37:32 unRAID kernel: I/O error, dev sdc, sector 66900032 op 0x0:(READ) flags 0x84700 phys_seg 128 prio class 3 Jul 2 22:37:32 unRAID kernel: I/O error, dev sdc, sector 66896960 op 0x0:(READ) flags 0x80700 phys_seg 128 prio class 3 Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#428 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#424 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#424 CDB: opcode=0x88 88 00 00 00 00 00 04 43 ce b0 00 00 07 38 00 00 Jul 2 22:37:41 unRAID kernel: I/O error, dev sdc, sector 71552688 op 0x0:(READ) flags 0x80700 phys_seg 128 prio class 3 Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#415 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#423 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#415 CDB: opcode=0x88 88 00 00 00 00 00 04 43 a7 f0 00 00 04 00 00 00 Jul 2 22:37:41 unRAID kernel: I/O error, dev sdc, sector 71542768 op 0x0:(READ) flags 0x80700 phys_seg 128 prio class 3 Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#423 CDB: opcode=0x88 88 00 00 00 00 00 04 43 c8 80 00 00 06 30 00 00 Jul 2 22:37:41 unRAID kernel: I/O error, dev sdc, sector 71551104 op 0x0:(READ) flags 0x84700 phys_seg 128 prio class 3 Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#414 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#414 CDB: opcode=0x88 88 00 00 00 00 00 04 43 a3 f0 00 00 04 00 00 00 Jul 2 22:37:41 unRAID kernel: I/O error, dev sdc, sector 71541744 op 0x0:(READ) flags 0x84700 phys_seg 128 prio class 3 Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#428 CDB: opcode=0x88 88 00 00 00 00 00 04 43 ff 68 00 00 12 20 00 00 Jul 2 22:37:41 unRAID kernel: I/O error, dev sdc, sector 71565160 op 0x0:(READ) flags 0x80700 phys_seg 128 prio class 3 Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#421 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#421 CDB: opcode=0x88 88 00 00 00 00 00 04 43 c0 00 00 00 08 80 00 00 Jul 2 22:37:41 unRAID kernel: I/O error, dev sdc, sector 71548928 op 0x0:(READ) flags 0x80700 phys_seg 128 prio class 3 Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#413 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#413 CDB: opcode=0x88 88 00 00 00 00 00 04 43 9f f0 00 00 04 00 00 00 Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#427 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#420 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:41 unRAID kernel: I/O error, dev sdc, sector 71540720 op 0x0:(READ) flags 0x80700 phys_seg 128 prio class 3 Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#420 CDB: opcode=0x88 88 00 00 00 00 00 04 43 bc 00 00 00 04 00 00 00 Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#427 CDB: opcode=0x88 88 00 00 00 00 00 04 43 ef 68 00 00 10 00 00 00 Jul 2 22:37:41 unRAID kernel: I/O error, dev sdc, sector 71561064 op 0x0:(READ) flags 0x84700 phys_seg 128 prio class 3 Jul 2 22:37:41 unRAID kernel: I/O error, dev sdc, sector 71547904 op 0x0:(READ) flags 0x84700 phys_seg 128 prio class 3 Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#412 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:41 unRAID kernel: sd 4:0:0:0: [sdc] tag#412 CDB: opcode=0x88 88 00 00 00 00 00 04 43 9b d0 00 00 04 20 00 00 Jul 2 22:37:41 unRAID kernel: I/O error, dev sdc, sector 71539664 op 0x0:(READ) flags 0x84700 phys_seg 128 prio class 3 Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#775 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#775 CDB: opcode=0x88 88 00 00 00 00 00 04 64 27 88 00 00 08 10 00 00 Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#786 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:47 unRAID kernel: I/O error, dev sdc, sector 73672584 op 0x0:(READ) flags 0x80700 phys_seg 128 prio class 3 Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#786 CDB: opcode=0x88 88 00 00 00 00 00 04 64 99 c0 00 00 04 00 00 00 Jul 2 22:37:47 unRAID kernel: I/O error, dev sdc, sector 73701824 op 0x0:(READ) flags 0x84700 phys_seg 128 prio class 3 Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#887 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#887 CDB: opcode=0x88 88 00 00 00 00 00 04 63 fd d0 00 00 04 00 00 00 Jul 2 22:37:47 unRAID kernel: I/O error, dev sdc, sector 73661904 op 0x0:(READ) flags 0x80700 phys_seg 128 prio class 3 Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#774 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#774 CDB: opcode=0x88 88 00 00 00 00 00 04 64 1f 88 00 00 08 00 00 00 Jul 2 22:37:47 unRAID kernel: I/O error, dev sdc, sector 73670536 op 0x0:(READ) flags 0x84700 phys_seg 128 prio class 3 Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#886 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#787 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#886 CDB: opcode=0x88 88 00 00 00 00 00 04 63 f9 d0 00 00 04 00 00 00 Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#787 CDB: opcode=0x88 88 00 00 00 00 00 04 64 9d c0 00 00 04 00 00 00 Jul 2 22:37:47 unRAID kernel: I/O error, dev sdc, sector 73660880 op 0x0:(READ) flags 0x84700 phys_seg 128 prio class 3 Jul 2 22:37:47 unRAID kernel: I/O error, dev sdc, sector 73702848 op 0x0:(READ) flags 0x80700 phys_seg 128 prio class 3 Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#807 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#807 CDB: opcode=0x88 88 00 00 00 00 00 04 64 ad c0 00 00 04 00 00 00 Jul 2 22:37:47 unRAID kernel: I/O error, dev sdc, sector 73706944 op 0x0:(READ) flags 0x80700 phys_seg 128 prio class 3 Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#784 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#784 CDB: opcode=0x88 88 00 00 00 00 00 04 64 82 88 00 00 10 00 00 00 Jul 2 22:37:47 unRAID kernel: I/O error, dev sdc, sector 73695880 op 0x0:(READ) flags 0x84700 phys_seg 128 prio class 3 Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#806 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#773 UNKNOWN(0x2003) Result: hostbyte=0x0b driverbyte=DRIVER_OK cmd_age=0s Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#806 CDB: opcode=0x88 88 00 00 00 00 00 04 64 a9 c0 00 00 04 00 00 00 Jul 2 22:37:47 unRAID kernel: I/O error, dev sdc, sector 73659856 op 0x0:(READ) flags 0x80700 phys_seg 128 prio class 3 Jul 2 22:37:47 unRAID kernel: sd 4:0:0:0: [sdc] tag#773 CDB: opcode=0x88 88 00 00 00 00 00 04 64 17 88 00 00 08 00 00 00 Jul 2 22:37:47 unRAID kernel: I/O error, dev sdc, sector 73705920 op 0x0:(READ) flags 0x84700 phys_seg 128 prio class 3 What can be done to fix this? i already have the same model of drive since before. This is the only drive that has errors in the logs.

Sorry for being unclear. just the "new" drives in a array to not mess up my data even worse... 3 disconnects with my real array is really stressful. I have just now connected all the "new" drives plus a extra 1tb i had so 5 in total directly to the motherboard to test the motherboard, cpu, ram, psu. So i removed the HBA, dual cables, Backplane from this equation for now.. I have a gut feeling it must be the backplane like in my old case from the same company called Gooxi. Where i asked the company to buy a new backplane and he just sent me two new once for free so i think they know its low quality and this case is 6 years old...

I now gotten 4 drives where i can test around.. Should i just try "New Config" again and just add the 4 new (used) drives? I can connect the drives directly to the motherboard and test if it's the motherboard/cpu/ram.. I'm just unsure what would be the best next step.. Otherwise i could try with breakout cables (miniSAS-4xSATA). The dmesg file did include some codes that i tried to google but i did not get to much information out of it..

Could it be the backplane? I don't think Gooxi stand for quality.

Sorry for that! Just sent you the logs here.

I also sent you a stripped syslog and a dmesg and a image from Proxmox for this LSI card on Discord. unraid-diagnostics-20240813-2144.zip

@JorgeB I thought i solved it with replacing the USB drive with a JetFlash 780. I did a rebuild with the two parity drives and that took around 36h and after that i was able to use the server for a few days but this morning i had a new crash with all drives going offline... In the logs it states error: Aug 13 09:12:08 unRAID kernel: mpt3sas_cm0: log_info(0x311201ff): originator(PL), code(0x12), sub_code(0x01ff) Aug 13 09:12:08 unRAID kernel: mpt3sas_cm0: log_info(0x31110d01): originator(PL), code(0x11), sub_code(0x0d01) And from that i found another post here where you also answered. I really don't know what would be my next step.. I could possibly borrow disks from a friend and connect drives directly to SATA on motherboard (X9SRL-F) and see if i get the same errors. So what i think right now.. One of the "HBA", "Cables", "Backplane" must be the failing part.. Any thoughts on what i should do next? I haven't even tried to start the array this time..

So with that command i would require another drive. I can't afford that so i will just have to loose the data and hope it's nothing i will miss..

root@unRAID:~# mount -o rescue=all,ro /dev/sdi1 /mnt/test mount: /mnt/test: wrong fs type, bad option, bad superblock on /dev/sdi1, missing codepage or helper program, or other error. dmesg(1) may have more information after failed mount system call. root@unRAID:~# Seems like it can't even see a partition so i'm screwed screwed.. fdisk tells me: Device Start End Sectors Size Type /dev/sdi1 64 35156656094 35156656031 16.4T Linux filesystem