Hello, i am trying to get my Unraid server up and running. While doing parity check, i get this error message and after that no more data is written to parity disks, read on all other data disks is still happening. I made diagnostics file, can someone please take a look what is going on and point me to the right direction please.

toru-diagnostics-20241126-0059.zip

Unraid drive is crashing, this is usually a hardware issue, but recommend retesitn with 7.0.0-beta4, in case it's a kernel compatibility issue.

So, i will install 7.0.0 beta4 and will report back if the issue is still there. Thank you! I will post if i still have issues with 7.0.0 

I updated to Unraid 7.0.0 beta4 now. Trying to reebuild parity. Now it gives me some kind of new error. I attached new diuagnostics file to my post. 

 

This is copied from the Unraid GUI log that was on there during the time it happened. I also made a diagnostics.zip and attached it to my post also.

 

When I dont start parity build then the server does not behave in this manner. Can anyone please help me again. And big thanks to JorgeB for your help earlyer this morning.

 

Nov 26 05:35:42 Toru emhttpd: mounting /mnt/disk1
Nov 26 05:35:42 Toru emhttpd: /sbin/blkid /dev/md1p1 2>&1
Nov 26 05:35:42 Toru emhttpd: /dev/md1p1: UUID="1aff64b5-e812-4118-bb0a-e52dac45a246" BLOCK_SIZE="512" TYPE="xfs"
Nov 26 05:35:42 Toru emhttpd: shcmd (127): mkdir -p /mnt/disk1
Nov 26 05:35:42 Toru emhttpd: shcmd (128): mount -t xfs -o noatime,nouuid /dev/md1p1 /mnt/disk1
Nov 26 05:35:42 Toru kernel: XFS (md1p1): Mounting V5 Filesystem 1aff64b5-e812-4118-bb0a-e52dac45a246
Nov 26 05:35:42 Toru kernel: XFS (md1p1): Starting recovery (logdev: internal)
Nov 26 05:35:42 Toru kernel: XFS (md1p1): Ending recovery (logdev: internal)
Nov 26 05:35:42 Toru emhttpd: shcmd (129): xfs_growfs /mnt/disk1
Nov 26 05:35:42 Toru root: meta-data=/dev/md1p1             isize=512    agcount=19, agsize=268435455 blks
Nov 26 05:35:42 Toru root:          =                       sectsz=512   attr=2, projid32bit=1
Nov 26 05:35:42 Toru root:          =                       crc=1        finobt=1, sparse=1, rmapbt=1
Nov 26 05:35:42 Toru root:          =                       reflink=1    bigtime=1 inobtcount=1 nrext64=1
Nov 26 05:35:42 Toru root:          =                       exchange=0  
Nov 26 05:35:42 Toru root: data     =                       bsize=4096   blocks=4882956275, imaxpct=5
Nov 26 05:35:42 Toru root:          =                       sunit=0      swidth=0 blks
Nov 26 05:35:42 Toru root: naming   =version 2              bsize=4096   ascii-ci=0, ftype=1, parent=0
Nov 26 05:35:42 Toru root: log      =internal log           bsize=4096   blocks=521728, version=2
Nov 26 05:35:42 Toru root:          =                       sectsz=512   sunit=0 blks, lazy-count=1
Nov 26 05:35:42 Toru root: realtime =none                   extsz=4096   blocks=0, rtextents=0
Nov 26 05:35:42 Toru emhttpd: mounting /mnt/disk2
Nov 26 05:35:42 Toru emhttpd: /sbin/blkid /dev/md2p1 2>&1
Nov 26 05:35:42 Toru emhttpd: /dev/md2p1: UUID="c5182921-6d3e-4669-9d18-34982bd35578" BLOCK_SIZE="512" TYPE="xfs"
Nov 26 05:35:42 Toru emhttpd: shcmd (130): mkdir -p /mnt/disk2
Nov 26 05:35:42 Toru emhttpd: shcmd (131): mount -t xfs -o noatime,nouuid /dev/md2p1 /mnt/disk2
Nov 26 05:35:42 Toru kernel: XFS (md2p1): Mounting V5 Filesystem c5182921-6d3e-4669-9d18-34982bd35578
Nov 26 05:35:42 Toru kernel: XFS (md2p1): Starting recovery (logdev: internal)
Nov 26 05:35:43 Toru kernel: XFS (md2p1): Ending recovery (logdev: internal)
Nov 26 05:35:43 Toru emhttpd: shcmd (132): xfs_growfs /mnt/disk2
Nov 26 05:35:43 Toru root: meta-data=/dev/md2p1             isize=512    agcount=19, agsize=268435455 blks
Nov 26 05:35:43 Toru root:          =                       sectsz=512   attr=2, projid32bit=1
Nov 26 05:35:43 Toru root:          =                       crc=1        finobt=1, sparse=1, rmapbt=1
Nov 26 05:35:43 Toru root:          =                       reflink=1    bigtime=1 inobtcount=1 nrext64=1
Nov 26 05:35:43 Toru root:          =                       exchange=0  
Nov 26 05:35:43 Toru root: data     =                       bsize=4096   blocks=4882956275, imaxpct=5
Nov 26 05:35:43 Toru root:          =                       sunit=0      swidth=0 blks
Nov 26 05:35:43 Toru root: naming   =version 2              bsize=4096   ascii-ci=0, ftype=1, parent=0
Nov 26 05:35:43 Toru root: log      =internal log           bsize=4096   blocks=521728, version=2
Nov 26 05:35:43 Toru root:          =                       sectsz=512   sunit=0 blks, lazy-count=1
Nov 26 05:35:43 Toru root: realtime =none                   extsz=4096   blocks=0, rtextents=0
Nov 26 05:35:43 Toru emhttpd: mounting /mnt/disk3
Nov 26 05:35:43 Toru emhttpd: /sbin/blkid /dev/md3p1 2>&1
Nov 26 05:35:43 Toru emhttpd: /dev/md3p1: UUID="817c60d6-59eb-4678-8ff0-4d86ed9ada7c" BLOCK_SIZE="512" TYPE="xfs"
Nov 26 05:35:43 Toru emhttpd: shcmd (133): mkdir -p /mnt/disk3
Nov 26 05:35:43 Toru emhttpd: shcmd (134): mount -t xfs -o noatime,nouuid /dev/md3p1 /mnt/disk3
Nov 26 05:35:43 Toru kernel: XFS (md3p1): Mounting V5 Filesystem 817c60d6-59eb-4678-8ff0-4d86ed9ada7c
Nov 26 05:35:43 Toru kernel: XFS (md3p1): Starting recovery (logdev: internal)
Nov 26 05:35:43 Toru kernel: XFS (md3p1): Ending recovery (logdev: internal)
Nov 26 05:35:43 Toru emhttpd: shcmd (135): xfs_growfs /mnt/disk3
Nov 26 05:35:43 Toru root: meta-data=/dev/md3p1             isize=512    agcount=19, agsize=268435455 blks
Nov 26 05:35:43 Toru root:          =                       sectsz=512   attr=2, projid32bit=1
Nov 26 05:35:43 Toru root:          =                       crc=1        finobt=1, sparse=1, rmapbt=1
Nov 26 05:35:43 Toru root:          =                       reflink=1    bigtime=1 inobtcount=1 nrext64=1
Nov 26 05:35:43 Toru root:          =                       exchange=0  
Nov 26 05:35:43 Toru root: data     =                       bsize=4096   blocks=4882956275, imaxpct=5
Nov 26 05:35:43 Toru root:          =                       sunit=0      swidth=0 blks
Nov 26 05:35:43 Toru root: naming   =version 2              bsize=4096   ascii-ci=0, ftype=1, parent=0
Nov 26 05:35:43 Toru root: log      =internal log           bsize=4096   blocks=521728, version=2
Nov 26 05:35:43 Toru root:          =                       sectsz=512   sunit=0 blks, lazy-count=1
Nov 26 05:35:43 Toru root: realtime =none                   extsz=4096   blocks=0, rtextents=0
Nov 26 05:35:43 Toru emhttpd: shcmd (136): /usr/sbin/zfs mount -a
Nov 26 05:35:43 Toru emhttpd: shcmd (137): sync
Nov 26 05:35:43 Toru emhttpd: shcmd (138): mkdir /mnt/user0
Nov 26 05:35:43 Toru emhttpd: shcmd (139): /usr/libexec/unraid/shfs /mnt/user0 -disks 14 -o default_permissions,allow_other,noatime 
Nov 26 05:35:43 Toru shfs: FUSE library version 3.16.2
Nov 26 05:35:43 Toru emhttpd: shcmd (140): mkdir /mnt/user
Nov 26 05:35:43 Toru emhttpd: shcmd (141): /usr/libexec/unraid/shfs /mnt/user -disks 15 -o default_permissions,allow_other,noatime -o remember=0 
Nov 26 05:35:43 Toru shfs: FUSE library version 3.16.2
Nov 26 05:35:43 Toru emhttpd: shcmd (144): /usr/local/sbin/update_cron
Nov 26 05:35:43 Toru emhttpd: Starting services...
Nov 26 05:35:43 Toru emhttpd: shcmd (147): /etc/rc.d/rc.samba reload
Nov 26 05:35:43 Toru wsdd2[3001]: 'Terminated' signal received.
Nov 26 05:35:43 Toru wsdd2[3001]: terminating.
Nov 26 05:35:43 Toru wsdd2[7285]: starting.
Nov 26 05:35:43 Toru emhttpd: shcmd (151): /etc/rc.d/rc.avahidaemon reload
Nov 26 05:35:43 Toru avahi-daemon[2458]: Got SIGHUP, reloading.
Nov 26 05:35:44 Toru kernel: mdcmd (36): check 
Nov 26 05:35:44 Toru kernel: md: recovery thread: recon Q ...
Nov 26 05:35:44 Toru sysDrivers: SysDrivers Build Complete
Nov 26 05:39:48 Toru ntpd[2323]: kernel reports TIME_ERROR: 0x41: Clock Unsynchronized
Nov 26 05:43:01 Toru kernel: pcieport 0000:00:06.0: AER: Corrected error message received from 0000:00:06.0
Nov 26 05:43:01 Toru kernel: pcieport 0000:00:06.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Receiver ID)
Nov 26 05:43:01 Toru kernel: pcieport 0000:00:06.0:   device [8086:a74d] error status/mask=00000001/00002000
Nov 26 05:43:01 Toru kernel: pcieport 0000:00:06.0:    [ 0] RxErr                 
Nov 26 05:46:24 Toru ool www[11479]: /usr/local/emhttp/plugins/dynamix/scripts/rsyslog_config
Nov 26 05:46:25 Toru rc.rsyslogd: Restarting Syslog server daemon...
Nov 26 05:46:25 Toru rc.rsyslogd: Stopping Syslog server daemon...
Nov 26 05:46:25 Toru rc.rsyslogd: killall --ns 11501 rsyslogd
Nov 26 05:46:28 Toru rc.rsyslogd: Syslog server daemon...  Started.
Nov 26 05:46:29 Toru rsyslogd: [origin software="rsyslogd" swVersion="8.2102.0" x-pid="11546" x-info="https://www.rsyslog.com"] start
Nov 26 05:46:52 Toru kernel: BUG: unable to handle page fault for address: 0000000000001018
Nov 26 05:46:52 Toru kernel: #PF: supervisor read access in kernel mode
Nov 26 05:46:52 Toru kernel: #PF: error_code(0x0000) - not-present page
Nov 26 05:46:52 Toru kernel: PGD 0 P4D 0 
Nov 26 05:46:52 Toru kernel: Oops: 0000 [#1] PREEMPT SMP NOPTI
Nov 26 05:46:52 Toru kernel: CPU: 8 PID: 6386 Comm: unraidd0 Tainted: P           O       6.6.56-Unraid #1
Nov 26 05:46:52 Toru kernel: Hardware name: ASUS System Product Name/ProArt Z790-CREATOR WIFI, BIOS 2703 10/17/2024
Nov 26 05:46:52 Toru kernel: RIP: 0010:bio_associate_blkg_from_css+0x163/0x185
Nov 26 05:46:52 Toru kernel: Code: ee ff ff 84 c0 74 eb e8 2d 79 bb ff eb 27 48 8b 45 08 48 8b 40 18 48 8b b8 58 01 00 00 48 83 c7 38 e8 2e ef ff ff 48 8b 45 08 <48> 8b 40 18 4c 8b b8 58 01 00 00 4c 89 7d 48 48 83 c4 20 5b 5d 41
Nov 26 05:46:52 Toru kernel: RSP: 0018:ffffc90004827d20 EFLAGS: 00010202
Nov 26 05:46:52 Toru kernel: RAX: 0000000000001000 RBX: ffffffff82cb6b40 RCX: 0000000000000000
Nov 26 05:46:52 Toru kernel: RDX: ffff888142d9b000 RSI: ffffffff82cb6b40 RDI: ffff888108afd238
Nov 26 05:46:52 Toru kernel: RBP: ffff888165abb540 R08: 0000000000000000 R09: 0000000000000000
Nov 26 05:46:52 Toru kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000001
Nov 26 05:46:52 Toru kernel: R13: ffff888165abb540 R14: ffff888165abb5b8 R15: ffff8881512112e8
Nov 26 05:46:52 Toru kernel: FS:  0000000000000000(0000) GS:ffff88a03f200000(0000) knlGS:0000000000000000
Nov 26 05:46:52 Toru kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 26 05:46:52 Toru kernel: CR2: 0000000000001018 CR3: 0000000005416000 CR4: 0000000000750ee0
Nov 26 05:46:52 Toru kernel: PKRU: 55555554
Nov 26 05:46:52 Toru kernel: Call Trace:
Nov 26 05:46:52 Toru kernel: <TASK>
Nov 26 05:46:52 Toru kernel: ? __die_body+0x1a/0x5c
Nov 26 05:46:52 Toru kernel: ? page_fault_oops+0x329/0x376
Nov 26 05:46:52 Toru kernel: ? do_user_addr_fault+0x12d/0x48a
Nov 26 05:46:52 Toru kernel: ? exc_page_fault+0xf9/0x116
Nov 26 05:46:52 Toru kernel: ? asm_exc_page_fault+0x22/0x30
Nov 26 05:46:52 Toru kernel: ? bio_associate_blkg_from_css+0x163/0x185
Nov 26 05:46:52 Toru kernel: bio_associate_blkg+0x2f/0x35
Nov 26 05:46:52 Toru kernel: bio_init+0x59/0x92
Nov 26 05:46:52 Toru kernel: unraidd+0x1117/0x1278 [md_mod]
Nov 26 05:46:52 Toru kernel: ? preempt_latency_start+0x2b/0x46
Nov 26 05:46:52 Toru kernel: ? preempt_latency_start+0x2b/0x46
Nov 26 05:46:52 Toru kernel: md_thread+0xf7/0x127 [md_mod]
Nov 26 05:46:52 Toru kernel: ? __pfx_autoremove_wake_function+0x10/0x10
Nov 26 05:46:52 Toru kernel: ? __pfx_md_thread+0x10/0x10 [md_mod]
Nov 26 05:46:52 Toru kernel: kthread+0xf1/0xfc
Nov 26 05:46:52 Toru kernel: ? __pfx_kthread+0x10/0x10
Nov 26 05:46:52 Toru kernel: ret_from_fork+0x21/0x36
Nov 26 05:46:52 Toru kernel: ? __pfx_kthread+0x10/0x10
Nov 26 05:46:52 Toru kernel: ret_from_fork_asm+0x1b/0x30
Nov 26 05:46:52 Toru kernel: </TASK>
Nov 26 05:46:52 Toru kernel: Modules linked in: md_mod ip6table_filter ip6_tables iptable_filter ip_tables x_tables efivarfs macvtap macvlan tap igc atlantic intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel sha512_ssse3 sha256_ssse3 sha1_ssse3 aesni_intel crypto_simd cryptd btusb btrtl rapl btbcm zfs(PO) i915 btintel intel_cstate bluetooth iosf_mbi drm_buddy ttm i2c_algo_bit drm_display_helper spl(O) input_leds drm_kms_helper mei_pxp mei_hdcp led_class joydev ecdh_generic ecc tpm_crb wmi_bmof drm intel_uncore thunderbolt i2c_i801 ahci nvme tpm_tis mei_me i2c_smbus video libahci tpm_tis_core mpt3sas nvme_core mei backlight tpm vmd intel_gtt thermal fan acpi_tad acpi_pad agpgart raid_class i2c_core scsi_transport_sas wmi button [last unloaded: md_mod]
Nov 26 05:46:52 Toru kernel: CR2: 0000000000001018
Nov 26 05:46:52 Toru kernel: ---[ end trace 0000000000000000 ]---
Nov 26 05:46:52 Toru kernel: pstore: backend (efi_pstore) writing error (-5)
Nov 26 05:46:52 Toru kernel: RIP: 0010:bio_associate_blkg_from_css+0x163/0x185
Nov 26 05:46:52 Toru kernel: Code: ee ff ff 84 c0 74 eb e8 2d 79 bb ff eb 27 48 8b 45 08 48 8b 40 18 48 8b b8 58 01 00 00 48 83 c7 38 e8 2e ef ff ff 48 8b 45 08 <48> 8b 40 18 4c 8b b8 58 01 00 00 4c 89 7d 48 48 83 c4 20 5b 5d 41
Nov 26 05:46:52 Toru kernel: RSP: 0018:ffffc90004827d20 EFLAGS: 00010202
Nov 26 05:46:52 Toru kernel: RAX: 0000000000001000 RBX: ffffffff82cb6b40 RCX: 0000000000000000
Nov 26 05:46:52 Toru kernel: RDX: ffff888142d9b000 RSI: ffffffff82cb6b40 RDI: ffff888108afd238
Nov 26 05:46:52 Toru kernel: RBP: ffff888165abb540 R08: 0000000000000000 R09: 0000000000000000
Nov 26 05:46:52 Toru kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000001
Nov 26 05:46:52 Toru kernel: R13: ffff888165abb540 R14: ffff888165abb5b8 R15: ffff8881512112e8
Nov 26 05:46:52 Toru kernel: FS:  0000000000000000(0000) GS:ffff88a03f200000(0000) knlGS:0000000000000000
Nov 26 05:46:52 Toru kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 26 05:46:52 Toru kernel: CR2: 0000000000001018 CR3: 000000013e510000 CR4: 0000000000750ee0
Nov 26 05:46:52 Toru kernel: PKRU: 55555554
Nov 26 05:46:52 Toru kernel: note: unraidd0[6386] exited with irqs disabled
Nov 26 05:46:52 Toru kernel: ------------[ cut here ]------------
Nov 26 05:46:52 Toru kernel: WARNING: CPU: 8 PID: 6386 at kernel/exit.c:820 do_exit+0x81/0x910
Nov 26 05:46:52 Toru kernel: Modules linked in: md_mod ip6table_filter ip6_tables iptable_filter ip_tables x_tables efivarfs macvtap macvlan tap igc atlantic intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel sha512_ssse3 sha256_ssse3 sha1_ssse3 aesni_intel crypto_simd cryptd btusb btrtl rapl btbcm zfs(PO) i915 btintel intel_cstate bluetooth iosf_mbi drm_buddy ttm i2c_algo_bit drm_display_helper spl(O) input_leds drm_kms_helper mei_pxp mei_hdcp led_class joydev ecdh_generic ecc tpm_crb wmi_bmof drm intel_uncore thunderbolt i2c_i801 ahci nvme tpm_tis mei_me i2c_smbus video libahci tpm_tis_core mpt3sas nvme_core mei backlight tpm vmd intel_gtt thermal fan acpi_tad acpi_pad agpgart raid_class i2c_core scsi_transport_sas wmi button [last unloaded: md_mod]
Nov 26 05:46:52 Toru kernel: CPU: 8 PID: 6386 Comm: unraidd0 Tainted: P      D    O       6.6.56-Unraid #1
Nov 26 05:46:52 Toru kernel: Hardware name: ASUS System Product Name/ProArt Z790-CREATOR WIFI, BIOS 2703 10/17/2024
Nov 26 05:46:52 Toru kernel: RIP: 0010:do_exit+0x81/0x910
Nov 26 05:46:52 Toru kernel: Code: 24 74 04 75 13 b8 01 00 00 00 41 89 6c 24 60 48 c1 e0 22 49 89 44 24 70 4c 89 ef e8 27 ca 9b 00 48 83 bb a8 07 00 00 00 74 02 <0f> 0b 48 8b bb c0 06 00 00 e8 f1 c8 9b 00 48 8b 83 b8 06 00 00 83
Nov 26 05:46:52 Toru kernel: RSP: 0018:ffffc90004827ee0 EFLAGS: 00010286
Nov 26 05:46:52 Toru kernel: RAX: 0000000000000000 RBX: ffff888142d9b000 RCX: 0000000000000000
Nov 26 05:46:52 Toru kernel: RDX: 0000000000000001 RSI: 0000000000002710 RDI: 00000000ffffffff
Nov 26 05:46:52 Toru kernel: RBP: 0000000000000009 R08: 0000000000000000 R09: ffff888108f13000
Nov 26 05:46:52 Toru kernel: R10: 0000000000000001 R11: 0000000000aaaaaa R12: ffff8881072f3b80
Nov 26 05:46:52 Toru kernel: R13: ffff88815162f380 R14: 0000000000000000 R15: 0000000000000000
Nov 26 05:46:52 Toru kernel: FS:  0000000000000000(0000) GS:ffff88a03f200000(0000) knlGS:0000000000000000
Nov 26 05:46:52 Toru kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 26 05:46:52 Toru kernel: CR2: 0000000000001018 CR3: 000000013e510000 CR4: 0000000000750ee0
Nov 26 05:46:52 Toru kernel: PKRU: 55555554
Nov 26 05:46:52 Toru kernel: Call Trace:
Nov 26 05:46:52 Toru kernel: <TASK>
Nov 26 05:46:52 Toru kernel: ? __warn+0x99/0x11a
Nov 26 05:46:52 Toru kernel: ? report_bug+0xd9/0x153
Nov 26 05:46:52 Toru kernel: ? do_exit+0x81/0x910
Nov 26 05:46:52 Toru kernel: ? handle_bug+0x3c/0x63
Nov 26 05:46:52 Toru kernel: ? exc_invalid_op+0x13/0x60
Nov 26 05:46:52 Toru kernel: ? asm_exc_invalid_op+0x16/0x20
Nov 26 05:46:52 Toru kernel: ? do_exit+0x81/0x910
Nov 26 05:46:52 Toru kernel: make_task_dead+0x113/0x113
Nov 26 05:46:52 Toru kernel: rewind_stack_and_make_dead+0x17/0x17
Nov 26 05:46:52 Toru kernel: RIP: 0000:0x0
Nov 26 05:46:52 Toru kernel: Code: Unable to access opcode bytes at 0xffffffffffffffd6.
Nov 26 05:46:52 Toru kernel: RSP: 0000:0000000000000000 EFLAGS: 00000000 ORIG_RAX: 0000000000000000
Nov 26 05:46:52 Toru kernel: RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
Nov 26 05:46:52 Toru kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
Nov 26 05:46:52 Toru kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
Nov 26 05:46:52 Toru kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
Nov 26 05:46:52 Toru kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
Nov 26 05:46:52 Toru kernel: </TASK>
Nov 26 05:46:52 Toru kernel: ---[ end trace 0000000000000000 ]---
Nov 26 05:47:32 Toru kernel: block nvme0n1: the capability attribute has been deprecated.

 

 

toru-diagnostics-20241126-0550.zip toru-diagnostics-20241126-0550.zip

It's still the Unraid driver crashing, so most likely a hardware problem, if you have multiple sticks try using the server with just one, if the same try with a different one, that will basically rule out bad RAM.

2 hours ago, JorgeB said:

It's still the Unraid driver crashing, so most likely a hardware problem, if you have multiple sticks try using the server with just one, if the same try with a different one, that will basically rule out bad RAM.

I have run MemTest86 for 17 hours without any errors so i would think it is highly unlikeley that it is a memory issue. I have 4 RAM sticks, I can try to run the server with only just one. But what else could be the cause of this? 

 

I tried and updated BIOS also, so it is on its newest version. Funny thing is that the issues started about 2 days before the 1 month trial period ended, untill then the same hardware (all new comopnents, bought for unraid server build) worked fine, and when i bought the licence, after that server is only crashing, or the unraid driver is crashing.

 

Would there be anyh point trying even older Unraid version? 6.12.11 or 6.12.10? The first OS i installed a month ago was 7 beta, but since i thought in the end when the trial period ended, that it is the beta verison, i tried to go back on the last stable release but the issue continued..

Edited November 26, 20241 yr by kk61vo

18 minutes ago, kk61vo said:

But what else could be the cause of this? 

Other than the RAM, it's usually CPU or board.

 

19 minutes ago, kk61vo said:

Would there be anyh point trying even older Unraid version? 6.12.11 or 6.12.10?

Should be the same, kernel is very similar, if it does the same with 6.x (kernel 6.1) and 7.0.0-beta4 (kernel 6.6) unlikely that it's a kernel compatibility issue, since they are very different.

3 minutes ago, JorgeB said:

Other than the RAM, it's usually CPU or board.

 

Should be the same, kernel is very similar, if it does the same with 6.x (kernel 6.1) and 7.0.0-beta4 (kernel 6.6) unlikely that it's a kernel compatibility issue, since they are very different.

Okay.. in my logs now, is this also a sign of the Unraid driver crashing?

 

 

Nope, that a PCIe device causing errors, those were corrected, so not great but not necessarily a reason for a crash, this may help with that:

 

https://forums.unraid.net/topic/118286-nvme-drives-throwing-errors-filling-logs-instantly-how-to-resolve/?do=findComment&comment=1165009
 

3 minutes ago, JorgeB said:

Nope, that a PCIe device causing errors, those were corrected, so not great but not necessarily a reason for a crash, this may help with that:

 

 

Yes, i found that also after posting the picture and added pcie_aspm=off also, right now it seems to work and i dont see these PCIe device errors any more. I also digged around in the BIOS and disabled all "´AI boosts" and even disabled XMP. I just started Parioty Sync couple of minutes ago. The server was stable without doing the parity sync for about an hour now, no crashing, no errors in the Sys Log. Right now I am at about 110GB of 20TB of Parity Sync. Will see how it goes, last time it crashed about 20-30sec after starting it, so fingers crossed. 

 

But as i understand, my issue is more likeley to be caused by unstable hardware in my server then?

4 minutes ago, kk61vo said:

my issue is more likeley to be caused by unstable hardware in my server then?

Yes, that would be the most likely scenario.

8 minutes ago, JorgeB said:

Yes, that would be the most likely scenario.

Damn, okay then, somehow i have to find the unstable component then.. And ofcourse after my last post, the Parity Sync crashed the system again.. 

 

 

 

Nov 26 20:57:29 Toru rsyslogd: [origin software="rsyslogd" swVersion="8.2102.0" x-pid="22408" x-info="https://www.rsyslog.com"] start
Nov 26 20:58:37 Toru ntpd[13964]: kernel reports TIME_ERROR: 0x2041: Clock Unsynchronized
Nov 26 21:11:01 Toru kernel: BUG: unable to handle page fault for address: 0000000000001018
Nov 26 21:11:01 Toru kernel: #PF: supervisor read access in kernel mode
Nov 26 21:11:01 Toru kernel: #PF: error_code(0x0000) - not-present page
Nov 26 21:11:01 Toru kernel: PGD 0 P4D 0 
Nov 26 21:11:01 Toru kernel: Oops: 0000 [#1] PREEMPT SMP NOPTI
Nov 26 21:11:01 Toru kernel: CPU: 8 PID: 20849 Comm: unraidd0 Tainted: P           O       6.6.56-Unraid #1
Nov 26 21:11:01 Toru kernel: Hardware name: ASUS System Product Name/ProArt Z790-CREATOR WIFI, BIOS 2703 10/17/2024
Nov 26 21:11:01 Toru kernel: RIP: 0010:submit_bio_noacct+0x18/0x2f3
Nov 26 21:11:01 Toru kernel: Code: cc cc 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1f 44 00 00 41 57 41 56 41 55 41 54 55 53 48 89 fb 41 50 4c 8b 67 08 <4d> 8b 6c 24 18 e8 55 2a 51 00 8b 53 10 0f ba e2 15 73 16 49 8b 44
Nov 26 21:11:01 Toru kernel: RSP: 0018:ffffc90004fbfd68 EFLAGS: 00010206
Nov 26 21:11:01 Toru kernel: RAX: ffff888148f57950 RBX: ffff888148f57cf0 RCX: 0000000000000000
Nov 26 21:11:01 Toru kernel: RDX: 0000000000000000 RSI: ffffffff82cb6b40 RDI: ffff888148f57cf0
Nov 26 21:11:01 Toru kernel: RBP: 0000000000000004 R08: 0000000000000000 R09: 0000000000000000
Nov 26 21:11:01 Toru kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000001000
Nov 26 21:11:01 Toru kernel: R13: ffff888148f57cf0 R14: ffff888148f57da0 R15: ffff88816b90e800
Nov 26 21:11:01 Toru kernel: FS:  0000000000000000(0000) GS:ffff88a03f200000(0000) knlGS:0000000000000000
Nov 26 21:11:01 Toru kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 26 21:11:01 Toru kernel: CR2: 0000000000001018 CR3: 0000000005416000 CR4: 0000000000750ee0
Nov 26 21:11:01 Toru kernel: PKRU: 55555554
Nov 26 21:11:01 Toru kernel: Call Trace:
Nov 26 21:11:01 Toru kernel: <TASK>
Nov 26 21:11:01 Toru kernel: ? __die_body+0x1a/0x5c
Nov 26 21:11:01 Toru kernel: ? page_fault_oops+0x329/0x376
Nov 26 21:11:01 Toru kernel: ? do_user_addr_fault+0x12d/0x48a
Nov 26 21:11:01 Toru kernel: ? exc_page_fault+0xf9/0x116
Nov 26 21:11:01 Toru kernel: ? asm_exc_page_fault+0x22/0x30
Nov 26 21:11:01 Toru kernel: ? submit_bio_noacct+0x18/0x2f3
Nov 26 21:11:01 Toru kernel: unraidd+0x11eb/0x1278 [md_mod]
Nov 26 21:11:01 Toru kernel: ? preempt_latency_start+0x2b/0x46
Nov 26 21:11:01 Toru kernel: ? preempt_latency_start+0x2b/0x46
Nov 26 21:11:01 Toru kernel: md_thread+0xf7/0x127 [md_mod]
Nov 26 21:11:01 Toru kernel: ? __pfx_autoremove_wake_function+0x10/0x10
Nov 26 21:11:01 Toru kernel: ? __pfx_md_thread+0x10/0x10 [md_mod]
Nov 26 21:11:01 Toru kernel: kthread+0xf1/0xfc
Nov 26 21:11:01 Toru kernel: ? __pfx_kthread+0x10/0x10
Nov 26 21:11:01 Toru kernel: ret_from_fork+0x21/0x36
Nov 26 21:11:01 Toru kernel: ? __pfx_kthread+0x10/0x10
Nov 26 21:11:01 Toru kernel: ret_from_fork_asm+0x1b/0x30
Nov 26 21:11:01 Toru kernel: </TASK>
Nov 26 21:11:01 Toru kernel: Modules linked in: md_mod ip6table_filter ip6_tables iptable_filter ip_tables x_tables efivarfs macvtap macvlan tap igc atlantic zfs(PO) spl(O) nvme intel_rapl_common nvme_core ahci x86_pkg_temp_thermal libahci intel_powerclamp coretemp i915 kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel sha512_ssse3 sha256_ssse3 iosf_mbi sha1_ssse3 drm_buddy aesni_intel ttm crypto_simd i2c_algo_bit cryptd drm_display_helper btusb btrtl btbcm rapl btintel drm_kms_helper bluetooth drm input_leds ecdh_generic led_class joydev ecc mei_hdcp mei_pxp i2c_i801 intel_gtt intel_cstate mpt3sas wmi_bmof mei_me agpgart thunderbolt i2c_smbus intel_uncore mei i2c_core raid_class scsi_transport_sas vmd tpm_crb video tpm_tis tpm_tis_core backlight tpm thermal fan acpi_tad acpi_pad wmi button [last unloaded: md_mod]
Nov 26 21:11:01 Toru kernel: CR2: 0000000000001018
Nov 26 21:11:01 Toru kernel: ---[ end trace 0000000000000000 ]---
Nov 26 21:11:01 Toru kernel: pstore: backend (efi_pstore) writing error (-5)
Nov 26 21:11:01 Toru kernel: RIP: 0010:submit_bio_noacct+0x18/0x2f3
Nov 26 21:11:01 Toru kernel: Code: cc cc 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1f 44 00 00 41 57 41 56 41 55 41 54 55 53 48 89 fb 41 50 4c 8b 67 08 <4d> 8b 6c 24 18 e8 55 2a 51 00 8b 53 10 0f ba e2 15 73 16 49 8b 44
Nov 26 21:11:01 Toru kernel: RSP: 0018:ffffc90004fbfd68 EFLAGS: 00010206
Nov 26 21:11:01 Toru kernel: RAX: ffff888148f57950 RBX: ffff888148f57cf0 RCX: 0000000000000000
Nov 26 21:11:01 Toru kernel: RDX: 0000000000000000 RSI: ffffffff82cb6b40 RDI: ffff888148f57cf0
Nov 26 21:11:01 Toru kernel: RBP: 0000000000000004 R08: 0000000000000000 R09: 0000000000000000
Nov 26 21:11:01 Toru kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000001000
Nov 26 21:11:01 Toru kernel: R13: ffff888148f57cf0 R14: ffff888148f57da0 R15: ffff88816b90e800
Nov 26 21:11:01 Toru kernel: FS:  0000000000000000(0000) GS:ffff88a03f200000(0000) knlGS:0000000000000000
Nov 26 21:11:01 Toru kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 26 21:11:01 Toru kernel: CR2: 0000000000001018 CR3: 000000015fcc2000 CR4: 0000000000750ee0
Nov 26 21:11:01 Toru kernel: PKRU: 55555554
Nov 26 21:11:01 Toru kernel: note: unraidd0[20849] exited with irqs disabled
Nov 26 21:11:01 Toru kernel: ------------[ cut here ]------------
Nov 26 21:11:01 Toru kernel: WARNING: CPU: 8 PID: 20849 at kernel/exit.c:820 do_exit+0x81/0x910
Nov 26 21:11:01 Toru kernel: Modules linked in: md_mod ip6table_filter ip6_tables iptable_filter ip_tables x_tables efivarfs macvtap macvlan tap igc atlantic zfs(PO) spl(O) nvme intel_rapl_common nvme_core ahci x86_pkg_temp_thermal libahci intel_powerclamp coretemp i915 kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel sha512_ssse3 sha256_ssse3 iosf_mbi sha1_ssse3 drm_buddy aesni_intel ttm crypto_simd i2c_algo_bit cryptd drm_display_helper btusb btrtl btbcm rapl btintel drm_kms_helper bluetooth drm input_leds ecdh_generic led_class joydev ecc mei_hdcp mei_pxp i2c_i801 intel_gtt intel_cstate mpt3sas wmi_bmof mei_me agpgart thunderbolt i2c_smbus intel_uncore mei i2c_core raid_class scsi_transport_sas vmd tpm_crb video tpm_tis tpm_tis_core backlight tpm thermal fan acpi_tad acpi_pad wmi button [last unloaded: md_mod]
Nov 26 21:11:01 Toru kernel: CPU: 8 PID: 20849 Comm: unraidd0 Tainted: P      D    O       6.6.56-Unraid #1
Nov 26 21:11:01 Toru kernel: Hardware name: ASUS System Product Name/ProArt Z790-CREATOR WIFI, BIOS 2703 10/17/2024
Nov 26 21:11:01 Toru kernel: RIP: 0010:do_exit+0x81/0x910
Nov 26 21:11:01 Toru kernel: Code: 24 74 04 75 13 b8 01 00 00 00 41 89 6c 24 60 48 c1 e0 22 49 89 44 24 70 4c 89 ef e8 27 ca 9b 00 48 83 bb a8 07 00 00 00 74 02 <0f> 0b 48 8b bb c0 06 00 00 e8 f1 c8 9b 00 48 8b 83 b8 06 00 00 83
Nov 26 21:11:01 Toru kernel: RSP: 0018:ffffc90004fbfee0 EFLAGS: 00010286
Nov 26 21:11:01 Toru kernel: RAX: 0000000000000000 RBX: ffff88815edfb000 RCX: 0000000000000000
Nov 26 21:11:01 Toru kernel: RDX: 0000000000000001 RSI: 0000000000002710 RDI: 00000000ffffffff
Nov 26 21:11:01 Toru kernel: RBP: 0000000000000009 R08: 0000000000000000 R09: ffff88813ffe9400
Nov 26 21:11:01 Toru kernel: R10: 0000000000000001 R11: 0000000000aaaaaa R12: ffff8881074ab740
Nov 26 21:11:01 Toru kernel: R13: ffff88814703e300 R14: 0000000000000000 R15: 0000000000000000
Nov 26 21:11:01 Toru kernel: FS:  0000000000000000(0000) GS:ffff88a03f200000(0000) knlGS:0000000000000000
Nov 26 21:11:01 Toru kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 26 21:11:01 Toru kernel: CR2: 0000000000001018 CR3: 000000015fcc2000 CR4: 0000000000750ee0
Nov 26 21:11:01 Toru kernel: PKRU: 55555554
Nov 26 21:11:01 Toru kernel: Call Trace:
Nov 26 21:11:01 Toru kernel: <TASK>
Nov 26 21:11:01 Toru kernel: ? __warn+0x99/0x11a
Nov 26 21:11:01 Toru kernel: ? report_bug+0xd9/0x153
Nov 26 21:11:01 Toru kernel: ? do_exit+0x81/0x910
Nov 26 21:11:01 Toru kernel: ? handle_bug+0x3c/0x63
Nov 26 21:11:01 Toru kernel: ? exc_invalid_op+0x13/0x60
Nov 26 21:11:01 Toru kernel: ? asm_exc_invalid_op+0x16/0x20
Nov 26 21:11:01 Toru kernel: ? do_exit+0x81/0x910
Nov 26 21:11:01 Toru kernel: make_task_dead+0x113/0x113
Nov 26 21:11:01 Toru kernel: rewind_stack_and_make_dead+0x17/0x17
Nov 26 21:11:01 Toru kernel: RIP: 0000:0x0
Nov 26 21:11:01 Toru kernel: Code: Unable to access opcode bytes at 0xffffffffffffffd6.
Nov 26 21:11:01 Toru kernel: RSP: 0000:0000000000000000 EFLAGS: 00000000 ORIG_RAX: 0000000000000000
Nov 26 21:11:01 Toru kernel: RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
Nov 26 21:11:01 Toru kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
Nov 26 21:11:01 Toru kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
Nov 26 21:11:01 Toru kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
Nov 26 21:11:01 Toru kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
Nov 26 21:11:01 Toru kernel: </TASK>
Nov 26 21:11:01 Toru kernel: ---[ end trace 0000000000000000 ]---

On 11/26/2024 at 12:59 PM, kk61vo said:

I have 4 RAM sticks, I can try to run the server with only just one.

Have you done this? Memtest is only definitive when it fails the RAM, passing just means it didn't hit the failure conditions. Last week I had to replace a stick of DDR5 that consistently blue screen rebooted windows 11, yet passed 24 hours of memtest with no issues. I trusted memtest and replaced both the CPU and the motherboard, only to continue to get the same reboots. Replaced the RAM, boom, stable system.