TeeDouche

Disks that get spun down eventually accrue errors at the same rate of every other spun down disk. Errors do not persist after a reboot. Disks show in unassigned devices by itself. They are manually removed after each reboot. This has happened 3 times now. Spun down drives with same amount of errors. Array drives appearing in Unassigned Disks. Syslog shows bad sectors but attributes show large amount of seek errors which also do make sense to me since the drives only accrue these errors while they are spun down. Thanks for the help. This is my first time asking for assistance so if more information is needed please let me know. Thank you. diagnostics.zip

I havent ran a memtest, ill put that on my list to do this weekend. I just did have it crash again though and did a power cycle through IPMI to bring it back online. Attached below is the new syslog after clearing for BTRFS errors which seem to be gone after removing nerdpack. You can see the 7 minute downtime between crash and reboot Dec 7 20:20 - 20:27 syslog-192.168.1.111 (8).log

Okay so the docker.img file was recreated and is on my cache pool and was recreated yesterday yet still BTRFS errors still exist. Would it be favorable to just forgo the BTRFS filesystem and set up two cache drives to backup to each other overnight to be able to use XFS? Should I just move the docker image to the array and see if it spits out any errors there?

its been enabled and it is uploaded below. The snippet in the main body of my initial post is the section of the log just before it stopped capturing logs until new logs were formed after a reboot. You can see the time jump from Dec 6th at 2:23 AM to when I rebooted around 9 AM. syslog-192.168.1.111 (5).log

I have just removed Nerdpack as I wasnt actually using any of the plugins. For the docker image, I have recreated it 3 times already in the past month. I think I am past doing another recreation.

Diagnostics posted here. diagnostics.zip

This is an issue that has plagued me for a few months now. Approximately every 8-10 days, UnRaid will go fully unresponsive where the GUI doesn't load, I can't access SMB shares, and internet runs over backup DNS rather than the hosted PiHole. I finally got around to setting up Syslogging and was able to track down the specific excerpt that correlated to when the server lost connection. I am unsure what I am seeing here. Can anybody translate/advise of a fix? Dec 6 02:23:07 Ragnarok kernel: BTRFS critical (device loop2): panic in extent_io_tree_panic:703: locking error: extent tree was modified by another thread while locked (errno=-17 Object already exists) Dec 6 02:23:07 Ragnarok kernel: ------------[ cut here ]------------ Dec 6 02:23:07 Ragnarok kernel: kernel BUG at fs/btrfs/extent_io.c:703! Dec 6 02:23:07 Ragnarok kernel: invalid opcode: 0000 [#1] PREEMPT SMP PTI Dec 6 02:23:07 Ragnarok kernel: CPU: 1 PID: 373 Comm: kswapd0 Tainted: P W O 5.19.17-Unraid #2 Dec 6 02:23:07 Ragnarok kernel: Hardware name: Supermicro X9DRi-LN4+/X9DR3-LN4+/X9DRi-LN4+/X9DR3-LN4+, BIOS 3.4 11/20/2019 Dec 6 02:23:07 Ragnarok kernel: RIP: 0010:extent_io_tree_panic.isra.0+0x1f/0x21 Dec 6 02:23:07 Ragnarok kernel: Code: 8b 3d 56 12 0c 01 e9 79 07 9a ff 0f 1f 44 00 00 89 f1 49 c7 c0 fb 55 0f 82 ba bf 02 00 00 48 c7 c6 50 1a e4 81 e8 15 e1 ff ff <0f> 0b 0f 1f 44 00 00 48 8b 3d d4 13 0c 01 e9 47 07 9a ff 0f 1f 44 Dec 6 02:23:07 Ragnarok kernel: RSP: 0018:ffffc9000bc37a60 EFLAGS: 00010246 Dec 6 02:23:07 Ragnarok kernel: RAX: 0000000000000000 RBX: ffff8880124c29b0 RCX: 0000000000000000 Dec 6 02:23:07 Ragnarok kernel: RDX: 0000000000000000 RSI: ffffffff820d7be1 RDI: 00000000ffffffff Dec 6 02:23:07 Ragnarok kernel: RBP: ffff8882094692c8 R08: 0000000000000000 R09: 0000000000000040 Dec 6 02:23:07 Ragnarok kernel: R10: ffff8880124c29b0 R11: 0000000000000000 R12: 0000000011865fff Dec 6 02:23:07 Ragnarok kernel: R13: ffff8880124c29b0 R14: 0000000000000000 R15: ffff8884d34dae60 Dec 6 02:23:07 Ragnarok kernel: FS: 0000000000000000(0000) GS:ffff888667840000(0000) knlGS:0000000000000000 Dec 6 02:23:07 Ragnarok kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Dec 6 02:23:07 Ragnarok kernel: CR2: 00001526fbf0efd0 CR3: 000000000220a004 CR4: 00000000001706e0 Dec 6 02:23:07 Ragnarok kernel: Call Trace: Dec 6 02:23:07 Ragnarok kernel: <TASK> Dec 6 02:23:07 Ragnarok kernel: __clear_extent_bit+0x242/0x320 Dec 6 02:23:07 Ragnarok kernel: try_release_extent_mapping+0x1fa/0x216 Dec 6 02:23:07 Ragnarok kernel: ? rmap_walk_anon+0x16e/0x16e Dec 6 02:23:07 Ragnarok kernel: __btrfs_release_folio+0xf/0x31 Dec 6 02:23:07 Ragnarok kernel: shrink_page_list+0x659/0x965 Dec 6 02:23:07 Ragnarok kernel: shrink_lruvec+0x5e1/0x96a Dec 6 02:23:07 Ragnarok kernel: shrink_node+0x310/0x542 Dec 6 02:23:07 Ragnarok kernel: balance_pgdat+0x294/0x426 Dec 6 02:23:07 Ragnarok kernel: ? preempt_latency_start+0x2b/0x46 Dec 6 02:23:07 Ragnarok kernel: kswapd+0x2fa/0x33d Dec 6 02:23:07 Ragnarok kernel: ? _raw_spin_rq_lock_irqsave+0x20/0x20 Dec 6 02:23:07 Ragnarok kernel: ? balance_pgdat+0x426/0x426 Dec 6 02:23:07 Ragnarok kernel: kthread+0xe7/0xef Dec 6 02:23:07 Ragnarok kernel: ? kthread_complete_and_exit+0x1b/0x1b Dec 6 02:23:07 Ragnarok kernel: ret_from_fork+0x22/0x30 Dec 6 02:23:07 Ragnarok kernel: </TASK> Dec 6 02:23:07 Ragnarok kernel: Modules linked in: bluetooth ecdh_generic ecc tcp_diag udp_diag inet_diag wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libchacha nvidia_uvm(PO) xt_CHECKSUM ipt_REJECT nf_reject_ipv4 ip6table_mangle ip6table_nat iptable_mangle vhost_net vhost vhost_iotlb tap tun macvlan veth xt_nat xt_tcpudp xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo xt_addrtype iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter xfs md_mod nct7904 watchdog ip6table_filter ip6_tables iptable_filter ip_tables x_tables bonding tls bridge stp llc igb nvidia_drm(PO) nvidia_modeset(PO) x86_pkg_temp_thermal intel_powerclamp coretemp nvidia(PO) mgag200 drm_shmem_helper kvm_intel drm_kms_helper kvm drm crct10dif_pclmul crc32_pclmul crc32c_intel backlight ghash_clmulni_intel syscopyarea i2c_i801 sysfillrect aesni_intel crypto_simd cryptd rapl intel_cstate intel_uncore sysimgblt Dec 6 02:23:07 Ragnarok kernel: i2c_smbus ipmi_ssif fb_sys_fops i2c_algo_bit i2c_core isci libsas input_leds led_class ahci joydev libahci scsi_transport_sas wmi acpi_ipmi ipmi_si acpi_pad button unix [last unloaded: igb] Dec 6 02:23:07 Ragnarok kernel: ---[ end trace 0000000000000000 ]--- Dec 6 02:23:07 Ragnarok kernel: RIP: 0010:extent_io_tree_panic.isra.0+0x1f/0x21 Dec 6 02:23:07 Ragnarok kernel: Code: 8b 3d 56 12 0c 01 e9 79 07 9a ff 0f 1f 44 00 00 89 f1 49 c7 c0 fb 55 0f 82 ba bf 02 00 00 48 c7 c6 50 1a e4 81 e8 15 e1 ff ff <0f> 0b 0f 1f 44 00 00 48 8b 3d d4 13 0c 01 e9 47 07 9a ff 0f 1f 44 Dec 6 02:23:07 Ragnarok kernel: RSP: 0018:ffffc9000bc37a60 EFLAGS: 00010246 Dec 6 02:23:07 Ragnarok kernel: RAX: 0000000000000000 RBX: ffff8880124c29b0 RCX: 0000000000000000 Dec 6 02:23:07 Ragnarok kernel: RDX: 0000000000000000 RSI: ffffffff820d7be1 RDI: 00000000ffffffff Dec 6 02:23:07 Ragnarok kernel: RBP: ffff8882094692c8 R08: 0000000000000000 R09: 0000000000000040 Dec 6 02:23:07 Ragnarok kernel: R10: ffff8880124c29b0 R11: 0000000000000000 R12: 0000000011865fff Dec 6 02:23:07 Ragnarok kernel: R13: ffff8880124c29b0 R14: 0000000000000000 R15: ffff8884d34dae60 Dec 6 02:23:07 Ragnarok kernel: FS: 0000000000000000(0000) GS:ffff888667840000(0000) knlGS:0000000000000000 Dec 6 02:23:07 Ragnarok kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Dec 6 02:23:07 Ragnarok kernel: CR2: 00001526fbf0efd0 CR3: 000000000220a004 CR4: 00000000001706e0 Dec 6 02:23:07 Ragnarok kernel: note: kswapd0[373] exited with preempt_count 1 Dec 6 02:23:07 Ragnarok kernel: ------------[ cut here ]------------ Dec 6 02:23:07 Ragnarok kernel: WARNING: CPU: 1 PID: 373 at kernel/exit.c:741 do_exit+0x39/0x8e5 Dec 6 02:23:07 Ragnarok kernel: Modules linked in: bluetooth ecdh_generic ecc tcp_diag udp_diag inet_diag wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libchacha nvidia_uvm(PO) xt_CHECKSUM ipt_REJECT nf_reject_ipv4 ip6table_mangle ip6table_nat iptable_mangle vhost_net vhost vhost_iotlb tap tun macvlan veth xt_nat xt_tcpudp xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo xt_addrtype iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter xfs md_mod nct7904 watchdog ip6table_filter ip6_tables iptable_filter ip_tables x_tables bonding tls bridge stp llc igb nvidia_drm(PO) nvidia_modeset(PO) x86_pkg_temp_thermal intel_powerclamp coretemp nvidia(PO) mgag200 drm_shmem_helper kvm_intel drm_kms_helper kvm drm crct10dif_pclmul crc32_pclmul crc32c_intel backlight ghash_clmulni_intel syscopyarea i2c_i801 sysfillrect aesni_intel crypto_simd cryptd rapl intel_cstate intel_uncore sysimgblt Dec 6 02:23:07 Ragnarok kernel: i2c_smbus ipmi_ssif fb_sys_fops i2c_algo_bit i2c_core isci libsas input_leds led_class ahci joydev libahci scsi_transport_sas wmi acpi_ipmi ipmi_si acpi_pad button unix [last unloaded: igb] Dec 6 02:23:07 Ragnarok kernel: CPU: 1 PID: 373 Comm: kswapd0 Tainted: P D W O 5.19.17-Unraid #2 Dec 6 02:23:07 Ragnarok kernel: Hardware name: Supermicro X9DRi-LN4+/X9DR3-LN4+/X9DRi-LN4+/X9DR3-LN4+, BIOS 3.4 11/20/2019 Dec 6 02:23:07 Ragnarok kernel: RIP: 0010:do_exit+0x39/0x8e5 Dec 6 02:23:07 Ragnarok kernel: Code: 89 fd 53 48 83 ec 28 65 48 8b 04 25 28 00 00 00 48 89 44 24 20 31 c0 65 48 8b 1c 25 c0 bb 01 00 48 83 bb a0 07 00 00 00 74 02 <0f> 0b 48 8b bb c8 06 00 00 e8 b7 c0 7c 00 48 8b 83 c0 06 00 00 83 Dec 6 02:23:07 Ragnarok kernel: RSP: 0018:ffffc9000bc37ee0 EFLAGS: 00010286 Dec 6 02:23:07 Ragnarok kernel: RAX: 0000000000000000 RBX: ffff888103efaf40 RCX: 0000000000000000 Dec 6 02:23:07 Ragnarok kernel: RDX: 0000000000000001 RSI: ffffffff820d7be1 RDI: 000000000000000b Dec 6 02:23:07 Ragnarok kernel: RBP: 000000000000000b R08: 0000000000000000 R09: ffffc9000976c020 Dec 6 02:23:07 Ragnarok kernel: R10: 0000000000aaaaaa R11: 0000000000000001 R12: ffffc9000bc379b8 Dec 6 02:23:07 Ragnarok kernel: R13: ffff888103efaf40 R14: 0000000000000002 R15: ffffffff820b236d Dec 6 02:23:07 Ragnarok kernel: FS: 0000000000000000(0000) GS:ffff888667840000(0000) knlGS:0000000000000000 Dec 6 02:23:07 Ragnarok kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Dec 6 02:23:07 Ragnarok kernel: CR2: 00001526fbf0efd0 CR3: 000000000220a004 CR4: 00000000001706e0 Dec 6 02:23:07 Ragnarok kernel: Call Trace: Dec 6 02:23:07 Ragnarok kernel: <TASK> Dec 6 02:23:07 Ragnarok kernel: make_task_dead+0xba/0xba Dec 6 02:23:07 Ragnarok kernel: rewind_stack_and_make_dead+0x17/0x17 Dec 6 02:23:07 Ragnarok kernel: RIP: 0000:0x0 Dec 6 02:23:07 Ragnarok kernel: Code: Unable to access opcode bytes at RIP 0xffffffffffffffd6. Dec 6 02:23:07 Ragnarok kernel: RSP: 0000:0000000000000000 EFLAGS: 00000000 ORIG_RAX: 0000000000000000 Dec 6 02:23:07 Ragnarok kernel: RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000 Dec 6 02:23:07 Ragnarok kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 Dec 6 02:23:07 Ragnarok kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 Dec 6 02:23:07 Ragnarok kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 Dec 6 02:23:07 Ragnarok kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 Dec 6 02:23:07 Ragnarok kernel: </TASK> Dec 6 02:23:07 Ragnarok kernel: ---[ end trace 0000000000000000 ]---