werkkrew

Members
  • Posts

    13
  • Joined

  • Last visited

Recent Profile Visitors

The recent visitors block is disabled and is not being shown to other users.

werkkrew's Achievements

Noob

Noob (1/14)

0

Reputation

  1. When I woke up this morning now everything is working again, but I have no idea why. I will do some digging, it could have been on the router side also.
  2. So I haven't had a Kernel panic since I made this change but today after rebooting my router I suddenly cannot get any internet access from my Unraid box, or the containers it runs. Based on some searching this seems likely related to the IPVLAN change but I can't find any clear resolution. Any idea?
  3. I have made the change and will upgrade again soon, will report back if this solves the problem. Thanks.
  4. Ever since upgrading to 6.12.4 my system has been experiencing a kernel panic every few hours. I have attached the diagnostic bundle as well as as chunk of the syslog from my remote syslog server if anyone wants to take a stab at trying to diagnose this. Nov 11 22:08:54 arthas kernel: ------------[ cut here ]------------ Nov 11 22:08:54 arthas kernel: WARNING: CPU: 33 PID: 13137 at net/netfilter/nf_nat_core.c:594 nf_nat_setup_info+0x8c/0x7d1 [nf_nat] Nov 11 22:08:54 arthas kernel: Modules linked in: xt_CHECKSUM ipt_REJECT nf_reject_ipv4 ip6table_mangle ip6table_nat iptable_mangle vhost_net tun vhost vhost_iotlb tap veth macvlan xt_nat xt_tcpudp xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 xt_addrtype br_netfilter xfs md_mod zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) tcp_diag inet_diag ip6table_filter ip6_tables iptable_filter ip_tables x_tables af_packet 8021q garp mrp bridge stp llc bonding tls e1000e amdgpu gpu_sched drm_buddy radeon intel_rapl_msr intel_rapl_common iosf_mbi x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel video i2c_algo_bit drm_ttm_helper ttm drm_display_helper drm_kms_helper tpm_infineon kvm drm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel sha512_ssse3 aesni_intel crypto_simd backlight cryptd mei_hdcp mei_pxp agpgart i2c_i801 rapl tpm_tis intel_cstate wmi_bmof mpt3sas Nov 11 22:08:54 arthas kernel: isci firewire_ohci tpm_tis_core i2c_smbus syscopyarea nvme mei_me libsas ahci sysfillrect raid_class sysimgblt intel_uncore firewire_core i2c_core nvme_core mei libahci scsi_transport_sas fb_sys_fops wmi tpm button unix [last unloaded: e1000e] Nov 11 22:08:54 arthas kernel: CPU: 33 PID: 13137 Comm: kworker/u97:6 Tainted: P W O 6.1.49-Unraid #1 Nov 11 22:08:54 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Nov 11 22:08:54 arthas kernel: Workqueue: events_unbound macvlan_process_broadcast [macvlan] Nov 11 22:08:54 arthas kernel: RIP: 0010:nf_nat_setup_info+0x8c/0x7d1 [nf_nat] Nov 11 22:08:54 arthas kernel: Code: a8 80 75 26 48 8d 73 58 48 8d 7c 24 20 e8 18 9b fc ff 48 8d 43 0c 4c 8b bb 88 00 00 00 48 89 44 24 18 eb 54 0f ba e0 08 73 07 <0f> 0b e9 75 06 00 00 48 8d 73 58 48 8d 7c 24 20 e8 eb 9a fc ff 48 Nov 11 22:08:54 arthas kernel: RSP: 0018:ffffc90006c00c78 EFLAGS: 00010282 Nov 11 22:08:54 arthas kernel: RAX: 0000000000000180 RBX: ffff8882683a6c00 RCX: ffff88903b8f3480 Nov 11 22:08:54 arthas kernel: RDX: 0000000000000000 RSI: ffffc90006c00d5c RDI: ffff8882683a6c00 Nov 11 22:08:54 arthas kernel: RBP: ffffc90006c00d40 R08: 000000001501a8c0 R09: 0000000000000000 Nov 11 22:08:54 arthas kernel: R10: 0000000000000158 R11: 0000000000000000 R12: ffffc90006c00d5c Nov 11 22:08:54 arthas kernel: R13: 0000000000000000 R14: ffffc90006c00e40 R15: 0000000000000001 Nov 11 22:08:54 arthas kernel: FS: 0000000000000000(0000) GS:ffff888fefd40000(0000) knlGS:0000000000000000 Nov 11 22:08:54 arthas kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Nov 11 22:08:54 arthas kernel: CR2: 0000152dabebce80 CR3: 000000000220a004 CR4: 00000000001706e0 Nov 11 22:08:54 arthas kernel: Call Trace: Nov 11 22:08:54 arthas kernel: <IRQ> Nov 11 22:08:54 arthas kernel: ? __warn+0xab/0x122 Nov 11 22:08:54 arthas kernel: ? report_bug+0x109/0x17e Nov 11 22:08:54 arthas kernel: ? nf_nat_setup_info+0x8c/0x7d1 [nf_nat] Nov 11 22:08:54 arthas kernel: ? handle_bug+0x41/0x6f Nov 11 22:08:54 arthas kernel: ? exc_invalid_op+0x13/0x60 Nov 11 22:08:54 arthas kernel: ? asm_exc_invalid_op+0x16/0x20 Nov 11 22:08:54 arthas kernel: ? nf_nat_setup_info+0x8c/0x7d1 [nf_nat] Nov 11 22:08:54 arthas kernel: ? nf_nat_setup_info+0x44/0x7d1 [nf_nat] Nov 11 22:08:54 arthas kernel: ? xt_write_recseq_end+0xf/0x1c [ip_tables] Nov 11 22:08:54 arthas kernel: ? __local_bh_enable_ip+0x56/0x6b Nov 11 22:08:54 arthas kernel: ? ipt_do_table+0x57a/0x5bf [ip_tables] Nov 11 22:08:54 arthas kernel: ? xt_write_recseq_end+0xf/0x1c [ip_tables] Nov 11 22:08:54 arthas kernel: __nf_nat_alloc_null_binding+0x66/0x81 [nf_nat] Nov 11 22:08:54 arthas kernel: nf_nat_inet_fn+0xc0/0x1a8 [nf_nat] Nov 11 22:08:54 arthas kernel: nf_nat_ipv4_local_in+0x2a/0xaa [nf_nat] Nov 11 22:08:54 arthas kernel: nf_hook_slow+0x3d/0x96 Nov 11 22:08:54 arthas kernel: ? ip_protocol_deliver_rcu+0x164/0x164 Nov 11 22:08:54 arthas kernel: NF_HOOK.constprop.0+0x79/0xd9 Nov 11 22:08:54 arthas kernel: ? ip_protocol_deliver_rcu+0x164/0x164 Nov 11 22:08:54 arthas kernel: __netif_receive_skb_one_core+0x77/0x9c Nov 11 22:08:54 arthas kernel: process_backlog+0x8c/0x116 Nov 11 22:08:54 arthas kernel: __napi_poll.constprop.0+0x2b/0x124 Nov 11 22:08:54 arthas kernel: net_rx_action+0x159/0x24f arthas-diagnostics-20231112-0925.zip
  5. Every time I enable IPv6, within a few hours my server crashes hard with a kernel panic. I have captured the logs here. It could just be a coincidence and a symptom of a different problem, I'm not sure. Oct 21 22:24:32 arthas kernel: BUG: Bad page map in process Lidarr pte:8400777ea47d4075 pmd:36a9d8067 Oct 21 22:24:32 arthas kernel: addr:0000150506533000 vm_flags:00100073 anon_vma:ffff8885e726daf8 mapping:0000000000000000 index:150506533 Oct 21 22:24:32 arthas kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 21 22:24:32 arthas kernel: CPU: 10 PID: 5205 Comm: Lidarr Tainted: G B D W 5.19.14-Unraid #1 Oct 21 22:24:32 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Oct 21 22:24:32 arthas kernel: Call Trace: Oct 21 22:24:32 arthas kernel: <TASK> Oct 21 22:24:32 arthas kernel: dump_stack_lvl+0x44/0x5c Oct 21 22:24:32 arthas kernel: print_bad_pte+0x1cb/0x1e5 Oct 21 22:24:32 arthas kernel: vm_normal_page+0x84/0x9e Oct 21 22:24:32 arthas kernel: change_protection+0x76a/0xc41 Oct 21 22:24:32 arthas kernel: change_prot_numa+0x55/0x97 Oct 21 22:24:32 arthas kernel: ? timerqueue_add+0x6a/0x76 Oct 21 22:24:32 arthas kernel: ? enqueue_hrtimer+0x77/0x82 Oct 21 22:24:32 arthas kernel: task_numa_work+0x228/0x2db Oct 21 22:24:32 arthas kernel: task_work_run+0x69/0x7e Oct 21 22:24:32 arthas kernel: exit_to_user_mode_prepare+0x75/0x10d Oct 21 22:24:32 arthas kernel: irqentry_exit_to_user_mode+0x5/0x13 Oct 21 22:24:32 arthas kernel: asm_sysvec_apic_timer_interrupt+0x16/0x20 Oct 21 22:24:32 arthas kernel: RIP: 0033:0x1504feb01f80 Oct 21 22:24:32 arthas kernel: Code: Unable to access opcode bytes at RIP 0x1504feb01f56. Oct 21 22:24:32 arthas kernel: RSP: 002b:00001504daacd058 EFLAGS: 00000206 Oct 21 22:24:32 arthas kernel: RAX: 0000000000000001 RBX: 00001504e0a607e0 RCX: 0000000000000036 Oct 21 22:24:32 arthas kernel: RDX: 000000000000000f RSI: 00001504e0460ab0 RDI: 00001504e0a607a8 Oct 21 22:24:32 arthas kernel: RBP: 00001504daacd0b0 R08: 000000000000002f R09: 0000000000000036 Oct 21 22:24:32 arthas kernel: R10: 0000002f00000000 R11: 0000150505752a48 R12: 0000150505ac0400 Oct 21 22:24:32 arthas kernel: R13: 0000000000000003 R14: 0000150505ac0450 R15: 00001504e0a607a8 Oct 21 22:24:32 arthas kernel: </TASK> Oct 21 22:30:31 arthas kernel: BUG: Bad page map in process Lidarr pte:8400777ea47d4075 pmd:36a9d8067 Oct 21 22:30:31 arthas kernel: addr:0000150506533000 vm_flags:00100073 anon_vma:ffff8885e726daf8 mapping:0000000000000000 index:150506533 Oct 21 22:30:31 arthas kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 21 22:30:32 arthas kernel: CPU: 2 PID: 5204 Comm: Lidarr Tainted: G B D W 5.19.14-Unraid #1 Oct 21 22:30:32 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Oct 21 22:30:32 arthas kernel: Call Trace: Oct 21 22:30:32 arthas kernel: <TASK> Oct 21 22:30:32 arthas kernel: dump_stack_lvl+0x44/0x5c Oct 21 22:30:32 arthas kernel: print_bad_pte+0x1cb/0x1e5 Oct 21 22:30:32 arthas kernel: vm_normal_page+0x84/0x9e Oct 21 22:30:32 arthas kernel: change_protection+0x76a/0xc41 Oct 21 22:30:32 arthas kernel: change_prot_numa+0x55/0x97 Oct 21 22:30:32 arthas kernel: ? vma_migratable+0x9/0x78 Oct 21 22:30:32 arthas kernel: task_numa_work+0x228/0x2db Oct 21 22:30:32 arthas kernel: task_work_run+0x69/0x7e Oct 21 22:30:32 arthas kernel: exit_to_user_mode_prepare+0x75/0x10d Oct 21 22:30:32 arthas kernel: syscall_exit_to_user_mode+0x18/0x27 Oct 21 22:30:32 arthas kernel: do_syscall_64+0x77/0x81 Oct 21 22:30:32 arthas kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Oct 21 22:30:32 arthas kernel: RIP: 0033:0x1505791a04a3 Oct 21 22:30:32 arthas kernel: Code: c3 8b 07 85 c0 75 24 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 <c3> e9 c7 d1 ff ff 41 54 b8 02 00 00 00 49 89 f4 be 00 88 08 00 55 Oct 21 22:30:32 arthas kernel: RSP: 002b:00001504dac4f4a8 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca Oct 21 22:30:32 arthas kernel: RAX: 0000000000000000 RBX: 00001504dac50b30 RCX: 00001505791a04a3 Oct 21 22:30:32 arthas kernel: RDX: 0000000000000002 RSI: 0000000000000080 RDI: 00001504dac4f574 Oct 21 22:30:32 arthas kernel: RBP: 00001504dac4f574 R08: 0000000000000000 R09: 0000000000000000 Oct 21 22:30:32 arthas kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 00000000000000ca Oct 21 22:30:32 arthas kernel: R13: 0000000000000001 R14: 00001504dcecb1e8 R15: 00001504dcecb1e8 Oct 21 22:30:32 arthas kernel: </TASK> Oct 21 22:54:32 arthas kernel: BUG: Bad page map in process Lidarr pte:8400777ea47d4075 pmd:36a9d8067 Oct 21 22:54:32 arthas kernel: addr:0000150506533000 vm_flags:00100073 anon_vma:ffff8885e726daf8 mapping:0000000000000000 index:150506533 Oct 21 22:54:32 arthas kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 21 22:54:32 arthas kernel: CPU: 3 PID: 5204 Comm: Lidarr Tainted: G B D W 5.19.14-Unraid #1 Oct 21 22:54:32 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Oct 21 22:54:32 arthas kernel: Call Trace: Oct 21 22:54:32 arthas kernel: <TASK> Oct 21 22:54:32 arthas kernel: dump_stack_lvl+0x44/0x5c Oct 21 22:54:32 arthas kernel: print_bad_pte+0x1cb/0x1e5 Oct 21 22:54:32 arthas kernel: vm_normal_page+0x84/0x9e Oct 21 22:54:32 arthas kernel: change_protection+0x76a/0xc41 Oct 21 22:54:32 arthas kernel: change_prot_numa+0x55/0x97 Oct 21 22:54:32 arthas kernel: ? fcntl_setlk+0x1cd/0x1e2 Oct 21 22:54:32 arthas kernel: task_numa_work+0x228/0x2db Oct 21 22:54:32 arthas kernel: task_work_run+0x69/0x7e Oct 21 22:54:32 arthas kernel: exit_to_user_mode_prepare+0x75/0x10d Oct 21 22:54:32 arthas kernel: syscall_exit_to_user_mode+0x18/0x27 Oct 21 22:54:32 arthas kernel: do_syscall_64+0x77/0x81 Oct 21 22:54:32 arthas kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Oct 21 22:54:32 arthas kernel: RIP: 0033:0x150579168338 Oct 21 22:54:32 arthas kernel: Code: 89 c0 0f 05 eb 27 48 63 f6 83 f8 06 7f 07 83 f8 04 7f 0d eb 08 8d 50 f1 83 fa 01 76 03 48 63 f0 b8 48 00 00 00 4c 89 d2 0f 05 <48> 89 c7 e8 dc 19 00 00 48 83 c4 58 c3 53 89 f3 49 89 fa 48 83 ec Oct 21 22:54:32 arthas kernel: RSP: 002b:00001504dac4f700 EFLAGS: 00000202 ORIG_RAX: 0000000000000048 Oct 21 22:54:32 arthas kernel: RAX: 0000000000000000 RBX: 0000000000000010 RCX: 0000150579168338 Oct 21 22:54:32 arthas kernel: RDX: 00001504dac4f768 RSI: 0000000000000006 RDI: 00000000000000fc Oct 21 22:54:32 arthas kernel: RBP: 0000000000000004 R08: 0000000000000046 R09: 0000000000000001 Oct 21 22:54:32 arthas kernel: R10: 00001504dac4f768 R11: 0000000000000202 R12: 0000000000000001 Oct 21 22:54:32 arthas kernel: R13: 00001505052f02a8 R14: 00001504dbb50188 R15: 00001505052f0258 Oct 21 22:54:32 arthas kernel: </TASK> Oct 21 22:59:02 arthas kernel: BUG: Bad page map in process Lidarr pte:8400777ea47d4075 pmd:36a9d8067 Oct 21 22:59:02 arthas kernel: addr:0000150506533000 vm_flags:00100073 anon_vma:ffff8885e726daf8 mapping:0000000000000000 index:150506533 Oct 21 22:59:02 arthas kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 21 22:59:02 arthas kernel: CPU: 6 PID: 5205 Comm: Lidarr Tainted: G B D W 5.19.14-Unraid #1 Oct 21 22:59:02 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Oct 21 22:59:02 arthas kernel: Call Trace: Oct 21 22:59:02 arthas kernel: <TASK> Oct 21 22:59:02 arthas kernel: dump_stack_lvl+0x44/0x5c Oct 21 22:59:02 arthas kernel: print_bad_pte+0x1cb/0x1e5 Oct 21 22:59:02 arthas kernel: vm_normal_page+0x84/0x9e Oct 21 22:59:02 arthas kernel: change_protection+0x76a/0xc41 Oct 21 22:59:02 arthas kernel: change_prot_numa+0x55/0x97 Oct 21 22:59:02 arthas kernel: ? _raw_spin_unlock_irqrestore+0x24/0x3a Oct 21 22:59:02 arthas kernel: ? note_gp_changes+0x62/0x78 Oct 21 22:59:02 arthas kernel: ? rcu_core+0x27f/0x2ac Oct 21 22:59:02 arthas kernel: task_numa_work+0x228/0x2db Oct 21 22:59:02 arthas kernel: task_work_run+0x69/0x7e Oct 21 22:59:02 arthas kernel: exit_to_user_mode_prepare+0x75/0x10d Oct 21 22:59:02 arthas kernel: irqentry_exit_to_user_mode+0x5/0x13 Oct 21 22:59:02 arthas kernel: asm_sysvec_apic_timer_interrupt+0x16/0x20 Oct 21 22:59:02 arthas kernel: RIP: 0033:0x1505047f7a60 Oct 21 22:59:02 arthas kernel: Code: Unable to access opcode bytes at RIP 0x1505047f7a36. Oct 21 22:59:02 arthas kernel: RSP: 002b:00001504daaccdb8 EFLAGS: 00000216 Oct 21 22:59:02 arthas kernel: RAX: 0000150578d704b8 RBX: 00001504e0abc5d0 RCX: 0000000000000000 Oct 21 22:59:02 arthas kernel: RDX: 00001504e0ac58c8 RSI: 000015050527ee70 RDI: 00001504e0ac5890 Oct 21 22:59:02 arthas kernel: RBP: 00001504daacce60 R08: 0000000000004000 R09: 0000000000004000 Oct 21 22:59:02 arthas kernel: R10: 0000000d00000000 R11: 0000150505753a88 R12: 0000150505203bc8 Oct 21 22:59:02 arthas kernel: R13: 00001505052037c0 R14: 00001504e0ac5740 R15: 0000150505203ac8 Oct 21 22:59:02 arthas kernel: </TASK> Oct 21 23:03:52 arthas kernel: BUG: Bad page map in process .NET ThreadPool pte:8400777ea47d4075 pmd:36a9d8067 Oct 21 23:03:52 arthas kernel: addr:0000150506533000 vm_flags:00100073 anon_vma:ffff8885e726daf8 mapping:0000000000000000 index:150506533 Oct 21 23:03:52 arthas kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 21 23:03:52 arthas kernel: CPU: 6 PID: 3102 Comm: .NET ThreadPool Tainted: G B D W 5.19.14-Unraid #1 Oct 21 23:03:52 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Oct 21 23:03:52 arthas kernel: Call Trace: Oct 21 23:03:52 arthas kernel: <TASK> Oct 21 23:03:52 arthas kernel: dump_stack_lvl+0x44/0x5c Oct 21 23:03:52 arthas kernel: print_bad_pte+0x1cb/0x1e5 Oct 21 23:03:52 arthas kernel: vm_normal_page+0x84/0x9e Oct 21 23:03:52 arthas kernel: change_protection+0x76a/0xc41 Oct 21 23:03:52 arthas kernel: change_prot_numa+0x55/0x97 Oct 21 23:03:52 arthas kernel: ? _raw_spin_unlock_irqrestore+0x24/0x3a Oct 21 23:03:52 arthas kernel: ? note_gp_changes+0x62/0x78 Oct 21 23:03:52 arthas kernel: ? rcu_core+0x27f/0x2ac Oct 21 23:03:52 arthas kernel: task_numa_work+0x228/0x2db Oct 21 23:03:52 arthas kernel: task_work_run+0x69/0x7e Oct 21 23:03:52 arthas kernel: exit_to_user_mode_prepare+0x75/0x10d Oct 21 23:03:52 arthas kernel: irqentry_exit_to_user_mode+0x5/0x13 Oct 21 23:03:52 arthas kernel: asm_sysvec_apic_timer_interrupt+0x16/0x20 Oct 21 23:03:52 arthas kernel: RIP: 0033:0x1504ffea5382 Oct 21 23:03:52 arthas kernel: Code: Unable to access opcode bytes at RIP 0x1504ffea5358. Oct 21 23:03:52 arthas kernel: RSP: 002b:00001504dc9df428 EFLAGS: 00000202 Oct 21 23:03:52 arthas kernel: RAX: 00001504ff6045f0 RBX: 0000000000000000 RCX: 0000000000000000 Oct 21 23:03:52 arthas kernel: RDX: 0000000000000000 RSI: 0000000002134b17 RDI: 00001504dc9df500 Oct 21 23:03:52 arthas kernel: RBP: 00001504dc9df550 R08: 0000000000000001 R09: 0000000000000000 Oct 21 23:03:52 arthas kernel: R10: 00007ffe9c537080 R11: 00001504dc9defd8 R12: 00001504f6461028 Oct 21 23:03:52 arthas kernel: R13: 0000000002134b17 R14: 0000000000000000 R15: 00001504de4a59a8 Oct 21 23:03:52 arthas kernel: </TASK> Oct 21 23:18:32 arthas avahi-daemon[28128]: Leaving mDNS multicast group on interface br0.IPv6 with address 2600:4040:7e6a:c800:7431:26ff:fe4d:c9bf. Oct 21 23:18:32 arthas avahi-daemon[28128]: Joining mDNS multicast group on interface br0.IPv6 with address 2600:4040:7e6c:6300::2000. Oct 21 23:18:32 arthas dhcpcd[25591]: br0: pid 0 deleted address 2600:4040:7e6a:c800:7431:26ff:fe4d:c9bf/56 Oct 21 23:18:32 arthas dhcpcd[25591]: br0: part of a Router Advertisement expired Oct 21 23:18:32 arthas dhcpcd[25591]: br0: deleting route to 2600:4040:7e6a:c800::/56 Oct 21 23:18:33 arthas ntpd[1593]: Deleting interface #16 br0, 2600:4040:7e6a:c800:7431:26ff:fe4d:c9bf#123, interface stats: received=0, sent=0, dropped=0, active_time=7205 secs Oct 21 23:20:03 arthas kernel: BUG: Bad page map in process Lidarr pte:8400777ea47d4075 pmd:36a9d8067 Oct 21 23:20:03 arthas kernel: addr:0000150506533000 vm_flags:00100073 anon_vma:ffff8885e726daf8 mapping:0000000000000000 index:150506533 Oct 21 23:20:03 arthas kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 21 23:20:03 arthas kernel: CPU: 22 PID: 5205 Comm: Lidarr Tainted: G B D W 5.19.14-Unraid #1 Oct 21 23:20:03 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Oct 21 23:20:03 arthas kernel: Call Trace: Oct 21 23:20:03 arthas kernel: <TASK> Oct 21 23:20:03 arthas kernel: dump_stack_lvl+0x44/0x5c Oct 21 23:20:03 arthas kernel: print_bad_pte+0x1cb/0x1e5 Oct 21 23:20:03 arthas kernel: vm_normal_page+0x84/0x9e Oct 21 23:20:03 arthas kernel: change_protection+0x76a/0xc41 Oct 21 23:20:03 arthas kernel: change_prot_numa+0x55/0x97 Oct 21 23:20:03 arthas kernel: ? rcu_core+0x27f/0x2ac Oct 21 23:20:03 arthas kernel: task_numa_work+0x228/0x2db Oct 21 23:20:03 arthas kernel: task_work_run+0x69/0x7e Oct 21 23:20:03 arthas kernel: exit_to_user_mode_prepare+0x75/0x10d Oct 21 23:20:03 arthas kernel: irqentry_exit_to_user_mode+0x5/0x13 Oct 21 23:20:03 arthas kernel: asm_sysvec_apic_timer_interrupt+0x16/0x20 Oct 21 23:20:03 arthas kernel: RIP: 0033:0x15050480df50 Oct 21 23:20:03 arthas kernel: Code: Unable to access opcode bytes at RIP 0x15050480df26. Oct 21 23:20:03 arthas kernel: RSP: 002b:00001504daaccf78 EFLAGS: 00000246 Oct 21 23:20:03 arthas kernel: RAX: 00001504e0485b40 RBX: 00001504e04858e0 RCX: 00001504dcecb640 Oct 21 23:20:03 arthas kernel: RDX: 00001504e0485b40 RSI: 00001504e0485b40 RDI: 00001504e0c7cc98 Oct 21 23:20:03 arthas kernel: RBP: 00001504daaccfa0 R08: 0000000000000006 R09: 0000000000000005 Oct 21 23:20:03 arthas kernel: R10: 0000000d00000000 R11: 0000150505752a38 R12: 00001504e0c7cc98 Oct 21 23:20:03 arthas kernel: R13: 0000000000000003 R14: 00001504e0487710 R15: 00001504e0c7cc80 Oct 21 23:20:03 arthas kernel: </TASK> Oct 21 23:20:11 arthas webGUI: Successful login user root from 192.168.1.102 Oct 21 23:21:33 arthas kernel: BUG: Bad page map in process Lidarr pte:8400777ea47d4075 pmd:36a9d8067 Oct 21 23:21:33 arthas kernel: addr:0000150506533000 vm_flags:00100073 anon_vma:ffff8885e726daf8 mapping:0000000000000000 index:150506533 Oct 21 23:21:33 arthas kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 21 23:21:33 arthas kernel: CPU: 5 PID: 5204 Comm: Lidarr Tainted: G B D W 5.19.14-Unraid #1 Oct 21 23:21:33 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Oct 21 23:21:33 arthas kernel: Call Trace: Oct 21 23:21:33 arthas kernel: <TASK> Oct 21 23:21:33 arthas kernel: dump_stack_lvl+0x44/0x5c Oct 21 23:21:33 arthas kernel: print_bad_pte+0x1cb/0x1e5 Oct 21 23:21:33 arthas kernel: vm_normal_page+0x84/0x9e Oct 21 23:21:33 arthas kernel: change_protection+0x76a/0xc41 Oct 21 23:21:33 arthas kernel: change_prot_numa+0x55/0x97 Oct 21 23:21:33 arthas kernel: ? rcu_core+0x27f/0x2ac Oct 21 23:21:33 arthas kernel: task_numa_work+0x228/0x2db Oct 21 23:21:33 arthas kernel: task_work_run+0x69/0x7e Oct 21 23:21:33 arthas kernel: exit_to_user_mode_prepare+0x75/0x10d Oct 21 23:21:33 arthas kernel: irqentry_exit_to_user_mode+0x5/0x13 Oct 21 23:21:33 arthas kernel: asm_sysvec_apic_timer_interrupt+0x16/0x20 Oct 21 23:21:33 arthas kernel: RIP: 0033:0x150505ab0d05 Oct 21 23:21:33 arthas kernel: Code: Unable to access opcode bytes at RIP 0x150505ab0cdb. Oct 21 23:21:33 arthas kernel: RSP: 002b:00001504dac4fcf0 EFLAGS: 00000206 Oct 21 23:21:33 arthas kernel: RAX: 0000000000000009 RBX: 00001504def895a0 RCX: 00001504def89b80 Oct 21 23:21:33 arthas kernel: RDX: 0000000000000113 RSI: 0000000000000001 RDI: 00001504def12498 Oct 21 23:21:33 arthas kernel: RBP: 00001504dac4fd60 R08: 0000150505ab0056 R09: 00001504def89708 Oct 21 23:21:33 arthas kernel: R10: 0000000000000000 R11: 00001504def89430 R12: 0000000000000012 Oct 21 23:21:33 arthas kernel: R13: 000000000000001e R14: 00001504de46c578 R15: 00001504e072c730 Oct 21 23:21:33 arthas kernel: </TASK> Oct 21 23:25:36 arthas kernel: docker0: port 3(veth2906ae5) entered disabled state Oct 21 23:25:36 arthas kernel: vetheff0ebd: renamed from eth0 Oct 21 23:25:36 arthas avahi-daemon[28128]: Interface veth2906ae5.IPv6 no longer relevant for mDNS. Oct 21 23:25:36 arthas avahi-daemon[28128]: Leaving mDNS multicast group on interface veth2906ae5.IPv6 with address fe80::4c75:c3ff:fe9a:4b1c. Oct 21 23:25:36 arthas kernel: docker0: port 3(veth2906ae5) entered disabled state Oct 21 23:25:36 arthas kernel: device veth2906ae5 left promiscuous mode Oct 21 23:25:36 arthas kernel: docker0: port 3(veth2906ae5) entered disabled state Oct 21 23:25:36 arthas avahi-daemon[28128]: Withdrawing address record for fe80::4c75:c3ff:fe9a:4b1c on veth2906ae5. Oct 21 23:25:37 arthas kernel: docker0: port 3(veth21a1f43) entered blocking state Oct 21 23:25:37 arthas kernel: docker0: port 3(veth21a1f43) entered disabled state Oct 21 23:25:37 arthas kernel: device veth21a1f43 entered promiscuous mode Oct 21 23:25:37 arthas kernel: eth0: renamed from veth509a313 Oct 21 23:25:37 arthas kernel: IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Oct 21 23:25:37 arthas kernel: IPv6: ADDRCONF(NETDEV_CHANGE): veth21a1f43: link becomes ready Oct 21 23:25:37 arthas kernel: docker0: port 3(veth21a1f43) entered blocking state Oct 21 23:25:37 arthas kernel: docker0: port 3(veth21a1f43) entered forwarding state Oct 21 23:25:39 arthas avahi-daemon[28128]: Joining mDNS multicast group on interface veth21a1f43.IPv6 with address fe80::90f8:e8ff:fe12:3456. Oct 21 23:25:39 arthas avahi-daemon[28128]: New relevant interface veth21a1f43.IPv6 for mDNS. Oct 21 23:25:39 arthas avahi-daemon[28128]: Registering new address record for fe80::90f8:e8ff:fe12:3456 on veth21a1f43.*. Oct 21 23:36:14 arthas dhcpcd[25591]: br0: expired address 2600:4040:7e6c:2d00:7431:26ff:fe4d:c9bf/56 Oct 21 23:36:14 arthas dhcpcd[25591]: br0: part of a Router Advertisement expired Oct 21 23:36:14 arthas dhcpcd[25591]: br0: deleting route to 2600:4040:7e6c:2d00::/56 Oct 21 23:36:15 arthas ntpd[1593]: Deleting interface #19 br0, 2600:4040:7e6c:2d00:7431:26ff:fe4d:c9bf#123, interface stats: received=0, sent=0, dropped=0, active_time=8260 secs Oct 21 23:47:03 arthas kernel: BUG: Bad page map in process Lidarr pte:8400777ea47d4075 pmd:36a9d8067 Oct 21 23:47:03 arthas kernel: addr:0000150506533000 vm_flags:00100073 anon_vma:ffff8885e726daf8 mapping:0000000000000000 index:150506533 Oct 21 23:47:03 arthas kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 21 23:47:03 arthas kernel: CPU: 15 PID: 5205 Comm: Lidarr Tainted: G B D W 5.19.14-Unraid #1 Oct 21 23:47:03 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Oct 21 23:47:03 arthas kernel: Call Trace: Oct 21 23:47:03 arthas kernel: <TASK> Oct 21 23:47:03 arthas kernel: dump_stack_lvl+0x44/0x5c Oct 21 23:47:03 arthas kernel: print_bad_pte+0x1cb/0x1e5 Oct 21 23:47:03 arthas kernel: vm_normal_page+0x84/0x9e Oct 21 23:47:03 arthas kernel: change_protection+0x76a/0xc41 Oct 21 23:47:03 arthas kernel: change_prot_numa+0x55/0x97 Oct 21 23:47:03 arthas kernel: ? fcntl_setlk+0x1cd/0x1e2 Oct 21 23:47:03 arthas kernel: task_numa_work+0x228/0x2db Oct 21 23:47:03 arthas kernel: task_work_run+0x69/0x7e Oct 21 23:47:03 arthas kernel: exit_to_user_mode_prepare+0x75/0x10d Oct 21 23:47:03 arthas kernel: syscall_exit_to_user_mode+0x18/0x27 Oct 21 23:47:03 arthas kernel: do_syscall_64+0x77/0x81 Oct 21 23:47:03 arthas kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Oct 21 23:47:03 arthas kernel: RIP: 0033:0x150579168338 Oct 21 23:47:03 arthas kernel: Code: 89 c0 0f 05 eb 27 48 63 f6 83 f8 06 7f 07 83 f8 04 7f 0d eb 08 8d 50 f1 83 fa 01 76 03 48 63 f0 b8 48 00 00 00 4c 89 d2 0f 05 <48> 89 c7 e8 dc 19 00 00 48 83 c4 58 c3 53 89 f3 49 89 fa 48 83 ec Oct 21 23:47:03 arthas kernel: RSP: 002b:00001504daacc890 EFLAGS: 00000202 ORIG_RAX: 0000000000000048 Oct 21 23:47:03 arthas kernel: RAX: 0000000000000000 RBX: 0000000000000008 RCX: 0000150579168338 Oct 21 23:47:03 arthas kernel: RDX: 00001504daacc8f8 RSI: 0000000000000006 RDI: 0000000000000105 Oct 21 23:47:03 arthas kernel: RBP: 0000000000000003 R08: 0000000000000009 R09: 0000000000000001 Oct 21 23:47:03 arthas kernel: R10: 00001504daacc8f8 R11: 0000000000000202 R12: 0000000000000001 Oct 21 23:47:03 arthas kernel: R13: 00001504dc5f68d4 R14: 00001504dc161828 R15: 00001504dc5f6888 Oct 21 23:47:03 arthas kernel: </TASK> Oct 21 23:51:33 arthas kernel: BUG: Bad page map in process Lidarr pte:8400777ea47d4075 pmd:36a9d8067 Oct 21 23:51:33 arthas kernel: addr:0000150506533000 vm_flags:00100073 anon_vma:ffff8885e726daf8 mapping:0000000000000000 index:150506533 Oct 21 23:51:33 arthas kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 21 23:51:33 arthas kernel: CPU: 8 PID: 5204 Comm: Lidarr Tainted: G B D W 5.19.14-Unraid #1 Oct 21 23:51:33 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Oct 21 23:51:33 arthas kernel: Call Trace: Oct 21 23:51:33 arthas kernel: <TASK> Oct 21 23:51:33 arthas kernel: dump_stack_lvl+0x44/0x5c Oct 21 23:51:33 arthas kernel: print_bad_pte+0x1cb/0x1e5 Oct 21 23:51:33 arthas kernel: vm_normal_page+0x84/0x9e Oct 21 23:51:33 arthas kernel: change_protection+0x76a/0xc41 Oct 21 23:51:33 arthas kernel: change_prot_numa+0x55/0x97 Oct 21 23:51:33 arthas kernel: ? _raw_spin_unlock_irqrestore+0x24/0x3a Oct 21 23:51:33 arthas kernel: ? note_gp_changes+0x62/0x78 Oct 21 23:51:33 arthas kernel: ? rcu_core+0x27f/0x2ac Oct 21 23:51:33 arthas kernel: task_numa_work+0x228/0x2db Oct 21 23:51:33 arthas kernel: task_work_run+0x69/0x7e Oct 21 23:51:33 arthas kernel: exit_to_user_mode_prepare+0x75/0x10d Oct 21 23:51:33 arthas kernel: irqentry_exit_to_user_mode+0x5/0x13 Oct 21 23:51:33 arthas kernel: asm_sysvec_apic_timer_interrupt+0x16/0x20 Oct 21 23:51:33 arthas kernel: RIP: 0033:0x150505b65ed4 Oct 21 23:51:33 arthas kernel: Code: Unable to access opcode bytes at RIP 0x150505b65eaa. Oct 21 23:51:33 arthas kernel: RSP: 002b:00001504dac4ff80 EFLAGS: 00000216 Oct 21 23:51:33 arthas kernel: RAX: 0000000000000096 RBX: 00001504e0c6e7f8 RCX: 00001504e0c6eed8 Oct 21 23:51:33 arthas kernel: RDX: 0000000000000096 RSI: 000000000000003a RDI: 00001504e0c6e790 Oct 21 23:51:33 arthas kernel: RBP: 00001504dac4ff90 R08: 0000000000000200 R09: 0000000000000080 Oct 21 23:51:33 arthas kernel: R10: 00001504ee467480 R11: 0000150505751be0 R12: 00001505059f40b0 Oct 21 23:51:33 arthas kernel: R13: 000000000000001a R14: 00001504e0c6d088 R15: 00001504dee6f7d8 Oct 21 23:51:33 arthas kernel: </TASK> Oct 22 00:07:48 arthas dhcpcd[25591]: br0: expired address 2600:4040:7e6c:6000:7431:26ff:fe4d:c9bf/56 Oct 22 00:07:48 arthas dhcpcd[25591]: br0: part of a Router Advertisement expired Oct 22 00:07:48 arthas dhcpcd[25591]: br0: deleting route to 2600:4040:7e6c:6000::/56 Oct 22 00:07:50 arthas ntpd[1593]: Deleting interface #25 br0, 2600:4040:7e6c:6000:7431:26ff:fe4d:c9bf#123, interface stats: received=0, sent=0, dropped=0, active_time=7300 secs Oct 22 00:12:34 arthas kernel: BUG: Bad page map in process Lidarr pte:8400777ea47d4075 pmd:36a9d8067 Oct 22 00:12:34 arthas kernel: addr:0000150506533000 vm_flags:00100073 anon_vma:ffff8885e726daf8 mapping:0000000000000000 index:150506533 Oct 22 00:12:34 arthas kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 22 00:12:34 arthas kernel: CPU: 2 PID: 5204 Comm: Lidarr Tainted: G B D W 5.19.14-Unraid #1 Oct 22 00:12:34 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Oct 22 00:12:34 arthas kernel: Call Trace: Oct 22 00:12:34 arthas kernel: <TASK> Oct 22 00:12:34 arthas kernel: dump_stack_lvl+0x44/0x5c Oct 22 00:12:34 arthas kernel: print_bad_pte+0x1cb/0x1e5 Oct 22 00:12:34 arthas kernel: vm_normal_page+0x84/0x9e Oct 22 00:12:34 arthas kernel: change_protection+0x76a/0xc41 Oct 22 00:12:34 arthas kernel: change_prot_numa+0x55/0x97 Oct 22 00:12:34 arthas kernel: ? vma_migratable+0x9/0x78 Oct 22 00:12:34 arthas kernel: task_numa_work+0x228/0x2db Oct 22 00:12:34 arthas kernel: task_work_run+0x69/0x7e Oct 22 00:12:34 arthas kernel: exit_to_user_mode_prepare+0x75/0x10d Oct 22 00:12:34 arthas kernel: irqentry_exit_to_user_mode+0x5/0x13 Oct 22 00:12:34 arthas kernel: asm_sysvec_apic_timer_interrupt+0x16/0x20 Oct 22 00:12:34 arthas kernel: RIP: 0033:0x1505055ff0b9 Oct 22 00:12:34 arthas kernel: Code: Unable to access opcode bytes at RIP 0x1505055ff08f. Oct 22 00:12:34 arthas kernel: RSP: 002b:00001504dac4ffe0 EFLAGS: 00000202 Oct 22 00:12:34 arthas kernel: RAX: 00001504e095c9d8 RBX: 0000000000000001 RCX: 0000000000000027 Oct 22 00:12:34 arthas kernel: RDX: 0000000000000025 RSI: 000000000000003a RDI: 0000000000000027 Oct 22 00:12:34 arthas kernel: RBP: 00001504dac50040 R08: 0000000000000025 R09: 0000000000000039 Oct 22 00:12:34 arthas kernel: R10: 0000000000000020 R11: 0000000000000026 R12: 0000000000000026 Oct 22 00:12:34 arthas kernel: R13: 0000000000000027 R14: 0000000000000001 R15: 00001504e044ad80 Oct 22 00:12:34 arthas kernel: </TASK> Oct 22 00:15:34 arthas kernel: BUG: Bad page map in process Lidarr pte:8400777ea47d4075 pmd:36a9d8067 Oct 22 00:15:34 arthas kernel: addr:0000150506533000 vm_flags:00100073 anon_vma:ffff8885e726daf8 mapping:0000000000000000 index:150506533 Oct 22 00:15:34 arthas kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 22 00:15:34 arthas kernel: CPU: 1 PID: 5205 Comm: Lidarr Tainted: G B D W 5.19.14-Unraid #1 Oct 22 00:15:34 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Oct 22 00:15:34 arthas kernel: Call Trace: Oct 22 00:15:34 arthas kernel: <TASK> Oct 22 00:15:34 arthas kernel: dump_stack_lvl+0x44/0x5c Oct 22 00:15:34 arthas kernel: print_bad_pte+0x1cb/0x1e5 Oct 22 00:15:34 arthas kernel: vm_normal_page+0x84/0x9e Oct 22 00:15:34 arthas kernel: change_protection+0x76a/0xc41 Oct 22 00:15:34 arthas kernel: change_prot_numa+0x55/0x97 Oct 22 00:15:34 arthas kernel: ? vma_migratable+0x5b/0x78 Oct 22 00:15:34 arthas kernel: task_numa_work+0x228/0x2db Oct 22 00:15:34 arthas kernel: task_work_run+0x69/0x7e Oct 22 00:15:34 arthas kernel: exit_to_user_mode_prepare+0x75/0x10d Oct 22 00:15:34 arthas kernel: syscall_exit_to_user_mode+0x18/0x27 Oct 22 00:15:34 arthas kernel: do_syscall_64+0x77/0x81 Oct 22 00:15:34 arthas kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Oct 22 00:15:34 arthas kernel: RIP: 0033:0x1505791a04a3 Oct 22 00:15:34 arthas kernel: Code: c3 8b 07 85 c0 75 24 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 <c3> e9 c7 d1 ff ff 41 54 b8 02 00 00 00 49 89 f4 be 00 88 08 00 55 Oct 22 00:15:34 arthas kernel: RSP: 002b:00001504daacc678 EFLAGS: 00000246 ORIG_RAX: 0000000000000002 Oct 22 00:15:34 arthas kernel: RAX: 00000000000000fc RBX: 00001504daacdb30 RCX: 00001505791a04a3 Oct 22 00:15:34 arthas kernel: RDX: 00000000000001a4 RSI: 00000000000a8042 RDI: 00001504dc7cca24 Oct 22 00:15:34 arthas kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 Oct 22 00:15:34 arthas kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000002 Oct 22 00:15:34 arthas kernel: R13: 00000000000001a4 R14: 0000000000028042 R15: 00001504db445f26 Oct 22 00:15:34 arthas kernel: </TASK> Oct 22 00:24:34 arthas kernel: BUG: Bad page map in process Lidarr pte:8400777ea47d4075 pmd:36a9d8067 Oct 22 00:24:34 arthas kernel: addr:0000150506533000 vm_flags:00100073 anon_vma:ffff8885e726daf8 mapping:0000000000000000 index:150506533 Oct 22 00:24:34 arthas kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 22 00:24:34 arthas kernel: CPU: 5 PID: 5204 Comm: Lidarr Tainted: G B D W 5.19.14-Unraid #1 Oct 22 00:24:34 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Oct 22 00:24:34 arthas kernel: Call Trace: Oct 22 00:24:34 arthas kernel: <TASK> Oct 22 00:24:34 arthas kernel: dump_stack_lvl+0x44/0x5c Oct 22 00:24:34 arthas kernel: print_bad_pte+0x1cb/0x1e5 Oct 22 00:24:34 arthas kernel: vm_normal_page+0x84/0x9e Oct 22 00:24:34 arthas kernel: change_protection+0x76a/0xc41 Oct 22 00:24:34 arthas kernel: change_prot_numa+0x55/0x97 Oct 22 00:24:34 arthas kernel: ? vma_migratable+0x9/0x78 Oct 22 00:24:34 arthas kernel: task_numa_work+0x228/0x2db Oct 22 00:24:34 arthas kernel: task_work_run+0x69/0x7e Oct 22 00:24:34 arthas kernel: exit_to_user_mode_prepare+0x75/0x10d Oct 22 00:24:34 arthas kernel: syscall_exit_to_user_mode+0x18/0x27 Oct 22 00:24:34 arthas kernel: do_syscall_64+0x77/0x81 Oct 22 00:24:34 arthas kernel: entry_SYSCALL_64_after_hwframe+0x63/0xcd Oct 22 00:24:34 arthas kernel: RIP: 0033:0x1505791a04a3 Oct 22 00:24:34 arthas kernel: Code: c3 8b 07 85 c0 75 24 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 <c3> e9 c7 d1 ff ff 41 54 b8 02 00 00 00 49 89 f4 be 00 88 08 00 55 Oct 22 00:24:34 arthas kernel: RSP: 002b:00001504dac4f5f8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 Oct 22 00:24:34 arthas kernel: RAX: 0000000000000400 RBX: 00001504dac50b30 RCX: 00001505791a04a3 Oct 22 00:24:34 arthas kernel: RDX: 0000000000000400 RSI: 00001504dc1b6ff8 RDI: 00000000000000f9 Oct 22 00:24:34 arthas kernel: RBP: 0000000000000400 R08: 0000000000000000 R09: 0000000000000000 Oct 22 00:24:34 arthas kernel: R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Oct 22 00:24:34 arthas kernel: R13: 0000000000000000 R14: 00001504dd9d2470 R15: 00001504dc1b6ff8 Oct 22 00:24:34 arthas kernel: </TASK> Oct 22 00:42:34 arthas kernel: BUG: Bad page map in process Lidarr pte:8400777ea47d4075 pmd:36a9d8067 Oct 22 00:42:34 arthas kernel: addr:0000150506533000 vm_flags:00100073 anon_vma:ffff8885e726daf8 mapping:0000000000000000 index:150506533 Oct 22 00:42:34 arthas kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 22 00:42:34 arthas kernel: CPU: 15 PID: 5205 Comm: Lidarr Tainted: G B D W 5.19.14-Unraid #1 Oct 22 00:42:34 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Oct 22 00:42:34 arthas kernel: Call Trace: Oct 22 00:42:34 arthas kernel: <TASK> Oct 22 00:42:34 arthas kernel: dump_stack_lvl+0x44/0x5c Oct 22 00:42:34 arthas kernel: print_bad_pte+0x1cb/0x1e5 Oct 22 00:42:34 arthas kernel: vm_normal_page+0x84/0x9e Oct 22 00:42:34 arthas kernel: change_protection+0x76a/0xc41 Oct 22 00:42:34 arthas kernel: change_prot_numa+0x55/0x97 Oct 22 00:42:34 arthas kernel: ? vma_migratable+0x9/0x78 Oct 22 00:42:34 arthas kernel: task_numa_work+0x228/0x2db Oct 22 00:42:34 arthas kernel: task_work_run+0x69/0x7e Oct 22 00:42:34 arthas kernel: exit_to_user_mode_prepare+0x75/0x10d Oct 22 00:42:34 arthas kernel: irqentry_exit_to_user_mode+0x5/0x13 Oct 22 00:42:34 arthas kernel: asm_sysvec_apic_timer_interrupt+0x16/0x20 Oct 22 00:42:34 arthas kernel: RIP: 0033:0x1505055ff0b6 Oct 22 00:42:34 arthas kernel: Code: Unable to access opcode bytes at RIP 0x1505055ff08c. Oct 22 00:42:34 arthas kernel: RSP: 002b:00001504daaccf80 EFLAGS: 00000202 Oct 22 00:42:34 arthas kernel: RAX: 00001504e0f65b68 RBX: 0000000000000001 RCX: 0000000000000005 Oct 22 00:42:34 arthas kernel: RDX: 0000000000000005 RSI: 0000000000000006 RDI: 0000000000000005 Oct 22 00:42:34 arthas kernel: RBP: 00001504daaccfe0 R08: 0000000000000004 R09: 0000000000000005 Oct 22 00:42:34 arthas kernel: R10: 000000000000006e R11: 0000000000000005 R12: 0000000000000004 Oct 22 00:42:34 arthas kernel: R13: 0000000000000005 R14: 0000000000000001 R15: 00001504e0f64ab0 Oct 22 00:42:34 arthas kernel: </TASK> Oct 22 00:56:05 arthas kernel: BUG: Bad page map in process Lidarr pte:8400777ea47d4075 pmd:36a9d8067 Oct 22 00:56:05 arthas kernel: addr:0000150506533000 vm_flags:00100073 anon_vma:ffff8885e726daf8 mapping:0000000000000000 index:150506533 Oct 22 00:56:05 arthas kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 22 00:56:05 arthas kernel: CPU: 8 PID: 5204 Comm: Lidarr Tainted: G B D W 5.19.14-Unraid #1 Oct 22 00:56:05 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Oct 22 00:56:05 arthas kernel: Call Trace: Oct 22 00:56:05 arthas kernel: <TASK> Oct 22 00:56:05 arthas kernel: dump_stack_lvl+0x44/0x5c Oct 22 00:56:05 arthas kernel: print_bad_pte+0x1cb/0x1e5 Oct 22 00:56:05 arthas kernel: vm_normal_page+0x84/0x9e Oct 22 00:56:05 arthas kernel: change_protection+0x76a/0xc41 Oct 22 00:56:05 arthas kernel: change_prot_numa+0x55/0x97 Oct 22 00:56:05 arthas kernel: ? timerqueue_add+0x6a/0x76 Oct 22 00:56:05 arthas kernel: ? enqueue_hrtimer+0x77/0x82 Oct 22 00:56:05 arthas kernel: task_numa_work+0x228/0x2db Oct 22 00:56:05 arthas kernel: task_work_run+0x69/0x7e Oct 22 00:56:05 arthas kernel: exit_to_user_mode_prepare+0x75/0x10d Oct 22 00:56:05 arthas kernel: irqentry_exit_to_user_mode+0x5/0x13 Oct 22 00:56:05 arthas kernel: asm_sysvec_apic_timer_interrupt+0x16/0x20 Oct 22 00:56:05 arthas kernel: RIP: 0033:0x1505055ff0b6 Oct 22 00:56:05 arthas kernel: Code: Unable to access opcode bytes at RIP 0x1505055ff08c. Oct 22 00:56:05 arthas kernel: RSP: 002b:00001504dac4ff80 EFLAGS: 00000202 Oct 22 00:56:05 arthas kernel: RAX: 00001504e0b92510 RBX: 0000000000000001 RCX: 000000000000000c Oct 22 00:56:05 arthas kernel: RDX: 000000000000000b RSI: 0000000000000038 RDI: 000000000000000c Oct 22 00:56:05 arthas kernel: RBP: 00001504dac4ffe0 R08: 000000000000000a R09: 0000000000000037 Oct 22 00:56:05 arthas kernel: R10: 0000000000000068 R11: 000000000000000b R12: 000000000000000b Oct 22 00:56:05 arthas kernel: R13: 000000000000000c R14: 0000000000000001 R15: 00001504e0b0a6e8 Oct 22 00:56:05 arthas kernel: </TASK> Oct 22 01:09:35 arthas kernel: BUG: Bad page map in process Lidarr pte:8400777ea47d4075 pmd:36a9d8067 Oct 22 01:09:35 arthas kernel: addr:0000150506533000 vm_flags:00100073 anon_vma:ffff8885e726daf8 mapping:0000000000000000 index:150506533 Oct 22 01:09:35 arthas kernel: file:(null) fault:0x0 mmap:0x0 read_folio:0x0 Oct 22 01:09:35 arthas kernel: CPU: 9 PID: 5205 Comm: Lidarr Tainted: G B D W 5.19.14-Unraid #1 Oct 22 01:09:35 arthas kernel: Hardware name: Hewlett-Packard HP Z820 Workstation/158B, BIOS J63 v03.96 10/28/2019 Oct 22 01:09:35 arthas kernel: Call Trace: Oct 22 01:09:35 arthas kernel: <TASK> Oct 22 01:09:35 arthas kernel: dump_stack_lvl+0x44/0x5c Oct 22 01:09:35 arthas kernel: print_bad_pte+0x1cb/0x1e5 Oct 22 01:09:35 arthas kernel: vm_normal_page+0x84/0x9e Oct 22 01:09:35 arthas kernel: change_protection+0x76a/0xc41 Oct 22 01:09:35 arthas kernel: change_prot_numa+0x55/0x97 Oct 22 01:09:35 arthas kernel: ? timerqueue_add+0x6a/0x76 Oct 22 01:09:35 arthas kernel: ? enqueue_hrtimer+0x77/0x82 Oct 22 01:09:35 arthas kernel: task_numa_work+0x228/0x2db Oct 22 01:09:35 arthas kernel: task_work_run+0x69/0x7e Oct 22 01:09:35 arthas kernel: exit_to_user_mode_prepare+0x75/0x10d Oct 22 01:09:35 arthas kernel: irqentry_exit_to_user_mode+0x5/0x13 Oct 22 01:09:35 arthas kernel: asm_sysvec_apic_timer_interrupt+0x16/0x20 Oct 22 01:09:35 arthas kernel: RIP: 0033:0x1505055ff0b6 Oct 22 01:09:35 arthas kernel: Code: Unable to access opcode bytes at RIP 0x1505055ff08c. Oct 22 01:09:35 arthas kernel: RSP: 002b:00001504daacce70 EFLAGS: 00000202 Oct 22 01:09:35 arthas kernel: RAX: 00001504e10847d8 RBX: 0000000000000001 RCX: 0000000000000001 Oct 22 01:09:35 arthas kernel: RDX: 0000000000000005 RSI: 0000000000000004 RDI: 0000000000000004 Oct 22 01:09:35 arthas kernel: RBP: 00001504daacced0 R08: 0000000000000003 R09: 0000000000000003 Oct 22 01:09:35 arthas kernel: R10: 0000000000000061 R11: 0000000000000004 R12: 0000000000000003 Oct 22 01:09:35 arthas kernel: R13: 0000000000000001 R14: 0000000000000001 R15: 00001504e1083cb0 Oct 22 01:09:35 arthas kernel: </TASK>
  6. After upgrading from 6.10.2 to 6.10.3 my system is freezing constantly. I am getting lots of CPU Stall related errors in the logs: Jul 11 11:43:47 arthas kernel: rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 12-... } 25655672 jiffies s: 27249 root: 0x2/. Jul 11 11:43:47 arthas kernel: rcu: blocking rcu_node structures (internal RCU debug): l=1:12-23:0x1/. Jul 11 11:43:47 arthas kernel: Task dump for CPU 12: Jul 11 11:43:47 arthas kernel: task:kcompactd0 state:R running task stack: 0 pid: 142 ppid: 2 flags:0x00004008 Jul 11 11:43:47 arthas kernel: Call Trace: Jul 11 11:43:47 arthas kernel: <TASK> Jul 11 11:43:47 arthas kernel: ? pmd_pfn+0x9/0x49 Jul 11 11:43:47 arthas kernel: ? queued_spin_lock_slowpath+0x7/0xa Jul 11 11:43:47 arthas kernel: ? page_vma_mapped_walk+0x417/0x51b Jul 11 11:43:47 arthas kernel: ? try_to_migrate_one+0x106/0x2bf Jul 11 11:43:47 arthas kernel: ? mem_cgroup_charge_statistics.constprop.0+0x1c/0x3f Jul 11 11:43:47 arthas kernel: ? rmap_walk_file+0xa5/0x10d Jul 11 11:43:47 arthas kernel: ? try_to_migrate+0x96/0xb2 Jul 11 11:43:47 arthas kernel: ? try_to_unmap_one+0x566/0x566 Jul 11 11:43:47 arthas kernel: ? anon_vma_ctor+0x39/0x39 Jul 11 11:43:47 arthas kernel: ? page_get_anon_vma+0x6a/0x6a Jul 11 11:43:47 arthas kernel: ? migrate_pages+0x5eb/0xa08 Jul 11 11:43:47 arthas kernel: ? compact_lock_irqsave+0x5e/0x5e Jul 11 11:43:47 arthas kernel: ? release_freepages+0x8f/0x8f Jul 11 11:43:47 arthas kernel: ? compact_zone+0x84f/0xa29 Jul 11 11:43:47 arthas kernel: ? __raw_spin_unlock+0x5/0x6 Jul 11 11:43:47 arthas kernel: ? proactive_compact_node+0x7f/0xac Jul 11 11:43:47 arthas kernel: ? kcompactd+0x24e/0x29c Jul 11 11:43:47 arthas kernel: ? init_wait_entry+0x29/0x29 Jul 11 11:43:47 arthas kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 11 11:43:47 arthas kernel: ? kthread+0xde/0xe3 Jul 11 11:43:47 arthas kernel: ? set_kthread_struct+0x32/0x32 Jul 11 11:43:47 arthas kernel: ? ret_from_fork+0x22/0x30 Jul 11 11:43:47 arthas kernel: </TASK> Going to try to downgrade to 6.10.2 to see if anything changes. System is an HP z820 Workstation with dual e2640v2 xeons EDIT: Can confirm, downgrading to 6.10.2 solved my issues with freezing and terrible performance.
  7. Not as far as I can tell. They seem to only release firmware via some windows SSD Toolkit thing. I haven't been able to find any standalone downloads.
  8. I am seeing a similar issue. I have a ASX7000NPC-512GT-C M.2 NVMe device connected via PCIe 3.0x4, unRaid sees it just fine and it has been assigned as cache for about a week (I am still in my trial). I have most of my shares set up to use cache and during periods of heavy download/write activity I noticed every now and then unraid would appear to freeze for 30 seconds or so. I followed some advice in another thread and set vm.dirty_background_ratio to 3 and vm.dirty_ratio to 2 as advised and it seemed to help with the random hangs a bit, but not completely. For what its worth my system is a dual cpu E5-2630v2 box (12 core/24 thread) with 128GB of ECC memory, all applications doing IO are running in Docker, I don't think it is a system resource issue even though the entire system seems to hang for anywhere between 15-60 seconds during high write times. I started looking at the logs and I see a lot of entries like this: Aug 22 11:54:11 arthas kernel: nvme nvme0: I/O 0 QID 8 timeout, reset controller Aug 22 11:55:20 arthas kernel: nvme nvme0: I/O 0 QID 8 timeout, aborting Aug 22 11:55:20 arthas kernel: nvme nvme0: I/O 1 QID 8 timeout, aborting Aug 22 11:55:20 arthas kernel: nvme nvme0: I/O 2 QID 8 timeout, aborting Aug 22 11:55:20 arthas kernel: nvme nvme0: I/O 3 QID 8 timeout, aborting Aug 22 11:55:20 arthas kernel: nvme nvme0: I/O 4 QID 8 timeout, aborting Aug 22 11:55:20 arthas kernel: nvme nvme0: Abort status: 0x0 Aug 22 11:55:20 arthas kernel: nvme nvme0: Abort status: 0x0 Aug 22 11:55:20 arthas kernel: nvme nvme0: Abort status: 0x0 Aug 22 11:55:20 arthas kernel: nvme nvme0: Abort status: 0x0 Aug 22 11:55:20 arthas kernel: nvme nvme0: Abort status: 0x0 Aug 22 11:55:24 arthas kernel: nvme nvme0: I/O 92 QID 8 timeout, aborting Aug 22 11:55:24 arthas kernel: nvme nvme0: I/O 93 QID 8 timeout, aborting Aug 22 11:55:24 arthas kernel: nvme nvme0: I/O 94 QID 8 timeout, aborting Aug 22 11:55:24 arthas kernel: nvme nvme0: I/O 95 QID 8 timeout, aborting Aug 22 11:55:24 arthas kernel: nvme nvme0: I/O 96 QID 8 timeout, aborting Aug 22 11:55:24 arthas kernel: nvme nvme0: Abort status: 0x0 Aug 22 11:55:24 arthas kernel: nvme nvme0: Abort status: 0x0 Aug 22 11:55:24 arthas kernel: nvme nvme0: Abort status: 0x0 Aug 22 11:55:24 arthas kernel: nvme nvme0: Abort status: 0x0 Aug 22 11:55:24 arthas kernel: nvme nvme0: Abort status: 0x0 This is concerning as it seems to coincide with the hangs, but, the good news is no data ever seems to get corrupted or lost. The lspci output the NVMe drive is: 06:00.0 Non-Volatile memory controller: Silicon Motion, Inc. Device 2260 (rev 03) (prog-if 02 [NVM Express]) Subsystem: Silicon Motion, Inc. Device 2260 Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx+ Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx- Latency: 0, Cache Line Size: 64 bytes Interrupt: pin A routed to IRQ 25 NUMA node: 0 Region 0: Memory at ef500000 (64-bit, non-prefetchable) [size=16K] Capabilities: [40] Power Management version 3 Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-) Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME- Capabilities: [70] Express (v2) Endpoint, MSI 00 DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 75.000W DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+ RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- FLReset- MaxPayload 128 bytes, MaxReadReq 1024 bytes DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend- LnkCap: Port #0, Speed 8GT/s, Width x4, ASPM L1, Exit Latency L1 <8us ClockPM+ Surprise- LLActRep- BwNot- ASPMOptComp+ LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+ ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt- LnkSta: Speed 8GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt- DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR+, OBFF Via message AtomicOpsCap: 32bit- 64bit- 128bitCAS- DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled AtomicOpsCtl: ReqEn- LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis- Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS- Compliance De-emphasis: -6dB LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+ EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest- Capabilities: [b0] MSI-X: Enable+ Count=16 Masked- Vector table: BAR=0 offset=00002000 PBA: BAR=0 offset=00002100 Capabilities: [100 v2] Advanced Error Reporting UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol- UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol- CESta: RxErr+ BadTLP+ BadDLLP- Rollover- Timeout- NonFatalErr- CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+ AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn- MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap- HeaderLog: 00000000 00000000 00000000 00000000 Capabilities: [158 v1] #19 Capabilities: [178 v1] Latency Tolerance Reporting Max snoop latency: 0ns Max no snoop latency: 0ns Capabilities: [180 v1] L1 PM Substates L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+ PortCommonModeRestoreTime=10us PortTPowerOnTime=10us L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1- T_CommonMode=0us LTR1.2_Threshold=0ns L1SubCtl2: T_PwrOn=10us Kernel driver in use: nvme Kernel modules: nvme I have seen some posts around the web about a potential change to the nvme timeout settings, but I don't know if I can easily do that in unRaid, or if it's even the right thing to do. Any help is appreciated.
  9. Yeah, the more I thought about it the more I just decided to live with what I have while I get the stuff I need to do it with SAS. I think I'm going to follow this guide and use a LSI SAS 9206-16e HBA. https://www.reddit.com/r/DataHoarder/comments/89jqfu/my_300_diy_16_drive_das_build/ I think I can build a really nice, bottleneck-free DAS to attact to my z820 for around $300 or so and it would give me 16 (11 empty) external bays to grow into vs the 8 (3 empty) I have now.
  10. As the subject says I am looking for the highest performance SATA 3 port multiplier I can find. I am completely new to unRaid so please don't hesitate to let me know if my concerns are misplaced, specifically as to how the parity check speed relates to real-world performance of unRaid. Here is my current unRaid system: HP z820 Workstation, Dual Xeon E5-2630v2's with 128GB ECC Memory 13 spinning disks - 4x 8TB WD Reds, 6x 4TB Seagate, 3x 3TB HGST Cache is a 512GB M.2 NVMe card on a PCIe 3.0 adapter The tower itself has room for 8 drives, which are on the on-board LSI SAS 2308 SAS controller which is on the PCIe 3.0 bus (4x 8TB WD Reds, 4x 4TB Seagate) 5 drives are in a SANS Digital 8-bay TowerRaid enclosure, 3 drives on 1 expander and 2 on the other which is connected to a HighPoint RocketRaid 622 PCIe 2.0 x1 Adapter I got the z820, the TowerRaid and the RocketRaid for dirt cheap from a friend, so I am inclined to try to use it before I go spending a bunch of money trying to set up a proper SAS HBA with expanders and a separate enclosure - or better yet, a 24+ bay rackmount case. Although I will likely go down that road eventually, money is a bit tight at the moment so I'm trying to get the most out of what I have for the time being. The RR622 is flashed with the Quick BIOS and is in full JBOD mode - I had to use the "enable_ahci" script to get unRaid to recognize the drives which I don't really like. When running DiskSpeed against the RocketRaid 622 the controller was able to max out the PCIe 2.0x1 slot at 500MB/s using 3 drives on an expander. Each drive tested individually showed identical performance to when they were on the LSI SAS adapter. Really, this isn't too bad and was better than I expected. However, parity checking is only able to peak out at about 70-72MB/s when the system is completely idle, generally around 40-50MB/s when the system has activity on it such as Plex streams, which is pretty much all the time. With an 8TB parity drive this puts my parity check/rebuilt time at over 50 hours which is a huge concern. Another concern is what day to day performance will be like once the initial parity check is completed - when things are not going to cache. Luckily I have a MicroCenter nearby so I thought I would test out some other adapters. I tried a Syba SI-PEX40057 which is a Marvell 88SE9230 based PCIe 2.0x2 card thinking I would at least double the bandwidth and get 1 dedicated PCIe lane per eSATA port with it for <$50. Good news is it worked right out of the box with unRaid (no special BIOS or enable_ahci script needed). The bad news is that it can only address 4 drives maximum, no matter if its 1 on each port or 4 multiplied on 1 port - so this wouldn't work for my needs. I returned that and got two MediaSonic HP1-SS3 cards, which are AsMedia ASM1062 based PCIe 2.0x1 cards. They were <$20 each so I figured with two it would be equivalent to what I attempted above. The also worked out of the box with no BIOS flash or enable_ahci script needed. However, in DiskSpeed one drive would work at full speed (~180MB/s) but each additional drive would drop that total down linearly. 2 drives would peak out at about 160MB/s (80 each) and 3 drives would peak out at about 120MB/s (40 each). I am really suprised at how slow these cards are even though they state they have FIS based switching, the performance is really bad. So now I'm here. I'm leaning toward spending the money on this: https://www.shopaddonics.com/ProductInfo.aspx?code=AD4ES6GPX4 It's PCIe 2.0x4 (~2000MB/s) with full (advertised) support for all the SATA features I need, and potentially enough bandwidth to not be a bottleneck. Before I do though, I want to see if it's worth it as opposed to other options, or even just living with the slow parity checks. That would make the bottleneck the 2x 6Gb/s eSATA ports. Giving each drive about 1.5Gb/s or about 185MB/s, theoretically. Which is about the peak performance I see out of any one drive in my system. Since I plan to keep the z820 for a while before I consider a proper rack mount storage chassis I want to get a solution for externally attached drives which are not bottle-necked by anything other than the speed of the disks themselves. I suppose I am also open to what is essentially the best route to have an a cost-effective external enclosure of disks that will leave the individual drives as the bottleneck and not anything in between but I would like to see if I can make it happen with the SATA multipliers.
  11. In case anyone is wondering this script is still required and still works for the HighPoint RocketRaid 622 (620) Controller. I also flashed the "Quick" BIOS to the card to put it into JBOD (passthrough) mode, but that was not technically required to get unRaid to see the disks.
  12. Update: I think I had it right, but due to how rsync works (pre-populates empty folders) unraid was not able to do what I expected. Trying some advice in this thread to see if it helps:
  13. I know this question has been asked ad nauseam but it is still not clear. The wiki: https://lime-technology.com/wiki/Un-Official_UnRAID_Manual#Split_level Seems to refer to older terminology/examples than the current version. "Level" instead of the more verbose "Split only the top level", etc. It also uses diagrams which visually explain split levels but is off by one level vs. what the community and the help tooltips describe. Several forum posts, such as: And Change the example by moving everything up a level from what the wiki says. I am following the examples provided by the forums/community since they seem to be more up-to-date and there is more consensus, but the high water allocation isn't behaving how I would expect leading me to believe I might have my split level chosen wrong. I have mine currently set up as per the Forum/Community guidelines with the expectation files get split as per the orange highlighted level below, but it does not seem to be doing that. For example, my "Movies" share is set up to use disk 1 (8TB) and disk 2 (4TB) only, and I am currently copying my media from my old array onto this one. Currently the 8TB disk is over 5TB used and no data has landed on the 4TB disk. I would have expected data to start going to disk 2 once disk 1 had more than 4TB on it. This leads me to believe that maybe I need to move my split level up one level from where it is, but I can't imagine that's right as the way the wiki describes level 1 would force the entire share onto one disk, making the disk inclusion/exclusion irrelevant which seems pointless to even have as an option. Here are my share settings: Here is my current capacity usage for disk 1 and 2: