Skip to content
View in the app

A better way to browse. Learn more.
Unraid

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.
Unraid Summer Sale in live: 20% off Starter and Unleashed + buy one, get one 50% off

Opawesome

Members

  • Joined

  • Last visited

View Profile Find content

Everything posted by Opawesome

  1. Backup and restore of LUKS headers on ARRAY data drives

    Opawesome replied to Opawesome's topic in General Support
    I did further testing: If I run "cryptsetup erase" on an encrypted drive to clear the LUKS encryption key on that drive (but maintaining the LUKS header) then the array won't start, even if I tick "maintenance mode". If I run "cryptsetup erase" on an encrypted drive to clear the LUKS encryption key on that drive and then also "wipefs -a /dev/sdX1" to erase the LUKS remaining header (as instructed here), then the array will start, as on your system.

  2. Backup and restore of LUKS headers on ARRAY data drives

    Opawesome replied to Opawesome's topic in General Support
    Yes. But in any case, I think that the encryption key is in the LUKS header, and is not the passphrase, which is only a way to decipher the actual encryption key in the LUKS header. Also, I think the encryption keys in the LUKS header are different on each drive.

  3. [Script] Backup LUKS headers of encrypted devices

    Opawesome replied to Opawesome's topic in User Customizations
    I opened a new General support thread to obtain additional info here and did some testing. It seems that it is not possible to write to /dev/mdX if the array is not started, and starting the array with one bad LUKS header is not possible. So I guess that in the scenario of a bad LUKS header preventing the start of the array, a rebuild of the parity would be needed. Do you concur ?

  4. Backup and restore of LUKS headers on ARRAY data drives

    Opawesome replied to Opawesome's topic in General Support
    I checked and the array does not start (even in maintenance mode) if one data drive doesn't have the proper LUKS key is its header: Jan 21 11:24:29 BEETHOVEN kernel: mdcmd (117): set md_num_stripes 1280 Jan 21 11:24:29 BEETHOVEN kernel: mdcmd (118): set md_queue_limit 80 Jan 21 11:24:29 BEETHOVEN kernel: mdcmd (119): set md_sync_limit 5 Jan 21 11:24:29 BEETHOVEN kernel: mdcmd (120): set md_write_method Jan 21 11:24:29 BEETHOVEN kernel: mdcmd (121): start STOPPED Jan 21 11:24:29 BEETHOVEN kernel: unraid: allocating 20870K for 1280 stripes (4 disks) Jan 21 11:24:29 BEETHOVEN kernel: md1: running, size: 2097120 blocks Jan 21 11:24:29 BEETHOVEN kernel: md2: running, size: 2097120 blocks Jan 21 11:24:29 BEETHOVEN emhttpd: shcmd (5231): udevadm settle Jan 21 11:24:29 BEETHOVEN emhttpd: Opening encrypted volumes... Jan 21 11:24:29 BEETHOVEN emhttpd: shcmd (5234): /usr/sbin/cryptsetup luksOpen /dev/md1 md1 --allow-discards Jan 21 11:24:29 BEETHOVEN emhttpd: shcmd (5237): /usr/sbin/cryptsetup luksOpen /dev/md2 md2 --allow-discards Jan 21 11:24:31 BEETHOVEN emhttpd: shcmd (5240): /usr/sbin/cryptsetup luksOpen /dev/sdc1 sdc1 --allow-discards Jan 21 11:24:33 BEETHOVEN emhttpd: Missing encryption key Jan 21 11:24:33 BEETHOVEN emhttpd: shcmd (5241): /usr/sbin/cryptsetup luksClose md2 Jan 21 11:24:33 BEETHOVEN emhttpd: shcmd (5242): /usr/sbin/cryptsetup luksClose sdc1 Jan 21 11:24:33 BEETHOVEN kernel: mdcmd (122): stop Jan 21 11:24:33 BEETHOVEN kernel: md1: stopping Jan 21 11:24:33 BEETHOVEN kernel: md2: stopping So the operations should be performed on /dev/sdX1 I guess.

  5. Backup and restore of LUKS headers on ARRAY data drives

    Opawesome replied to Opawesome's topic in General Support
    OK. I will try and revert back. Many thanks.

  6. Backup and restore of LUKS headers on ARRAY data drives

    Opawesome replied to Opawesome's topic in General Support
    Many Thanks. This is useful. I will have to check whether the array can be started (even in maintenance mode) if the LUKS header of one array data drive is missing, because I think I remember that an error is issues by Unraid about "missing encryption key".

  7. Backup and restore of LUKS headers on ARRAY data drives

    Opawesome replied to Opawesome's topic in General Support
    After some testing, it seems that "/dev/sdX" should maybe be avoided and that "/dev/sdX1" (the partition) shall be preferred. It would be awesome if someone knowledgeable could confirm.

  8. [Script] Backup LUKS headers of encrypted devices

    Opawesome replied to Opawesome's topic in User Customizations
    I requested an extension of my trial key and did some testing on my testing Unraid VM. If I do this: backup the LUKS header of a device /dev/sdX with "cryptsetup luksHeaderBackup /dev/sdc --header-backup-file QEMU_HARDDISK_QM00005.bin" stop the array erase the LUKS keys with "cryptsetup erase /dev/sdc" restore the LUKS keys with "cryptsetup luksHeaderRestore /dev/sdc --header-backup-file QEMU_HARDDISK_QM00005.bin" start the array then indeed, the disk fails to mount. If i do this: backup the LUKS header of the parition /dev/sdX1 (notice the "1" added at the end) with "cryptsetup luksHeaderBackup /dev/sdc1 --header-backup-file QEMU_HARDDISK_QM00005.bin" stop the array erase the LUKS keys with "cryptsetup erase /dev/sdc1" (notice the "1" at the end again) restore of the LUKS keys with "cryptsetup luksHeaderRestore /dev/sdc1 --header-backup-file QEMU_HARDDISK_QM00005.bin" (notice the "1" at the end once again) start the array then the disk mounts successfully. I did this test with a 1 disk cache pool drive, and also with an array data drive. I did a parity check after restoring the LUKS keys on the array data drive and no error were detected. I think that clear one part of the problem. Regarding the /dev/mdX suggestion, I notice that this "volume" is not available when the array is stopped, so I am unsure whether it should be used for the LUKS header backup/restore process (I could be wrong though). Now I need to do the tests again with a complete deletion of the LUKS header (not just the LUKS keys), like you did, to see if the restore works, and if the parity is preserved.

  9. [Script] Backup LUKS headers of encrypted devices

    Opawesome replied to Opawesome's topic in User Customizations
    I really don't understand why the drive would not mount. Does that make sense to you ?

  10. Backup and restore of LUKS headers on ARRAY data drives

    Opawesome posted a topic in General Support
    A few month ago I tried writing a script in order to backup and restore LUKS headers on encrypted drives. Some interesting issues were raised by @Kilrah here, highlighting in particular the fact that the first 32kB of every drive is "reserved" by Unraid on array data drives, which could cause issues. Has anyone input to provide on the following ? should the "cryptsetup luksHeaderBackup" command be run on "/dev/sdX" (the raw drive) or on "/dev/mdX" (the mounted volume) on array data drives? should the "cryptsetup luksHeaderBackup" command be run with the array started or the array stopped, and how would that affect parity? should the "cryptsetup luksHeaderRestore" command be run on "/dev/sdX" (the raw drive) or on "/dev/mdX" (the mounted volume) on array data drives? should the "cryptsetup luksHeaderRestore" command be run with the array started or the array stopped, and how would that affect parity? I thank you very much in advance. As I said earlier, I would love to see @limetech implement backup/restore of LUKS headers directly into Unraid, as I feel I really should not play with theses scary headers. With regards, OP

  11. [Script] Backup LUKS headers of encrypted devices

    Opawesome replied to Opawesome's topic in User Customizations
    Many @Kilrah, Regarding the RESTORE PROCESS: I read carefully your comment and I realize that indeed, the restore command is not correct. The "if cryptsetup luksDump $i &>/dev/null; then" part would indeed cause the restore to fail is the LUKS headers were completely removed (instead of just corrupted). Also, I realize that after a reboot, one drive may be assigned as another /dev/sdX, which would also cause the script to fail. Regarding the BACKUP PROCESS: I also understand that the backup script may not be correct, because of it using /dev/sdX instead of /dev/mdX. That part, I do not understand, especially your remark on parity. Indeed, I do not see why the "cryptsetup luksHeaderBackup" command would change parity. I will edit my original post accordingly and update it when I can. Meanwhile, any feedback or help would be greatly appreciated, especially from @limetech. Frankly, since Unraid offers to create encrypted partitions, I believe that backup/restore of LUKS headers should be embedded in Unraid directly. Many thanks, OP

  12. [Script] Backup LUKS headers of encrypted devices

    Opawesome replied to Opawesome's topic in User Customizations
    Thank you @T-Birth for reporting the error. Indeed, I also have this error since I upgraded Unraid to a version above 6.8.3. I have updated the script and backup command to fix it. It turned out that I needed to add some double quotes because some disks' SERIAL_ID now have space characters in them. I successfully tested the backup script (but not the restore command) on Unraid 6.10.3.

  13. [Support] Linuxserver.io - openssh-server

    Opawesome replied to linuxserver.io's topic in Docker Containers
    Folks at linuxserver.io actually made a mod to enable reverse ssh tunneling: https://github.com/linuxserver/docker-mods/tree/openssh-server-ssh-tunnel To use it, you should add the following variable: DOCKER_MODS=linuxserver/mods:openssh-server-ssh-tunnel as well as an extra port (the 10022 forwarding port in your case) to your docker container configuration. With regards, OP

  14. [Support] Linuxserver.io - openssh-server

    Opawesome replied to linuxserver.io's topic in Docker Containers
    Hi all, I have exactly the same problem, trying to achieve exactly the same thing. Is there any solution? @absolute_badger, have you managed to setup a reverse SSH tunnel after all ? With thanks, OP

  15. Server crash - Help needed to understand syslog

    Opawesome replied to Opawesome's topic in General Support
    Hi @JorgeB Thank you so much for reverting to me. I just did that. I will revert back with the result. Best regards, OP

  16. Server crash - Help needed to understand syslog

    Opawesome posted a topic in General Support
    Hi all, My server crashed today. Below is the content of the syslog I was able to retrieve. Unfortunately, I could not get the diagnostics before the crash. I am attaching the diagnostics obtained after a forced reboot. I also had another crash a few days ago. The content of the syslog right before that other crash is also below. I am a bit lost and unsure as to how troubleshoot the issue because the logs look quite cryptic to me. Does anybody have an idea on how to pin point the issue? Many thanks, OP LATEST SYSLOG RIGHT BEFORE CRASH: Aug 8 20:19:40 MOZART kernel: ------------[ cut here ]------------ Aug 8 20:19:40 MOZART kernel: NETDEV WATCHDOG: eth0 (igb): transmit queue 3 timed out Aug 8 20:19:40 MOZART kernel: WARNING: CPU: 6 PID: 0 at net/sched/sch_generic.c:477 dev_watchdog+0x115/0x180 Aug 8 20:19:40 MOZART kernel: Modules linked in: ccp veth xt_CHECKSUM ipt_REJECT nf_reject_ipv4 ip6table_mangle ip6table_nat iptable_mangle vhost_net vhost vhost_iotlb tap wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libchacha macvlan xt_nat xt_tcpudp xt_conntrack nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_multiport xfs dm_crypt dm_mod dax md_mod iptable_nat xt_MASQUERADE nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 tun ip6table_filter ip6_tables iptable_filter ip_tables x_tables igb x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel ipmi_ssif crypto_simd cryptd i915 rapl intel_cstate ast intel_uncore drm_vram_helper iosf_mbi drm_ttm_helper ttm drm_kms_helper i2c_i801 nvme i2c_smbus ahci drm nvme_core i2c_algo_bit acpi_ipmi libahci intel_pch_thermal video input_leds intel_gtt led_class mpt3sas ipmi_si backlight agpgart Aug 8 20:19:40 MOZART kernel: thermal fan i2c_core acpi_power_meter syscopyarea button raid_class sysfillrect acpi_pad sysimgblt scsi_transport_sas fb_sys_fops [last unloaded: igb] Aug 8 20:19:40 MOZART kernel: CPU: 6 PID: 0 Comm: swapper/6 Tainted: G W I 5.15.46-Unraid #1 Aug 8 20:19:40 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Aug 8 20:19:40 MOZART kernel: RIP: 0010:dev_watchdog+0x115/0x180 Aug 8 20:19:40 MOZART kernel: Code: 25 cb 00 00 75 36 48 89 ef c6 05 7d 25 cb 00 01 e8 d0 8e fb ff 44 89 e1 48 89 ee 48 c7 c7 54 09 15 82 48 89 c2 e8 ae 30 12 00 <0f> 0b eb 0e 41 ff c4 48 05 40 01 00 00 e9 65 ff ff ff 48 8b 83 48 Aug 8 20:19:40 MOZART kernel: RSP: 0018:ffffc90000208ec8 EFLAGS: 00010282 Aug 8 20:19:40 MOZART kernel: RAX: 0000000000000000 RBX: ffff888106890480 RCX: 0000000000000027 Aug 8 20:19:40 MOZART kernel: RDX: 0000000000000003 RSI: ffffc90000208d50 RDI: ffff88904539c510 Aug 8 20:19:40 MOZART kernel: RBP: ffff888106890000 R08: ffffffff822b4e68 R09: ffffffff82244e48 Aug 8 20:19:40 MOZART kernel: R10: 0000000000000000 R11: ffffffff8284ecaf R12: 0000000000000003 Aug 8 20:19:40 MOZART kernel: R13: 0000000147683e00 R14: ffffc90000208f10 R15: ffffffff816df274 Aug 8 20:19:40 MOZART kernel: FS: 0000000000000000(0000) GS:ffff889045380000(0000) knlGS:0000000000000000 Aug 8 20:19:40 MOZART kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 8 20:19:40 MOZART kernel: CR2: 0000237c9ac6d068 CR3: 000000000220a003 CR4: 00000000003726e0 Aug 8 20:19:40 MOZART kernel: Call Trace: Aug 8 20:19:40 MOZART kernel: <IRQ> Aug 8 20:19:40 MOZART kernel: ? psched_ppscfg_precompute+0x40/0x40 Aug 8 20:19:40 MOZART kernel: call_timer_fn+0x59/0xde Aug 8 20:19:40 MOZART kernel: __run_timers+0x146/0x184 Aug 8 20:19:40 MOZART kernel: ? enqueue_hrtimer+0x62/0x69 Aug 8 20:19:40 MOZART kernel: ? recalibrate_cpu_khz+0x1/0x1 Aug 8 20:19:40 MOZART kernel: run_timer_softirq+0x19/0x2d Aug 8 20:19:40 MOZART kernel: __do_softirq+0xef/0x218 Aug 8 20:19:40 MOZART kernel: __irq_exit_rcu+0x4d/0x88 Aug 8 20:19:40 MOZART kernel: sysvec_apic_timer_interrupt+0x66/0x7d Aug 8 20:19:40 MOZART kernel: </IRQ> Aug 8 20:19:40 MOZART kernel: <TASK> Aug 8 20:19:40 MOZART kernel: asm_sysvec_apic_timer_interrupt+0x12/0x20 Aug 8 20:19:40 MOZART kernel: RIP: 0010:arch_local_irq_enable+0x7/0x8 Aug 8 20:19:40 MOZART kernel: Code: a2 bc 1c 00 85 db 48 89 e8 79 03 48 63 c3 5b 5d 41 5c c3 9c 58 0f 1f 44 00 00 c3 fa 66 0f 1f 44 00 00 c3 fb 66 0f 1f 44 00 00 <c3> 0f 1f 44 00 00 55 49 89 d3 48 81 c7 b0 00 00 00 48 83 c6 70 53 Aug 8 20:19:40 MOZART kernel: RSP: 0018:ffffc900000efea0 EFLAGS: 00000246 Aug 8 20:19:40 MOZART kernel: RAX: ffff8890453abb40 RBX: 0000000000000006 RCX: 000000000000001f Aug 8 20:19:40 MOZART kernel: RDX: 0000000000000006 RSI: 0000000000000006 RDI: 0000000000000000 Aug 8 20:19:40 MOZART kernel: RBP: ffff8890453b4c68 R08: 00000000ffffffff R09: 071c71c71c71c71c Aug 8 20:19:40 MOZART kernel: R10: 0000000000000020 R11: 0000000000000354 R12: ffffffff82311d20 Aug 8 20:19:40 MOZART kernel: R13: 0000000000000006 R14: 000441d8f8574715 R15: 0000000000000000 Aug 8 20:19:40 MOZART kernel: cpuidle_enter_state+0x117/0x1db Aug 8 20:19:40 MOZART kernel: cpuidle_enter+0x2a/0x36 Aug 8 20:19:40 MOZART kernel: do_idle+0x1b7/0x225 Aug 8 20:19:40 MOZART kernel: cpu_startup_entry+0x1d/0x1f Aug 8 20:19:40 MOZART kernel: secondary_startup_64_no_verify+0xb0/0xbb Aug 8 20:19:40 MOZART kernel: </TASK> Aug 8 20:19:40 MOZART kernel: ---[ end trace 5d4004415d5f3338 ]--- Aug 8 20:19:40 MOZART kernel: igb 0000:0a:00.0 eth0: Reset adapter Aug 8 20:19:41 MOZART kernel: igb 0000:0a:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX Aug 8 20:20:33 MOZART kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 8 20:20:33 MOZART kernel: rcu: #0112-....: (60006 ticks this GP) idle=17f/1/0x4000000000000004 softirq=257932014/257932015 fqs=14988 Aug 8 20:20:33 MOZART kernel: #011(t=60000 jiffies g=483494137 q=339738) Aug 8 20:20:33 MOZART kernel: NMI backtrace for cpu 2 Aug 8 20:20:33 MOZART kernel: CPU: 2 PID: 0 Comm: swapper/2 Tainted: G W I 5.15.46-Unraid #1 Aug 8 20:20:33 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Aug 8 20:20:33 MOZART kernel: Call Trace: Aug 8 20:20:33 MOZART kernel: <IRQ> Aug 8 20:20:33 MOZART kernel: dump_stack_lvl+0x46/0x5a Aug 8 20:20:33 MOZART kernel: nmi_cpu_backtrace+0xae/0xd2 Aug 8 20:20:33 MOZART kernel: ? lapic_can_unplug_cpu+0x93/0x93 Aug 8 20:20:33 MOZART kernel: nmi_trigger_cpumask_backtrace+0x56/0xd3 Aug 8 20:20:33 MOZART kernel: rcu_dump_cpu_stacks+0xc3/0xea Aug 8 20:20:33 MOZART kernel: rcu_sched_clock_irq+0x22d/0x631 Aug 8 20:20:33 MOZART kernel: ? _raw_spin_unlock_irqrestore+0xe/0x1b Aug 8 20:20:33 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Aug 8 20:20:33 MOZART kernel: update_process_times+0x8c/0xab Aug 8 20:20:33 MOZART kernel: tick_sched_timer+0x38/0x65 Aug 8 20:20:33 MOZART kernel: __hrtimer_run_queues+0xfa/0x18a Aug 8 20:20:33 MOZART kernel: hrtimer_interrupt+0x92/0x160 Aug 8 20:20:33 MOZART kernel: __sysvec_apic_timer_interrupt+0x99/0xdb Aug 8 20:20:33 MOZART kernel: sysvec_apic_timer_interrupt+0x37/0x7d Aug 8 20:20:33 MOZART kernel: asm_sysvec_apic_timer_interrupt+0x12/0x20 Aug 8 20:20:33 MOZART kernel: RIP: 0010:nf_ct_tuple_equal+0x32/0x47 [nf_conntrack] Aug 8 20:20:33 MOZART kernel: Code: 48 8b 4f 08 48 33 4e 08 48 09 ca 75 2e 8b 4e 10 39 4f 10 75 26 48 8b 57 14 48 8b 4f 1c 48 33 56 14 48 33 4e 1c 48 09 ca 75 11 <8b> 47 24 33 46 24 a9 ff ff ff 00 0f 94 c0 0f b6 c0 83 e0 01 c3 0f Aug 8 20:20:33 MOZART kernel: RSP: 0018:ffffc90000158908 EFLAGS: 00000246 Aug 8 20:20:33 MOZART kernel: RAX: 0000000000000000 RBX: ffff8881e0fa28c0 RCX: 0000000000000000 Aug 8 20:20:33 MOZART kernel: RDX: 0000000000000000 RSI: ffff8881e0fa2520 RDI: ffff8881e0fa28e0 Aug 8 20:20:33 MOZART kernel: RBP: 00000000000123b5 R08: 0000000000000003 R09: 7f5ab9ce7bc1419e Aug 8 20:20:33 MOZART kernel: R10: a0cf3fad5ce73de0 R11: 45ecf4d24635c54c R12: ffff8881e0fa2548 Aug 8 20:20:33 MOZART kernel: R13: ffffffff828e1500 R14: ffffc90000158970 R15: ffff8881e0fa2500 Aug 8 20:20:33 MOZART kernel: nf_conntrack_tuple_taken+0xdb/0x156 [nf_conntrack] Aug 8 20:20:33 MOZART kernel: nf_nat_used_tuple+0x33/0x4e [nf_nat] Aug 8 20:20:33 MOZART kernel: nf_nat_setup_info+0x3f5/0x773 [nf_nat] Aug 8 20:20:33 MOZART kernel: ? addrtype_mt_v1+0xc2/0x100 [xt_addrtype] Aug 8 20:20:33 MOZART kernel: __nf_nat_alloc_null_binding+0x68/0x7f [nf_nat] Aug 8 20:20:33 MOZART kernel: nf_nat_inet_fn+0xa6/0x187 [nf_nat] Aug 8 20:20:33 MOZART kernel: nf_nat_ipv4_pre_routing+0x23/0x4e [nf_nat] Aug 8 20:20:33 MOZART kernel: nf_hook_slow+0x3e/0x93 Aug 8 20:20:33 MOZART kernel: ? br_nf_forward_finish+0xdc/0xdc [br_netfilter] Aug 8 20:20:33 MOZART kernel: NF_HOOK.isra.0+0xbd/0x119 [br_netfilter] Aug 8 20:20:33 MOZART kernel: ? br_nf_forward_finish+0xdc/0xdc [br_netfilter] Aug 8 20:20:33 MOZART kernel: br_nf_pre_routing+0x226/0x236 [br_netfilter] Aug 8 20:20:33 MOZART kernel: ? br_nf_forward_finish+0xdc/0xdc [br_netfilter] Aug 8 20:20:33 MOZART kernel: br_handle_frame+0x292/0x2da Aug 8 20:20:33 MOZART kernel: ? tcp_v4_destroy_sock+0x50/0x18c Aug 8 20:20:33 MOZART kernel: ? br_handle_local_finish+0x13/0x13 Aug 8 20:20:33 MOZART kernel: __netif_receive_skb_core.constprop.0+0x4b6/0x685 Aug 8 20:20:33 MOZART kernel: __netif_receive_skb_list_core+0x81/0x112 Aug 8 20:20:33 MOZART kernel: netif_receive_skb_list_internal+0x1c7/0x1fc Aug 8 20:20:33 MOZART kernel: gro_normal_list+0x22/0x3e Aug 8 20:20:33 MOZART kernel: napi_complete_done+0x7f/0x118 Aug 8 20:20:33 MOZART kernel: igb_poll+0xd69/0xf96 [igb] Aug 8 20:20:33 MOZART kernel: ? update_cfs_rq_load_avg+0x138/0x146 Aug 8 20:20:33 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Aug 8 20:20:33 MOZART kernel: __napi_poll.constprop.0+0x2a/0x114 Aug 8 20:20:33 MOZART kernel: net_rx_action+0xe8/0x1f2 Aug 8 20:20:33 MOZART kernel: __do_softirq+0xef/0x218 Aug 8 20:20:33 MOZART kernel: __irq_exit_rcu+0x4d/0x88 Aug 8 20:20:33 MOZART kernel: common_interrupt+0x73/0x8b Aug 8 20:20:33 MOZART kernel: </IRQ> Aug 8 20:20:33 MOZART kernel: <TASK> Aug 8 20:20:33 MOZART kernel: asm_common_interrupt+0x1e/0x40 Aug 8 20:20:33 MOZART kernel: RIP: 0010:arch_local_irq_enable+0x7/0x8 Aug 8 20:20:33 MOZART kernel: Code: a2 bc 1c 00 85 db 48 89 e8 79 03 48 63 c3 5b 5d 41 5c c3 9c 58 0f 1f 44 00 00 c3 fa 66 0f 1f 44 00 00 c3 fb 66 0f 1f 44 00 00 <c3> 0f 1f 44 00 00 55 49 89 d3 48 81 c7 b0 00 00 00 48 83 c6 70 53 Aug 8 20:20:33 MOZART kernel: RSP: 0018:ffffc900000cfea0 EFLAGS: 00000246 Aug 8 20:20:33 MOZART kernel: RAX: ffff8890452abb40 RBX: 0000000000000004 RCX: 000000000000001f Aug 8 20:20:33 MOZART kernel: RDX: 0000000000000002 RSI: 0000000000000002 RDI: 0000000000000000 Aug 8 20:20:33 MOZART kernel: RBP: ffff8890452b4c68 R08: 00000000ffffffff R09: 071c71c71c71c71c Aug 8 20:20:33 MOZART kernel: R10: 0000000000000020 R11: 000000000000006a R12: ffffffff82311d20 Aug 8 20:20:33 MOZART kernel: R13: 0000000000000004 R14: 000441d7297f9002 R15: 0000000000000000 Aug 8 20:20:33 MOZART kernel: cpuidle_enter_state+0x117/0x1db Aug 8 20:20:33 MOZART kernel: cpuidle_enter+0x2a/0x36 Aug 8 20:20:33 MOZART kernel: do_idle+0x1b7/0x225 Aug 8 20:20:33 MOZART kernel: cpu_startup_entry+0x1d/0x1f Aug 8 20:20:33 MOZART kernel: secondary_startup_64_no_verify+0xb0/0xbb Aug 8 20:20:33 MOZART kernel: </TASK> Aug 8 20:20:38 MOZART kernel: rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 2-... } 63702 jiffies s: 2989065 root: 0x4/. Aug 8 20:20:38 MOZART kernel: rcu: blocking rcu_node structures (internal RCU debug): Aug 8 20:20:38 MOZART kernel: Task dump for CPU 2: Aug 8 20:20:38 MOZART kernel: task:swapper/2 state:R running task stack: 0 pid: 0 ppid: 1 flags:0x00004808 Aug 8 20:20:38 MOZART kernel: Call Trace: Aug 8 20:20:38 MOZART kernel: <TASK> Aug 8 20:20:38 MOZART kernel: ? arch_local_irq_enable+0x7/0x8 Aug 8 20:20:38 MOZART kernel: ? cpuidle_enter_state+0x117/0x1db Aug 8 20:20:38 MOZART kernel: ? cpuidle_enter+0x2a/0x36 Aug 8 20:20:38 MOZART kernel: ? do_idle+0x1b7/0x225 Aug 8 20:20:38 MOZART kernel: ? cpu_startup_entry+0x1d/0x1f Aug 8 20:20:38 MOZART kernel: ? secondary_startup_64_no_verify+0xb0/0xbb Aug 8 20:20:38 MOZART kernel: </TASK> Aug 8 20:23:24 MOZART emhttpd: spinning down /dev/sdb Aug 8 20:23:33 MOZART kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 8 20:23:33 MOZART kernel: rcu: #0112-....: (240009 ticks this GP) idle=17f/1/0x4000000000000004 softirq=257932014/257932015 fqs=59974 Aug 8 20:23:33 MOZART kernel: #011(t=240003 jiffies g=483494137 q=1231599) Aug 8 20:23:33 MOZART kernel: NMI backtrace for cpu 2 Aug 8 20:23:33 MOZART kernel: CPU: 2 PID: 0 Comm: swapper/2 Tainted: G W I 5.15.46-Unraid #1 Aug 8 20:23:33 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Aug 8 20:23:33 MOZART kernel: Call Trace: Aug 8 20:23:33 MOZART kernel: <IRQ> Aug 8 20:23:33 MOZART kernel: dump_stack_lvl+0x46/0x5a Aug 8 20:23:33 MOZART kernel: nmi_cpu_backtrace+0xae/0xd2 Aug 8 20:23:33 MOZART kernel: ? lapic_can_unplug_cpu+0x93/0x93 Aug 8 20:23:33 MOZART kernel: nmi_trigger_cpumask_backtrace+0x56/0xd3 Aug 8 20:23:33 MOZART kernel: rcu_dump_cpu_stacks+0xc3/0xea Aug 8 20:23:33 MOZART kernel: rcu_sched_clock_irq+0x22d/0x631 Aug 8 20:23:33 MOZART kernel: ? _raw_spin_unlock_irqrestore+0xe/0x1b Aug 8 20:23:33 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Aug 8 20:23:33 MOZART kernel: update_process_times+0x8c/0xab Aug 8 20:23:33 MOZART kernel: tick_sched_timer+0x38/0x65 Aug 8 20:23:33 MOZART kernel: __hrtimer_run_queues+0xfa/0x18a Aug 8 20:23:33 MOZART kernel: hrtimer_interrupt+0x92/0x160 Aug 8 20:23:33 MOZART kernel: __sysvec_apic_timer_interrupt+0x99/0xdb Aug 8 20:23:33 MOZART kernel: sysvec_apic_timer_interrupt+0x37/0x7d Aug 8 20:23:33 MOZART kernel: asm_sysvec_apic_timer_interrupt+0x12/0x20 Aug 8 20:23:33 MOZART kernel: RIP: 0010:nf_ct_key_equal+0x48/0x70 [nf_conntrack] Aug 8 20:23:33 MOZART kernel: Code: ff ff 84 c0 74 3d 48 89 ef e8 6c ef ff ff 0f b6 4d 37 41 8a 55 03 48 89 c7 48 89 c3 66 41 8b 75 00 e8 91 ff ff ff 84 c0 74 19 <48> 8b 83 80 00 00 00 a8 08 74 0e 45 31 e4 4c 39 b3 90 00 00 00 41 Aug 8 20:23:33 MOZART kernel: RSP: 0018:ffffc900001588e0 EFLAGS: 00000202 Aug 8 20:23:33 MOZART kernel: RAX: 0000000000000001 RBX: ffff8881e0fa2500 RCX: 0000000000000000 Aug 8 20:23:33 MOZART kernel: RDX: 0000000000000003 RSI: 00000000e0fa0000 RDI: ffff8881e0fa2500 Aug 8 20:23:33 MOZART kernel: RBP: ffff8881e0fa2548 R08: 0000000000000003 R09: 7f5ab9ce7bc1419e Aug 8 20:23:33 MOZART kernel: R10: a0cf3fad5ce73de0 R11: 45ecf4d24635c54c R12: 0000000000000000 Aug 8 20:23:33 MOZART kernel: R13: ffff8881e0fa28cc R14: ffffffff828e1500 R15: ffff8881e0fa2500 Aug 8 20:23:33 MOZART kernel: nf_conntrack_tuple_taken+0xc9/0x156 [nf_conntrack] Aug 8 20:23:33 MOZART kernel: nf_nat_used_tuple+0x33/0x4e [nf_nat] Aug 8 20:23:33 MOZART kernel: nf_nat_setup_info+0x3f5/0x773 [nf_nat] Aug 8 20:23:33 MOZART kernel: ? addrtype_mt_v1+0xc2/0x100 [xt_addrtype] Aug 8 20:23:33 MOZART kernel: __nf_nat_alloc_null_binding+0x68/0x7f [nf_nat] Aug 8 20:23:33 MOZART kernel: nf_nat_inet_fn+0xa6/0x187 [nf_nat] Aug 8 20:23:33 MOZART kernel: nf_nat_ipv4_pre_routing+0x23/0x4e [nf_nat] Aug 8 20:23:33 MOZART kernel: nf_hook_slow+0x3e/0x93 Aug 8 20:23:33 MOZART kernel: ? br_nf_forward_finish+0xdc/0xdc [br_netfilter] Aug 8 20:23:33 MOZART kernel: NF_HOOK.isra.0+0xbd/0x119 [br_netfilter] Aug 8 20:23:33 MOZART kernel: ? br_nf_forward_finish+0xdc/0xdc [br_netfilter] Aug 8 20:23:33 MOZART kernel: br_nf_pre_routing+0x226/0x236 [br_netfilter] Aug 8 20:23:33 MOZART kernel: ? br_nf_forward_finish+0xdc/0xdc [br_netfilter] Aug 8 20:23:33 MOZART kernel: br_handle_frame+0x292/0x2da Aug 8 20:23:33 MOZART kernel: ? tcp_v4_destroy_sock+0x50/0x18c Aug 8 20:23:33 MOZART kernel: ? br_handle_local_finish+0x13/0x13 Aug 8 20:23:33 MOZART kernel: __netif_receive_skb_core.constprop.0+0x4b6/0x685 Aug 8 20:23:33 MOZART kernel: __netif_receive_skb_list_core+0x81/0x112 Aug 8 20:23:33 MOZART kernel: netif_receive_skb_list_internal+0x1c7/0x1fc Aug 8 20:23:33 MOZART kernel: gro_normal_list+0x22/0x3e Aug 8 20:23:33 MOZART kernel: napi_complete_done+0x7f/0x118 Aug 8 20:23:33 MOZART kernel: igb_poll+0xd69/0xf96 [igb] Aug 8 20:23:33 MOZART kernel: ? update_cfs_rq_load_avg+0x138/0x146 Aug 8 20:23:33 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Aug 8 20:23:33 MOZART kernel: __napi_poll.constprop.0+0x2a/0x114 Aug 8 20:23:33 MOZART kernel: net_rx_action+0xe8/0x1f2 Aug 8 20:23:33 MOZART kernel: __do_softirq+0xef/0x218 Aug 8 20:23:33 MOZART kernel: __irq_exit_rcu+0x4d/0x88 Aug 8 20:23:33 MOZART kernel: common_interrupt+0x73/0x8b Aug 8 20:23:33 MOZART kernel: </IRQ> Aug 8 20:23:33 MOZART kernel: <TASK> Aug 8 20:23:33 MOZART kernel: asm_common_interrupt+0x1e/0x40 Aug 8 20:23:33 MOZART kernel: RIP: 0010:arch_local_irq_enable+0x7/0x8 Aug 8 20:23:33 MOZART kernel: Code: a2 bc 1c 00 85 db 48 89 e8 79 03 48 63 c3 5b 5d 41 5c c3 9c 58 0f 1f 44 00 00 c3 fa 66 0f 1f 44 00 00 c3 fb 66 0f 1f 44 00 00 <c3> 0f 1f 44 00 00 55 49 89 d3 48 81 c7 b0 00 00 00 48 83 c6 70 53 Aug 8 20:23:33 MOZART kernel: RSP: 0018:ffffc900000cfea0 EFLAGS: 00000246 Aug 8 20:23:33 MOZART kernel: RAX: ffff8890452abb40 RBX: 0000000000000004 RCX: 000000000000001f Aug 8 20:23:33 MOZART kernel: RDX: 0000000000000002 RSI: 0000000000000002 RDI: 0000000000000000 Aug 8 20:23:33 MOZART kernel: RBP: ffff8890452b4c68 R08: 00000000ffffffff R09: 071c71c71c71c71c Aug 8 20:23:33 MOZART kernel: R10: 0000000000000020 R11: 000000000000006a R12: ffffffff82311d20 Aug 8 20:23:33 MOZART kernel: R13: 0000000000000004 R14: 000441d7297f9002 R15: 0000000000000000 Aug 8 20:23:33 MOZART kernel: cpuidle_enter_state+0x117/0x1db Aug 8 20:23:33 MOZART kernel: cpuidle_enter+0x2a/0x36 Aug 8 20:23:33 MOZART kernel: do_idle+0x1b7/0x225 Aug 8 20:23:33 MOZART kernel: cpu_startup_entry+0x1d/0x1f Aug 8 20:23:33 MOZART kernel: secondary_startup_64_no_verify+0xb0/0xbb Aug 8 20:23:33 MOZART kernel: </TASK> Aug 8 20:23:38 MOZART kernel: rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 2-... } 243926 jiffies s: 2989065 root: 0x4/. Aug 8 20:23:38 MOZART kernel: rcu: blocking rcu_node structures (internal RCU debug): Aug 8 20:23:38 MOZART kernel: Task dump for CPU 2: Aug 8 20:23:38 MOZART kernel: task:swapper/2 state:R running task stack: 0 pid: 0 ppid: 1 flags:0x00004808 Aug 8 20:23:38 MOZART kernel: Call Trace: Aug 8 20:23:38 MOZART kernel: <TASK> Aug 8 20:23:38 MOZART kernel: ? arch_local_irq_enable+0x7/0x8 Aug 8 20:23:38 MOZART kernel: ? cpuidle_enter_state+0x117/0x1db Aug 8 20:23:38 MOZART kernel: ? cpuidle_enter+0x2a/0x36 Aug 8 20:23:38 MOZART kernel: ? do_idle+0x1b7/0x225 Aug 8 20:23:38 MOZART kernel: ? cpu_startup_entry+0x1d/0x1f Aug 8 20:23:38 MOZART kernel: ? secondary_startup_64_no_verify+0xb0/0xbb Aug 8 20:23:38 MOZART kernel: </TASK> Aug 8 20:26:33 MOZART kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 8 20:26:33 MOZART kernel: rcu: #0112-....: (420012 ticks this GP) idle=17f/1/0x4000000000000004 softirq=257932014/257932015 fqs=104959 Aug 8 20:26:33 MOZART kernel: #011(t=420006 jiffies g=483494137 q=2159462) Aug 8 20:26:33 MOZART kernel: NMI backtrace for cpu 2 Aug 8 20:26:33 MOZART kernel: CPU: 2 PID: 0 Comm: swapper/2 Tainted: G W I 5.15.46-Unraid #1 Aug 8 20:26:33 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Aug 8 20:26:33 MOZART kernel: Call Trace: Aug 8 20:26:33 MOZART kernel: <IRQ> Aug 8 20:26:33 MOZART kernel: dump_stack_lvl+0x46/0x5a Aug 8 20:26:33 MOZART kernel: nmi_cpu_backtrace+0xae/0xd2 Aug 8 20:26:33 MOZART kernel: ? lapic_can_unplug_cpu+0x93/0x93 Aug 8 20:26:33 MOZART kernel: nmi_trigger_cpumask_backtrace+0x56/0xd3 Aug 8 20:26:33 MOZART kernel: rcu_dump_cpu_stacks+0xc3/0xea Aug 8 20:26:33 MOZART kernel: rcu_sched_clock_irq+0x22d/0x631 Aug 8 20:26:33 MOZART kernel: ? _raw_spin_unlock_irqrestore+0xe/0x1b Aug 8 20:26:33 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Aug 8 20:26:33 MOZART kernel: update_process_times+0x8c/0xab Aug 8 20:26:33 MOZART kernel: tick_sched_timer+0x38/0x65 Aug 8 20:26:33 MOZART kernel: __hrtimer_run_queues+0xfa/0x18a Aug 8 20:26:33 MOZART kernel: hrtimer_interrupt+0x92/0x160 Aug 8 20:26:33 MOZART kernel: __sysvec_apic_timer_interrupt+0x99/0xdb Aug 8 20:26:33 MOZART kernel: sysvec_apic_timer_interrupt+0x37/0x7d Aug 8 20:26:33 MOZART kernel: asm_sysvec_apic_timer_interrupt+0x12/0x20 Aug 8 20:26:33 MOZART kernel: RIP: 0010:nf_ct_zone_equal.isra.0+0x24/0x2b [nf_conntrack] Aug 8 20:26:33 MOZART kernel: Code: 0f fa ff ff 5d c3 44 0f b6 47 0f b8 01 00 00 00 d3 e0 31 c9 41 85 c0 74 04 66 8b 4f 0c 0f b6 d2 85 c2 b8 00 00 00 00 0f 44 f0 <66> 39 ce 0f 94 c0 c3 41 56 49 89 ce 41 55 49 89 d5 41 54 45 31 e4 Aug 8 20:26:33 MOZART kernel: RSP: 0018:ffffc900001588d8 EFLAGS: 00000202 Aug 8 20:26:33 MOZART kernel: RAX: 0000000000000000 RBX: ffff8881e0fa2500 RCX: 0000000000000000 Aug 8 20:26:33 MOZART kernel: RDX: 0000000000000003 RSI: 00000000e0fa0000 RDI: ffff8881e0fa2500 Aug 8 20:26:33 MOZART kernel: RBP: ffff8881e0fa2548 R08: 0000000000000003 R09: 7f5ab9ce7bc1419e Aug 8 20:26:33 MOZART kernel: R10: a0cf3fad5ce73de0 R11: 45ecf4d24635c54c R12: 0000000000000000 Aug 8 20:26:33 MOZART kernel: R13: ffff8881e0fa28cc R14: ffffffff828e1500 R15: ffff8881e0fa2500 Aug 8 20:26:33 MOZART kernel: nf_ct_key_equal+0x44/0x70 [nf_conntrack] Aug 8 20:26:33 MOZART kernel: nf_conntrack_tuple_taken+0xc9/0x156 [nf_conntrack] Aug 8 20:26:33 MOZART kernel: nf_nat_used_tuple+0x33/0x4e [nf_nat] Aug 8 20:26:33 MOZART kernel: nf_nat_setup_info+0x3f5/0x773 [nf_nat] Aug 8 20:26:33 MOZART kernel: ? addrtype_mt_v1+0xc2/0x100 [xt_addrtype] Aug 8 20:26:33 MOZART kernel: __nf_nat_alloc_null_binding+0x68/0x7f [nf_nat] Aug 8 20:26:33 MOZART kernel: nf_nat_inet_fn+0xa6/0x187 [nf_nat] Aug 8 20:26:33 MOZART kernel: nf_nat_ipv4_pre_routing+0x23/0x4e [nf_nat] Aug 8 20:26:33 MOZART kernel: nf_hook_slow+0x3e/0x93 Aug 8 20:26:33 MOZART kernel: ? br_nf_forward_finish+0xdc/0xdc [br_netfilter] Aug 8 20:26:33 MOZART kernel: NF_HOOK.isra.0+0xbd/0x119 [br_netfilter] Aug 8 20:26:33 MOZART kernel: ? br_nf_forward_finish+0xdc/0xdc [br_netfilter] Aug 8 20:26:33 MOZART kernel: br_nf_pre_routing+0x226/0x236 [br_netfilter] Aug 8 20:26:33 MOZART kernel: ? br_nf_forward_finish+0xdc/0xdc [br_netfilter] Aug 8 20:26:33 MOZART kernel: br_handle_frame+0x292/0x2da Aug 8 20:26:33 MOZART kernel: ? tcp_v4_destroy_sock+0x50/0x18c Aug 8 20:26:33 MOZART kernel: ? br_handle_local_finish+0x13/0x13 Aug 8 20:26:33 MOZART kernel: __netif_receive_skb_core.constprop.0+0x4b6/0x685 Aug 8 20:26:33 MOZART kernel: __netif_receive_skb_list_core+0x81/0x112 Aug 8 20:26:33 MOZART kernel: netif_receive_skb_list_internal+0x1c7/0x1fc Aug 8 20:26:33 MOZART kernel: gro_normal_list+0x22/0x3e Aug 8 20:26:33 MOZART kernel: napi_complete_done+0x7f/0x118 Aug 8 20:26:33 MOZART kernel: igb_poll+0xd69/0xf96 [igb] Aug 8 20:26:33 MOZART kernel: ? update_cfs_rq_load_avg+0x138/0x146 Aug 8 20:26:33 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Aug 8 20:26:33 MOZART kernel: __napi_poll.constprop.0+0x2a/0x114 Aug 8 20:26:33 MOZART kernel: net_rx_action+0xe8/0x1f2 Aug 8 20:26:33 MOZART kernel: __do_softirq+0xef/0x218 Aug 8 20:26:33 MOZART kernel: __irq_exit_rcu+0x4d/0x88 Aug 8 20:26:33 MOZART kernel: common_interrupt+0x73/0x8b Aug 8 20:26:33 MOZART kernel: </IRQ> Aug 8 20:26:33 MOZART kernel: <TASK> Aug 8 20:26:33 MOZART kernel: asm_common_interrupt+0x1e/0x40 Aug 8 20:26:33 MOZART kernel: RIP: 0010:arch_local_irq_enable+0x7/0x8 Aug 8 20:26:33 MOZART kernel: Code: a2 bc 1c 00 85 db 48 89 e8 79 03 48 63 c3 5b 5d 41 5c c3 9c 58 0f 1f 44 00 00 c3 fa 66 0f 1f 44 00 00 c3 fb 66 0f 1f 44 00 00 <c3> 0f 1f 44 00 00 55 49 89 d3 48 81 c7 b0 00 00 00 48 83 c6 70 53 Aug 8 20:26:33 MOZART kernel: RSP: 0018:ffffc900000cfea0 EFLAGS: 00000246 Aug 8 20:26:33 MOZART kernel: RAX: ffff8890452abb40 RBX: 0000000000000004 RCX: 000000000000001f Aug 8 20:26:33 MOZART kernel: RDX: 0000000000000002 RSI: 0000000000000002 RDI: 0000000000000000 Aug 8 20:26:33 MOZART kernel: RBP: ffff8890452b4c68 R08: 00000000ffffffff R09: 071c71c71c71c71c Aug 8 20:26:33 MOZART kernel: R10: 0000000000000020 R11: 000000000000006a R12: ffffffff82311d20 Aug 8 20:26:33 MOZART kernel: R13: 0000000000000004 R14: 000441d7297f9002 R15: 0000000000000000 Aug 8 20:26:33 MOZART kernel: cpuidle_enter_state+0x117/0x1db Aug 8 20:26:33 MOZART kernel: cpuidle_enter+0x2a/0x36 Aug 8 20:26:33 MOZART kernel: do_idle+0x1b7/0x225 Aug 8 20:26:33 MOZART kernel: cpu_startup_entry+0x1d/0x1f Aug 8 20:26:33 MOZART kernel: secondary_startup_64_no_verify+0xb0/0xbb Aug 8 20:26:33 MOZART kernel: </TASK> Aug 8 20:26:39 MOZART kernel: rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 2-... } 424150 jiffies s: 2989065 root: 0x4/. Aug 8 20:26:39 MOZART kernel: rcu: blocking rcu_node structures (internal RCU debug): Aug 8 20:26:39 MOZART kernel: Task dump for CPU 2: Aug 8 20:26:39 MOZART kernel: task:swapper/2 state:R running task stack: 0 pid: 0 ppid: 1 flags:0x00004808 Aug 8 20:26:39 MOZART kernel: Call Trace: Aug 8 20:26:39 MOZART kernel: <TASK> Aug 8 20:26:39 MOZART kernel: ? arch_local_irq_enable+0x7/0x8 Aug 8 20:26:39 MOZART kernel: ? cpuidle_enter_state+0x117/0x1db Aug 8 20:26:39 MOZART kernel: ? cpuidle_enter+0x2a/0x36 Aug 8 20:26:39 MOZART kernel: ? do_idle+0x1b7/0x225 Aug 8 20:26:39 MOZART kernel: ? cpu_startup_entry+0x1d/0x1f Aug 8 20:26:39 MOZART kernel: ? secondary_startup_64_no_verify+0xb0/0xbb Aug 8 20:26:39 MOZART kernel: </TASK> Aug 8 20:29:33 MOZART kernel: rcu: INFO: rcu_sched self-detected stall on CPU Aug 8 20:29:33 MOZART kernel: rcu: #0112-....: (600015 ticks this GP) idle=17f/1/0x4000000000000004 softirq=257932014/257932015 fqs=149945 Aug 8 20:29:33 MOZART kernel: #011(t=600009 jiffies g=483494137 q=3080021) Aug 8 20:29:33 MOZART kernel: NMI backtrace for cpu 2 Aug 8 20:29:33 MOZART kernel: CPU: 2 PID: 0 Comm: swapper/2 Tainted: G W I 5.15.46-Unraid #1 Aug 8 20:29:33 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Aug 8 20:29:33 MOZART kernel: Call Trace: Aug 8 20:29:33 MOZART kernel: <IRQ> Aug 8 20:29:33 MOZART kernel: dump_stack_lvl+0x46/0x5a Aug 8 20:29:33 MOZART kernel: nmi_cpu_backtrace+0xae/0xd2 Aug 8 20:29:33 MOZART kernel: ? lapic_can_unplug_cpu+0x93/0x93 Aug 8 20:29:33 MOZART kernel: nmi_trigger_cpumask_backtrace+0x56/0xd3 Aug 8 20:29:33 MOZART kernel: rcu_dump_cpu_stacks+0xc3/0xea Aug 8 20:29:33 MOZART kernel: rcu_sched_clock_irq+0x22d/0x631 Aug 8 20:29:33 MOZART kernel: ? _raw_spin_unlock_irqrestore+0xe/0x1b Aug 8 20:29:33 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Aug 8 20:29:33 MOZART kernel: update_process_times+0x8c/0xab Aug 8 20:29:33 MOZART kernel: tick_sched_timer+0x38/0x65 Aug 8 20:29:33 MOZART kernel: __hrtimer_run_queues+0xfa/0x18a Aug 8 20:29:33 MOZART kernel: hrtimer_interrupt+0x92/0x160 Aug 8 20:29:33 MOZART kernel: __sysvec_apic_timer_interrupt+0x99/0xdb Aug 8 20:29:33 MOZART kernel: sysvec_apic_timer_interrupt+0x37/0x7d Aug 8 20:29:33 MOZART kernel: asm_sysvec_apic_timer_interrupt+0x12/0x20 Aug 8 20:29:33 MOZART kernel: RIP: 0010:nf_ct_tuple_equal+0x3/0x47 [nf_conntrack] Aug 8 20:29:33 MOZART kernel: Code: 80 e8 08 00 00 48 85 c0 74 1c 53 89 fb 48 89 f7 be 04 00 00 00 e8 8a ff ff ff 48 85 c0 74 05 f0 48 0f ab 18 5b c3 c3 48 8b 17 <31> c0 48 33 16 48 8b 4f 08 48 33 4e 08 48 09 ca 75 2e 8b 4e 10 39 Aug 8 20:29:33 MOZART kernel: RSP: 0018:ffffc900001588d8 EFLAGS: 00000246 Aug 8 20:29:33 MOZART kernel: RAX: 00000000475f69c3 RBX: ffff8881e0fa28c0 RCX: ffffffff828e1500 Aug 8 20:29:33 MOZART kernel: RDX: 00000000fc0000e0 RSI: ffff8881e0fa2558 RDI: ffffc90000158970 Aug 8 20:29:33 MOZART kernel: RBP: ffff8881e0fa2548 R08: 0000000000000003 R09: 7f5ab9ce7bc1419e Aug 8 20:29:33 MOZART kernel: R10: a0cf3fad5ce73de0 R11: 45ecf4d24635c54c R12: 0000000000000000 Aug 8 20:29:33 MOZART kernel: R13: ffff8881e0fa28cc R14: ffffffff828e1500 R15: ffff8881e0fa2500 Aug 8 20:29:33 MOZART kernel: nf_ct_key_equal+0x20/0x70 [nf_conntrack] Aug 8 20:29:33 MOZART kernel: nf_conntrack_tuple_taken+0xc9/0x156 [nf_conntrack] Aug 8 20:29:33 MOZART kernel: nf_nat_used_tuple+0x33/0x4e [nf_nat] Aug 8 20:29:33 MOZART kernel: nf_nat_setup_info+0x3f5/0x773 [nf_nat] Aug 8 20:29:33 MOZART kernel: ? addrtype_mt_v1+0xc2/0x100 [xt_addrtype] Aug 8 20:29:33 MOZART kernel: __nf_nat_alloc_null_binding+0x68/0x7f [nf_nat] Aug 8 20:29:33 MOZART kernel: nf_nat_inet_fn+0xa6/0x187 [nf_nat] Aug 8 20:29:33 MOZART kernel: nf_nat_ipv4_pre_routing+0x23/0x4e [nf_nat] Aug 8 20:29:33 MOZART kernel: nf_hook_slow+0x3e/0x93 Aug 8 20:29:33 MOZART kernel: ? br_nf_forward_finish+0xdc/0xdc [br_netfilter] Aug 8 20:29:33 MOZART kernel: NF_HOOK.isra.0+0xbd/0x119 [br_netfilter] Aug 8 20:29:33 MOZART kernel: ? br_nf_forward_finish+0xdc/0xdc [br_netfilter] Aug 8 20:29:33 MOZART kernel: br_nf_pre_routing+0x226/0x236 [br_netfilter] Aug 8 20:29:33 MOZART kernel: ? br_nf_forward_finish+0xdc/0xdc [br_netfilter] Aug 8 20:29:33 MOZART kernel: br_handle_frame+0x292/0x2da Aug 8 20:29:33 MOZART kernel: ? tcp_v4_destroy_sock+0x50/0x18c Aug 8 20:29:33 MOZART kernel: ? br_handle_local_finish+0x13/0x13 Aug 8 20:29:33 MOZART kernel: __netif_receive_skb_core.constprop.0+0x4b6/0x685 Aug 8 20:29:33 MOZART kernel: __netif_receive_skb_list_core+0x81/0x112 Aug 8 20:29:33 MOZART kernel: netif_receive_skb_list_internal+0x1c7/0x1fc Aug 8 20:29:33 MOZART kernel: gro_normal_list+0x22/0x3e Aug 8 20:29:33 MOZART kernel: napi_complete_done+0x7f/0x118 Aug 8 20:29:33 MOZART kernel: igb_poll+0xd69/0xf96 [igb] Aug 8 20:29:33 MOZART kernel: ? update_cfs_rq_load_avg+0x138/0x146 Aug 8 20:29:33 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Aug 8 20:29:33 MOZART kernel: __napi_poll.constprop.0+0x2a/0x114 Aug 8 20:29:33 MOZART kernel: net_rx_action+0xe8/0x1f2 Aug 8 20:29:33 MOZART kernel: __do_softirq+0xef/0x218 Aug 8 20:29:33 MOZART kernel: __irq_exit_rcu+0x4d/0x88 Aug 8 20:29:33 MOZART kernel: common_interrupt+0x73/0x8b Aug 8 20:29:33 MOZART kernel: </IRQ> Aug 8 20:29:33 MOZART kernel: <TASK> Aug 8 20:29:33 MOZART kernel: asm_common_interrupt+0x1e/0x40 Aug 8 20:29:33 MOZART kernel: RIP: 0010:arch_local_irq_enable+0x7/0x8 Aug 8 20:29:33 MOZART kernel: Code: a2 bc 1c 00 85 db 48 89 e8 79 03 48 63 c3 5b 5d 41 5c c3 9c 58 0f 1f 44 00 00 c3 fa 66 0f 1f 44 00 00 c3 fb 66 0f 1f 44 00 00 <c3> 0f 1f 44 00 00 55 49 89 d3 48 81 c7 b0 00 00 00 48 83 c6 70 53 Aug 8 20:29:33 MOZART kernel: RSP: 0018:ffffc900000cfea0 EFLAGS: 00000246 Aug 8 20:29:33 MOZART kernel: RAX: ffff8890452abb40 RBX: 0000000000000004 RCX: 000000000000001f Aug 8 20:29:33 MOZART kernel: RDX: 0000000000000002 RSI: 0000000000000002 RDI: 0000000000000000 Aug 8 20:29:33 MOZART kernel: RBP: ffff8890452b4c68 R08: 00000000ffffffff R09: 071c71c71c71c71c Aug 8 20:29:33 MOZART kernel: R10: 0000000000000020 R11: 000000000000006a R12: ffffffff82311d20 Aug 8 20:29:33 MOZART kernel: R13: 0000000000000004 R14: 000441d7297f9002 R15: 0000000000000000 Aug 8 20:29:33 MOZART kernel: cpuidle_enter_state+0x117/0x1db Aug 8 20:29:33 MOZART kernel: cpuidle_enter+0x2a/0x36 Aug 8 20:29:33 MOZART kernel: do_idle+0x1b7/0x225 Aug 8 20:29:33 MOZART kernel: cpu_startup_entry+0x1d/0x1f Aug 8 20:29:33 MOZART kernel: secondary_startup_64_no_verify+0xb0/0xbb Aug 8 20:29:33 MOZART kernel: </TASK> Aug 8 20:29:39 MOZART kernel: rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 2-... } 604374 jiffies s: 2989065 root: 0x4/. Aug 8 20:29:39 MOZART kernel: rcu: blocking rcu_node structures (internal RCU debug): Aug 8 20:29:39 MOZART kernel: Task dump for CPU 2: Aug 8 20:29:39 MOZART kernel: task:swapper/2 state:R running task stack: 0 pid: 0 ppid: 1 flags:0x00004808 Aug 8 20:29:39 MOZART kernel: Call Trace: Aug 8 20:29:39 MOZART kernel: <TASK> Aug 8 20:29:39 MOZART kernel: ? arch_local_irq_enable+0x7/0x8 Aug 8 20:29:39 MOZART kernel: ? cpuidle_enter_state+0x117/0x1db Aug 8 20:29:39 MOZART kernel: ? cpuidle_enter+0x2a/0x36 Aug 8 20:29:39 MOZART kernel: ? do_idle+0x1b7/0x225 Aug 8 20:29:39 MOZART kernel: ? cpu_startup_entry+0x1d/0x1f Aug 8 20:29:39 MOZART kernel: ? secondary_startup_64_no_verify+0xb0/0xbb Aug 8 20:29:39 MOZART kernel: </TASK> SYSLOG BEFORE FORMER CRASH: Jul 25 00:46:40 MOZART kernel: BUG: unable to handle page fault for address: fffff8efd6226208 Jul 25 00:46:40 MOZART kernel: #PF: supervisor read access in kernel mode Jul 25 00:46:40 MOZART kernel: #PF: error_code(0x0000) - not-present page Jul 25 00:46:40 MOZART kernel: PGD 0 P4D 0 Jul 25 00:46:40 MOZART kernel: Oops: 0000 [#1] SMP PTI Jul 25 00:46:40 MOZART kernel: CPU: 7 PID: 11675 Comm: postgres Tainted: G W I 5.15.46-Unraid #1 Jul 25 00:46:40 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Jul 25 00:46:40 MOZART kernel: RIP: 0010:_compound_head+0x0/0x11 Jul 25 00:46:40 MOZART kernel: Code: b8 98 0f 00 00 00 00 f0 7f 48 85 c2 0f 95 c0 0f b6 c0 c3 48 c1 ef 3a 83 ff 1f 0f 94 c0 48 83 ff 1e 0f 94 c2 09 d0 0f b6 c0 c3 <48> 8b 57 08 48 89 f8 f6 c2 01 74 04 48 8d 42 ff c3 e8 ea ff ff ff Jul 25 00:46:40 MOZART kernel: RSP: 0018:ffffc90004887cc0 EFLAGS: 00010202 Jul 25 00:46:40 MOZART kernel: RAX: 0000000000000001 RBX: 0000147636694000 RCX: 00000000000000ad Jul 25 00:46:40 MOZART kernel: RDX: 7c00000000000000 RSI: ffffea002f17b1c0 RDI: fffff8efd6226200 Jul 25 00:46:40 MOZART kernel: RBP: ffffc90004887e00 R08: ffffea002f17b1c0 R09: ffff8881789bd000 Jul 25 00:46:40 MOZART kernel: R10: 0000000000000100 R11: 0000000000000297 R12: fffff8efd6226200 Jul 25 00:46:40 MOZART kernel: R13: 7c00003bbf588988 R14: ffff88814eecee08 R15: ffff888599005d80 Jul 25 00:46:40 MOZART kernel: FS: 0000000000000000(0000) GS:ffff8890453c0000(0000) knlGS:0000000000000000 Jul 25 00:46:40 MOZART kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jul 25 00:46:40 MOZART kernel: CR2: fffff8efd6226208 CR3: 000000000220a001 CR4: 00000000003726e0 Jul 25 00:46:40 MOZART kernel: Call Trace: Jul 25 00:46:40 MOZART kernel: <TASK> Jul 25 00:46:40 MOZART kernel: pfn_swap_entry_to_page+0x26/0x35 Jul 25 00:46:40 MOZART kernel: unmap_page_range+0x4c3/0x711 Jul 25 00:46:40 MOZART kernel: unmap_vmas+0x6f/0x9d Jul 25 00:46:40 MOZART kernel: exit_mmap+0xd6/0x145 Jul 25 00:46:40 MOZART kernel: __mmput+0x43/0xd7 Jul 25 00:46:40 MOZART kernel: do_exit+0x385/0x915 Jul 25 00:46:40 MOZART kernel: do_group_exit+0x93/0x93 Jul 25 00:46:40 MOZART kernel: __x64_sys_exit_group+0x14/0x14 Jul 25 00:46:40 MOZART kernel: do_syscall_64+0x83/0xa5 Jul 25 00:46:40 MOZART kernel: entry_SYSCALL_64_after_hwframe+0x44/0xae Jul 25 00:46:40 MOZART kernel: RIP: 0033:0x147636f7ff0b Jul 25 00:46:40 MOZART kernel: Code: Unable to access opcode bytes at RIP 0x147636f7fee1. Jul 25 00:46:40 MOZART kernel: RSP: 002b:00007ffe9b0509c8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7 Jul 25 00:46:40 MOZART kernel: RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 0000147636f7ff0b Jul 25 00:46:40 MOZART kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 Jul 25 00:46:40 MOZART kernel: RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 Jul 25 00:46:40 MOZART kernel: R10: 0000000000000008 R11: 0000000000000246 R12: 00007ffe9b050b60 Jul 25 00:46:40 MOZART kernel: R13: 000014763496e028 R14: 0000000000000003 R15: 0000000000000000 Jul 25 00:46:40 MOZART kernel: </TASK> Jul 25 00:46:40 MOZART kernel: Modules linked in: ccp veth wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libchacha xt_nat xt_CHECKSUM ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_mangle ip6table_nat iptable_mangle vhost_net vhost vhost_iotlb tap macvlan xt_conntrack nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_multiport xfs dm_crypt dm_mod dax md_mod iptable_nat xt_MASQUERADE nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 tun ip6table_filter ip6_tables iptable_filter ip_tables x_tables igb x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel i915 kvm ast drm_vram_helper crct10dif_pclmul iosf_mbi drm_ttm_helper crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel crypto_simd ipmi_ssif cryptd rapl ttm intel_cstate intel_uncore drm_kms_helper nvme i2c_i801 i2c_smbus drm nvme_core mpt3sas acpi_ipmi intel_gtt agpgart ahci i2c_algo_bit raid_class syscopyarea input_leds sysfillrect i2c_core libahci led_class Jul 25 00:46:40 MOZART kernel: intel_pch_thermal sysimgblt scsi_transport_sas fb_sys_fops ipmi_si video backlight acpi_power_meter thermal acpi_pad button fan [last unloaded: igb] Jul 25 00:46:40 MOZART kernel: CR2: fffff8efd6226208 Jul 25 00:46:40 MOZART kernel: ---[ end trace 76b9687835eec572 ]--- Jul 25 00:46:40 MOZART kernel: RIP: 0010:_compound_head+0x0/0x11 Jul 25 00:46:40 MOZART kernel: Code: b8 98 0f 00 00 00 00 f0 7f 48 85 c2 0f 95 c0 0f b6 c0 c3 48 c1 ef 3a 83 ff 1f 0f 94 c0 48 83 ff 1e 0f 94 c2 09 d0 0f b6 c0 c3 <48> 8b 57 08 48 89 f8 f6 c2 01 74 04 48 8d 42 ff c3 e8 ea ff ff ff Jul 25 00:46:40 MOZART kernel: RSP: 0018:ffffc90004887cc0 EFLAGS: 00010202 Jul 25 00:46:40 MOZART kernel: RAX: 0000000000000001 RBX: 0000147636694000 RCX: 00000000000000ad Jul 25 00:46:40 MOZART kernel: RDX: 7c00000000000000 RSI: ffffea002f17b1c0 RDI: fffff8efd6226200 Jul 25 00:46:40 MOZART kernel: RBP: ffffc90004887e00 R08: ffffea002f17b1c0 R09: ffff8881789bd000 Jul 25 00:46:40 MOZART kernel: R10: 0000000000000100 R11: 0000000000000297 R12: fffff8efd6226200 Jul 25 00:46:40 MOZART kernel: R13: 7c00003bbf588988 R14: ffff88814eecee08 R15: ffff888599005d80 Jul 25 00:46:40 MOZART kernel: FS: 0000000000000000(0000) GS:ffff8890453c0000(0000) knlGS:0000000000000000 Jul 25 00:46:40 MOZART kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jul 25 00:46:40 MOZART kernel: CR2: fffff8efd6226208 CR3: 000000000220a001 CR4: 00000000003726e0 Jul 25 00:46:40 MOZART kernel: Fixing recursive fault but reboot is needed! Jul 25 00:48:57 MOZART kernel: rcu: INFO: rcu_sched self-detected stall on CPU Jul 25 00:48:57 MOZART kernel: rcu: #0113-....: (59999 ticks this GP) idle=149/1/0x4000000000000000 softirq=205821660/205821660 fqs=14996 Jul 25 00:48:57 MOZART kernel: #011(t=60000 jiffies g=440205233 q=184829) Jul 25 00:48:57 MOZART kernel: NMI backtrace for cpu 3 Jul 25 00:48:57 MOZART kernel: CPU: 3 PID: 58 Comm: kcompactd0 Tainted: G D W I 5.15.46-Unraid #1 Jul 25 00:48:57 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Jul 25 00:48:57 MOZART kernel: Call Trace: Jul 25 00:48:57 MOZART kernel: <IRQ> Jul 25 00:48:57 MOZART kernel: dump_stack_lvl+0x46/0x5a Jul 25 00:48:57 MOZART kernel: nmi_cpu_backtrace+0xae/0xd2 Jul 25 00:48:57 MOZART kernel: ? lapic_can_unplug_cpu+0x93/0x93 Jul 25 00:48:57 MOZART kernel: nmi_trigger_cpumask_backtrace+0x56/0xd3 Jul 25 00:48:57 MOZART kernel: rcu_dump_cpu_stacks+0xc3/0xea Jul 25 00:48:57 MOZART kernel: rcu_sched_clock_irq+0x22d/0x631 Jul 25 00:48:57 MOZART kernel: ? _raw_spin_unlock_irqrestore+0xe/0x1b Jul 25 00:48:57 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Jul 25 00:48:57 MOZART kernel: update_process_times+0x8c/0xab Jul 25 00:48:57 MOZART kernel: tick_sched_timer+0x38/0x65 Jul 25 00:48:57 MOZART kernel: __hrtimer_run_queues+0xfa/0x18a Jul 25 00:48:57 MOZART kernel: hrtimer_interrupt+0x92/0x160 Jul 25 00:48:57 MOZART kernel: __sysvec_apic_timer_interrupt+0x99/0xdb Jul 25 00:48:57 MOZART kernel: sysvec_apic_timer_interrupt+0x61/0x7d Jul 25 00:48:57 MOZART kernel: </IRQ> Jul 25 00:48:57 MOZART kernel: <TASK> Jul 25 00:48:57 MOZART kernel: asm_sysvec_apic_timer_interrupt+0x12/0x20 Jul 25 00:48:57 MOZART kernel: RIP: 0010:native_queued_spin_lock_slowpath+0x76/0x18f Jul 25 00:48:57 MOZART kernel: Code: 0f ba 2a 08 8b 02 0f 92 c1 0f b6 c9 c1 e1 08 30 e4 09 c8 a9 00 01 ff ff 74 0c 0f ba e0 08 72 1a c6 42 01 00 eb 14 85 c0 74 0a <8b> 02 84 c0 74 04 f3 90 eb f6 66 c7 02 01 00 c3 48 c7 c1 40 c8 02 Jul 25 00:48:57 MOZART kernel: RSP: 0018:ffffc9000026bb20 EFLAGS: 00000202 Jul 25 00:48:57 MOZART kernel: RAX: 0000000000000101 RBX: ffffea0004457540 RCX: 0000000000000000 Jul 25 00:48:57 MOZART kernel: RDX: ffffea000f20b0e8 RSI: 0000000000000000 RDI: ffffea000f20b0e8 Jul 25 00:48:57 MOZART kernel: RBP: ffffc9000026bb70 R08: ffffea0004457540 R09: ffff8881789bd000 Jul 25 00:48:57 MOZART kernel: R10: 0000000000000100 R11: 00000000000305e0 R12: ffff88815840aec0 Jul 25 00:48:57 MOZART kernel: R13: 0000147636673000 R14: ffff8883c82c3390 R15: 0000000000000003 Jul 25 00:48:57 MOZART kernel: queued_spin_lock_slowpath+0x7/0xa Jul 25 00:48:57 MOZART kernel: page_vma_mapped_walk+0x417/0x51b Jul 25 00:48:57 MOZART kernel: remove_migration_pte+0x5e/0x22e Jul 25 00:48:57 MOZART kernel: rmap_walk_anon+0xd2/0x13e Jul 25 00:48:57 MOZART kernel: remove_migration_ptes+0x4e/0x68 Jul 25 00:48:57 MOZART kernel: ? page_is_file_lru+0x16/0x16 Jul 25 00:48:57 MOZART kernel: migrate_pages+0x632/0xa08 Jul 25 00:48:57 MOZART kernel: ? compact_lock_irqsave+0x5e/0x5e Jul 25 00:48:57 MOZART kernel: ? release_freepages+0x8f/0x8f Jul 25 00:48:57 MOZART kernel: compact_zone+0x84f/0xa29 Jul 25 00:48:57 MOZART kernel: ? __switch_to_xtra+0x50/0x3d0 Jul 25 00:48:57 MOZART kernel: ? __raw_spin_unlock+0x5/0x6 Jul 25 00:48:57 MOZART kernel: proactive_compact_node+0x7f/0xac Jul 25 00:48:57 MOZART kernel: kcompactd+0x24e/0x29c Jul 25 00:48:57 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 00:48:57 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 00:48:57 MOZART kernel: kthread+0xde/0xe3 Jul 25 00:48:57 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 00:48:57 MOZART kernel: ret_from_fork+0x22/0x30 Jul 25 00:48:57 MOZART kernel: </TASK> Jul 25 00:49:03 MOZART kernel: rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 61782 jiffies s: 2757133 root: 0x8/. Jul 25 00:49:03 MOZART kernel: rcu: blocking rcu_node structures (internal RCU debug): Jul 25 00:49:03 MOZART kernel: Task dump for CPU 3: Jul 25 00:49:03 MOZART kernel: task:kcompactd0 state:R running task stack: 0 pid: 58 ppid: 2 flags:0x00004808 Jul 25 00:49:03 MOZART kernel: Call Trace: Jul 25 00:49:03 MOZART kernel: <TASK> Jul 25 00:49:03 MOZART kernel: ? proactive_compact_node+0x7f/0xac Jul 25 00:49:03 MOZART kernel: ? kcompactd+0x24e/0x29c Jul 25 00:49:03 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 00:49:03 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 00:49:03 MOZART kernel: ? kthread+0xde/0xe3 Jul 25 00:49:03 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 00:49:03 MOZART kernel: ? ret_from_fork+0x22/0x30 Jul 25 00:49:03 MOZART kernel: </TASK> Jul 25 00:51:33 MOZART emhttpd: spinning down /dev/sdb Jul 25 00:51:57 MOZART kernel: rcu: INFO: rcu_sched self-detected stall on CPU Jul 25 00:51:57 MOZART kernel: rcu: #0113-....: (239966 ticks this GP) idle=149/1/0x4000000000000000 softirq=205821660/205821660 fqs=59972 Jul 25 00:51:57 MOZART kernel: #011(t=240003 jiffies g=440205233 q=1178748) Jul 25 00:51:57 MOZART kernel: NMI backtrace for cpu 3 Jul 25 00:51:57 MOZART kernel: CPU: 3 PID: 58 Comm: kcompactd0 Tainted: G D W I 5.15.46-Unraid #1 Jul 25 00:51:57 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Jul 25 00:51:57 MOZART kernel: Call Trace: Jul 25 00:51:57 MOZART kernel: <IRQ> Jul 25 00:51:57 MOZART kernel: dump_stack_lvl+0x46/0x5a Jul 25 00:51:57 MOZART kernel: nmi_cpu_backtrace+0xae/0xd2 Jul 25 00:51:57 MOZART kernel: ? lapic_can_unplug_cpu+0x93/0x93 Jul 25 00:51:57 MOZART kernel: nmi_trigger_cpumask_backtrace+0x56/0xd3 Jul 25 00:51:57 MOZART kernel: rcu_dump_cpu_stacks+0xc3/0xea Jul 25 00:51:57 MOZART kernel: rcu_sched_clock_irq+0x22d/0x631 Jul 25 00:51:57 MOZART kernel: ? _raw_spin_unlock_irqrestore+0xe/0x1b Jul 25 00:51:57 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Jul 25 00:51:57 MOZART kernel: update_process_times+0x8c/0xab Jul 25 00:51:57 MOZART kernel: tick_sched_timer+0x38/0x65 Jul 25 00:51:57 MOZART kernel: __hrtimer_run_queues+0xfa/0x18a Jul 25 00:51:57 MOZART kernel: hrtimer_interrupt+0x92/0x160 Jul 25 00:51:57 MOZART kernel: __sysvec_apic_timer_interrupt+0x99/0xdb Jul 25 00:51:57 MOZART kernel: sysvec_apic_timer_interrupt+0x61/0x7d Jul 25 00:51:57 MOZART kernel: </IRQ> Jul 25 00:51:57 MOZART kernel: <TASK> Jul 25 00:51:57 MOZART kernel: asm_sysvec_apic_timer_interrupt+0x12/0x20 Jul 25 00:51:57 MOZART kernel: RIP: 0010:native_queued_spin_lock_slowpath+0x7e/0x18f Jul 25 00:51:57 MOZART kernel: Code: c1 0f b6 c9 c1 e1 08 30 e4 09 c8 a9 00 01 ff ff 74 0c 0f ba e0 08 72 1a c6 42 01 00 eb 14 85 c0 74 0a 8b 02 84 c0 74 04 f3 90 <eb> f6 66 c7 02 01 00 c3 48 c7 c1 40 c8 02 00 65 48 03 0d f7 93 f6 Jul 25 00:51:57 MOZART kernel: RSP: 0018:ffffc9000026bb20 EFLAGS: 00000202 Jul 25 00:51:57 MOZART kernel: RAX: 0000000000180101 RBX: ffffea0004457540 RCX: 0000000000000000 Jul 25 00:51:57 MOZART kernel: RDX: ffffea000f20b0e8 RSI: 0000000000000000 RDI: ffffea000f20b0e8 Jul 25 00:51:57 MOZART kernel: RBP: ffffc9000026bb70 R08: ffffea0004457540 R09: ffff8881789bd000 Jul 25 00:51:57 MOZART kernel: R10: 0000000000000100 R11: 00000000000305e0 R12: ffff88815840aec0 Jul 25 00:51:57 MOZART kernel: R13: 0000147636673000 R14: ffff8883c82c3390 R15: 0000000000000003 Jul 25 00:51:57 MOZART kernel: queued_spin_lock_slowpath+0x7/0xa Jul 25 00:51:57 MOZART kernel: page_vma_mapped_walk+0x417/0x51b Jul 25 00:51:57 MOZART kernel: remove_migration_pte+0x5e/0x22e Jul 25 00:51:57 MOZART kernel: rmap_walk_anon+0xd2/0x13e Jul 25 00:51:57 MOZART kernel: remove_migration_ptes+0x4e/0x68 Jul 25 00:51:57 MOZART kernel: ? page_is_file_lru+0x16/0x16 Jul 25 00:51:57 MOZART kernel: migrate_pages+0x632/0xa08 Jul 25 00:51:57 MOZART kernel: ? compact_lock_irqsave+0x5e/0x5e Jul 25 00:51:57 MOZART kernel: ? release_freepages+0x8f/0x8f Jul 25 00:51:57 MOZART kernel: compact_zone+0x84f/0xa29 Jul 25 00:51:57 MOZART kernel: ? __switch_to_xtra+0x50/0x3d0 Jul 25 00:51:57 MOZART kernel: ? __raw_spin_unlock+0x5/0x6 Jul 25 00:51:57 MOZART kernel: proactive_compact_node+0x7f/0xac Jul 25 00:51:57 MOZART kernel: kcompactd+0x24e/0x29c Jul 25 00:51:57 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 00:51:57 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 00:51:57 MOZART kernel: kthread+0xde/0xe3 Jul 25 00:51:57 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 00:51:57 MOZART kernel: ret_from_fork+0x22/0x30 Jul 25 00:51:57 MOZART kernel: </TASK> Jul 25 00:52:04 MOZART kernel: rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 242006 jiffies s: 2757133 root: 0x8/. Jul 25 00:52:04 MOZART kernel: rcu: blocking rcu_node structures (internal RCU debug): Jul 25 00:52:04 MOZART kernel: Task dump for CPU 3: Jul 25 00:52:04 MOZART kernel: task:kcompactd0 state:R running task stack: 0 pid: 58 ppid: 2 flags:0x00004808 Jul 25 00:52:04 MOZART kernel: Call Trace: Jul 25 00:52:04 MOZART kernel: <TASK> Jul 25 00:52:04 MOZART kernel: ? proactive_compact_node+0x7f/0xac Jul 25 00:52:04 MOZART kernel: ? kcompactd+0x24e/0x29c Jul 25 00:52:04 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 00:52:04 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 00:52:04 MOZART kernel: ? kthread+0xde/0xe3 Jul 25 00:52:04 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 00:52:04 MOZART kernel: ? ret_from_fork+0x22/0x30 Jul 25 00:52:04 MOZART kernel: </TASK> Jul 25 00:54:57 MOZART kernel: rcu: INFO: rcu_sched self-detected stall on CPU Jul 25 00:54:57 MOZART kernel: rcu: #0113-....: (419941 ticks this GP) idle=149/1/0x4000000000000000 softirq=205821660/205821660 fqs=104948 Jul 25 00:54:57 MOZART kernel: #011(t=420006 jiffies g=440205233 q=1690772) Jul 25 00:54:57 MOZART kernel: NMI backtrace for cpu 3 Jul 25 00:54:57 MOZART kernel: CPU: 3 PID: 58 Comm: kcompactd0 Tainted: G D W I 5.15.46-Unraid #1 Jul 25 00:54:57 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Jul 25 00:54:57 MOZART kernel: Call Trace: Jul 25 00:54:57 MOZART kernel: <IRQ> Jul 25 00:54:57 MOZART kernel: dump_stack_lvl+0x46/0x5a Jul 25 00:54:57 MOZART kernel: nmi_cpu_backtrace+0xae/0xd2 Jul 25 00:54:57 MOZART kernel: ? lapic_can_unplug_cpu+0x93/0x93 Jul 25 00:54:57 MOZART kernel: nmi_trigger_cpumask_backtrace+0x56/0xd3 Jul 25 00:54:57 MOZART kernel: rcu_dump_cpu_stacks+0xc3/0xea Jul 25 00:54:57 MOZART kernel: rcu_sched_clock_irq+0x22d/0x631 Jul 25 00:54:57 MOZART kernel: ? _raw_spin_unlock_irqrestore+0xe/0x1b Jul 25 00:54:57 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Jul 25 00:54:57 MOZART kernel: update_process_times+0x8c/0xab Jul 25 00:54:57 MOZART kernel: tick_sched_timer+0x38/0x65 Jul 25 00:54:57 MOZART kernel: __hrtimer_run_queues+0xfa/0x18a Jul 25 00:54:57 MOZART kernel: hrtimer_interrupt+0x92/0x160 Jul 25 00:54:57 MOZART kernel: __sysvec_apic_timer_interrupt+0x99/0xdb Jul 25 00:54:57 MOZART kernel: sysvec_apic_timer_interrupt+0x61/0x7d Jul 25 00:54:57 MOZART kernel: </IRQ> Jul 25 00:54:57 MOZART kernel: <TASK> Jul 25 00:54:57 MOZART kernel: asm_sysvec_apic_timer_interrupt+0x12/0x20 Jul 25 00:54:57 MOZART kernel: RIP: 0010:native_queued_spin_lock_slowpath+0x7e/0x18f Jul 25 00:54:57 MOZART kernel: Code: c1 0f b6 c9 c1 e1 08 30 e4 09 c8 a9 00 01 ff ff 74 0c 0f ba e0 08 72 1a c6 42 01 00 eb 14 85 c0 74 0a 8b 02 84 c0 74 04 f3 90 <eb> f6 66 c7 02 01 00 c3 48 c7 c1 40 c8 02 00 65 48 03 0d f7 93 f6 Jul 25 00:54:57 MOZART kernel: RSP: 0018:ffffc9000026bb20 EFLAGS: 00000202 Jul 25 00:54:57 MOZART kernel: RAX: 0000000000180101 RBX: ffffea0004457540 RCX: 0000000000000000 Jul 25 00:54:57 MOZART kernel: RDX: ffffea000f20b0e8 RSI: 0000000000000000 RDI: ffffea000f20b0e8 Jul 25 00:54:57 MOZART kernel: RBP: ffffc9000026bb70 R08: ffffea0004457540 R09: ffff8881789bd000 Jul 25 00:54:57 MOZART kernel: R10: 0000000000000100 R11: 00000000000305e0 R12: ffff88815840aec0 Jul 25 00:54:57 MOZART kernel: R13: 0000147636673000 R14: ffff8883c82c3390 R15: 0000000000000003 Jul 25 00:54:57 MOZART kernel: queued_spin_lock_slowpath+0x7/0xa Jul 25 00:54:57 MOZART kernel: page_vma_mapped_walk+0x417/0x51b Jul 25 00:54:57 MOZART kernel: remove_migration_pte+0x5e/0x22e Jul 25 00:54:57 MOZART kernel: rmap_walk_anon+0xd2/0x13e Jul 25 00:54:57 MOZART kernel: remove_migration_ptes+0x4e/0x68 Jul 25 00:54:57 MOZART kernel: ? page_is_file_lru+0x16/0x16 Jul 25 00:54:57 MOZART kernel: migrate_pages+0x632/0xa08 Jul 25 00:54:57 MOZART kernel: ? compact_lock_irqsave+0x5e/0x5e Jul 25 00:54:57 MOZART kernel: ? release_freepages+0x8f/0x8f Jul 25 00:54:57 MOZART kernel: compact_zone+0x84f/0xa29 Jul 25 00:54:57 MOZART kernel: ? __switch_to_xtra+0x50/0x3d0 Jul 25 00:54:57 MOZART kernel: ? __raw_spin_unlock+0x5/0x6 Jul 25 00:54:57 MOZART kernel: proactive_compact_node+0x7f/0xac Jul 25 00:54:57 MOZART kernel: kcompactd+0x24e/0x29c Jul 25 00:54:57 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 00:54:57 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 00:54:57 MOZART kernel: kthread+0xde/0xe3 Jul 25 00:54:57 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 00:54:57 MOZART kernel: ret_from_fork+0x22/0x30 Jul 25 00:54:57 MOZART kernel: </TASK> Jul 25 00:55:04 MOZART kernel: rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 422230 jiffies s: 2757133 root: 0x8/. Jul 25 00:55:04 MOZART kernel: rcu: blocking rcu_node structures (internal RCU debug): Jul 25 00:55:04 MOZART kernel: Task dump for CPU 3: Jul 25 00:55:04 MOZART kernel: task:kcompactd0 state:R running task stack: 0 pid: 58 ppid: 2 flags:0x00004808 Jul 25 00:55:04 MOZART kernel: Call Trace: Jul 25 00:55:04 MOZART kernel: <TASK> Jul 25 00:55:04 MOZART kernel: ? proactive_compact_node+0x7f/0xac Jul 25 00:55:04 MOZART kernel: ? kcompactd+0x24e/0x29c Jul 25 00:55:04 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 00:55:04 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 00:55:04 MOZART kernel: ? kthread+0xde/0xe3 Jul 25 00:55:04 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 00:55:04 MOZART kernel: ? ret_from_fork+0x22/0x30 Jul 25 00:55:04 MOZART kernel: </TASK> Jul 25 00:57:57 MOZART kernel: rcu: INFO: rcu_sched self-detected stall on CPU Jul 25 00:57:57 MOZART kernel: rcu: #0113-....: (599916 ticks this GP) idle=149/1/0x4000000000000000 softirq=205821660/205821660 fqs=149927 Jul 25 00:57:57 MOZART kernel: #011(t=600009 jiffies g=440205233 q=2185924) Jul 25 00:57:57 MOZART kernel: NMI backtrace for cpu 3 Jul 25 00:57:57 MOZART kernel: CPU: 3 PID: 58 Comm: kcompactd0 Tainted: G D W I 5.15.46-Unraid #1 Jul 25 00:57:57 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Jul 25 00:57:57 MOZART kernel: Call Trace: Jul 25 00:57:57 MOZART kernel: <IRQ> Jul 25 00:57:57 MOZART kernel: dump_stack_lvl+0x46/0x5a Jul 25 00:57:57 MOZART kernel: nmi_cpu_backtrace+0xae/0xd2 Jul 25 00:57:57 MOZART kernel: ? lapic_can_unplug_cpu+0x93/0x93 Jul 25 00:57:57 MOZART kernel: nmi_trigger_cpumask_backtrace+0x56/0xd3 Jul 25 00:57:57 MOZART kernel: rcu_dump_cpu_stacks+0xc3/0xea Jul 25 00:57:57 MOZART kernel: rcu_sched_clock_irq+0x22d/0x631 Jul 25 00:57:57 MOZART kernel: ? _raw_spin_unlock_irqrestore+0xe/0x1b Jul 25 00:57:57 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Jul 25 00:57:57 MOZART kernel: update_process_times+0x8c/0xab Jul 25 00:57:57 MOZART kernel: tick_sched_timer+0x38/0x65 Jul 25 00:57:57 MOZART kernel: __hrtimer_run_queues+0xfa/0x18a Jul 25 00:57:57 MOZART kernel: hrtimer_interrupt+0x92/0x160 Jul 25 00:57:57 MOZART kernel: __sysvec_apic_timer_interrupt+0x99/0xdb Jul 25 00:57:57 MOZART kernel: sysvec_apic_timer_interrupt+0x61/0x7d Jul 25 00:57:57 MOZART kernel: </IRQ> Jul 25 00:57:57 MOZART kernel: <TASK> Jul 25 00:57:57 MOZART kernel: asm_sysvec_apic_timer_interrupt+0x12/0x20 Jul 25 00:57:57 MOZART kernel: RIP: 0010:native_queued_spin_lock_slowpath+0x7e/0x18f Jul 25 00:57:57 MOZART kernel: Code: c1 0f b6 c9 c1 e1 08 30 e4 09 c8 a9 00 01 ff ff 74 0c 0f ba e0 08 72 1a c6 42 01 00 eb 14 85 c0 74 0a 8b 02 84 c0 74 04 f3 90 <eb> f6 66 c7 02 01 00 c3 48 c7 c1 40 c8 02 00 65 48 03 0d f7 93 f6 Jul 25 00:57:57 MOZART kernel: RSP: 0018:ffffc9000026bb20 EFLAGS: 00000202 Jul 25 00:57:57 MOZART kernel: RAX: 0000000000180101 RBX: ffffea0004457540 RCX: 0000000000000000 Jul 25 00:57:57 MOZART kernel: RDX: ffffea000f20b0e8 RSI: 0000000000000000 RDI: ffffea000f20b0e8 Jul 25 00:57:57 MOZART kernel: RBP: ffffc9000026bb70 R08: ffffea0004457540 R09: ffff8881789bd000 Jul 25 00:57:57 MOZART kernel: R10: 0000000000000100 R11: 00000000000305e0 R12: ffff88815840aec0 Jul 25 00:57:57 MOZART kernel: R13: 0000147636673000 R14: ffff8883c82c3390 R15: 0000000000000003 Jul 25 00:57:57 MOZART kernel: queued_spin_lock_slowpath+0x7/0xa Jul 25 00:57:57 MOZART kernel: page_vma_mapped_walk+0x417/0x51b Jul 25 00:57:57 MOZART kernel: remove_migration_pte+0x5e/0x22e Jul 25 00:57:57 MOZART kernel: rmap_walk_anon+0xd2/0x13e Jul 25 00:57:57 MOZART kernel: remove_migration_ptes+0x4e/0x68 Jul 25 00:57:57 MOZART kernel: ? page_is_file_lru+0x16/0x16 Jul 25 00:57:57 MOZART kernel: migrate_pages+0x632/0xa08 Jul 25 00:57:57 MOZART kernel: ? compact_lock_irqsave+0x5e/0x5e Jul 25 00:57:57 MOZART kernel: ? release_freepages+0x8f/0x8f Jul 25 00:57:57 MOZART kernel: compact_zone+0x84f/0xa29 Jul 25 00:57:57 MOZART kernel: ? __switch_to_xtra+0x50/0x3d0 Jul 25 00:57:57 MOZART kernel: ? __raw_spin_unlock+0x5/0x6 Jul 25 00:57:57 MOZART kernel: proactive_compact_node+0x7f/0xac Jul 25 00:57:57 MOZART kernel: kcompactd+0x24e/0x29c Jul 25 00:57:57 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 00:57:57 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 00:57:57 MOZART kernel: kthread+0xde/0xe3 Jul 25 00:57:57 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 00:57:57 MOZART kernel: ret_from_fork+0x22/0x30 Jul 25 00:57:57 MOZART kernel: </TASK> Jul 25 00:58:04 MOZART kernel: rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 602454 jiffies s: 2757133 root: 0x8/. Jul 25 00:58:04 MOZART kernel: rcu: blocking rcu_node structures (internal RCU debug): Jul 25 00:58:04 MOZART kernel: Task dump for CPU 3: Jul 25 00:58:04 MOZART kernel: task:kcompactd0 state:R running task stack: 0 pid: 58 ppid: 2 flags:0x00004808 Jul 25 00:58:04 MOZART kernel: Call Trace: Jul 25 00:58:04 MOZART kernel: <TASK> Jul 25 00:58:04 MOZART kernel: ? proactive_compact_node+0x7f/0xac Jul 25 00:58:04 MOZART kernel: ? kcompactd+0x24e/0x29c Jul 25 00:58:04 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 00:58:04 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 00:58:04 MOZART kernel: ? kthread+0xde/0xe3 Jul 25 00:58:04 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 00:58:04 MOZART kernel: ? ret_from_fork+0x22/0x30 Jul 25 00:58:04 MOZART kernel: </TASK> Jul 25 01:00:57 MOZART kernel: rcu: INFO: rcu_sched self-detected stall on CPU Jul 25 01:00:57 MOZART kernel: rcu: #0113-....: (779891 ticks this GP) idle=149/1/0x4000000000000000 softirq=205821660/205821660 fqs=194906 Jul 25 01:00:57 MOZART kernel: #011(t=780012 jiffies g=440205233 q=2680626) Jul 25 01:00:57 MOZART kernel: NMI backtrace for cpu 3 Jul 25 01:00:57 MOZART kernel: CPU: 3 PID: 58 Comm: kcompactd0 Tainted: G D W I 5.15.46-Unraid #1 Jul 25 01:00:57 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Jul 25 01:00:57 MOZART kernel: Call Trace: Jul 25 01:00:57 MOZART kernel: <IRQ> Jul 25 01:00:57 MOZART kernel: dump_stack_lvl+0x46/0x5a Jul 25 01:00:57 MOZART kernel: nmi_cpu_backtrace+0xae/0xd2 Jul 25 01:00:57 MOZART kernel: ? lapic_can_unplug_cpu+0x93/0x93 Jul 25 01:00:57 MOZART kernel: nmi_trigger_cpumask_backtrace+0x56/0xd3 Jul 25 01:00:57 MOZART kernel: rcu_dump_cpu_stacks+0xc3/0xea Jul 25 01:00:57 MOZART kernel: rcu_sched_clock_irq+0x22d/0x631 Jul 25 01:00:57 MOZART kernel: ? _raw_spin_unlock_irqrestore+0xe/0x1b Jul 25 01:00:57 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Jul 25 01:00:57 MOZART kernel: update_process_times+0x8c/0xab Jul 25 01:00:57 MOZART kernel: tick_sched_timer+0x38/0x65 Jul 25 01:00:57 MOZART kernel: __hrtimer_run_queues+0xfa/0x18a Jul 25 01:00:57 MOZART kernel: hrtimer_interrupt+0x92/0x160 Jul 25 01:00:57 MOZART kernel: __sysvec_apic_timer_interrupt+0x99/0xdb Jul 25 01:00:57 MOZART kernel: sysvec_apic_timer_interrupt+0x61/0x7d Jul 25 01:00:57 MOZART kernel: </IRQ> Jul 25 01:00:57 MOZART kernel: <TASK> Jul 25 01:00:57 MOZART kernel: asm_sysvec_apic_timer_interrupt+0x12/0x20 Jul 25 01:00:57 MOZART kernel: RIP: 0010:native_queued_spin_lock_slowpath+0x7e/0x18f Jul 25 01:00:57 MOZART kernel: Code: c1 0f b6 c9 c1 e1 08 30 e4 09 c8 a9 00 01 ff ff 74 0c 0f ba e0 08 72 1a c6 42 01 00 eb 14 85 c0 74 0a 8b 02 84 c0 74 04 f3 90 <eb> f6 66 c7 02 01 00 c3 48 c7 c1 40 c8 02 00 65 48 03 0d f7 93 f6 Jul 25 01:00:57 MOZART kernel: RSP: 0018:ffffc9000026bb20 EFLAGS: 00000202 Jul 25 01:00:57 MOZART kernel: RAX: 0000000000180101 RBX: ffffea0004457540 RCX: 0000000000000000 Jul 25 01:00:57 MOZART kernel: RDX: ffffea000f20b0e8 RSI: 0000000000000000 RDI: ffffea000f20b0e8 Jul 25 01:00:57 MOZART kernel: RBP: ffffc9000026bb70 R08: ffffea0004457540 R09: ffff8881789bd000 Jul 25 01:00:57 MOZART kernel: R10: 0000000000000100 R11: 00000000000305e0 R12: ffff88815840aec0 Jul 25 01:00:57 MOZART kernel: R13: 0000147636673000 R14: ffff8883c82c3390 R15: 0000000000000003 Jul 25 01:00:57 MOZART kernel: queued_spin_lock_slowpath+0x7/0xa Jul 25 01:00:57 MOZART kernel: page_vma_mapped_walk+0x417/0x51b Jul 25 01:00:57 MOZART kernel: remove_migration_pte+0x5e/0x22e Jul 25 01:00:57 MOZART kernel: rmap_walk_anon+0xd2/0x13e Jul 25 01:00:57 MOZART kernel: remove_migration_ptes+0x4e/0x68 Jul 25 01:00:57 MOZART kernel: ? page_is_file_lru+0x16/0x16 Jul 25 01:00:57 MOZART kernel: migrate_pages+0x632/0xa08 Jul 25 01:00:57 MOZART kernel: ? compact_lock_irqsave+0x5e/0x5e Jul 25 01:00:57 MOZART kernel: ? release_freepages+0x8f/0x8f Jul 25 01:00:57 MOZART kernel: compact_zone+0x84f/0xa29 Jul 25 01:00:57 MOZART kernel: ? __switch_to_xtra+0x50/0x3d0 Jul 25 01:00:57 MOZART kernel: ? __raw_spin_unlock+0x5/0x6 Jul 25 01:00:57 MOZART kernel: proactive_compact_node+0x7f/0xac Jul 25 01:00:57 MOZART kernel: kcompactd+0x24e/0x29c Jul 25 01:00:57 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 01:00:57 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 01:00:57 MOZART kernel: kthread+0xde/0xe3 Jul 25 01:00:57 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 01:00:57 MOZART kernel: ret_from_fork+0x22/0x30 Jul 25 01:00:57 MOZART kernel: </TASK> Jul 25 01:01:04 MOZART kernel: rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 782678 jiffies s: 2757133 root: 0x8/. Jul 25 01:01:04 MOZART kernel: rcu: blocking rcu_node structures (internal RCU debug): Jul 25 01:01:04 MOZART kernel: Task dump for CPU 3: Jul 25 01:01:04 MOZART kernel: task:kcompactd0 state:R running task stack: 0 pid: 58 ppid: 2 flags:0x00004808 Jul 25 01:01:04 MOZART kernel: Call Trace: Jul 25 01:01:04 MOZART kernel: <TASK> Jul 25 01:01:04 MOZART kernel: ? proactive_compact_node+0x7f/0xac Jul 25 01:01:04 MOZART kernel: ? kcompactd+0x24e/0x29c Jul 25 01:01:04 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 01:01:04 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 01:01:04 MOZART kernel: ? kthread+0xde/0xe3 Jul 25 01:01:04 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 01:01:04 MOZART kernel: ? ret_from_fork+0x22/0x30 Jul 25 01:01:04 MOZART kernel: </TASK> Jul 25 01:03:57 MOZART kernel: rcu: INFO: rcu_sched self-detected stall on CPU Jul 25 01:03:57 MOZART kernel: rcu: #0113-....: (959866 ticks this GP) idle=149/1/0x4000000000000000 softirq=205821660/205821660 fqs=239882 Jul 25 01:03:57 MOZART kernel: #011(t=960015 jiffies g=440205233 q=3163400) Jul 25 01:03:57 MOZART kernel: NMI backtrace for cpu 3 Jul 25 01:03:57 MOZART kernel: CPU: 3 PID: 58 Comm: kcompactd0 Tainted: G D W I 5.15.46-Unraid #1 Jul 25 01:03:57 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Jul 25 01:03:57 MOZART kernel: Call Trace: Jul 25 01:03:57 MOZART kernel: <IRQ> Jul 25 01:03:57 MOZART kernel: dump_stack_lvl+0x46/0x5a Jul 25 01:03:57 MOZART kernel: nmi_cpu_backtrace+0xae/0xd2 Jul 25 01:03:57 MOZART kernel: ? lapic_can_unplug_cpu+0x93/0x93 Jul 25 01:03:57 MOZART kernel: nmi_trigger_cpumask_backtrace+0x56/0xd3 Jul 25 01:03:57 MOZART kernel: rcu_dump_cpu_stacks+0xc3/0xea Jul 25 01:03:57 MOZART kernel: rcu_sched_clock_irq+0x22d/0x631 Jul 25 01:03:57 MOZART kernel: ? _raw_spin_unlock_irqrestore+0xe/0x1b Jul 25 01:03:57 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Jul 25 01:03:57 MOZART kernel: update_process_times+0x8c/0xab Jul 25 01:03:57 MOZART kernel: tick_sched_timer+0x38/0x65 Jul 25 01:03:57 MOZART kernel: __hrtimer_run_queues+0xfa/0x18a Jul 25 01:03:57 MOZART kernel: hrtimer_interrupt+0x92/0x160 Jul 25 01:03:57 MOZART kernel: __sysvec_apic_timer_interrupt+0x99/0xdb Jul 25 01:03:57 MOZART kernel: sysvec_apic_timer_interrupt+0x61/0x7d Jul 25 01:03:57 MOZART kernel: </IRQ> Jul 25 01:03:57 MOZART kernel: <TASK> Jul 25 01:03:57 MOZART kernel: asm_sysvec_apic_timer_interrupt+0x12/0x20 Jul 25 01:03:57 MOZART kernel: RIP: 0010:native_queued_spin_lock_slowpath+0x7e/0x18f Jul 25 01:03:57 MOZART kernel: Code: c1 0f b6 c9 c1 e1 08 30 e4 09 c8 a9 00 01 ff ff 74 0c 0f ba e0 08 72 1a c6 42 01 00 eb 14 85 c0 74 0a 8b 02 84 c0 74 04 f3 90 <eb> f6 66 c7 02 01 00 c3 48 c7 c1 40 c8 02 00 65 48 03 0d f7 93 f6 Jul 25 01:03:57 MOZART kernel: RSP: 0018:ffffc9000026bb20 EFLAGS: 00000202 Jul 25 01:03:57 MOZART kernel: RAX: 0000000000180101 RBX: ffffea0004457540 RCX: 0000000000000000 Jul 25 01:03:57 MOZART kernel: RDX: ffffea000f20b0e8 RSI: 0000000000000000 RDI: ffffea000f20b0e8 Jul 25 01:03:57 MOZART kernel: RBP: ffffc9000026bb70 R08: ffffea0004457540 R09: ffff8881789bd000 Jul 25 01:03:57 MOZART kernel: R10: 0000000000000100 R11: 00000000000305e0 R12: ffff88815840aec0 Jul 25 01:03:57 MOZART kernel: R13: 0000147636673000 R14: ffff8883c82c3390 R15: 0000000000000003 Jul 25 01:03:57 MOZART kernel: queued_spin_lock_slowpath+0x7/0xa Jul 25 01:03:57 MOZART kernel: page_vma_mapped_walk+0x417/0x51b Jul 25 01:03:57 MOZART kernel: remove_migration_pte+0x5e/0x22e Jul 25 01:03:57 MOZART kernel: rmap_walk_anon+0xd2/0x13e Jul 25 01:03:57 MOZART kernel: remove_migration_ptes+0x4e/0x68 Jul 25 01:03:57 MOZART kernel: ? page_is_file_lru+0x16/0x16 Jul 25 01:03:57 MOZART kernel: migrate_pages+0x632/0xa08 Jul 25 01:03:57 MOZART kernel: ? compact_lock_irqsave+0x5e/0x5e Jul 25 01:03:57 MOZART kernel: ? release_freepages+0x8f/0x8f Jul 25 01:03:57 MOZART kernel: compact_zone+0x84f/0xa29 Jul 25 01:03:57 MOZART kernel: ? __switch_to_xtra+0x50/0x3d0 Jul 25 01:03:57 MOZART kernel: ? __raw_spin_unlock+0x5/0x6 Jul 25 01:03:57 MOZART kernel: proactive_compact_node+0x7f/0xac Jul 25 01:03:57 MOZART kernel: kcompactd+0x24e/0x29c Jul 25 01:03:57 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 01:03:57 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 01:03:57 MOZART kernel: kthread+0xde/0xe3 Jul 25 01:03:57 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 01:03:57 MOZART kernel: ret_from_fork+0x22/0x30 Jul 25 01:03:57 MOZART kernel: </TASK> Jul 25 01:04:05 MOZART kernel: rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 962902 jiffies s: 2757133 root: 0x8/. Jul 25 01:04:05 MOZART kernel: rcu: blocking rcu_node structures (internal RCU debug): Jul 25 01:04:05 MOZART kernel: Task dump for CPU 3: Jul 25 01:04:05 MOZART kernel: task:kcompactd0 state:R running task stack: 0 pid: 58 ppid: 2 flags:0x00004808 Jul 25 01:04:05 MOZART kernel: Call Trace: Jul 25 01:04:05 MOZART kernel: <TASK> Jul 25 01:04:05 MOZART kernel: ? proactive_compact_node+0x7f/0xac Jul 25 01:04:05 MOZART kernel: ? kcompactd+0x24e/0x29c Jul 25 01:04:05 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 01:04:05 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 01:04:05 MOZART kernel: ? kthread+0xde/0xe3 Jul 25 01:04:05 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 01:04:05 MOZART kernel: ? ret_from_fork+0x22/0x30 Jul 25 01:04:05 MOZART kernel: </TASK> Jul 25 01:06:34 MOZART emhttpd: spinning down /dev/sdb Jul 25 01:06:57 MOZART kernel: rcu: INFO: rcu_sched self-detected stall on CPU Jul 25 01:06:57 MOZART kernel: rcu: #0113-....: (1139841 ticks this GP) idle=149/1/0x4000000000000000 softirq=205821660/205821660 fqs=284856 Jul 25 01:06:57 MOZART kernel: #011(t=1140018 jiffies g=440205233 q=3674408) Jul 25 01:06:57 MOZART kernel: NMI backtrace for cpu 3 Jul 25 01:06:57 MOZART kernel: CPU: 3 PID: 58 Comm: kcompactd0 Tainted: G D W I 5.15.46-Unraid #1 Jul 25 01:06:57 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Jul 25 01:06:57 MOZART kernel: Call Trace: Jul 25 01:06:57 MOZART kernel: <IRQ> Jul 25 01:06:57 MOZART kernel: dump_stack_lvl+0x46/0x5a Jul 25 01:06:57 MOZART kernel: nmi_cpu_backtrace+0xae/0xd2 Jul 25 01:06:57 MOZART kernel: ? lapic_can_unplug_cpu+0x93/0x93 Jul 25 01:06:57 MOZART kernel: nmi_trigger_cpumask_backtrace+0x56/0xd3 Jul 25 01:06:57 MOZART kernel: rcu_dump_cpu_stacks+0xc3/0xea Jul 25 01:06:57 MOZART kernel: rcu_sched_clock_irq+0x22d/0x631 Jul 25 01:06:57 MOZART kernel: ? _raw_spin_unlock_irqrestore+0xe/0x1b Jul 25 01:06:57 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Jul 25 01:06:57 MOZART kernel: update_process_times+0x8c/0xab Jul 25 01:06:57 MOZART kernel: tick_sched_timer+0x38/0x65 Jul 25 01:06:57 MOZART kernel: __hrtimer_run_queues+0xfa/0x18a Jul 25 01:06:57 MOZART kernel: hrtimer_interrupt+0x92/0x160 Jul 25 01:06:57 MOZART kernel: __sysvec_apic_timer_interrupt+0x99/0xdb Jul 25 01:06:57 MOZART kernel: sysvec_apic_timer_interrupt+0x61/0x7d Jul 25 01:06:57 MOZART kernel: </IRQ> Jul 25 01:06:57 MOZART kernel: <TASK> Jul 25 01:06:57 MOZART kernel: asm_sysvec_apic_timer_interrupt+0x12/0x20 Jul 25 01:06:57 MOZART kernel: RIP: 0010:native_queued_spin_lock_slowpath+0x7e/0x18f Jul 25 01:06:57 MOZART kernel: Code: c1 0f b6 c9 c1 e1 08 30 e4 09 c8 a9 00 01 ff ff 74 0c 0f ba e0 08 72 1a c6 42 01 00 eb 14 85 c0 74 0a 8b 02 84 c0 74 04 f3 90 <eb> f6 66 c7 02 01 00 c3 48 c7 c1 40 c8 02 00 65 48 03 0d f7 93 f6 Jul 25 01:06:57 MOZART kernel: RSP: 0018:ffffc9000026bb20 EFLAGS: 00000202 Jul 25 01:06:57 MOZART kernel: RAX: 0000000000180101 RBX: ffffea0004457540 RCX: 0000000000000000 Jul 25 01:06:57 MOZART kernel: RDX: ffffea000f20b0e8 RSI: 0000000000000000 RDI: ffffea000f20b0e8 Jul 25 01:06:57 MOZART kernel: RBP: ffffc9000026bb70 R08: ffffea0004457540 R09: ffff8881789bd000 Jul 25 01:06:57 MOZART kernel: R10: 0000000000000100 R11: 00000000000305e0 R12: ffff88815840aec0 Jul 25 01:06:57 MOZART kernel: R13: 0000147636673000 R14: ffff8883c82c3390 R15: 0000000000000003 Jul 25 01:06:57 MOZART kernel: queued_spin_lock_slowpath+0x7/0xa Jul 25 01:06:57 MOZART kernel: page_vma_mapped_walk+0x417/0x51b Jul 25 01:06:57 MOZART kernel: remove_migration_pte+0x5e/0x22e Jul 25 01:06:57 MOZART kernel: rmap_walk_anon+0xd2/0x13e Jul 25 01:06:57 MOZART kernel: remove_migration_ptes+0x4e/0x68 Jul 25 01:06:57 MOZART kernel: ? page_is_file_lru+0x16/0x16 Jul 25 01:06:57 MOZART kernel: migrate_pages+0x632/0xa08 Jul 25 01:06:57 MOZART kernel: ? compact_lock_irqsave+0x5e/0x5e Jul 25 01:06:57 MOZART kernel: ? release_freepages+0x8f/0x8f Jul 25 01:06:57 MOZART kernel: compact_zone+0x84f/0xa29 Jul 25 01:06:57 MOZART kernel: ? __switch_to_xtra+0x50/0x3d0 Jul 25 01:06:57 MOZART kernel: ? __raw_spin_unlock+0x5/0x6 Jul 25 01:06:57 MOZART kernel: proactive_compact_node+0x7f/0xac Jul 25 01:06:57 MOZART kernel: kcompactd+0x24e/0x29c Jul 25 01:06:57 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 01:06:57 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 01:06:57 MOZART kernel: kthread+0xde/0xe3 Jul 25 01:06:57 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 01:06:57 MOZART kernel: ret_from_fork+0x22/0x30 Jul 25 01:06:57 MOZART kernel: </TASK> Jul 25 01:07:05 MOZART kernel: rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 1143126 jiffies s: 2757133 root: 0x8/. Jul 25 01:07:05 MOZART kernel: rcu: blocking rcu_node structures (internal RCU debug): Jul 25 01:07:05 MOZART kernel: Task dump for CPU 3: Jul 25 01:07:05 MOZART kernel: task:kcompactd0 state:R running task stack: 0 pid: 58 ppid: 2 flags:0x00004808 Jul 25 01:07:05 MOZART kernel: Call Trace: Jul 25 01:07:05 MOZART kernel: <TASK> Jul 25 01:07:05 MOZART kernel: ? proactive_compact_node+0x7f/0xac Jul 25 01:07:05 MOZART kernel: ? kcompactd+0x24e/0x29c Jul 25 01:07:05 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 01:07:05 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 01:07:05 MOZART kernel: ? kthread+0xde/0xe3 Jul 25 01:07:05 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 01:07:05 MOZART kernel: ? ret_from_fork+0x22/0x30 Jul 25 01:07:05 MOZART kernel: </TASK> Jul 25 01:09:57 MOZART kernel: rcu: INFO: rcu_sched self-detected stall on CPU Jul 25 01:09:57 MOZART kernel: rcu: #0113-....: (1319816 ticks this GP) idle=149/1/0x4000000000000000 softirq=205821660/205821660 fqs=329827 Jul 25 01:09:57 MOZART kernel: #011(t=1320021 jiffies g=440205233 q=4202851) Jul 25 01:09:57 MOZART kernel: NMI backtrace for cpu 3 Jul 25 01:09:57 MOZART kernel: CPU: 3 PID: 58 Comm: kcompactd0 Tainted: G D W I 5.15.46-Unraid #1 Jul 25 01:09:57 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Jul 25 01:09:57 MOZART kernel: Call Trace: Jul 25 01:09:57 MOZART kernel: <IRQ> Jul 25 01:09:57 MOZART kernel: dump_stack_lvl+0x46/0x5a Jul 25 01:09:57 MOZART kernel: nmi_cpu_backtrace+0xae/0xd2 Jul 25 01:09:57 MOZART kernel: ? lapic_can_unplug_cpu+0x93/0x93 Jul 25 01:09:57 MOZART kernel: nmi_trigger_cpumask_backtrace+0x56/0xd3 Jul 25 01:09:57 MOZART kernel: rcu_dump_cpu_stacks+0xc3/0xea Jul 25 01:09:57 MOZART kernel: rcu_sched_clock_irq+0x22d/0x631 Jul 25 01:09:57 MOZART kernel: ? _raw_spin_unlock_irqrestore+0xe/0x1b Jul 25 01:09:57 MOZART kernel: ? tick_sched_do_timer+0x3e/0x3e Jul 25 01:09:57 MOZART kernel: update_process_times+0x8c/0xab Jul 25 01:09:57 MOZART kernel: tick_sched_timer+0x38/0x65 Jul 25 01:09:57 MOZART kernel: __hrtimer_run_queues+0xfa/0x18a Jul 25 01:09:57 MOZART kernel: hrtimer_interrupt+0x92/0x160 Jul 25 01:09:57 MOZART kernel: __sysvec_apic_timer_interrupt+0x99/0xdb Jul 25 01:09:57 MOZART kernel: sysvec_apic_timer_interrupt+0x61/0x7d Jul 25 01:09:57 MOZART kernel: </IRQ> Jul 25 01:09:57 MOZART kernel: <TASK> Jul 25 01:09:57 MOZART kernel: asm_sysvec_apic_timer_interrupt+0x12/0x20 Jul 25 01:09:57 MOZART kernel: RIP: 0010:native_queued_spin_lock_slowpath+0x7e/0x18f Jul 25 01:09:57 MOZART kernel: Code: c1 0f b6 c9 c1 e1 08 30 e4 09 c8 a9 00 01 ff ff 74 0c 0f ba e0 08 72 1a c6 42 01 00 eb 14 85 c0 74 0a 8b 02 84 c0 74 04 f3 90 <eb> f6 66 c7 02 01 00 c3 48 c7 c1 40 c8 02 00 65 48 03 0d f7 93 f6 Jul 25 01:09:57 MOZART kernel: RSP: 0018:ffffc9000026bb20 EFLAGS: 00000202 Jul 25 01:09:57 MOZART kernel: RAX: 0000000000180101 RBX: ffffea0004457540 RCX: 0000000000000000 Jul 25 01:09:57 MOZART kernel: RDX: ffffea000f20b0e8 RSI: 0000000000000000 RDI: ffffea000f20b0e8 Jul 25 01:09:57 MOZART kernel: RBP: ffffc9000026bb70 R08: ffffea0004457540 R09: ffff8881789bd000 Jul 25 01:09:57 MOZART kernel: R10: 0000000000000100 R11: 00000000000305e0 R12: ffff88815840aec0 Jul 25 01:09:57 MOZART kernel: R13: 0000147636673000 R14: ffff8883c82c3390 R15: 0000000000000003 Jul 25 01:09:57 MOZART kernel: queued_spin_lock_slowpath+0x7/0xa Jul 25 01:09:57 MOZART kernel: page_vma_mapped_walk+0x417/0x51b Jul 25 01:09:57 MOZART kernel: remove_migration_pte+0x5e/0x22e Jul 25 01:09:57 MOZART kernel: rmap_walk_anon+0xd2/0x13e Jul 25 01:09:57 MOZART kernel: remove_migration_ptes+0x4e/0x68 Jul 25 01:09:57 MOZART kernel: ? page_is_file_lru+0x16/0x16 Jul 25 01:09:57 MOZART kernel: migrate_pages+0x632/0xa08 Jul 25 01:09:57 MOZART kernel: ? compact_lock_irqsave+0x5e/0x5e Jul 25 01:09:57 MOZART kernel: ? release_freepages+0x8f/0x8f Jul 25 01:09:57 MOZART kernel: compact_zone+0x84f/0xa29 Jul 25 01:09:57 MOZART kernel: ? __switch_to_xtra+0x50/0x3d0 Jul 25 01:09:57 MOZART kernel: ? __raw_spin_unlock+0x5/0x6 Jul 25 01:09:57 MOZART kernel: proactive_compact_node+0x7f/0xac Jul 25 01:09:57 MOZART kernel: kcompactd+0x24e/0x29c Jul 25 01:09:57 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 01:09:57 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 01:09:57 MOZART kernel: kthread+0xde/0xe3 Jul 25 01:09:57 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 01:09:57 MOZART kernel: ret_from_fork+0x22/0x30 Jul 25 01:09:57 MOZART kernel: </TASK> Jul 25 01:10:00 MOZART webGUI: Successful login user root from 192.168.92.185 Jul 25 01:10:05 MOZART kernel: rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 1323350 jiffies s: 2757133 root: 0x8/. Jul 25 01:10:05 MOZART kernel: rcu: blocking rcu_node structures (internal RCU debug): Jul 25 01:10:05 MOZART kernel: Task dump for CPU 3: Jul 25 01:10:05 MOZART kernel: task:kcompactd0 state:R running task stack: 0 pid: 58 ppid: 2 flags:0x00004808 Jul 25 01:10:05 MOZART kernel: Call Trace: Jul 25 01:10:05 MOZART kernel: <TASK> Jul 25 01:10:05 MOZART kernel: ? proactive_compact_node+0x7f/0xac Jul 25 01:10:05 MOZART kernel: ? kcompactd+0x24e/0x29c Jul 25 01:10:05 MOZART kernel: ? init_wait_entry+0x29/0x29 Jul 25 01:10:05 MOZART kernel: ? kcompactd_do_work+0x1bd/0x1bd Jul 25 01:10:05 MOZART kernel: ? kthread+0xde/0xe3 Jul 25 01:10:05 MOZART kernel: ? set_kthread_struct+0x32/0x32 Jul 25 01:10:05 MOZART kernel: ? ret_from_fork+0x22/0x30 Jul 25 01:10:05 MOZART kernel: </TASK>

  17. [Plugin] CA User Scripts

    Opawesome replied to Squid's topic in Plugin Support
    Have you tried this: 'Update UD Preclear and reboot' ?

  18. [Plugin] CA User Scripts

    Opawesome replied to Squid's topic in Plugin Support
    Hi @dlandon, Indeed, updating with UD Preclear plugin to version 2022.07.11 ("Fix: Revert tmux to 3.1b for Unraid 6.10") fixed the issue with the User Scripts plugin on my system. Many thanks (for this fix, and for your work in general on your plugins). Best regards, OP

  19. [Plugin] CA User Scripts

    Opawesome replied to Squid's topic in Plugin Support
    Hi @Squid, Thank you again for your wonderful plugin. Here is my issue: Since upgrade to Unrid 6.10.2 it seems that "run in background" function does not work any more on my system. When I click it, the usual popup "Now starting the script in the background' shows up, but after clicking "done", the script does not shows as "running" and the "view log", "download log" and "abort" button do not show up. The paths to the scripts are as follows (with no puntuation): /tmp/user.scripts/tmpScripts/unraid_fix-files-owner-and-permissions/script /tmp/user.scripts/tmpScripts/unraid_backup-flash-to-mozart/script Any idea on how to fix this ? Many thanks, OP EDIT: It seems that scheduled scripts are not running either (i.e. when "At startup of the array" is selected from the dropdown menu). .

  20. [Script] Backup LUKS headers of encrypted devices

    Opawesome replied to Opawesome's topic in User Customizations
    Hi @Grimlious, Reading that error, it looks like you are trying to run the "restore" command i mentionned in my original post and not the script inside the .zip archive attached to it. Can you confirm that you downloaded the attached .zip file and run the script contained therein ? With regards, OP

  21. libvirt.img is in-use, cannot mount

    Opawesome replied to PR.'s topic in VM Engine (KVM)
    I encoutered the issue again today. Here is the output of what you suggested: BEFORE STOPPING THE ARRAY: root@MOZART:~# losetup -l NAME SIZELIMIT OFFSET AUTOCLEAR RO BACK-FILE DIO LOG-SEC /dev/loop1 0 0 1 1 /boot/bzfirmware 0 512 /dev/loop2 0 0 1 0 /mnt/cache/system/libvirt/libvirt.img 1 512 /dev/loop0 0 0 1 1 /boot/bzmodules 0 512 /dev/loop3 0 0 1 0 /mnt/cache/system/docker/docker.img 1 512 root@MOZART:~# LOOPDEV_DEBUG=all losetup -vd /dev/loop2 24350: loopdev: CXT: [0x7fffc39eaf60]: initialize context 24350: loopdev: CXT: [0x7fffc39eaf60]: init: ignore ioctls 24350: loopdev: CXT: [0x7fffc39eaf60]: init: loop-control detected 24350: loopdev: CXT: [0x7fffc39eaf60]: /dev/loop2 name assigned 24350: loopdev: CXT: [0x7fffc39eaf60]: open /dev/loop2 [ro]: No such file or directory 24350: loopdev: CXT: [0x7fffc39eaf60]: device removed 24350: loopdev: CXT: [0x7fffc39eaf60]: de-initialize 24350: loopdev: CXT: [0x7fffc39eaf60]: closing old open fd 24350: loopdev: ITER: [0x7fffc39eb0f0]: de-initialize root@MOZART:~# AFTER STOPPING THE ARRAY: root@MOZART:~# losetup -l NAME SIZELIMIT OFFSET AUTOCLEAR RO BACK-FILE DIO LOG-SEC /dev/loop1 0 0 1 1 /boot/bzfirmware 0 512 /dev/loop0 0 0 1 1 /boot/bzmodules 0 512 root@MOZART:~# I hope this helps and that @limetech will be able to fix this issue. Best, OP

  22. BTRFS errors

    Opawesome replied to Opawesome's topic in General Support
    Hi @JorgeB - Thank you for your answer. I have rebooted and will do that today. I would still appreciate it if someone had additional information as to what caused this error. Many thanks, OP

  23. BTRFS errors

    Opawesome posted a topic in General Support
    Hi all ! This night I encountered a series of kernel errors mentionning BTRFS. The only BTRFS volume on my system is my encrypted cache drive. Then thousands of rsyslogd errors occured relating to syslog, mentionning that the syslog file (which is on the above cache drive) could not be written to. Does anyone have an idea of what caused the kernel errors and how I can prevent them from occuring again ? Below is the relevant abstract from UNRAID logs, and attached are the UNRAID diagnotic files. Many thanks, OP Feb 8 04:38:06 MOZART kernel: ------------[ cut here ]------------ Feb 8 04:38:06 MOZART kernel: WARNING: CPU: 3 PID: 31247 at fs/btrfs/extent-tree.c:3086 __btrfs_free_extent+0x236/0xb20 Feb 8 04:38:06 MOZART kernel: Modules linked in: xt_owner vhost_net vhost vhost_iotlb tap kvm_intel kvm xt_mark xt_CHECKSUM ipt_REJECT nf_reject_ipv4 ip6table_mangle ip6table_nat iptable_mangle nf_tables wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libblake2s blake2s_x86_64 libblake2s_generic libchacha macvlan veth xt_nat xt_tcpudp xt_conntrack nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_multiport xfs dm_crypt dm_mod dax md_mod iptable_nat xt_MASQUERADE nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 tun i915 iosf_mbi drm_kms_helper drm intel_gtt agpgart syscopyarea sysfillrect sysimgblt fb_sys_fops ip6table_filter ip6_tables iptable_filter ip_tables x_tables igb i2c_algo_bit x86_pkg_temp_thermal intel_powerclamp coretemp crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel crypto_simd cryptd ipmi_ssif glue_helper nvme rapl intel_cstate mpt3sas intel_uncore nvme_core i2c_i801 raid_class Feb 8 04:38:06 MOZART kernel: acpi_power_meter i2c_smbus input_leds scsi_transport_sas i2c_core ahci led_class intel_pch_thermal video libahci acpi_ipmi ie31200_edac backlight ipmi_si thermal acpi_pad button fan [last unloaded: vhost_iotlb] Feb 8 04:38:06 MOZART kernel: CPU: 3 PID: 31247 Comm: worker Tainted: G U W I 5.10.28-Unraid #1 Feb 8 04:38:06 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Feb 8 04:38:06 MOZART kernel: RIP: 0010:__btrfs_free_extent+0x236/0xb20 Feb 8 04:38:06 MOZART kernel: Code: 75 0f 48 8b 04 24 48 39 44 24 70 0f 84 c4 00 00 00 41 8b 45 40 29 d8 83 f8 05 0f 8f 94 06 00 00 ff cb eb a3 41 83 fc fe 75 6d <0f> 0b 49 8b 7d 00 e8 a5 43 00 00 49 89 d8 4c 89 f1 4c 89 ff ff 74 Feb 8 04:38:06 MOZART kernel: RSP: 0018:ffffc90001f57c18 EFLAGS: 00010246 Feb 8 04:38:06 MOZART kernel: RAX: 00000000fffffffe RBX: 0000000000000007 RCX: 0000000000000000 Feb 8 04:38:06 MOZART kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff888479359070 Feb 8 04:38:06 MOZART kernel: RBP: ffff88819dfc56e8 R08: 0000000000000000 R09: ffff88810c17aa50 Feb 8 04:38:06 MOZART kernel: R10: 0000000000000002 R11: 0000000000000087 R12: 00000000fffffffe Feb 8 04:38:06 MOZART kernel: R13: ffff888479359070 R14: 0000000000000000 R15: ffff888188f5a000 Feb 8 04:38:06 MOZART kernel: FS: 0000148e96132700(0000) GS:ffff8890452c0000(0000) knlGS:0000000000000000 Feb 8 04:38:06 MOZART kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Feb 8 04:38:06 MOZART kernel: CR2: 00007fffa89d67c8 CR3: 0000000290a46004 CR4: 00000000003726e0 Feb 8 04:38:06 MOZART kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Feb 8 04:38:06 MOZART kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Feb 8 04:38:06 MOZART kernel: Call Trace: Feb 8 04:38:06 MOZART kernel: ? btrfs_merge_delayed_refs+0x91/0x17d Feb 8 04:38:06 MOZART kernel: __btrfs_run_delayed_refs+0x65b/0xab8 Feb 8 04:38:06 MOZART kernel: btrfs_run_delayed_refs+0x58/0x12c Feb 8 04:38:06 MOZART kernel: btrfs_commit_transaction+0x57/0x9cc Feb 8 04:38:06 MOZART kernel: ? __raw_spin_unlock_irq+0x5/0xd Feb 8 04:38:06 MOZART kernel: ? btrfs_lookup_first_ordered_extent+0x47/0x50 Feb 8 04:38:06 MOZART kernel: ? btrfs_wait_ordered_range+0x6f/0xde Feb 8 04:38:06 MOZART kernel: btrfs_sync_file+0x2d1/0x340 Feb 8 04:38:06 MOZART kernel: do_fsync+0x2a/0x44 Feb 8 04:38:06 MOZART kernel: __x64_sys_fdatasync+0xe/0x11 Feb 8 04:38:06 MOZART kernel: do_syscall_64+0x5d/0x6a Feb 8 04:38:06 MOZART kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9 Feb 8 04:38:06 MOZART kernel: RIP: 0033:0x1490bffcc18b Feb 8 04:38:06 MOZART kernel: Code: 0f 05 48 3d 00 f0 ff ff 77 45 c3 0f 1f 40 00 48 83 ec 18 89 7c 24 0c e8 e3 2c f8 ff 8b 7c 24 0c 41 89 c0 b8 4b 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 2f 44 89 c7 89 44 24 0c e8 21 2d f8 ff 8b 44 Feb 8 04:38:06 MOZART kernel: RSP: 002b:0000148e9612ff40 EFLAGS: 00000293 ORIG_RAX: 000000000000004b Feb 8 04:38:06 MOZART kernel: RAX: ffffffffffffffda RBX: 00001490be865dd0 RCX: 00001490bffcc18b Feb 8 04:38:06 MOZART kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: 000000000000000c Feb 8 04:38:06 MOZART kernel: RBP: 00001490be87d0f0 R08: 0000000000000000 R09: 00000000ffffffff Feb 8 04:38:06 MOZART kernel: R10: 0000148e9612ff30 R11: 0000000000000293 R12: 000055da03fc18b0 Feb 8 04:38:06 MOZART kernel: R13: 00001490be87d158 R14: 00001490bdfc0690 R15: 00001490be87d0e0 Feb 8 04:38:06 MOZART kernel: ---[ end trace 36c0d627e375738b ]--- Feb 8 04:38:06 MOZART kernel: BTRFS info (device dm-12): leaf 426908631040 gen 819661 total ptrs 101 free space 8405 owner 2 Feb 8 04:38:06 MOZART kernel: item 0 key (1216556290048 168 69632) itemoff 16230 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15212658688 count 1 Feb 8 04:38:06 MOZART kernel: item 1 key (1216556359680 168 36864) itemoff 16177 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15212744704 count 1 Feb 8 04:38:06 MOZART kernel: item 2 key (1216556396544 168 4096) itemoff 16124 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15213514752 count 1 Feb 8 04:38:06 MOZART kernel: item 3 key (1216556400640 168 159744) itemoff 16071 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15213584384 count 1 Feb 8 04:38:06 MOZART kernel: item 4 key (1216556560384 168 688128) itemoff 16018 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 2 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15213785088 count 2 Feb 8 04:38:06 MOZART kernel: item 5 key (1216557248512 168 172032) itemoff 15965 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15214477312 count 1 Feb 8 04:38:06 MOZART kernel: item 6 key (1216557420544 168 4096) itemoff 15912 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15214690304 count 1 Feb 8 04:38:06 MOZART kernel: item 7 key (1216557424640 168 196608) itemoff 15859 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15214968832 count 1 Feb 8 04:38:06 MOZART kernel: item 8 key (1216557621248 168 380928) itemoff 15806 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15215230976 count 1 Feb 8 04:38:06 MOZART kernel: item 9 key (1216558002176 168 20480) itemoff 15753 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15215616000 count 1 Feb 8 04:38:06 MOZART kernel: item 10 key (1216558022656 168 102400) itemoff 15700 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15215644672 count 1 Feb 8 04:38:06 MOZART kernel: item 11 key (1216558125056 168 8192) itemoff 15647 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15215755264 count 1 Feb 8 04:38:06 MOZART kernel: item 12 key (1216558133248 168 69632) itemoff 15594 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15215788032 count 1 Feb 8 04:38:06 MOZART kernel: item 13 key (1216558202880 168 8192) itemoff 15541 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15215869952 count 1 Feb 8 04:38:06 MOZART kernel: item 14 key (1216558211072 168 32768) itemoff 15488 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15215943680 count 1 Feb 8 04:38:06 MOZART kernel: item 15 key (1216558243840 168 499712) itemoff 15435 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15215980544 count 1 Feb 8 04:38:06 MOZART kernel: item 16 key (1216558743552 168 16384) itemoff 15382 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15216549888 count 1 Feb 8 04:38:06 MOZART kernel: item 17 key (1216558759936 168 200704) itemoff 15329 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15216574464 count 1 Feb 8 04:38:06 MOZART kernel: item 18 key (1216558960640 168 434176) itemoff 15276 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15216779264 count 1 Feb 8 04:38:06 MOZART kernel: item 19 key (1216559394816 168 8192) itemoff 15223 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15217299456 count 1 Feb 8 04:38:06 MOZART kernel: item 20 key (1216559403008 168 32768) itemoff 15170 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15217315840 count 1 Feb 8 04:38:06 MOZART kernel: item 21 key (1216559435776 168 512000) itemoff 15117 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15217696768 count 1 Feb 8 04:38:06 MOZART kernel: item 22 key (1216559947776 168 8192) itemoff 15064 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15218262016 count 1 Feb 8 04:38:06 MOZART kernel: item 23 key (1216559955968 168 20480) itemoff 15011 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15218274304 count 1 Feb 8 04:38:06 MOZART kernel: item 24 key (1216559976448 168 16384) itemoff 14958 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15218302976 count 1 Feb 8 04:38:06 MOZART kernel: item 25 key (1216559992832 168 176128) itemoff 14905 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15218323456 count 1 Feb 8 04:38:06 MOZART kernel: item 26 key (1216560168960 168 466944) itemoff 14852 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15219507200 count 1 Feb 8 04:38:06 MOZART kernel: item 27 key (1216560635904 168 40960) itemoff 14799 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15219982336 count 1 Feb 8 04:38:06 MOZART kernel: item 28 key (1216560676864 168 98304) itemoff 14746 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15220027392 count 1 Feb 8 04:38:06 MOZART kernel: item 29 key (1216560775168 168 4096) itemoff 14693 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15220158464 count 1 Feb 8 04:38:06 MOZART kernel: item 30 key (1216560779264 168 12288) itemoff 14640 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15220256768 count 1 Feb 8 04:38:06 MOZART kernel: item 31 key (1216560791552 168 94208) itemoff 14587 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15220273152 count 1 Feb 8 04:38:06 MOZART kernel: item 32 key (1216560885760 168 61440) itemoff 14534 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15220371456 count 1 Feb 8 04:38:06 MOZART kernel: item 33 key (1216560947200 168 45056) itemoff 14481 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15220518912 count 1 Feb 8 04:38:06 MOZART kernel: item 34 key (1216560992256 168 8192) itemoff 14428 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15220580352 count 1 Feb 8 04:38:06 MOZART kernel: item 35 key (1216561000448 168 258048) itemoff 14375 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15220592640 count 1 Feb 8 04:38:06 MOZART kernel: item 36 key (1216561258496 168 8192) itemoff 14322 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15220854784 count 1 Feb 8 04:38:06 MOZART kernel: item 37 key (1216561266688 168 122880) itemoff 14269 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15221125120 count 1 Feb 8 04:38:06 MOZART kernel: item 38 key (1216561389568 168 196608) itemoff 14216 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15221268480 count 1 Feb 8 04:38:06 MOZART kernel: item 39 key (1216561586176 168 28672) itemoff 14163 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15221518336 count 1 Feb 8 04:38:06 MOZART kernel: item 40 key (1216561614848 168 180224) itemoff 14110 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15223091200 count 1 Feb 8 04:38:06 MOZART kernel: item 41 key (1216561795072 168 114688) itemoff 14057 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15224004608 count 1 Feb 8 04:38:06 MOZART kernel: item 42 key (1216561909760 168 8192) itemoff 14004 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15224127488 count 1 Feb 8 04:38:06 MOZART kernel: item 43 key (1216561917952 168 20480) itemoff 13951 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15224176640 count 1 Feb 8 04:38:06 MOZART kernel: item 44 key (1216561938432 168 24576) itemoff 13898 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15224205312 count 1 Feb 8 04:38:06 MOZART kernel: item 45 key (1216561963008 168 106496) itemoff 13845 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15224233984 count 1 Feb 8 04:38:06 MOZART kernel: item 46 key (1216562069504 168 20480) itemoff 13792 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15224348672 count 1 Feb 8 04:38:06 MOZART kernel: item 47 key (1216562089984 168 110592) itemoff 13739 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15224373248 count 1 Feb 8 04:38:06 MOZART kernel: item 48 key (1216562200576 168 98304) itemoff 13686 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15224487936 count 1 Feb 8 04:38:06 MOZART kernel: item 49 key (1216562298880 168 69632) itemoff 13633 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15224614912 count 1 Feb 8 04:38:06 MOZART kernel: item 50 key (1216562368512 168 307200) itemoff 13580 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15224750080 count 1 Feb 8 04:38:06 MOZART kernel: item 51 key (1216562675712 168 28672) itemoff 13527 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15225319424 count 1 Feb 8 04:38:06 MOZART kernel: item 52 key (1216562704384 168 163840) itemoff 13474 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15225610240 count 1 Feb 8 04:38:06 MOZART kernel: item 53 key (1216562868224 168 176128) itemoff 13421 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15225798656 count 1 Feb 8 04:38:06 MOZART kernel: item 54 key (1216563044352 168 16384) itemoff 13368 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15225978880 count 1 Feb 8 04:38:06 MOZART kernel: item 55 key (1216563060736 168 98304) itemoff 13315 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15226003456 count 1 Feb 8 04:38:06 MOZART kernel: item 56 key (1216563159040 168 65536) itemoff 13262 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15226122240 count 1 Feb 8 04:38:06 MOZART kernel: item 57 key (1216563224576 168 172032) itemoff 13209 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15226200064 count 1 Feb 8 04:38:06 MOZART kernel: item 58 key (1216563396608 168 16384) itemoff 13156 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15226421248 count 1 Feb 8 04:38:06 MOZART kernel: item 59 key (1216563412992 168 8192) itemoff 13103 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15226454016 count 1 Feb 8 04:38:06 MOZART kernel: item 60 key (1216563421184 168 208896) itemoff 13050 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15226593280 count 1 Feb 8 04:38:06 MOZART kernel: item 61 key (1216563630080 168 393216) itemoff 12997 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15227117568 count 1 Feb 8 04:38:06 MOZART kernel: item 62 key (1216564023296 168 12288) itemoff 12944 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15227518976 count 1 Feb 8 04:38:06 MOZART kernel: item 63 key (1216564035584 168 4096) itemoff 12891 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15227609088 count 1 Feb 8 04:38:06 MOZART kernel: item 64 key (1216564039680 168 24576) itemoff 12838 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15227674624 count 1 Feb 8 04:38:06 MOZART kernel: item 65 key (1216564064256 168 602112) itemoff 12785 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15227715584 count 1 Feb 8 04:38:06 MOZART kernel: item 66 key (1216564666368 168 12288) itemoff 12732 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15228420096 count 1 Feb 8 04:38:06 MOZART kernel: item 67 key (1216564678656 168 65536) itemoff 12679 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15228448768 count 1 Feb 8 04:38:06 MOZART kernel: item 68 key (1216564744192 168 90112) itemoff 12626 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15228530688 count 1 Feb 8 04:38:06 MOZART kernel: item 69 key (1216564834304 168 143360) itemoff 12573 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15228637184 count 1 Feb 8 04:38:06 MOZART kernel: item 70 key (1216564977664 168 69632) itemoff 12520 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15228813312 count 1 Feb 8 04:38:06 MOZART kernel: item 71 key (1216565047296 168 335872) itemoff 12467 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15228887040 count 1 Feb 8 04:38:06 MOZART kernel: item 72 key (1216565383168 168 8192) itemoff 12414 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15229325312 count 1 Feb 8 04:38:06 MOZART kernel: item 73 key (1216565391360 168 24576) itemoff 12361 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15229722624 count 1 Feb 8 04:38:06 MOZART kernel: item 74 key (1216565415936 168 94208) itemoff 12308 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15233806336 count 1 Feb 8 04:38:06 MOZART kernel: item 75 key (1216565510144 168 172032) itemoff 12255 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15234707456 count 1 Feb 8 04:38:06 MOZART kernel: item 76 key (1216565682176 168 225280) itemoff 12202 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15236964352 count 1 Feb 8 04:38:06 MOZART kernel: item 77 key (1216565907456 168 217088) itemoff 12149 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15238385664 count 1 Feb 8 04:38:06 MOZART kernel: item 78 key (1216566124544 168 53248) itemoff 12096 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15238606848 count 1 Feb 8 04:38:06 MOZART kernel: item 79 key (1216566177792 168 61440) itemoff 12043 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15239577600 count 1 Feb 8 04:38:06 MOZART kernel: item 80 key (1216566239232 168 262144) itemoff 11990 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15240273920 count 1 Feb 8 04:38:06 MOZART kernel: item 81 key (1216566501376 168 626688) itemoff 11937 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15240593408 count 1 Feb 8 04:38:06 MOZART kernel: item 82 key (1216567128064 168 262144) itemoff 11884 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15241240576 count 1 Feb 8 04:38:06 MOZART kernel: item 83 key (1216567390208 168 65536) itemoff 11831 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15241527296 count 1 Feb 8 04:38:06 MOZART kernel: item 84 key (1216567455744 168 393216) itemoff 11778 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15241699328 count 1 Feb 8 04:38:06 MOZART kernel: item 85 key (1216567848960 168 172032) itemoff 11725 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15242158080 count 1 Feb 8 04:38:06 MOZART kernel: item 86 key (1216568020992 168 24576) itemoff 11672 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15242346496 count 1 Feb 8 04:38:06 MOZART kernel: item 87 key (1216568045568 168 417792) itemoff 11619 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15243214848 count 1 Feb 8 04:38:06 MOZART kernel: item 88 key (1216568463360 168 32768) itemoff 11566 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15243694080 count 1 Feb 8 04:38:06 MOZART kernel: item 89 key (1216568496128 168 73728) itemoff 11513 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15248912384 count 1 Feb 8 04:38:06 MOZART kernel: item 90 key (1216568569856 168 319488) itemoff 11460 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15251005440 count 1 Feb 8 04:38:06 MOZART kernel: item 91 key (1216568889344 168 45056) itemoff 11407 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15254855680 count 1 Feb 8 04:38:06 MOZART kernel: item 92 key (1216568934400 168 356352) itemoff 11354 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15257133056 count 1 Feb 8 04:38:06 MOZART kernel: item 93 key (1216569290752 168 172032) itemoff 11301 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15259021312 count 1 Feb 8 04:38:06 MOZART kernel: item 94 key (1216569462784 168 475136) itemoff 11248 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15259197440 count 1 Feb 8 04:38:06 MOZART kernel: item 95 key (1216569937920 168 94208) itemoff 11195 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15260086272 count 1 Feb 8 04:38:06 MOZART kernel: item 96 key (1216570032128 168 262144) itemoff 11142 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15260217344 count 1 Feb 8 04:38:06 MOZART kernel: item 97 key (1216570294272 168 434176) itemoff 11089 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15260545024 count 1 Feb 8 04:38:06 MOZART kernel: item 98 key (1216570728448 168 65536) itemoff 11036 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15261528064 count 1 Feb 8 04:38:06 MOZART kernel: item 99 key (1216570793984 168 450560) itemoff 10983 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15261724672 count 1 Feb 8 04:38:06 MOZART kernel: item 100 key (1216571244544 168 196608) itemoff 10930 itemsize 53 Feb 8 04:38:06 MOZART kernel: extent refs 1 gen 796368 flags 1 Feb 8 04:38:06 MOZART kernel: ref#0: extent data backref root 5 objectid 751311 offset 15266279424 count 1 Feb 8 04:38:06 MOZART kernel: BTRFS error (device dm-12): unable to find ref byte nr 18446612687889093128 parent 0 root 7 owner 0 offset 0 Feb 8 04:38:06 MOZART kernel: ------------[ cut here ]------------ Feb 8 04:38:06 MOZART kernel: BTRFS: Transaction aborted (error -2) Feb 8 04:38:06 MOZART kernel: WARNING: CPU: 3 PID: 31247 at fs/btrfs/extent-tree.c:3092 __btrfs_free_extent+0x28a/0xb20 Feb 8 04:38:06 MOZART kernel: Modules linked in: xt_owner vhost_net vhost vhost_iotlb tap kvm_intel kvm xt_mark xt_CHECKSUM ipt_REJECT nf_reject_ipv4 ip6table_mangle ip6table_nat iptable_mangle nf_tables wireguard curve25519_x86_64 libcurve25519_generic libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libblake2s blake2s_x86_64 libblake2s_generic libchacha macvlan veth xt_nat xt_tcpudp xt_conntrack nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_multiport xfs dm_crypt dm_mod dax md_mod iptable_nat xt_MASQUERADE nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 tun i915 iosf_mbi drm_kms_helper drm intel_gtt agpgart syscopyarea sysfillrect sysimgblt fb_sys_fops ip6table_filter ip6_tables iptable_filter ip_tables x_tables igb i2c_algo_bit x86_pkg_temp_thermal intel_powerclamp coretemp crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel crypto_simd cryptd ipmi_ssif glue_helper nvme rapl intel_cstate mpt3sas intel_uncore nvme_core i2c_i801 raid_class Feb 8 04:38:06 MOZART kernel: acpi_power_meter i2c_smbus input_leds scsi_transport_sas i2c_core ahci led_class intel_pch_thermal video libahci acpi_ipmi ie31200_edac backlight ipmi_si thermal acpi_pad button fan [last unloaded: vhost_iotlb] Feb 8 04:38:06 MOZART kernel: CPU: 3 PID: 31247 Comm: worker Tainted: G U W I 5.10.28-Unraid #1 Feb 8 04:38:06 MOZART kernel: Hardware name: Supermicro Super Server/X11SSH-LN4F, BIOS 2.2 05/23/2018 Feb 8 04:38:06 MOZART kernel: RIP: 0010:__btrfs_free_extent+0x28a/0xb20 Feb 8 04:38:06 MOZART kernel: Code: 8a 39 49 00 48 8b 45 50 48 8d b8 40 0a 00 00 e8 68 cd ff ff 5e 84 c0 75 13 be fe ff ff ff 48 c7 c7 fc f1 d8 81 e8 b2 10 49 00 <0f> 0b b9 fe ff ff ff ba 14 0c 00 00 e9 ff 05 00 00 85 c0 0f 84 1b Feb 8 04:38:06 MOZART kernel: RSP: 0018:ffffc90001f57c18 EFLAGS: 00010286 Feb 8 04:38:06 MOZART kernel: RAX: 0000000000000000 RBX: 0000000000000007 RCX: 0000000000000027 Feb 8 04:38:06 MOZART kernel: RDX: 00000000ffffefff RSI: 0000000000000001 RDI: ffff8890452d8920 Feb 8 04:38:06 MOZART kernel: RBP: ffff88819dfc56e8 R08: 0000000000000000 R09: 00000000ffffefff Feb 8 04:38:06 MOZART kernel: R10: ffffc90001f57a48 R11: ffffc90001f57a40 R12: 00000000fffffffe Feb 8 04:38:06 MOZART kernel: R13: ffff888479359070 R14: 0000000000000000 R15: ffff888188f5a000 Feb 8 04:38:06 MOZART kernel: FS: 0000148e96132700(0000) GS:ffff8890452c0000(0000) knlGS:0000000000000000 Feb 8 04:38:06 MOZART kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Feb 8 04:38:06 MOZART kernel: CR2: 00007fffa89d67c8 CR3: 0000000290a46004 CR4: 00000000003726e0 Feb 8 04:38:06 MOZART kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Feb 8 04:38:06 MOZART kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Feb 8 04:38:06 MOZART kernel: Call Trace: Feb 8 04:38:06 MOZART kernel: ? btrfs_merge_delayed_refs+0x91/0x17d Feb 8 04:38:06 MOZART kernel: __btrfs_run_delayed_refs+0x65b/0xab8 Feb 8 04:38:06 MOZART kernel: btrfs_run_delayed_refs+0x58/0x12c Feb 8 04:38:06 MOZART kernel: btrfs_commit_transaction+0x57/0x9cc Feb 8 04:38:06 MOZART kernel: ? __raw_spin_unlock_irq+0x5/0xd Feb 8 04:38:06 MOZART kernel: ? btrfs_lookup_first_ordered_extent+0x47/0x50 Feb 8 04:38:06 MOZART kernel: ? btrfs_wait_ordered_range+0x6f/0xde Feb 8 04:38:06 MOZART kernel: btrfs_sync_file+0x2d1/0x340 Feb 8 04:38:06 MOZART kernel: do_fsync+0x2a/0x44 Feb 8 04:38:06 MOZART kernel: __x64_sys_fdatasync+0xe/0x11 Feb 8 04:38:06 MOZART kernel: do_syscall_64+0x5d/0x6a Feb 8 04:38:06 MOZART kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9 Feb 8 04:38:06 MOZART kernel: RIP: 0033:0x1490bffcc18b Feb 8 04:38:06 MOZART kernel: Code: 0f 05 48 3d 00 f0 ff ff 77 45 c3 0f 1f 40 00 48 83 ec 18 89 7c 24 0c e8 e3 2c f8 ff 8b 7c 24 0c 41 89 c0 b8 4b 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 2f 44 89 c7 89 44 24 0c e8 21 2d f8 ff 8b 44 Feb 8 04:38:06 MOZART kernel: RSP: 002b:0000148e9612ff40 EFLAGS: 00000293 ORIG_RAX: 000000000000004b Feb 8 04:38:06 MOZART kernel: RAX: ffffffffffffffda RBX: 00001490be865dd0 RCX: 00001490bffcc18b Feb 8 04:38:06 MOZART kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: 000000000000000c Feb 8 04:38:06 MOZART kernel: RBP: 00001490be87d0f0 R08: 0000000000000000 R09: 00000000ffffffff Feb 8 04:38:06 MOZART kernel: R10: 0000148e9612ff30 R11: 0000000000000293 R12: 000055da03fc18b0 Feb 8 04:38:06 MOZART kernel: R13: 00001490be87d158 R14: 00001490bdfc0690 R15: 00001490be87d0e0 Feb 8 04:38:06 MOZART kernel: ---[ end trace 36c0d627e375738c ]--- Feb 8 04:38:06 MOZART kernel: BTRFS: error (device dm-12) in __btrfs_free_extent:3092: errno=-2 No such entry Feb 8 04:38:06 MOZART kernel: BTRFS info (device dm-12): forced readonly Feb 8 04:38:06 MOZART kernel: BTRFS: error (device dm-12) in btrfs_run_delayed_refs:2144: errno=-2 No such entry Feb 8 04:38:06 MOZART rsyslogd: file '/mnt/user/logs/syslog/syslog-192.168.92.100.log'[9] write error - see https://www.rsyslog.com/solving-rsyslog-write-errors/ for help OS error: Read-only file system [v8.2002.0 try https://www.rsyslog.com/e/2027 ] Feb 8 04:38:06 MOZART rsyslogd: action 'action-3-builtin:omfile' (module 'builtin:omfile') message lost, could not be processed. Check for additional error messages before this one. [v8.2002.0 try https://www.rsyslog.com/e/2027 ] Feb 8 04:38:06 MOZART rsyslogd: file '/mnt/user/logs/syslog/syslog-192.168.92.100.log'[9] write error - see https://www.rsyslog.com/solving-rsyslog-write-errors/ for help OS error: Read-only file system [v8.2002.0 try https://www.rsyslog.com/e/2027 ] Feb 8 04:38:06 MOZART rsyslogd: action 'action-3-builtin:omfile' (module 'builtin:omfile') message lost, could not be processed. Check for additional error messages before this one. [v8.2002.0 try https://www.rsyslog.com/e/2027 ] Feb 8 04:38:06 MOZART rsyslogd: file '/mnt/user/logs/syslog/syslog-192.168.92.100.log'[9] write error - see https://www.rsyslog.com/solving-rsyslog-write-errors/ for help OS error: Read-only file system [v8.2002.0 try https://www.rsyslog.com/e/2027 ] Feb 8 04:38:06 MOZART rsyslogd: action 'action-3-builtin:omfile' (module 'builtin:omfile') message lost, could not be processed. Check for additional error messages before this one. [v8.2002.0 try https://www.rsyslog.com/e/2027 ] Feb 8 04:38:06 MOZART rsyslogd: file '/mnt/user/logs/syslog/syslog-192.168.92.100.log'[9] write error - see https://www.rsyslog.com/solving-rsyslog-write-errors/ for help OS error: Read-only file system [v8.2002.0 try https://www.rsyslog.com/e/2027 ] Feb 8 04:38:06 MOZART rsyslogd: action 'action-3-builtin:omfile' (module 'builtin:omfile') message lost, could not be processed. Check for additional error messages before this one. [v8.2002.0 try https://www.rsyslog.com/e/2027 ] Feb

  24. [SUPPORT] DiamondPrecisionComputing - ALL IMAGES AND FILES

    Opawesome replied to biggiesize's topic in Docker Containers
    I posted too fast. One can define a set OpenVPN IP by using a custom .ovpn configuration file. The procedure to do so is very clearly detailed by the author here: https://github.com/qdm12/gluetun/wiki/Openvpn-file. @biggiesize, if I may: how about adding a choice like "other/custom" in the dropdown menu for the "VPN_SERVICE_PROVIDER" variable in your docker container template, as well as adding the variable "OPENVPN_CUSTOM_CONFIG" right after, with a nice little description such as "OPTIONAL if you selected 'other/custom' in the 'VPN_SERVICE_PROVIDER' list above, please enter here the path to the .ovpn configuration file that Gluetun should use. https://github.com/qdm12/gluetun/wiki/Openvpn-file" ? Best, OP

  25. [SUPPORT] DiamondPrecisionComputing - ALL IMAGES AND FILES

    Opawesome replied to biggiesize's topic in Docker Containers
    Hi @biggiesize, Many thanks for your contribution. I would like to test your docker container and maybe use it as a "VPN gateway" that other "non-VPN capable" docker containers could use as "network", and therefore benefit from the VPN tunnel (with the proper port redirections made with the VPN service provider). Is there anyway I can set a particular OpenVPN server IP for the Gluetun VPN client to use ? Best, OP PS: Oh, and I forgot : congratulations for all the details provided in the Unraid docker container template. There is some very useful information and I which all docker container templates were as detailed as yours.

Account

Navigation

Search

Search

Configure browser push notifications
Chrome (Android)
  1. Tap the lock icon next to the address bar.
  2. Tap Permissions → Notifications.
  3. Adjust your preference.
Chrome (Desktop)
  1. Click the padlock icon in the address bar.
  2. Select Site settings.
  3. Find Notifications and adjust your preference.