1812 Posted August 17, 2018 Share Posted August 17, 2018 (edited) This is on a z420, new to me computer. It happened on one usb license that I was setting up, so to rule out unraid glitch on the usb I swapped a second one from another server. Same song. The other install had no isolated cpus, so unraid was free to do what it wanted and still did the same thing (this usb I think is restricted to 1 cpu for unraid... I don't remember, it's been a long day) top shows: top - 18:22:33 up 2 min, 1 user, load average: 0.88, 0.40, 0.15 Tasks: 182 total, 1 running, 97 sleeping, 0 stopped, 0 zombie %Cpu(s): 0.0 us, 6.9 sy, 0.0 ni, 93.1 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st KiB Mem : 49451448 total, 48636772 free, 217656 used, 597020 buff/cache KiB Swap: 0 total, 0 free, 0 used. 48235300 avail Mem PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 3 root 20 0 0 0 0 I 87.0 0.0 1:50.93 kworker/0:0 5455 root 20 0 18676 2876 2404 R 0.3 0.0 0:00.03 top 1 root 20 0 4504 1596 1500 S 0.0 0.0 0:06.64 init 2 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kthreadd 4 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/0:0H 5 root 20 0 0 0 0 I 0.0 0.0 0:00.00 kworker/u24:0 6 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 mm_percpu_wq 7 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/0 8 root 20 0 0 0 0 I 0.0 0.0 0:00.02 rcu_sched 9 root 20 0 0 0 0 I 0.0 0.0 0:00.00 rcu_bh 10 root rt 0 0 0 0 S 0.0 0.0 0:00.00 migration/0 11 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/0 12 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/1 13 root rt 0 0 0 0 S 0.0 0.0 0:00.00 migration/1 14 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/1 15 root 20 0 0 0 0 I 0.0 0.0 0:00.00 kworker/1:0 16 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/1:0H 17 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/2 18 root rt 0 0 0 0 S 0.0 0.0 0:00.00 migration/2 19 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/2 20 root 20 0 0 0 0 I 0.0 0.0 0:00.00 kworker/2:0 21 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/2:0H 22 root 20 0 0 0 0 S 0.0 0.0 0:00.00 cpuhp/3 23 root rt 0 0 0 0 S 0.0 0.0 0:00.00 migration/3 24 root 20 0 0 0 0 S 0.0 0.0 0:00.00 ksoftirqd/3 25 root 20 0 0 0 0 I 0.0 0.0 0:00.00 kworker/3:0 26 root 0 -20 0 0 0 I 0.0 0.0 0:00.00 kworker/3:0H not sure where to go from here. any assistance would be appreciated! diagnostics-20180817-1822.zip Edited August 19, 2018 by 1812 Quote Link to comment
1812 Posted August 18, 2018 Author Share Posted August 18, 2018 (edited) update: same issue on ubuntu, does not occur on metal windows 10 install. updated firmware from 2016 to 2018. booting in safe mode results in no change the kworker changes depends on boot and is now kworker/0:2 Edited August 18, 2018 by 1812 Quote Link to comment
1812 Posted August 18, 2018 Author Share Posted August 18, 2018 (edited) I found an article about finding out why kworker is hogging a core (https://askubuntu.com/questions/33640/kworker-what-is-it-and-why-is-it-hogging-so-much-cpu) it deals with initiating a backtrace using the command echo l > /proc/sysrq-trigger Aug 18 08:15:27 Backup login[5615]: ROOT LOGIN on '/dev/pts/0' Aug 18 08:16:23 Backup kernel: sysrq: SysRq : Show backtrace of all active CPUs Aug 18 08:16:23 Backup kernel: NMI backtrace for cpu 3 Aug 18 08:16:23 Backup kernel: CPU: 3 PID: 5615 Comm: bash Not tainted 4.14.49-unRAID #1 Aug 18 08:16:23 Backup kernel: Hardware name: Hewlett-Packard HP Z420 Workstation/1589, BIOS J61 v03.94 07/10/2018 Aug 18 08:16:23 Backup kernel: Call Trace: Aug 18 08:16:23 Backup kernel: dump_stack+0x5d/0x79 Aug 18 08:16:23 Backup kernel: nmi_cpu_backtrace+0x9b/0xba Aug 18 08:16:23 Backup kernel: ? irq_force_complete_move+0xf3/0xf3 Aug 18 08:16:23 Backup kernel: nmi_trigger_cpumask_backtrace+0x56/0xd4 Aug 18 08:16:23 Backup kernel: __handle_sysrq+0x7c/0xfc Aug 18 08:16:23 Backup kernel: write_sysrq_trigger+0x26/0x2b Aug 18 08:16:23 Backup kernel: proc_reg_write+0x42/0x60 Aug 18 08:16:23 Backup kernel: ? proc_reg_poll+0x55/0x55 Aug 18 08:16:23 Backup kernel: __vfs_write+0x1e/0x109 Aug 18 08:16:23 Backup kernel: ? __alloc_fd+0x95/0x14a Aug 18 08:16:23 Backup kernel: ? set_close_on_exec+0x2b/0x5c Aug 18 08:16:23 Backup kernel: vfs_write+0xc3/0x166 Aug 18 08:16:23 Backup kernel: SyS_write+0x48/0x81 Aug 18 08:16:23 Backup kernel: do_syscall_64+0x6d/0xfe Aug 18 08:16:23 Backup kernel: entry_SYSCALL_64_after_hwframe+0x3d/0xa2 Aug 18 08:16:23 Backup kernel: RIP: 0033:0x14a22b604414 Aug 18 08:16:23 Backup kernel: RSP: 002b:00007ffec3b66ef8 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Aug 18 08:16:23 Backup kernel: RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 000014a22b604414 Aug 18 08:16:23 Backup kernel: RDX: 0000000000000002 RSI: 0000000000719408 RDI: 0000000000000001 Aug 18 08:16:23 Backup kernel: RBP: 0000000000719408 R08: 000000000000000a R09: 0000000000000000 Aug 18 08:16:23 Backup kernel: R10: 000000000000000a R11: 0000000000000246 R12: 000014a22b8dd760 Aug 18 08:16:23 Backup kernel: R13: 0000000000000002 R14: 000014a22b8d92a0 R15: 000014a22b8d8760 Aug 18 08:16:23 Backup kernel: Sending NMI from CPU 3 to CPUs 0-2,4-11: Aug 18 08:16:23 Backup kernel: NMI backtrace for cpu 9 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:16:23 Backup kernel: NMI backtrace for cpu 0 Aug 18 08:16:23 Backup kernel: CPU: 0 PID: 1258 Comm: kworker/0:3 Not tainted 4.14.49-unRAID #1 Aug 18 08:16:23 Backup kernel: Hardware name: Hewlett-Packard HP Z420 Workstation/1589, BIOS J61 v03.94 07/10/2018 Aug 18 08:16:23 Backup kernel: Workqueue: kacpid acpi_os_execute_deferred Aug 18 08:16:23 Backup kernel: task: ffff88040c4fb600 task.stack: ffffc90002348000 Aug 18 08:16:23 Backup kernel: RIP: 0010:acpi_ex_access_region+0x91/0x24f Aug 18 08:16:23 Backup kernel: RSP: 0018:ffffc9000234bb50 EFLAGS: 00000202 Aug 18 08:16:23 Backup kernel: RAX: 0000000000000001 RBX: ffff88040ec420d8 RCX: 0000000000000001 Aug 18 08:16:23 Backup kernel: RDX: ffffc9000234bbc8 RSI: 0000000000000000 RDI: 00000000fffffff6 Aug 18 08:16:23 Backup kernel: RBP: ffff88040ec26dc8 R08: 0000000000000006 R09: 00000000000000ff Aug 18 08:16:23 Backup kernel: R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000000 Aug 18 08:16:23 Backup kernel: R13: 0000000000000001 R14: 0000000000000001 R15: ffffc9000234bbc8 Aug 18 08:16:23 Backup kernel: FS: 0000000000000000(0000) GS:ffff88040f200000(0000) knlGS:0000000000000000 Aug 18 08:16:23 Backup kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 18 08:16:23 Backup kernel: CR2: 000014b3c213ee1c CR3: 0000000004c0a005 CR4: 00000000001606f0 Aug 18 08:16:23 Backup kernel: Call Trace: Aug 18 08:16:23 Backup kernel: ? acpi_hw_read_port+0x39/0x97 Aug 18 08:16:23 Backup kernel: acpi_ex_field_datum_io+0xf2/0x16a Aug 18 08:16:23 Backup kernel: ? acpi_ev_address_space_dispatch+0x1e0/0x229 Aug 18 08:16:23 Backup kernel: acpi_ex_write_with_update_rule+0xb3/0xbc Aug 18 08:16:23 Backup kernel: acpi_ex_insert_into_field+0x1ce/0x1f0 Aug 18 08:16:23 Backup kernel: ? acpi_ns_search_and_enter+0x8a/0x19c Aug 18 08:16:23 Backup kernel: acpi_ex_field_datum_io+0xd8/0x16a Aug 18 08:16:23 Backup kernel: acpi_ex_extract_from_field+0xd4/0x213 Aug 18 08:16:23 Backup kernel: acpi_ex_read_data_from_field+0x14b/0x176 Aug 18 08:16:23 Backup kernel: acpi_ex_resolve_node_to_value+0x17f/0x206 Aug 18 08:16:23 Backup kernel: acpi_ex_resolve_to_value+0x1f5/0x1fc Aug 18 08:16:23 Backup kernel: acpi_ds_evaluate_name_path+0x71/0xe5 Aug 18 08:16:23 Backup kernel: acpi_ds_exec_end_op+0x86/0x3cb Aug 18 08:16:23 Backup kernel: acpi_ps_parse_loop+0x276/0x557 Aug 18 08:16:23 Backup kernel: ? kmem_cache_alloc+0x9f/0xe8 Aug 18 08:16:23 Backup kernel: acpi_ps_parse_aml+0x8c/0x292 Aug 18 08:16:23 Backup kernel: acpi_ps_execute_method+0x146/0x17a Aug 18 08:16:23 Backup kernel: acpi_ns_evaluate+0x1ba/0x247 Aug 18 08:16:23 Backup kernel: acpi_ev_asynch_execute_gpe_method+0x8e/0xf5 Aug 18 08:16:23 Backup kernel: acpi_os_execute_deferred+0x11/0x1b Aug 18 08:16:23 Backup kernel: process_one_work+0x155/0x237 Aug 18 08:16:23 Backup kernel: ? rescuer_thread+0x275/0x275 Aug 18 08:16:23 Backup kernel: worker_thread+0x1d5/0x2ad Aug 18 08:16:23 Backup kernel: kthread+0x111/0x119 Aug 18 08:16:23 Backup kernel: ? kthread_create_on_node+0x3a/0x3a Aug 18 08:16:23 Backup kernel: ? call_usermodehelper_exec_async+0x121/0x128 Aug 18 08:16:23 Backup kernel: ret_from_fork+0x35/0x40 Aug 18 08:16:23 Backup kernel: Code: 00 84 c0 75 26 44 89 f1 48 c7 c2 5e 58 b5 81 be 6f 00 00 00 48 c7 c7 60 3e a5 81 41 be 10 30 00 00 e8 d0 33 01 00 e9 ac 01 00 00 <f6> 45 0c 04 74 25 8b 43 1c 41 8d 75 f9 40 80 e6 fd 44 0f b6 43 Aug 18 08:16:23 Backup kernel: NMI backtrace for cpu 6 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:16:23 Backup kernel: NMI backtrace for cpu 1 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:16:23 Backup kernel: NMI backtrace for cpu 7 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:16:23 Backup kernel: NMI backtrace for cpu 2 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:16:23 Backup kernel: NMI backtrace for cpu 8 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:16:23 Backup kernel: NMI backtrace for cpu 4 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:16:23 Backup kernel: NMI backtrace for cpu 10 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:16:23 Backup kernel: NMI backtrace for cpu 5 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:16:23 Backup kernel: NMI backtrace for cpu 11 skipped: idling at pc 0xffffffff815dabd2 second one Aug 18 08:20:35 Backup kernel: NMI backtrace for cpu 3 Aug 18 08:20:35 Backup kernel: CPU: 3 PID: 5615 Comm: bash Not tainted 4.14.49-unRAID #1 Aug 18 08:20:35 Backup kernel: Hardware name: Hewlett-Packard HP Z420 Workstation/1589, BIOS J61 v03.94 07/10/2018 Aug 18 08:20:35 Backup kernel: Call Trace: Aug 18 08:20:35 Backup kernel: dump_stack+0x5d/0x79 Aug 18 08:20:35 Backup kernel: nmi_cpu_backtrace+0x9b/0xba Aug 18 08:20:35 Backup kernel: ? irq_force_complete_move+0xf3/0xf3 Aug 18 08:20:35 Backup kernel: nmi_trigger_cpumask_backtrace+0x56/0xd4 Aug 18 08:20:35 Backup kernel: __handle_sysrq+0x7c/0xfc Aug 18 08:20:35 Backup kernel: write_sysrq_trigger+0x26/0x2b Aug 18 08:20:35 Backup kernel: proc_reg_write+0x42/0x60 Aug 18 08:20:35 Backup kernel: ? proc_reg_poll+0x55/0x55 Aug 18 08:20:35 Backup kernel: __vfs_write+0x1e/0x109 Aug 18 08:20:35 Backup kernel: ? __alloc_fd+0x95/0x14a Aug 18 08:20:35 Backup kernel: ? set_close_on_exec+0x2b/0x5c Aug 18 08:20:35 Backup kernel: vfs_write+0xc3/0x166 Aug 18 08:20:35 Backup kernel: SyS_write+0x48/0x81 Aug 18 08:20:35 Backup kernel: do_syscall_64+0x6d/0xfe Aug 18 08:20:35 Backup kernel: entry_SYSCALL_64_after_hwframe+0x3d/0xa2 Aug 18 08:20:35 Backup kernel: RIP: 0033:0x14a22b604414 Aug 18 08:20:35 Backup kernel: RSP: 002b:00007ffec3b66ef8 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 Aug 18 08:20:35 Backup kernel: RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 000014a22b604414 Aug 18 08:20:35 Backup kernel: RDX: 0000000000000002 RSI: 0000000000719408 RDI: 0000000000000001 Aug 18 08:20:35 Backup kernel: RBP: 0000000000719408 R08: 000000000000000a R09: 0000000000000000 Aug 18 08:20:35 Backup kernel: R10: 000000000000000a R11: 0000000000000246 R12: 000014a22b8dd760 Aug 18 08:20:35 Backup kernel: R13: 0000000000000002 R14: 000014a22b8d92a0 R15: 000014a22b8d8760 Aug 18 08:20:35 Backup kernel: Sending NMI from CPU 3 to CPUs 0-2,4-11: Aug 18 08:20:35 Backup kernel: NMI backtrace for cpu 9 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:20:35 Backup kernel: NMI backtrace for cpu 10 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:20:35 Backup kernel: NMI backtrace for cpu 4 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:20:35 Backup kernel: NMI backtrace for cpu 0 Aug 18 08:20:35 Backup kernel: CPU: 0 PID: 1258 Comm: kworker/0:3 Not tainted 4.14.49-unRAID #1 Aug 18 08:20:35 Backup kernel: Hardware name: Hewlett-Packard HP Z420 Workstation/1589, BIOS J61 v03.94 07/10/2018 Aug 18 08:20:35 Backup kernel: Workqueue: kacpi_notify acpi_os_execute_deferred Aug 18 08:20:35 Backup kernel: task: ffff88040c4fb600 task.stack: ffffc90002348000 Aug 18 08:20:35 Backup kernel: RIP: 0010:pci_conf1_read+0xa6/0xcc Aug 18 08:20:35 Backup kernel: RSP: 0018:ffffc9000234bdc8 EFLAGS: 00000046 Aug 18 08:20:35 Backup kernel: RAX: 0000000080080008 RBX: 0000000000000000 RCX: 0000000000000044 Aug 18 08:20:35 Backup kernel: RDX: 0000000000000cfc RSI: 0000000000000206 RDI: ffffffff82027e50 Aug 18 08:20:35 Backup kernel: RBP: 0000000000000000 R08: 0000000000000002 R09: ffffc9000234bdfc Aug 18 08:20:35 Backup kernel: R10: 0000000000000000 R11: ffff880408d417d0 R12: 0000000000080000 Aug 18 08:20:35 Backup kernel: R13: ffffc9000234bdfc R14: 0000000000000002 R15: 0000000000000000 Aug 18 08:20:35 Backup kernel: FS: 0000000000000000(0000) GS:ffff88040f200000(0000) knlGS:0000000000000000 Aug 18 08:20:35 Backup kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 18 08:20:35 Backup kernel: CR2: 000014b3c213ee1c CR3: 0000000004c0a005 CR4: 00000000001606f0 Aug 18 08:20:35 Backup kernel: Call Trace: Aug 18 08:20:35 Backup kernel: pci_bus_read_config_word+0x32/0x3c Aug 18 08:20:35 Backup kernel: pci_check_pme_status+0x25/0x57 Aug 18 08:20:35 Backup kernel: ? pci_check_pme_status+0x57/0x57 Aug 18 08:20:35 Backup kernel: pci_pme_wakeup+0x24/0x4f Aug 18 08:20:35 Backup kernel: pci_walk_bus+0x76/0x7c Aug 18 08:20:35 Backup kernel: acpi_pm_notify_handler+0x56/0x6e Aug 18 08:20:35 Backup kernel: acpi_ev_notify_dispatch+0x40/0x55 Aug 18 08:20:35 Backup kernel: acpi_os_execute_deferred+0x11/0x1b Aug 18 08:20:35 Backup kernel: process_one_work+0x155/0x237 Aug 18 08:20:35 Backup kernel: ? rescuer_thread+0x275/0x275 Aug 18 08:20:35 Backup kernel: worker_thread+0x1d5/0x2ad Aug 18 08:20:35 Backup kernel: kthread+0x111/0x119 Aug 18 08:20:35 Backup kernel: ? kthread_create_on_node+0x3a/0x3a Aug 18 08:20:35 Backup kernel: ? call_usermodehelper_exec_async+0x121/0x128 Aug 18 08:20:35 Backup kernel: ret_from_fork+0x35/0x40 Aug 18 08:20:35 Backup kernel: Code: 41 83 fe 02 74 1a 41 83 fe 04 74 24 41 ff ce 75 29 83 e3 03 8d 93 fc 0c 00 00 ec 0f b6 c0 eb 16 83 e3 02 8d 93 fc 0c 00 00 66 ed <0f> b7 c0 eb 06 ba fc 0c 00 00 ed 41 89 45 00 48 c7 c7 50 7e 02 Aug 18 08:20:35 Backup kernel: NMI backtrace for cpu 6 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:20:35 Backup kernel: NMI backtrace for cpu 1 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:20:35 Backup kernel: NMI backtrace for cpu 7 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:20:35 Backup kernel: NMI backtrace for cpu 2 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:20:35 Backup kernel: NMI backtrace for cpu 8 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:20:35 Backup kernel: NMI backtrace for cpu 5 skipped: idling at pc 0xffffffff815dabd2 Aug 18 08:20:35 Backup kernel: NMI backtrace for cpu 11 skipped: idling at pc 0xffffffff815dabd2 so does this indicate an acpi issue? I added acpi=off to syslinux.cfg and the issue has disappeared. Anyone know of a better way to resolve "properly"? IOMMU is disabled with it off. Changed the above to acpi=force and iommu came back. Edited August 18, 2018 by 1812 1 Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.