Hello unRAID Community,

I've been using an unRAID server for almost a month now. During the first week, everything was running smoothly, and I didn't encounter any issues. However, as I began to download more containers and plugins, I started experiencing various problems.

The most common issue I'm facing is the server hanging and becoming unresponsive. Sometimes, containers refuse to shut down, and lately, the entire Docker service has been crashing. I haven't been able to pinpoint the exact cause of these issues. I've noticed that when a specific task runs (I've included the relevant logs below), the containers become unresponsive, and the server also becomes unresponsive. I've had to forcefully shut down the server every single day since the problem started.

 

Apr 20 23:01:32 MJ-unRaid kernel: <TASK>
Apr 20 23:01:32 MJ-unRaid kernel: ? writepage_delalloc+0xa5/0x155
Apr 20 23:01:32 MJ-unRaid kernel: ? __extent_writepage+0x18e/0x233
Apr 20 23:01:32 MJ-unRaid kernel: ? extent_write_cache_pages+0x22a/0x2f3
Apr 20 23:01:32 MJ-unRaid kernel: ? virt_to_slab+0x5/0x19
Apr 20 23:01:32 MJ-unRaid kernel: ? memcg_slab_free_hook+0x4b/0xf9
Apr 20 23:01:32 MJ-unRaid kernel: ? btrfs_drop_extent_cache+0x3a1/0x3c9
Apr 20 23:01:32 MJ-unRaid kernel: ? extent_writepages+0x7f/0xda
Apr 20 23:01:32 MJ-unRaid kernel: ? do_writepages+0xb8/0x124
Apr 20 23:01:32 MJ-unRaid kernel: ? filemap_fdatawrite_wbc+0x5e/0x73
Apr 20 23:01:32 MJ-unRaid kernel: ? __filemap_fdatawrite_range+0x53/0x71
Apr 20 23:01:32 MJ-unRaid kernel: ? btrfs_fdatawrite_range+0x1d/0x4a
Apr 20 23:01:32 MJ-unRaid kernel: ? start_ordered_ops.constprop.0+0x41/0x74
Apr 20 23:01:32 MJ-unRaid kernel: ? btrfs_sync_file+0xed/0x3ca
Apr 20 23:01:32 MJ-unRaid kernel: ? do_fsync+0x33/0x51
Apr 20 23:01:32 MJ-unRaid kernel: ? __x64_sys_fsync+0xf/0x16
Apr 20 23:01:32 MJ-unRaid kernel: ? do_syscall_64+0x68/0x81
Apr 20 23:01:32 MJ-unRaid kernel: ? entry_SYSCALL_64_after_hwframe+0x63/0xcd
Apr 20 23:01:32 MJ-unRaid kernel: </TASK>

Apr 20 23:01:32 MJ-unRaid kernel: sysimgblt fb_sys_fops thermal wmi fan tpm_crb tpm_tis tpm_tis_core tpm video backlight acpi_tad acpi_pad button unix
Apr 20 23:01:32 MJ-unRaid kernel: CPU: 12 PID: 6414 Comm: dockerd Tainted: P      D    O      5.19.17-Unraid #2
Apr 20 23:01:32 MJ-unRaid kernel: Hardware name: ASUS System Product Name/ROG MAXIMUS Z790 HERO, BIOS 0904 03/29/2023
Apr 20 23:01:32 MJ-unRaid kernel: RIP: 0010:do_exit+0x39/0x8e5
Apr 20 23:01:32 MJ-unRaid kernel: Code: 89 fd 53 48 83 ec 28 65 48 8b 04 25 28 00 00 00 48 89 44 24 20 31 c0 65 48 8b 1c 25 c0 bb 01 00 48 83 bb a0 07 00 00 00 74 02 <0f> 0b 48 8b bb c8 06 00 00 e8 b7 c0 7c 00 48 8b 83 c0 06 00 00 83
Apr 20 23:01:32 MJ-unRaid kernel: RSP: 0018:ffffc9000202bee0 EFLAGS: 00010086
Apr 20 23:01:32 MJ-unRaid kernel: RAX: 0000000000000000 RBX: ffff8881d3885000 RCX: 0000000000000000
Apr 20 23:01:32 MJ-unRaid kernel: RDX: 0000000000000000 RSI: ffffffff820d7be1 RDI: 0000000000000009
Apr 20 23:01:32 MJ-unRaid kernel: RBP: 0000000000000009 R08: 0000000000000000 R09: 0000000000aaaaaa
Apr 20 23:01:32 MJ-unRaid kernel: R10: 0000000000000001 R11: 0000000000000001 R12: 0000000000000000
Apr 20 23:01:32 MJ-unRaid kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000010
Apr 20 23:01:32 MJ-unRaid kernel: FS:  00001465a9e50700(0000) GS:ffff88a02d300000(0000) knlGS:0000000000000000
Apr 20 23:01:32 MJ-unRaid kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Apr 20 23:01:32 MJ-unRaid kernel: CR2: ffffffffffffffd6 CR3: 00000001bcaba004 CR4: 0000000000770ee0
Apr 20 23:01:32 MJ-unRaid kernel: PKRU: 55555554
Apr 20 23:01:32 MJ-unRaid kernel: Call Trace:
Apr 20 23:01:32 MJ-unRaid kernel: <TASK>
Apr 20 23:01:32 MJ-unRaid kernel: make_task_dead+0xba/0xba
Apr 20 23:01:32 MJ-unRaid kernel: rewind_stack_and_make_dead+0x17/0x17
Apr 20 23:01:32 MJ-unRaid kernel: RIP: 0033:0x4baa7b
Apr 20 23:01:32 MJ-unRaid kernel: Code: e8 2a e5 fa ff eb 88 cc cc cc cc cc cc cc cc e8 db 2c fb ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 28 ff ff ff ff 48 c7 44 24 30
Apr 20 23:01:32 MJ-unRaid kernel: RSP: 002b:000000c0001659e0 EFLAGS: 00000206 ORIG_RAX: 000000000000004a
Apr 20 23:01:32 MJ-unRaid kernel: RAX: ffffffffffffffda RBX: 000000c00005c000 RCX: 00000000004baa7b
Apr 20 23:01:32 MJ-unRaid kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000014
Apr 20 23:01:32 MJ-unRaid kernel: RBP: 000000c000165a20 R08: 0000000000000001 R09: 0000000000000000
Apr 20 23:01:32 MJ-unRaid kernel: R10: 000000c0017bcbd0 R11: 0000000000000206 R12: 0000000000000000
Apr 20 23:01:32 MJ-unRaid kernel: R13: 0000000000000000 R14: 000000c001886000 R15: ffffffffffffffff
Apr 20 23:01:32 MJ-unRaid kernel: </TASK>

 

At this point, I'm not sure if the problem lies with Docker itself or the plugins I've installed, but I'm guessing one of them might be the cause. I'm really frustrated and disappointed with my custom-built server, especially considering the amount of money I've invested in it. I've attached the diagnostics logs, syslogs, and a screenshot of the Docker service after it crashed.

 

I would greatly appreciate any help or guidance you can provide to resolve these issues.

 

Thank you in advance for your assistance.

unraid-diagnostics-20230421-0034.zip syslog.txt

Try booting the server in safe mode with all docker/VMs disabled, let it run as a basic NAS for a few days, if it still crashes it's likely a hardware problem, if it doesn't start turning on the other services one by one.

25 minutes ago, JorgeB said:

Try booting the server in safe mode with all docker/VMs disabled, let it run as a basic NAS for a few days, if it still crashes it's likely a hardware problem, if it doesn't start turning on the other services one by one.

 

Hope it's not hardware issue 😓

 

I will get back to this post after testing it.