jjbrunton

Any idea on how to diagnose excessive disk usage in this container? I am finding the deamons container using a large amount of docker.img for only two servers running. I can't exec into the container because /bin/bash /bin/sh aren't available.

Would anyone have any idea why my deamons docker container is slowly growing and growing in size? It's currently at 120gb.

Just started a rebuild and two different disks are throwing errors. I've got another card on the way: Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2857 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2857 Sense Key : 0x2 [current] Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2857 ASC=0x4 ASCQ=0x0 Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2857 CDB: opcode=0x88 88 00 00 00 00 00 a6 57 2d e8 00 00 04 00 00 00 Jun 4 16:26:13 Pluto kernel: I/O error, dev sdh, sector 2790731240 op 0x0:(READ) flags 0x0 phys_seg 128 prio class 2 Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2864 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2864 Sense Key : 0x2 [current] Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2864 ASC=0x4 ASCQ=0x0 Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2864 CDB: opcode=0x88 88 00 00 00 00 00 a6 57 31 e8 00 00 04 00 00 00 Jun 4 16:26:13 Pluto kernel: I/O error, dev sdh, sector 2790732264 op 0x0:(READ) flags 0x0 phys_seg 128 prio class 2 Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2871 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2871 Sense Key : 0x2 [current] Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2871 ASC=0x4 ASCQ=0x0 Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2871 CDB: opcode=0x88 88 00 00 00 00 00 a6 57 35 e8 00 00 02 70 00 00 Jun 4 16:26:13 Pluto kernel: I/O error, dev sdh, sector 2790733288 op 0x0:(READ) flags 0x0 phys_seg 78 prio class 2 Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2816 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2816 Sense Key : 0x2 [current] Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2816 ASC=0x4 ASCQ=0x0 Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2816 CDB: opcode=0x88 88 00 00 00 00 00 a6 57 38 58 00 00 01 90 00 00 Jun 4 16:26:13 Pluto kernel: I/O error, dev sdh, sector 2790733912 op 0x0:(READ) flags 0x0 phys_seg 50 prio class 2 Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2822 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2822 Sense Key : 0x2 [current] Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2822 ASC=0x4 ASCQ=0x0 Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2822 CDB: opcode=0x88 88 00 00 00 00 00 a6 57 39 e8 00 00 04 00 00 00 Jun 4 16:26:13 Pluto kernel: I/O error, dev sdh, sector 2790734312 op 0x0:(READ) flags 0x0 phys_seg 128 prio class 2 Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2829 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2829 Sense Key : 0x2 [current] Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2829 ASC=0x4 ASCQ=0x0 Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2829 CDB: opcode=0x88 88 00 00 00 00 00 a6 57 3d e8 00 00 04 00 00 00 Jun 4 16:26:13 Pluto kernel: I/O error, dev sdh, sector 2790735336 op 0x0:(READ) flags 0x0 phys_seg 128 prio class 2 Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2836 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2836 Sense Key : 0x2 [current] Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2836 ASC=0x4 ASCQ=0x0 Jun 4 16:26:13 Pluto kernel: sd 7:0:5:0: [sdh] tag#2836 CDB: opcode=0x88 88 00 00 00 00 00 a6 57 41 e8 00 00 04 00 00 00 Jun 4 16:26:13 Pluto kernel: I/O error, dev sdh, sector 2790736360 op 0x0:(READ) flags 0x0 phys_seg 128 prio class 2

As in moving the disks to the onboard SATA controller? Is there a card you'd recommend as one that works well with Unraid?

Hi, I'm really struggling with Unraid at the moment, I'm having disks that are seemingly fine one moment and then I wake up to them being disabled due to IO errors etc. I've tried replacing cables, removing sata extenders and changing power connections on the drives. In a couple of the drives cases I've even gone ahead and replaced them and I am still getting issues. Can anyone have a look at the logs and let me know if I am missing anything obvious? Maybe its my LSI card? pluto-diagnostics-20240604-1312.zip

In the docker settings? I've tried rebooting since the earlier post and that still shows as problem in Fix common problems.. Is there anything else that needs to be changed in the network settings?

I have rebooted multiple times but I can't actually remember selecting VLAN. The fix common problems still shows: "Macvlan and bridging has been found. This might cause issues with stability on your server."

Actually just to follow up on this, my Docker is set to IPVlan: Are there further settings required?

I've switched it to the onboard controller with a new SATA cable and so far so good. Thanks for the other tips.

Ah that'd be it. Here's the recent runtime. pluto-diagnostics-20240209-1143.zip

In the original post? That's directly from the disk log on the HDD attached at sdi (8TB WD). I've stopped using smallcache because it drops offline occasionally, I intend to remove it completely. The 8TB disk on the otherhand is problematic but I'll try the onboard raid controller to see if that makes a difference.

Cheers. I'll try the onboard SATA tonight and see how I get on. I assume I'm right in saying I have to rebuild after the reconnection? That's been my usual approach

pluto-diagnostics-20240205-1347.zip

I've rebuilt this disk multiple times at this point but I eventually end up getting these errors that bring the device offline: Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1151 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=4s Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1151 Sense Key : 0x2 [current] Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1151 ASC=0x4 ASCQ=0x0 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1151 CDB: opcode=0x88 88 00 00 00 00 00 b3 90 36 a0 00 00 00 30 00 00 Feb 9 00:06:59 Pluto kernel: I/O error, dev sdi, sector 3012572832 op 0x0:(READ) flags 0x0 phys_seg 6 prio class 2 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1088 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=4s Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1088 Sense Key : 0x2 [current] Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1088 ASC=0x4 ASCQ=0x0 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1088 CDB: opcode=0x8a 8a 00 00 00 00 00 9e 85 48 b8 00 00 00 50 00 00 Feb 9 00:06:59 Pluto kernel: I/O error, dev sdi, sector 2659535032 op 0x1:(WRITE) flags 0x0 phys_seg 10 prio class 2 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1089 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=4s Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1089 Sense Key : 0x2 [current] Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1089 ASC=0x4 ASCQ=0x0 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1089 CDB: opcode=0x88 88 00 00 00 00 00 b3 90 36 48 00 00 00 30 00 00 Feb 9 00:06:59 Pluto kernel: I/O error, dev sdi, sector 3012572744 op 0x0:(READ) flags 0x0 phys_seg 6 prio class 2 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1090 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=4s Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1090 Sense Key : 0x2 [current] Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1090 ASC=0x4 ASCQ=0x0 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1090 CDB: opcode=0x88 88 00 00 00 00 00 b3 90 36 78 00 00 00 28 00 00 Feb 9 00:06:59 Pluto kernel: I/O error, dev sdi, sector 3012572792 op 0x0:(READ) flags 0x0 phys_seg 5 prio class 2 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1091 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1091 Sense Key : 0x2 [current] Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1091 ASC=0x4 ASCQ=0x0 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1091 CDB: opcode=0x88 88 00 00 00 00 00 b3 90 36 d0 00 00 00 08 00 00 Feb 9 00:06:59 Pluto kernel: I/O error, dev sdi, sector 3012572880 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1092 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1092 Sense Key : 0x2 [current] Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1092 ASC=0x4 ASCQ=0x0 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1092 CDB: opcode=0x8a 8a 00 00 00 00 00 9e 85 49 08 00 00 00 10 00 00 Feb 9 00:06:59 Pluto kernel: I/O error, dev sdi, sector 2659535112 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 2 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1093 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1093 Sense Key : 0x2 [current] Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1093 ASC=0x4 ASCQ=0x0 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1093 CDB: opcode=0x88 88 00 00 00 00 00 b3 90 36 d8 00 00 00 08 00 00 Feb 9 00:06:59 Pluto kernel: I/O error, dev sdi, sector 3012572888 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1094 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1094 Sense Key : 0x2 [current] Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1094 ASC=0x4 ASCQ=0x0 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1094 CDB: opcode=0x8a 8a 00 00 00 00 00 9e 85 49 18 00 00 00 08 00 00 Feb 9 00:06:59 Pluto kernel: I/O error, dev sdi, sector 2659535128 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 2 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1095 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1095 Sense Key : 0x2 [current] Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1095 ASC=0x4 ASCQ=0x0 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1095 CDB: opcode=0x88 88 00 00 00 00 00 b3 90 36 e0 00 00 00 08 00 00 Feb 9 00:06:59 Pluto kernel: I/O error, dev sdi, sector 3012572896 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 2 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1096 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=DRIVER_OK cmd_age=0s Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1096 Sense Key : 0x2 [current] Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1096 ASC=0x4 ASCQ=0x0 Feb 9 00:06:59 Pluto kernel: sd 1:0:3:0: [sdi] tag#1096 CDB: opcode=0x8a 8a 00 00 00 00 00 9e 85 49 20 00 00 00 10 00 00 Feb 9 00:06:59 Pluto kernel: I/O error, dev sdi, sector 2659535136 op 0x1:(WRITE) flags 0x0 phys_seg 2 prio class 2 I have tried different cables to the controller and different power cables but nothing seems to make a difference. The drive isn't that old (1yr power on time) and the SMART info looks OK?1

Has anyone managed to get the scheduler working for this? I can't run scheduled backups etc.