• UNRAID 6.10.0-RC1 Random crashes


    Mathervius
    • Urgent

    Hi guys,

     

    I've been trying to capture this issue in my syslog and have been coming up empty. I am mirroring syslog to my flash drive but there doesn't seem to be anything noteworthy.

     

    What is strange was that on 6.8.3 this hardware would just run without issue. My uptime before updating the OS from 6.8.3 was ~200 days. This issue happened on the 6.9.* series as well but I thought maybe I'd get lucky with 6.10.0-RC1. Sometimes I will get crashes every day and then like this last one I had almost 4 days of uptime before a crash.

     

    Here is a bit of the syslog prior to the crash this morning:

     

    Sep 17 20:00:01 Tower root: Starting Mover
    Sep 17 20:00:01 Tower root: ionice -c 2 -n 0 nice -n 0 /usr/local/emhttp/plugins/ca.mover.tuning/age_mover start 1 0 0 '' '' '' '' no 70 '' ''
    Sep 17 20:00:01 Tower emhttpd: read SMART /dev/sdf
    Sep 17 20:10:20 Tower emhttpd: read SMART /dev/sdj
    Sep 17 20:12:59 Tower emhttpd: cmd: /usr/local/emhttp/plugins/dynamix/scripts/tail_log syslog 
    Sep 17 20:15:01 Tower emhttpd: read SMART /dev/sdf
    Sep 17 20:23:34 Tower emhttpd: read SMART /dev/sdh
    Sep 17 20:30:01 Tower emhttpd: read SMART /dev/sdf
    Sep 17 20:30:01 Tower emhttpd: spinning down /dev/sdh
    Sep 17 20:33:39 Tower emhttpd: read SMART /dev/sdh
    Sep 17 20:34:21 Tower emhttpd: spinning down /dev/sdb
    Sep 17 20:34:22 Tower emhttpd: read SMART /dev/sdb
    Sep 17 20:45:01 Tower emhttpd: read SMART /dev/sdf
    Sep 17 20:45:02 Tower emhttpd: spinning down /dev/sdh
    Sep 17 20:45:03 Tower emhttpd: spinning down /dev/sdj
    Sep 17 20:49:36 Tower emhttpd: read SMART /dev/sdg
    Sep 17 20:50:18 Tower emhttpd: read SMART /dev/sdj
    Sep 17 21:00:02 Tower root: Starting Mover
    Sep 17 21:00:02 Tower root: ionice -c 2 -n 0 nice -n 0 /usr/local/emhttp/plugins/ca.mover.tuning/age_mover start 1 0 0 '' '' '' '' no 70 '' ''
    Sep 17 21:00:02 Tower emhttpd: spinning down /dev/sdg
    Sep 17 21:12:48 Tower emhttpd: read SMART /dev/sdg
    Sep 17 21:15:01 Tower emhttpd: spinning down /dev/sdg
    Sep 17 21:15:02 Tower emhttpd: spinning down /dev/sdj
    Sep 17 21:15:55 Tower emhttpd: read SMART /dev/sdg
    Sep 17 21:20:28 Tower emhttpd: read SMART /dev/sdh
    Sep 17 21:29:05 Tower emhttpd: read SMART /dev/sdj
    Sep 17 21:30:01 Tower emhttpd: spinning down /dev/sdh
    Sep 17 21:45:02 Tower emhttpd: spinning down /dev/sdj
    Sep 17 21:47:22 Tower emhttpd: read SMART /dev/sdj
    Sep 17 22:00:01 Tower root: Starting Mover
    Sep 17 22:00:01 Tower root: ionice -c 2 -n 0 nice -n 0 /usr/local/emhttp/plugins/ca.mover.tuning/age_mover start 1 0 0 '' '' '' '' no 70 '' ''
    Sep 17 22:00:01 Tower emhttpd: spinning down /dev/sdg
    Sep 17 22:15:01 Tower emhttpd: read SMART /dev/sdf
    Sep 17 22:15:03 Tower emhttpd: spinning down /dev/sdj
    Sep 17 22:22:23 Tower emhttpd: read SMART /dev/sdj
    Sep 17 22:30:01 Tower emhttpd: read SMART /dev/sdf
    Sep 17 22:31:36 Tower emhttpd: read SMART /dev/sdg
    Sep 17 22:33:46 Tower emhttpd: spinning down /dev/sdf
    Sep 17 22:33:46 Tower emhttpd: spinning down /dev/sdq
    Sep 17 22:45:01 Tower emhttpd: spinning down /dev/sdg
    Sep 17 22:46:02 Tower emhttpd: read SMART /dev/sdg
    Sep 17 22:53:58 Tower emhttpd: read SMART /dev/sdh
    Sep 17 23:00:01 Tower root: Starting Mover
    Sep 17 23:00:01 Tower root: ionice -c 2 -n 0 nice -n 0 /usr/local/emhttp/plugins/ca.mover.tuning/age_mover start 1 0 0 '' '' '' '' no 70 '' ''
    Sep 17 23:00:01 Tower emhttpd: spinning down /dev/sdg
    Sep 17 23:00:02 Tower emhttpd: spinning down /dev/sdh
    Sep 17 23:00:03 Tower emhttpd: spinning down /dev/sdj
    Sep 17 23:01:02 Tower emhttpd: read SMART /dev/sdg
    Sep 17 23:02:46 Tower emhttpd: read SMART /dev/sdf
    Sep 17 23:02:46 Tower emhttpd: read SMART /dev/sdq
    Sep 17 23:19:12 Tower emhttpd: read SMART /dev/sdj
    Sep 17 23:31:49 Tower emhttpd: read SMART /dev/sdh
    Sep 17 23:45:01 Tower emhttpd: spinning down /dev/sdg
    Sep 17 23:45:02 Tower emhttpd: read SMART /dev/sdg
    Sep 18 00:00:01 Tower Docker Auto Update: Community Applications Docker Autoupdate running
    Sep 18 00:00:01 Tower Docker Auto Update: Checking for available updates
    Sep 18 00:00:01 Tower root: Starting Mover
    Sep 18 00:00:01 Tower root: ionice -c 2 -n 0 nice -n 0 /usr/local/emhttp/plugins/ca.mover.tuning/age_mover start 1 0 0 '' '' '' '' no 70 '' ''
    Sep 18 00:00:02 Tower emhttpd: spinning down /dev/sdh
    Sep 18 00:00:02 Tower kernel: sd 7:0:7:0: [sdi] tag#1462 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08 cmd_age=0s
    Sep 18 00:00:02 Tower kernel: sd 7:0:7:0: [sdi] tag#1462 Sense Key : 0x5 [current] 
    Sep 18 00:00:02 Tower kernel: sd 7:0:7:0: [sdi] tag#1462 ASC=0x21 ASCQ=0x0 
    Sep 18 00:00:02 Tower kernel: sd 7:0:7:0: [sdi] tag#1462 CDB: opcode=0x42 42 00 00 00 00 00 00 00 18 00
    Sep 18 00:00:02 Tower kernel: blk_update_request: critical target error, dev sdi, sector 976773104 op 0x3:(DISCARD) flags 0x800 phys_seg 1 prio class 0
    Sep 18 00:00:08 Tower kernel: sd 7:0:3:0: [sde] tag#1579 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08 cmd_age=0s
    Sep 18 00:00:08 Tower kernel: sd 7:0:3:0: [sde] tag#1579 Sense Key : 0x5 [current] 
    Sep 18 00:00:08 Tower kernel: sd 7:0:3:0: [sde] tag#1579 ASC=0x21 ASCQ=0x0 
    Sep 18 00:00:08 Tower kernel: sd 7:0:3:0: [sde] tag#1579 CDB: opcode=0x42 42 00 00 00 00 00 00 00 18 00
    Sep 18 00:00:08 Tower kernel: blk_update_request: critical target error, dev sde, sector 975896140 op 0x3:(DISCARD) flags 0x800 phys_seg 1 prio class 0
    Sep 18 00:00:46 Tower kernel: sd 7:0:1:0: [sdc] tag#1286 UNKNOWN(0x2003) Result: hostbyte=0x00 driverbyte=0x08 cmd_age=0s
    Sep 18 00:00:46 Tower kernel: sd 7:0:1:0: [sdc] tag#1286 Sense Key : 0x5 [current] 
    Sep 18 00:00:46 Tower kernel: sd 7:0:1:0: [sdc] tag#1286 ASC=0x21 ASCQ=0x0 
    Sep 18 00:00:46 Tower kernel: sd 7:0:1:0: [sdc] tag#1286 CDB: opcode=0x42 42 00 00 00 00 00 00 00 18 00
    Sep 18 00:00:46 Tower kernel: blk_update_request: critical target error, dev sdc, sector 973078547 op 0x3:(DISCARD) flags 0x0 phys_seg 1 prio class 0
    Sep 18 00:00:46 Tower kernel: BTRFS warning (device sdc1): failed to trim 1 device(s), last error -121
    Sep 18 00:00:51 Tower sSMTP[22487]: Creating SSL connection to host
    Sep 18 00:00:51 Tower sSMTP[22487]: SSL connection using TLS_AES_256_GCM_SHA384
    Sep 18 00:00:52 Tower sSMTP[22487]: Authorization failed (535 5.7.8  https://support.google.com/mail/?p=BadCredentials g141sm8008970pfb.128 - gsmtp)
    Sep 18 00:01:51 Tower Docker Auto Update: Stopping mariadb
    Sep 18 00:01:55 Tower kernel: veth44be009: renamed from eth0
    Sep 18 00:01:55 Tower Docker Auto Update: Stopping swag
    Sep 18 00:01:59 Tower kernel: veth4c56537: renamed from eth0
    Sep 18 00:01:59 Tower Docker Auto Update: Installing Updates for mariadb swag
    Sep 18 00:04:21 Tower Docker Auto Update: Restarting mariadb
    Sep 18 00:04:21 Tower kernel: eth0: renamed from vethabaf5de
    Sep 18 00:04:21 Tower Docker Auto Update: Restarting swag
    Sep 18 00:04:22 Tower kernel: eth0: renamed from vethe6bca19
    Sep 18 00:04:22 Tower Docker Auto Update: Community Applications Docker Autoupdate finished
    Sep 18 00:04:41 Tower emhttpd: read SMART /dev/sdh
    Sep 18 00:15:01 Tower emhttpd: spinning down /dev/sdg
    Sep 18 00:15:02 Tower emhttpd: spinning down /dev/sdh
    Sep 18 00:24:57 Tower emhttpd: read SMART /dev/sdg
    Sep 18 00:25:40 Tower emhttpd: read SMART /dev/sdh
    Sep 18 00:30:01 Tower emhttpd: spinning down /dev/sdg
    Sep 18 00:30:02 Tower emhttpd: spinning down /dev/sdh
    Sep 18 00:31:26 Tower emhttpd: read SMART /dev/sdg
    Sep 18 00:45:01 Tower emhttpd: spinning down /dev/sdg
    Sep 18 01:00:01 Tower root: Starting Mover
    Sep 18 01:00:01 Tower root: ionice -c 2 -n 0 nice -n 0 /usr/local/emhttp/plugins/ca.mover.tuning/age_mover start 1 0 0 '' '' '' '' no 70 '' ''
    Sep 18 01:00:01 Tower emhttpd: read SMART /dev/sdf
    Sep 18 01:00:02 Tower emhttpd: spinning down /dev/sdj
    Sep 18 01:00:12 Tower emhttpd: read SMART /dev/sdg
    Sep 18 01:15:01 Tower emhttpd: spinning down /dev/sdg
    Sep 18 01:24:26 Tower emhttpd: read SMART /dev/sdg
    Sep 18 01:29:34 Tower emhttpd: spinning down /dev/sds
    Sep 18 01:30:01 Tower emhttpd: spinning down /dev/sdg
    Sep 18 01:35:49 Tower emhttpd: spinning down /dev/sdo

     

    So I don't see any kernel panics or anything. I know there is the trim error for the ssd but that happened with 6.8.3 as well.

    tower-diagnostics-20210918-1430.zip




    User Feedback

    Recommended Comments

    I ended up switching out my supermicro board for an old Intel DQ77MK board and have had 9+ days of uptime.

     

    I'm not sure what the issue is with the supermicro board and any UNRAID versions past 6.8.3 but it just made it unstable.

     

    If I stayed on 6.8.3 everything ran perfectly but I didn't want to be stuck on that version.

    • Like 1
    Link to comment


    Join the conversation

    You can post now and register later. If you have an account, sign in now to post with your account.
    Note: Your post will require moderator approval before it will be visible.

    Guest
    Add a comment...

    ×   Pasted as rich text.   Restore formatting

      Only 75 emoji are allowed.

    ×   Your link has been automatically embedded.   Display as a link instead

    ×   Your previous content has been restored.   Clear editor

    ×   You cannot paste images directly. Upload or insert images from URL.


  • Status Definitions

     

    Open = Under consideration.

     

    Solved = The issue has been resolved.

     

    Solved version = The issue has been resolved in the indicated release version.

     

    Closed = Feedback or opinion better posted on our forum for discussion. Also for reports we cannot reproduce or need more information. In this case just add a comment and we will review it again.

     

    Retest = Please retest in latest release.


    Priority Definitions

     

    Minor = Something not working correctly.

     

    Urgent = Server crash, data loss, or other showstopper.

     

    Annoyance = Doesn't affect functionality but should be fixed.

     

    Other = Announcement or other non-issue.