al_uk

Members
  • Posts

    161
  • Joined

  • Last visited

Everything posted by al_uk

  1. The scrub aborted itself. Tried twice. Not sure what to do next? scrub status for 6110ce92-70ca-4bac-be5d-15972207af53 scrub started at Wed May 16 08:23:09 2018 and was aborted after 00:16:54 total bytes scrubbed: 723.26GiB with 2 errors error details: csum=2 corrected errors: 0, uncorrectable errors: 2, unverified errors: 0 Last part of log. y 16 08:09:19 Tower kernel: ------------[ cut here ]------------ May 16 08:09:19 Tower kernel: WARNING: CPU: 1 PID: 18865 at fs/btrfs/scrub.c:2746 scrub_stripe+0xb02/0xd92 May 16 08:09:19 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:09:19 Tower kernel: CPU: 1 PID: 18865 Comm: btrfs Not tainted 4.14.16-unRAID #1 May 16 08:09:19 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:09:19 Tower kernel: task: ffff880efec09c00 task.stack: ffffc9000be50000 May 16 08:09:19 Tower kernel: RIP: 0010:scrub_stripe+0xb02/0xd92 May 16 08:09:19 Tower kernel: RSP: 0018:ffffc9000be53a50 EFLAGS: 00010246 May 16 08:09:19 Tower kernel: RAX: 0000000000001000 RBX: ffff880f2d433400 RCX: 0000000000000000 May 16 08:09:19 Tower kernel: RDX: 000000004ceb3901 RSI: ffff8810124db540 RDI: ffff881033e5a300 May 16 08:09:19 Tower kernel: RBP: ffffc9000be53c00 R08: 000060efc08012b0 R09: ffffffff811d3060 May 16 08:09:19 Tower kernel: R10: ffffea00404936c0 R11: 0000000000000000 R12: 0000000000003000 May 16 08:09:19 Tower kernel: R13: 0000041400901000 R14: ffff88103527ed80 R15: 0000000000000000 May 16 08:09:19 Tower kernel: FS: 0000154229703700(0000) GS:ffff88103f240000(0000) knlGS:0000000000000000 May 16 08:09:19 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:09:19 Tower kernel: CR2: 00001480e7a2bb50 CR3: 0000000f82722003 CR4: 00000000001606e0 May 16 08:09:19 Tower kernel: Call Trace: May 16 08:09:19 Tower kernel: ? comp_keys+0x26/0x2b May 16 08:09:19 Tower kernel: ? scrub_chunk+0x108/0x133 May 16 08:09:19 Tower kernel: scrub_chunk+0x108/0x133 May 16 08:09:19 Tower kernel: scrub_enumerate_chunks+0x2f1/0x51b May 16 08:09:19 Tower kernel: ? wait_woken+0x1a/0x68 May 16 08:09:19 Tower kernel: btrfs_scrub_dev+0x2b9/0x400 May 16 08:09:19 Tower kernel: ? __kmalloc_track_caller+0xd1/0x11c May 16 08:09:19 Tower kernel: btrfs_ioctl+0x13d4/0x1e00 May 16 08:09:19 Tower kernel: ? kmem_cache_alloc_node+0xd0/0x105 May 16 08:09:19 Tower kernel: ? vfs_ioctl+0x19/0x26 May 16 08:09:19 Tower kernel: ? btrfs_ioctl_get_supported_features+0x1d/0x1d May 16 08:09:19 Tower kernel: vfs_ioctl+0x19/0x26 May 16 08:09:19 Tower kernel: do_vfs_ioctl+0x506/0x519 May 16 08:09:19 Tower kernel: ? get_task_io_context+0x3c/0x64 May 16 08:09:19 Tower kernel: SyS_ioctl+0x39/0x55 May 16 08:09:19 Tower kernel: entry_SYSCALL_64_fastpath+0x24/0x87 May 16 08:09:19 Tower kernel: RIP: 0033:0x15422980f727 May 16 08:09:19 Tower kernel: RSP: 002b:0000154229702d68 EFLAGS: 00000246 May 16 08:09:19 Tower kernel: Code: ff 89 85 c0 fe ff ff e8 09 e8 3a 00 48 ff 83 a8 02 00 00 4c 01 a3 b8 02 00 00 e9 1f fe ff ff 8b 80 5c 13 00 00 89 85 c0 fe ff ff <0f> ff e9 14 fe ff ff 48 89 df e8 4a ae ff ff 4d 8d 4f 38 49 89 May 16 08:09:19 Tower kernel: ---[ end trace 4497dd8cdf1a55ba ]--- May 16 08:09:19 Tower kernel: ------------[ cut here ]------------ May 16 08:09:19 Tower kernel: WARNING: CPU: 0 PID: 2245 at fs/btrfs/scrub.c:2044 scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:09:19 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:09:19 Tower kernel: CPU: 0 PID: 2245 Comm: kworker/u24:8 Tainted: G W 4.14.16-unRAID #1 May 16 08:09:19 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:09:19 Tower kernel: Workqueue: btrfs-scrub btrfs_scrub_helper May 16 08:09:19 Tower kernel: task: ffff8810383fe200 task.stack: ffffc90006704000 May 16 08:09:19 Tower kernel: RIP: 0010:scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:09:19 Tower kernel: RSP: 0018:ffffc90006707df0 EFLAGS: 00010246 May 16 08:09:19 Tower kernel: RAX: 000000ffff880fd8 RBX: ffff880eddd59e00 RCX: 0000000000000001 May 16 08:09:19 Tower kernel: RDX: ffff880edd7c5480 RSI: 0001000000000000 RDI: ffff88103ec03200 May 16 08:09:19 Tower kernel: RBP: ffff880ff4d0d140 R08: 0000000000000001 R09: ffffffff8122d300 May 16 08:09:19 Tower kernel: R10: ffffea003b775600 R11: ffff8810383fe201 R12: ffff880f2d433400 May 16 08:09:19 Tower kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000001 May 16 08:09:19 Tower kernel: FS: 0000000000000000(0000) GS:ffff88103f200000(0000) knlGS:0000000000000000 May 16 08:09:19 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:09:19 Tower kernel: CR2: 0000152ef3f8f2c0 CR3: 0000000001c0a002 CR4: 00000000001606f0 May 16 08:09:19 Tower kernel: Call Trace: May 16 08:09:19 Tower kernel: ? set_next_entity+0x123/0x351 May 16 08:09:19 Tower kernel: btrfs_worker_helper+0xc2/0x185 May 16 08:09:19 Tower kernel: process_one_work+0x14c/0x23f May 16 08:09:19 Tower kernel: ? rescuer_thread+0x258/0x258 May 16 08:09:19 Tower kernel: worker_thread+0x1c3/0x292 May 16 08:09:19 Tower kernel: kthread+0x111/0x119 May 16 08:09:19 Tower kernel: ? kthread_create_on_node+0x3a/0x3a May 16 08:09:19 Tower kernel: ret_from_fork+0x35/0x40 May 16 08:09:19 Tower kernel: Code: ff 86 e8 02 00 00 48 89 c7 e8 52 fc 3a 00 48 8b 03 45 85 ed be 03 00 00 00 48 8b 78 10 75 05 be 04 00 00 00 e8 9e 95 fd ff eb 02 <0f> ff 48 8b 83 90 00 00 00 44 8b a8 5c 02 00 00 45 85 ed 74 0b May 16 08:09:19 Tower kernel: ---[ end trace 4497dd8cdf1a55bb ]--- May 16 08:09:19 Tower kernel: ------------[ cut here ]------------ May 16 08:09:19 Tower kernel: WARNING: CPU: 0 PID: 2245 at fs/btrfs/scrub.c:2044 scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:09:19 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:09:19 Tower kernel: CPU: 0 PID: 2245 Comm: kworker/u24:8 Tainted: G W 4.14.16-unRAID #1 May 16 08:09:19 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:09:19 Tower kernel: Workqueue: btrfs-scrub btrfs_scrub_helper May 16 08:09:19 Tower kernel: task: ffff8810383fe200 task.stack: ffffc90006704000 May 16 08:09:19 Tower kernel: RIP: 0010:scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:09:19 Tower kernel: RSP: 0018:ffffc90006707df0 EFLAGS: 00010246 May 16 08:09:19 Tower kernel: RAX: 000000ffff880fd8 RBX: ffff880eddd59f00 RCX: 0000000000000001 May 16 08:09:19 Tower kernel: RDX: ffff880edd7c5400 RSI: 0001000000000000 RDI: ffff88103ec03200 May 16 08:09:19 Tower kernel: RBP: ffff880ff4d0d140 R08: 0000000000000001 R09: ffffffff8122d300 May 16 08:09:19 Tower kernel: R10: ffffea003b775600 R11: ffff8810383fe201 R12: ffff880f2d433400 May 16 08:09:19 Tower kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000002 May 16 08:09:19 Tower kernel: FS: 0000000000000000(0000) GS:ffff88103f200000(0000) knlGS:0000000000000000 May 16 08:09:19 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:09:19 Tower kernel: CR2: 0000152ef3f8f2c0 CR3: 0000000001c0a002 CR4: 00000000001606f0 May 16 08:09:19 Tower kernel: Call Trace: May 16 08:09:19 Tower kernel: ? set_next_entity+0x123/0x351 May 16 08:09:19 Tower kernel: btrfs_worker_helper+0xc2/0x185 May 16 08:09:19 Tower kernel: process_one_work+0x14c/0x23f May 16 08:09:19 Tower kernel: ? rescuer_thread+0x258/0x258 May 16 08:09:19 Tower kernel: worker_thread+0x1c3/0x292 May 16 08:09:19 Tower kernel: kthread+0x111/0x119 May 16 08:09:19 Tower kernel: ? kthread_create_on_node+0x3a/0x3a May 16 08:09:19 Tower kernel: ret_from_fork+0x35/0x40 May 16 08:09:19 Tower kernel: Code: ff 86 e8 02 00 00 48 89 c7 e8 52 fc 3a 00 48 8b 03 45 85 ed be 03 00 00 00 48 8b 78 10 75 05 be 04 00 00 00 e8 9e 95 fd ff eb 02 <0f> ff 48 8b 83 90 00 00 00 44 8b a8 5c 02 00 00 45 85 ed 74 0b May 16 08:09:19 Tower kernel: ---[ end trace 4497dd8cdf1a55bc ]--- May 16 08:09:19 Tower kernel: ------------[ cut here ]------------ May 16 08:09:19 Tower kernel: WARNING: CPU: 0 PID: 2245 at fs/btrfs/scrub.c:2044 scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:09:19 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:09:19 Tower kernel: CPU: 0 PID: 2245 Comm: kworker/u24:8 Tainted: G W 4.14.16-unRAID #1 May 16 08:09:19 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:09:19 Tower kernel: Workqueue: btrfs-scrub btrfs_scrub_helper May 16 08:09:19 Tower kernel: task: ffff8810383fe200 task.stack: ffffc90006704000 May 16 08:09:19 Tower kernel: RIP: 0010:scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:09:19 Tower kernel: RSP: 0018:ffffc90006707df0 EFLAGS: 00010246 May 16 08:09:19 Tower kernel: RAX: 000000ffff880fd8 RBX: ffff880eddd58900 RCX: 0000000000000001 May 16 08:09:19 Tower kernel: RDX: ffff880edd7c5380 RSI: 0001000000000000 RDI: ffff88103ec03200 May 16 08:09:19 Tower kernel: RBP: ffff880ff4d0d140 R08: 0000000000000001 R09: ffffffff8122d300 May 16 08:09:19 Tower kernel: R10: ffffea003b775600 R11: ffff8810383fe201 R12: ffff880f2d433400 May 16 08:09:19 Tower kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000003 May 16 08:09:19 Tower kernel: FS: 0000000000000000(0000) GS:ffff88103f200000(0000) knlGS:0000000000000000 May 16 08:09:19 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:09:19 Tower kernel: CR2: 0000152ef3f8f2c0 CR3: 0000000001c0a002 CR4: 00000000001606f0 May 16 08:09:19 Tower kernel: Call Trace: May 16 08:09:19 Tower kernel: ? set_next_entity+0x123/0x351 May 16 08:09:19 Tower kernel: btrfs_worker_helper+0xc2/0x185 May 16 08:09:19 Tower kernel: process_one_work+0x14c/0x23f May 16 08:09:19 Tower kernel: ? rescuer_thread+0x258/0x258 May 16 08:09:19 Tower kernel: worker_thread+0x1c3/0x292 May 16 08:09:19 Tower kernel: kthread+0x111/0x119 May 16 08:09:19 Tower kernel: ? kthread_create_on_node+0x3a/0x3a May 16 08:09:19 Tower kernel: ret_from_fork+0x35/0x40 May 16 08:09:19 Tower kernel: Code: ff 86 e8 02 00 00 48 89 c7 e8 52 fc 3a 00 48 8b 03 45 85 ed be 03 00 00 00 48 8b 78 10 75 05 be 04 00 00 00 e8 9e 95 fd ff eb 02 <0f> ff 48 8b 83 90 00 00 00 44 8b a8 5c 02 00 00 45 85 ed 74 0b May 16 08:09:19 Tower kernel: ---[ end trace 4497dd8cdf1a55bd ]--- May 16 08:13:00 Tower root: Fix Common Problems Version 2018.04.25 May 16 08:13:12 Tower root: Fix Common Problems: Error: Call Traces found on your server May 16 08:13:13 Tower kernel: ------------[ cut here ]------------ May 16 08:13:13 Tower kernel: WARNING: CPU: 6 PID: 18866 at fs/btrfs/scrub.c:2746 scrub_stripe+0xb02/0xd92 May 16 08:13:13 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:13:13 Tower kernel: CPU: 6 PID: 18866 Comm: btrfs Tainted: G W 4.14.16-unRAID #1 May 16 08:13:13 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:13:13 Tower kernel: task: ffff880efec0c600 task.stack: ffffc9000be58000 May 16 08:13:13 Tower kernel: RIP: 0010:scrub_stripe+0xb02/0xd92 May 16 08:13:13 Tower kernel: RSP: 0018:ffffc9000be5ba50 EFLAGS: 00010246 May 16 08:13:13 Tower kernel: RAX: 0000000000001000 RBX: ffff880f2d695400 RCX: 0000000000000000 May 16 08:13:13 Tower kernel: RDX: 000000008a92c306 RSI: ffff881013c6e850 RDI: ffff881033e5a300 May 16 08:13:13 Tower kernel: RBP: ffffc9000be5bc00 R08: 000060efc08012b0 R09: ffffffff811d3060 May 16 08:13:13 Tower kernel: R10: ffffea00404f1b80 R11: 0000000000000000 R12: 0000000000003000 May 16 08:13:13 Tower kernel: R13: 0000041400901000 R14: ffff88103527ed80 R15: 0000000000000000 May 16 08:13:13 Tower kernel: FS: 0000154229502700(0000) GS:ffff88103f380000(0000) knlGS:0000000000000000 May 16 08:13:13 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:13:13 Tower kernel: CR2: 0000000000636000 CR3: 0000000f82722005 CR4: 00000000001606e0 May 16 08:13:13 Tower kernel: Call Trace: May 16 08:13:13 Tower kernel: ? comp_keys+0x26/0x2b May 16 08:13:13 Tower kernel: ? scrub_chunk+0x108/0x133 May 16 08:13:13 Tower kernel: scrub_chunk+0x108/0x133 May 16 08:13:13 Tower kernel: scrub_enumerate_chunks+0x2f1/0x51b May 16 08:13:13 Tower kernel: ? wait_woken+0x1a/0x68 May 16 08:13:13 Tower kernel: btrfs_scrub_dev+0x2b9/0x400 May 16 08:13:13 Tower kernel: ? __kmalloc_track_caller+0xd1/0x11c May 16 08:13:13 Tower kernel: btrfs_ioctl+0x13d4/0x1e00 May 16 08:13:13 Tower kernel: ? kmem_cache_alloc_node+0xd0/0x105 May 16 08:13:13 Tower kernel: ? vfs_ioctl+0x19/0x26 May 16 08:13:13 Tower kernel: ? btrfs_ioctl_get_supported_features+0x1d/0x1d May 16 08:13:13 Tower kernel: vfs_ioctl+0x19/0x26 May 16 08:13:13 Tower kernel: do_vfs_ioctl+0x506/0x519 May 16 08:13:13 Tower kernel: ? get_task_io_context+0x3c/0x64 May 16 08:13:13 Tower kernel: SyS_ioctl+0x39/0x55 May 16 08:13:13 Tower kernel: entry_SYSCALL_64_fastpath+0x24/0x87 May 16 08:13:13 Tower kernel: RIP: 0033:0x15422980f727 May 16 08:13:13 Tower kernel: RSP: 002b:0000154229501d68 EFLAGS: 00000246 May 16 08:13:13 Tower kernel: Code: ff 89 85 c0 fe ff ff e8 09 e8 3a 00 48 ff 83 a8 02 00 00 4c 01 a3 b8 02 00 00 e9 1f fe ff ff 8b 80 5c 13 00 00 89 85 c0 fe ff ff <0f> ff e9 14 fe ff ff 48 89 df e8 4a ae ff ff 4d 8d 4f 38 49 89 May 16 08:13:13 Tower kernel: ---[ end trace 4497dd8cdf1a55be ]--- May 16 08:13:13 Tower kernel: ------------[ cut here ]------------ May 16 08:13:13 Tower kernel: WARNING: CPU: 0 PID: 13024 at fs/btrfs/scrub.c:2044 scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:13:13 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:13:13 Tower kernel: CPU: 0 PID: 13024 Comm: kworker/u24:1 Tainted: G W 4.14.16-unRAID #1 May 16 08:13:13 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:13:13 Tower kernel: Workqueue: btrfs-scrub btrfs_scrub_helper May 16 08:13:13 Tower kernel: task: ffff881013d2c600 task.stack: ffffc900207b4000 May 16 08:13:13 Tower kernel: RIP: 0010:scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:13:13 Tower kernel: RSP: 0018:ffffc900207b7df0 EFLAGS: 00010246 May 16 08:13:13 Tower kernel: RAX: 000000ffff880fd8 RBX: ffff880f90ee2b00 RCX: 0000000000000001 May 16 08:13:13 Tower kernel: RDX: ffff880fee9d6f80 RSI: 0001000000000000 RDI: ffff88103ec03200 May 16 08:13:13 Tower kernel: RBP: ffff880feca98540 R08: 0000000000000001 R09: ffffffff8122d300 May 16 08:13:13 Tower kernel: R10: ffffea003b35db00 R11: ffff88103f260901 R12: ffff880f2d695400 May 16 08:13:13 Tower kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000001 May 16 08:13:13 Tower kernel: FS: 0000000000000000(0000) GS:ffff88103f200000(0000) knlGS:0000000000000000 May 16 08:13:13 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:13:13 Tower kernel: CR2: 000014a319ebfb30 CR3: 0000000001c0a002 CR4: 00000000001606f0 May 16 08:13:13 Tower kernel: Call Trace: May 16 08:13:13 Tower kernel: ? enqueue_task_fair+0x94/0x42c May 16 08:13:13 Tower kernel: ? resched_curr+0x38/0x4b May 16 08:13:13 Tower kernel: ? check_preempt_curr+0x4a/0x71 May 16 08:13:13 Tower kernel: btrfs_worker_helper+0xc2/0x185 May 16 08:13:13 Tower kernel: process_one_work+0x14c/0x23f May 16 08:13:13 Tower kernel: ? rescuer_thread+0x258/0x258 May 16 08:13:13 Tower kernel: worker_thread+0x1c3/0x292 May 16 08:13:13 Tower kernel: kthread+0x111/0x119 May 16 08:13:13 Tower kernel: ? kthread_create_on_node+0x3a/0x3a May 16 08:13:13 Tower kernel: ? do_group_exit+0x95/0x95 May 16 08:13:13 Tower kernel: ret_from_fork+0x35/0x40 May 16 08:13:13 Tower kernel: Code: ff 86 e8 02 00 00 48 89 c7 e8 52 fc 3a 00 48 8b 03 45 85 ed be 03 00 00 00 48 8b 78 10 75 05 be 04 00 00 00 e8 9e 95 fd ff eb 02 <0f> ff 48 8b 83 90 00 00 00 44 8b a8 5c 02 00 00 45 85 ed 74 0b May 16 08:13:13 Tower kernel: ---[ end trace 4497dd8cdf1a55bf ]--- May 16 08:13:13 Tower kernel: ------------[ cut here ]------------ May 16 08:13:13 Tower kernel: WARNING: CPU: 0 PID: 13024 at fs/btrfs/scrub.c:2044 scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:13:13 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:13:13 Tower kernel: CPU: 0 PID: 13024 Comm: kworker/u24:1 Tainted: G W 4.14.16-unRAID #1 May 16 08:13:13 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:13:13 Tower kernel: Workqueue: btrfs-scrub btrfs_scrub_helper May 16 08:13:13 Tower kernel: task: ffff881013d2c600 task.stack: ffffc900207b4000 May 16 08:13:13 Tower kernel: RIP: 0010:scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:13:13 Tower kernel: RSP: 0018:ffffc900207b7df0 EFLAGS: 00010246 May 16 08:13:13 Tower kernel: RAX: 000000ffff880fd8 RBX: ffff880f90ee3b00 RCX: 0000000000000001 May 16 08:13:13 Tower kernel: RDX: ffff880fee9d6500 RSI: 0001000000000000 RDI: 000000000000001f May 16 08:13:13 Tower kernel: RBP: ffff880feca98540 R08: 0000000000000001 R09: ffffffff8122d301 May 16 08:13:13 Tower kernel: R10: ffffea003e43b880 R11: ffff88103f260900 R12: ffff880f2d695400 May 16 08:13:13 Tower kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000002 May 16 08:13:13 Tower kernel: FS: 0000000000000000(0000) GS:ffff88103f200000(0000) knlGS:0000000000000000 May 16 08:13:13 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:13:13 Tower kernel: CR2: 000014a319ebfb30 CR3: 0000000001c0a002 CR4: 00000000001606f0 May 16 08:13:13 Tower kernel: Call Trace: May 16 08:13:13 Tower kernel: ? enqueue_task_fair+0x94/0x42c May 16 08:13:13 Tower kernel: ? resched_curr+0x38/0x4b May 16 08:13:13 Tower kernel: ? check_preempt_curr+0x4a/0x71 May 16 08:13:13 Tower kernel: btrfs_worker_helper+0xc2/0x185 May 16 08:13:13 Tower kernel: process_one_work+0x14c/0x23f May 16 08:13:13 Tower kernel: ? rescuer_thread+0x258/0x258 May 16 08:13:13 Tower kernel: worker_thread+0x1c3/0x292 May 16 08:13:13 Tower kernel: kthread+0x111/0x119 May 16 08:13:13 Tower kernel: ? kthread_create_on_node+0x3a/0x3a May 16 08:13:13 Tower kernel: ? do_group_exit+0x95/0x95 May 16 08:13:13 Tower kernel: ret_from_fork+0x35/0x40 May 16 08:13:13 Tower kernel: Code: ff 86 e8 02 00 00 48 89 c7 e8 52 fc 3a 00 48 8b 03 45 85 ed be 03 00 00 00 48 8b 78 10 75 05 be 04 00 00 00 e8 9e 95 fd ff eb 02 <0f> ff 48 8b 83 90 00 00 00 44 8b a8 5c 02 00 00 45 85 ed 74 0b May 16 08:13:13 Tower kernel: ---[ end trace 4497dd8cdf1a55c0 ]--- May 16 08:13:13 Tower kernel: ------------[ cut here ]------------ May 16 08:13:13 Tower kernel: WARNING: CPU: 0 PID: 13024 at fs/btrfs/scrub.c:2044 scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:13:13 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:13:13 Tower kernel: CPU: 0 PID: 13024 Comm: kworker/u24:1 Tainted: G W 4.14.16-unRAID #1 May 16 08:13:13 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:13:13 Tower kernel: Workqueue: btrfs-scrub btrfs_scrub_helper May 16 08:13:13 Tower kernel: task: ffff881013d2c600 task.stack: ffffc900207b4000 May 16 08:13:13 Tower kernel: RIP: 0010:scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:13:13 Tower kernel: RSP: 0018:ffffc900207b7df0 EFLAGS: 00010246 May 16 08:13:13 Tower kernel: RAX: 000000ffff880fd8 RBX: ffff880f90ee3800 RCX: 0000000000000001 May 16 08:13:13 Tower kernel: RDX: ffff880fee9d6a80 RSI: 0001000000000000 RDI: ffff88103ec03200 May 16 08:13:13 Tower kernel: RBP: ffff880feca98540 R08: 0000000000000001 R09: ffffffff8122d300 May 16 08:13:13 Tower kernel: R10: ffffea003e43b880 R11: ffff88103f260901 R12: ffff880f2d695400 May 16 08:13:13 Tower kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000003 May 16 08:13:13 Tower kernel: FS: 0000000000000000(0000) GS:ffff88103f200000(0000) knlGS:0000000000000000 May 16 08:13:13 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:13:13 Tower kernel: CR2: 000014a319ebfb30 CR3: 0000000001c0a002 CR4: 00000000001606f0 May 16 08:13:13 Tower kernel: Call Trace: May 16 08:13:13 Tower kernel: ? enqueue_task_fair+0x94/0x42c May 16 08:13:13 Tower kernel: ? resched_curr+0x38/0x4b May 16 08:13:13 Tower kernel: ? check_preempt_curr+0x4a/0x71 May 16 08:13:13 Tower kernel: btrfs_worker_helper+0xc2/0x185 May 16 08:13:13 Tower kernel: process_one_work+0x14c/0x23f May 16 08:13:13 Tower kernel: ? rescuer_thread+0x258/0x258 May 16 08:13:13 Tower kernel: worker_thread+0x1c3/0x292 May 16 08:13:13 Tower kernel: kthread+0x111/0x119 May 16 08:13:13 Tower kernel: ? kthread_create_on_node+0x3a/0x3a May 16 08:13:13 Tower kernel: ? do_group_exit+0x95/0x95 May 16 08:13:13 Tower kernel: ret_from_fork+0x35/0x40 May 16 08:13:13 Tower kernel: Code: ff 86 e8 02 00 00 48 89 c7 e8 52 fc 3a 00 48 8b 03 45 85 ed be 03 00 00 00 48 8b 78 10 75 05 be 04 00 00 00 e8 9e 95 fd ff eb 02 <0f> ff 48 8b 83 90 00 00 00 44 8b a8 5c 02 00 00 45 85 ed 74 0b May 16 08:13:13 Tower kernel: ---[ end trace 4497dd8cdf1a55c1 ]--- May 16 08:13:13 Tower kernel: pcieport 0000:00:1c.7: Enabling MPC IRBNCE May 16 08:13:13 Tower kernel: pcieport 0000:00:1c.7: Intel PCH root port ACS workaround enabled May 16 08:13:13 Tower root: Fix Common Problems: Other Warning: Mover logging is enabled May 16 08:13:13 Tower sSMTP[11479]: Creating SSL connection to host May 16 08:13:13 Tower sSMTP[11479]: SSL connection using ECDHE-RSA-AES256-GCM-SHA384 May 16 08:13:15 Tower sSMTP[11479]: Sent mail for [email protected] (221 b-painless.mh.aa.net.uk closing connection) uid=0 username=root outbytes=653 May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4956, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4955, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4954, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4953, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4952, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4951, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4950, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4949, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4948, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4947, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4946, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4945, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4944, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4943, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4942, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4941, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4940, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4939, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4938, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4937, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4936, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4935, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4934, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4933, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4932, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4931, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4930, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4929, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4928, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4927, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4926, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4925, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4924, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4923, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4922, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4883, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4875, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4810, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS error (device sdf1): bdev /dev/sde1 errs: wr 0, rd 0, flush 0, corrupt 1, gen 0 May 16 08:14:54 Tower kernel: BTRFS error (device sdf1): unable to fixup (regular) error at logical 4868798496768 on dev /dev/sde1 May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4956, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4955, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4954, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4953, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4952, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4951, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4950, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4949, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4948, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4947, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4946, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4945, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4944, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4943, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4942, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4941, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4940, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4939, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4938, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4937, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4936, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4935, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4934, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4933, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4932, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4931, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4930, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4929, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4928, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4927, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4926, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4925, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4924, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4923, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4922, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4883, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4875, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4810, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:14:54 Tower kernel: BTRFS error (device sdf1): bdev /dev/sde1 errs: wr 0, rd 0, flush 0, corrupt 2, gen 0 May 16 08:14:54 Tower kernel: BTRFS error (device sdf1): unable to fixup (regular) error at logical 4868798500864 on dev /dev/sde1 May 16 08:15:37 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 16 08:15:37 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 16 08:22:44 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 16 08:22:44 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 16 08:23:09 Tower ool www[18045]: /usr/local/emhttp/plugins/dynamix/scripts/btrfs_scrub 'start' '/mnt/cache' '' May 16 08:26:05 Tower kernel: ------------[ cut here ]------------ May 16 08:26:05 Tower kernel: WARNING: CPU: 8 PID: 22855 at fs/btrfs/scrub.c:2746 scrub_stripe+0xb02/0xd92 May 16 08:26:05 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:26:05 Tower kernel: CPU: 8 PID: 22855 Comm: btrfs Tainted: G W 4.14.16-unRAID #1 May 16 08:26:05 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:26:05 Tower kernel: task: ffff881038768e00 task.stack: ffffc9000c4d0000 May 16 08:26:05 Tower kernel: RIP: 0010:scrub_stripe+0xb02/0xd92 May 16 08:26:05 Tower kernel: RSP: 0018:ffffc9000c4d3a50 EFLAGS: 00010246 May 16 08:26:05 Tower kernel: RAX: 0000000000001000 RBX: ffff880fed62d800 RCX: 0000000000000000 May 16 08:26:05 Tower kernel: RDX: 00000001c3a65508 RSI: ffff881002583a80 RDI: ffff881033e5a300 May 16 08:26:05 Tower kernel: RBP: ffffc9000c4d3c00 R08: 000060efc08012b0 R09: ffffffff811d3060 May 16 08:26:05 Tower kernel: R10: ffffea00400960c0 R11: 0000000000000000 R12: 0000000000003000 May 16 08:26:05 Tower kernel: R13: 0000041400901000 R14: ffff88103527ed80 R15: 0000000000000000 May 16 08:26:05 Tower kernel: FS: 000014767534a700(0000) GS:ffff88103f400000(0000) knlGS:0000000000000000 May 16 08:26:05 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:26:05 Tower kernel: CR2: 0000149cfe34f6f8 CR3: 0000000eb620c003 CR4: 00000000001606e0 May 16 08:26:05 Tower kernel: Call Trace: May 16 08:26:05 Tower kernel: ? comp_keys+0x26/0x2b May 16 08:26:05 Tower kernel: ? scrub_chunk+0x108/0x133 May 16 08:26:05 Tower kernel: scrub_chunk+0x108/0x133 May 16 08:26:05 Tower kernel: scrub_enumerate_chunks+0x2f1/0x51b May 16 08:26:05 Tower kernel: ? wait_woken+0x1a/0x68 May 16 08:26:05 Tower kernel: btrfs_scrub_dev+0x2b9/0x400 May 16 08:26:05 Tower kernel: ? __kmalloc_track_caller+0xd1/0x11c May 16 08:26:05 Tower kernel: btrfs_ioctl+0x13d4/0x1e00 May 16 08:26:05 Tower kernel: ? dequeue_entity+0x49d/0x4c2 May 16 08:26:05 Tower kernel: ? pick_next_task_fair+0x22d/0x3df May 16 08:26:05 Tower kernel: ? put_prev_entity+0x21/0x2dc May 16 08:26:05 Tower kernel: ? __update_idle_core+0x14/0x9a May 16 08:26:05 Tower kernel: ? kmem_cache_alloc_node+0xd0/0x105 May 16 08:26:05 Tower kernel: ? vfs_ioctl+0x19/0x26 May 16 08:26:05 Tower kernel: ? btrfs_ioctl_get_supported_features+0x1d/0x1d May 16 08:26:05 Tower kernel: vfs_ioctl+0x19/0x26 May 16 08:26:05 Tower kernel: do_vfs_ioctl+0x506/0x519 May 16 08:26:05 Tower kernel: ? get_task_io_context+0x3c/0x64 May 16 08:26:05 Tower kernel: SyS_ioctl+0x39/0x55 May 16 08:26:05 Tower kernel: entry_SYSCALL_64_fastpath+0x24/0x87 May 16 08:26:05 Tower kernel: RIP: 0033:0x147675456727 May 16 08:26:05 Tower kernel: RSP: 002b:0000147675349d68 EFLAGS: 00000246 May 16 08:26:05 Tower kernel: Code: ff 89 85 c0 fe ff ff e8 09 e8 3a 00 48 ff 83 a8 02 00 00 4c 01 a3 b8 02 00 00 e9 1f fe ff ff 8b 80 5c 13 00 00 89 85 c0 fe ff ff <0f> ff e9 14 fe ff ff 48 89 df e8 4a ae ff ff 4d 8d 4f 38 49 89 May 16 08:26:05 Tower kernel: ---[ end trace 4497dd8cdf1a55c2 ]--- May 16 08:26:05 Tower kernel: ------------[ cut here ]------------ May 16 08:26:05 Tower kernel: WARNING: CPU: 0 PID: 13023 at fs/btrfs/scrub.c:2044 scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:26:05 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:26:05 Tower kernel: CPU: 0 PID: 13023 Comm: kworker/u24:0 Tainted: G W 4.14.16-unRAID #1 May 16 08:26:05 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:26:05 Tower kernel: Workqueue: btrfs-scrub btrfs_scrub_helper May 16 08:26:05 Tower kernel: task: ffff881013e1d400 task.stack: ffffc90020b6c000 May 16 08:26:05 Tower kernel: RIP: 0010:scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:26:05 Tower kernel: RSP: 0018:ffffc90020b6fdf0 EFLAGS: 00010246 May 16 08:26:05 Tower kernel: RAX: 000000ffff880fd8 RBX: ffff880eb58b4600 RCX: 0000000000000001 May 16 08:26:05 Tower kernel: RDX: ffff880eb5156600 RSI: 0001000000000000 RDI: ffff88103ec03200 May 16 08:26:05 Tower kernel: RBP: ffff880ff0f19940 R08: 0000000000000001 R09: ffffffff8122d300 May 16 08:26:05 Tower kernel: R10: ffffea003ad62d00 R11: ffff88103f3a0901 R12: ffff880fed62d800 May 16 08:26:05 Tower kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000001 May 16 08:26:05 Tower kernel: FS: 0000000000000000(0000) GS:ffff88103f200000(0000) knlGS:0000000000000000 May 16 08:26:05 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:26:05 Tower kernel: CR2: 00007ffdccf71fb0 CR3: 0000000001c0a004 CR4: 00000000001606f0 May 16 08:26:05 Tower kernel: Call Trace: May 16 08:26:05 Tower kernel: ? enqueue_task_fair+0x94/0x42c May 16 08:26:05 Tower kernel: ? resched_curr+0x38/0x4b May 16 08:26:05 Tower kernel: ? check_preempt_curr+0x4a/0x71 May 16 08:26:05 Tower kernel: btrfs_worker_helper+0xc2/0x185 May 16 08:26:05 Tower kernel: process_one_work+0x14c/0x23f May 16 08:26:05 Tower kernel: ? rescuer_thread+0x258/0x258 May 16 08:26:05 Tower kernel: worker_thread+0x1c3/0x292 May 16 08:26:05 Tower kernel: kthread+0x111/0x119 May 16 08:26:05 Tower kernel: ? kthread_create_on_node+0x3a/0x3a May 16 08:26:05 Tower kernel: ? do_group_exit+0x95/0x95 May 16 08:26:05 Tower kernel: ret_from_fork+0x35/0x40 May 16 08:26:05 Tower kernel: Code: ff 86 e8 02 00 00 48 89 c7 e8 52 fc 3a 00 48 8b 03 45 85 ed be 03 00 00 00 48 8b 78 10 75 05 be 04 00 00 00 e8 9e 95 fd ff eb 02 <0f> ff 48 8b 83 90 00 00 00 44 8b a8 5c 02 00 00 45 85 ed 74 0b May 16 08:26:05 Tower kernel: ---[ end trace 4497dd8cdf1a55c3 ]--- May 16 08:26:05 Tower kernel: ------------[ cut here ]------------ May 16 08:26:05 Tower kernel: WARNING: CPU: 0 PID: 13023 at fs/btrfs/scrub.c:2044 scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:26:05 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:26:05 Tower kernel: CPU: 0 PID: 13023 Comm: kworker/u24:0 Tainted: G W 4.14.16-unRAID #1 May 16 08:26:05 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:26:05 Tower kernel: Workqueue: btrfs-scrub btrfs_scrub_helper May 16 08:26:05 Tower kernel: task: ffff881013e1d400 task.stack: ffffc90020b6c000 May 16 08:26:05 Tower kernel: RIP: 0010:scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:26:05 Tower kernel: RSP: 0018:ffffc90020b6fdf0 EFLAGS: 00010246 May 16 08:26:05 Tower kernel: RAX: 000000ffff880fd8 RBX: ffff880eb58b4700 RCX: 0000000000000001 May 16 08:26:05 Tower kernel: RDX: ffff880eb5156680 RSI: 0001000000000000 RDI: ffff88103ec03200 May 16 08:26:05 Tower kernel: RBP: ffff880ff0f19940 R08: 0000000000000001 R09: ffffffff8122d300 May 16 08:26:05 Tower kernel: R10: ffffea003ad62d00 R11: ffff88103f3a0901 R12: ffff880fed62d800 May 16 08:26:05 Tower kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000002 May 16 08:26:05 Tower kernel: FS: 0000000000000000(0000) GS:ffff88103f200000(0000) knlGS:0000000000000000 May 16 08:26:05 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:26:05 Tower kernel: CR2: 00007ffdccf71fb0 CR3: 0000000001c0a004 CR4: 00000000001606f0 May 16 08:26:05 Tower kernel: Call Trace: May 16 08:26:05 Tower kernel: ? enqueue_task_fair+0x94/0x42c May 16 08:26:05 Tower kernel: ? resched_curr+0x38/0x4b May 16 08:26:05 Tower kernel: ? check_preempt_curr+0x4a/0x71 May 16 08:26:05 Tower kernel: btrfs_worker_helper+0xc2/0x185 May 16 08:26:05 Tower kernel: process_one_work+0x14c/0x23f May 16 08:26:05 Tower kernel: ? rescuer_thread+0x258/0x258 May 16 08:26:05 Tower kernel: worker_thread+0x1c3/0x292 May 16 08:26:05 Tower kernel: kthread+0x111/0x119 May 16 08:26:05 Tower kernel: ? kthread_create_on_node+0x3a/0x3a May 16 08:26:05 Tower kernel: ? do_group_exit+0x95/0x95 May 16 08:26:05 Tower kernel: ret_from_fork+0x35/0x40 May 16 08:26:05 Tower kernel: Code: ff 86 e8 02 00 00 48 89 c7 e8 52 fc 3a 00 48 8b 03 45 85 ed be 03 00 00 00 48 8b 78 10 75 05 be 04 00 00 00 e8 9e 95 fd ff eb 02 <0f> ff 48 8b 83 90 00 00 00 44 8b a8 5c 02 00 00 45 85 ed 74 0b May 16 08:26:05 Tower kernel: ---[ end trace 4497dd8cdf1a55c4 ]--- May 16 08:26:05 Tower kernel: ------------[ cut here ]------------ May 16 08:26:05 Tower kernel: WARNING: CPU: 0 PID: 13023 at fs/btrfs/scrub.c:2044 scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:26:05 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:26:05 Tower kernel: CPU: 0 PID: 13023 Comm: kworker/u24:0 Tainted: G W 4.14.16-unRAID #1 May 16 08:26:05 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:26:05 Tower kernel: Workqueue: btrfs-scrub btrfs_scrub_helper May 16 08:26:05 Tower kernel: task: ffff881013e1d400 task.stack: ffffc90020b6c000 May 16 08:26:05 Tower kernel: RIP: 0010:scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:26:05 Tower kernel: RSP: 0018:ffffc90020b6fdf0 EFLAGS: 00010246 May 16 08:26:05 Tower kernel: RAX: 000000ffff880fd8 RBX: ffff880eb58b4800 RCX: 0000000000000001 May 16 08:26:05 Tower kernel: RDX: ffff880eb5156700 RSI: 0001000000000000 RDI: ffff88103ec03200 May 16 08:26:05 Tower kernel: RBP: ffff880ff0f19940 R08: 0000000000000001 R09: ffffffff8122d300 May 16 08:26:05 Tower kernel: R10: ffffea003ad62d00 R11: ffff88103f3a0901 R12: ffff880fed62d800 May 16 08:26:05 Tower kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000003 May 16 08:26:05 Tower kernel: FS: 0000000000000000(0000) GS:ffff88103f200000(0000) knlGS:0000000000000000 May 16 08:26:05 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:26:05 Tower kernel: CR2: 00007ffdccf71fb0 CR3: 0000000001c0a004 CR4: 00000000001606f0 May 16 08:26:05 Tower kernel: Call Trace: May 16 08:26:05 Tower kernel: ? enqueue_task_fair+0x94/0x42c May 16 08:26:05 Tower kernel: ? resched_curr+0x38/0x4b May 16 08:26:05 Tower kernel: ? check_preempt_curr+0x4a/0x71 May 16 08:26:05 Tower kernel: btrfs_worker_helper+0xc2/0x185 May 16 08:26:05 Tower kernel: process_one_work+0x14c/0x23f May 16 08:26:05 Tower kernel: ? rescuer_thread+0x258/0x258 May 16 08:26:05 Tower kernel: worker_thread+0x1c3/0x292 May 16 08:26:05 Tower kernel: kthread+0x111/0x119 May 16 08:26:05 Tower kernel: ? kthread_create_on_node+0x3a/0x3a May 16 08:26:05 Tower kernel: ? do_group_exit+0x95/0x95 May 16 08:26:05 Tower kernel: ret_from_fork+0x35/0x40 May 16 08:26:05 Tower kernel: Code: ff 86 e8 02 00 00 48 89 c7 e8 52 fc 3a 00 48 8b 03 45 85 ed be 03 00 00 00 48 8b 78 10 75 05 be 04 00 00 00 e8 9e 95 fd ff eb 02 <0f> ff 48 8b 83 90 00 00 00 44 8b a8 5c 02 00 00 45 85 ed 74 0b May 16 08:26:05 Tower kernel: ---[ end trace 4497dd8cdf1a55c5 ]--- May 16 08:29:45 Tower kernel: mdcmd (50): spindown 1 May 16 08:29:59 Tower kernel: mdcmd (51): spindown 3 May 16 08:30:01 Tower kernel: mdcmd (52): spindown 0 May 16 08:30:01 Tower kernel: mdcmd (53): spindown 2 May 16 08:30:12 Tower kernel: ------------[ cut here ]------------ May 16 08:30:12 Tower kernel: WARNING: CPU: 8 PID: 22856 at fs/btrfs/scrub.c:2746 scrub_stripe+0xb02/0xd92 May 16 08:30:12 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:30:12 Tower kernel: CPU: 8 PID: 22856 Comm: btrfs Tainted: G W 4.14.16-unRAID #1 May 16 08:30:12 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:30:12 Tower kernel: task: ffff88103876e200 task.stack: ffffc9000c930000 May 16 08:30:12 Tower kernel: RIP: 0010:scrub_stripe+0xb02/0xd92 May 16 08:30:12 Tower kernel: RSP: 0018:ffffc9000c933a50 EFLAGS: 00010246 May 16 08:30:12 Tower kernel: RAX: 0000000000001000 RBX: ffff880fe99da800 RCX: 0000000000000000 May 16 08:30:12 Tower kernel: RDX: 000000022bf4f908 RSI: ffff881002583690 RDI: ffff881033e5a300 May 16 08:30:12 Tower kernel: RBP: ffffc9000c933c00 R08: 000060efc08012b0 R09: ffffffff811d3060 May 16 08:30:12 Tower kernel: R10: ffffea00400960c0 R11: 0000000000000000 R12: 0000000000003000 May 16 08:30:12 Tower kernel: R13: 0000041400901000 R14: ffff88103527ed80 R15: 0000000000000000 May 16 08:30:12 Tower kernel: FS: 0000147675149700(0000) GS:ffff88103f400000(0000) knlGS:0000000000000000 May 16 08:30:12 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:30:12 Tower kernel: CR2: 00000000006517e0 CR3: 0000000eb620c001 CR4: 00000000001606e0 May 16 08:30:12 Tower kernel: Call Trace: May 16 08:30:12 Tower kernel: ? comp_keys+0x26/0x2b May 16 08:30:12 Tower kernel: ? scrub_chunk+0x108/0x133 May 16 08:30:12 Tower kernel: scrub_chunk+0x108/0x133 May 16 08:30:12 Tower kernel: scrub_enumerate_chunks+0x2f1/0x51b May 16 08:30:12 Tower kernel: ? wait_woken+0x1a/0x68 May 16 08:30:12 Tower kernel: btrfs_scrub_dev+0x2b9/0x400 May 16 08:30:12 Tower kernel: ? __kmalloc_track_caller+0xd1/0x11c May 16 08:30:12 Tower kernel: btrfs_ioctl+0x13d4/0x1e00 May 16 08:30:12 Tower kernel: ? kmem_cache_alloc_node+0xd0/0x105 May 16 08:30:12 Tower kernel: ? vfs_ioctl+0x19/0x26 May 16 08:30:12 Tower kernel: ? btrfs_ioctl_get_supported_features+0x1d/0x1d May 16 08:30:12 Tower kernel: vfs_ioctl+0x19/0x26 May 16 08:30:12 Tower kernel: do_vfs_ioctl+0x506/0x519 May 16 08:30:12 Tower kernel: ? get_task_io_context+0x3c/0x64 May 16 08:30:12 Tower kernel: SyS_ioctl+0x39/0x55 May 16 08:30:12 Tower kernel: entry_SYSCALL_64_fastpath+0x24/0x87 May 16 08:30:12 Tower kernel: RIP: 0033:0x147675456727 May 16 08:30:12 Tower kernel: RSP: 002b:0000147675148d68 EFLAGS: 00000246 May 16 08:30:12 Tower kernel: Code: ff 89 85 c0 fe ff ff e8 09 e8 3a 00 48 ff 83 a8 02 00 00 4c 01 a3 b8 02 00 00 e9 1f fe ff ff 8b 80 5c 13 00 00 89 85 c0 fe ff ff <0f> ff e9 14 fe ff ff 48 89 df e8 4a ae ff ff 4d 8d 4f 38 49 89 May 16 08:30:12 Tower kernel: ---[ end trace 4497dd8cdf1a55c6 ]--- May 16 08:30:12 Tower kernel: ------------[ cut here ]------------ May 16 08:30:12 Tower kernel: WARNING: CPU: 8 PID: 79 at fs/btrfs/scrub.c:2044 scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:30:12 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:30:12 Tower kernel: CPU: 8 PID: 79 Comm: kworker/u24:3 Tainted: G W 4.14.16-unRAID #1 May 16 08:30:12 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:30:12 Tower kernel: Workqueue: btrfs-scrub btrfs_scrub_helper May 16 08:30:12 Tower kernel: task: ffff881038769c00 task.stack: ffffc90006574000 May 16 08:30:12 Tower kernel: RIP: 0010:scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:30:12 Tower kernel: RSP: 0018:ffffc90006577df0 EFLAGS: 00010246 May 16 08:30:12 Tower kernel: RAX: 000000ffff880fd8 RBX: ffff880eb66ee900 RCX: 0000000000000001 May 16 08:30:12 Tower kernel: RDX: ffff880eb51f5380 RSI: 0001000000000000 RDI: 000000000000001f May 16 08:30:12 Tower kernel: RBP: ffff880fec71f140 R08: 0000000000000001 R09: ffffffff8122d301 May 16 08:30:12 Tower kernel: R10: ffffea003ad9bb80 R11: ffff88103f2a0900 R12: ffff880fe99da800 May 16 08:30:12 Tower kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000001 May 16 08:30:12 Tower kernel: FS: 0000000000000000(0000) GS:ffff88103f400000(0000) knlGS:0000000000000000 May 16 08:30:12 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:30:12 Tower kernel: CR2: 00000000006517e0 CR3: 0000000001c0a004 CR4: 00000000001606e0 May 16 08:30:12 Tower kernel: Call Trace: May 16 08:30:12 Tower kernel: ? check_preempt_wakeup+0x12b/0x179 May 16 08:30:12 Tower kernel: ? check_preempt_curr+0x2a/0x71 May 16 08:30:12 Tower kernel: btrfs_worker_helper+0xc2/0x185 May 16 08:30:12 Tower kernel: process_one_work+0x14c/0x23f May 16 08:30:12 Tower kernel: ? rescuer_thread+0x258/0x258 May 16 08:30:12 Tower kernel: worker_thread+0x1c3/0x292 May 16 08:30:12 Tower kernel: kthread+0x111/0x119 May 16 08:30:12 Tower kernel: ? kthread_create_on_node+0x3a/0x3a May 16 08:30:12 Tower kernel: ? call_usermodehelper_exec_async+0x116/0x11d May 16 08:30:12 Tower kernel: ret_from_fork+0x35/0x40 May 16 08:30:12 Tower kernel: Code: ff 86 e8 02 00 00 48 89 c7 e8 52 fc 3a 00 48 8b 03 45 85 ed be 03 00 00 00 48 8b 78 10 75 05 be 04 00 00 00 e8 9e 95 fd ff eb 02 <0f> ff 48 8b 83 90 00 00 00 44 8b a8 5c 02 00 00 45 85 ed 74 0b May 16 08:30:12 Tower kernel: ---[ end trace 4497dd8cdf1a55c7 ]--- May 16 08:30:12 Tower kernel: ------------[ cut here ]------------ May 16 08:30:12 Tower kernel: WARNING: CPU: 8 PID: 79 at fs/btrfs/scrub.c:2044 scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:30:12 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:30:12 Tower kernel: CPU: 8 PID: 79 Comm: kworker/u24:3 Tainted: G W 4.14.16-unRAID #1 May 16 08:30:12 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:30:12 Tower kernel: Workqueue: btrfs-scrub btrfs_scrub_helper May 16 08:30:12 Tower kernel: task: ffff881038769c00 task.stack: ffffc90006574000 May 16 08:30:12 Tower kernel: RIP: 0010:scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:30:12 Tower kernel: RSP: 0018:ffffc90006577df0 EFLAGS: 00010246 May 16 08:30:12 Tower kernel: RAX: 000000ffff880fd8 RBX: ffff880eb66ef900 RCX: 0000000000000001 May 16 08:30:12 Tower kernel: RDX: ffff880eb51f5400 RSI: 0001000000000000 RDI: ffff88103ec03200 May 16 08:30:12 Tower kernel: RBP: ffff880fec71f140 R08: 0000000000000001 R09: ffffffff8122d300 May 16 08:30:12 Tower kernel: R10: ffffea003ad9bb80 R11: ffff88103f2a0901 R12: ffff880fe99da800 May 16 08:30:12 Tower kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000002 May 16 08:30:12 Tower kernel: FS: 0000000000000000(0000) GS:ffff88103f400000(0000) knlGS:0000000000000000 May 16 08:30:12 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:30:12 Tower kernel: CR2: 00000000006517e0 CR3: 0000000001c0a004 CR4: 00000000001606e0 May 16 08:30:12 Tower kernel: Call Trace: May 16 08:30:12 Tower kernel: ? check_preempt_wakeup+0x12b/0x179 May 16 08:30:12 Tower kernel: ? check_preempt_curr+0x2a/0x71 May 16 08:30:12 Tower kernel: btrfs_worker_helper+0xc2/0x185 May 16 08:30:12 Tower kernel: process_one_work+0x14c/0x23f May 16 08:30:12 Tower kernel: ? rescuer_thread+0x258/0x258 May 16 08:30:12 Tower kernel: worker_thread+0x1c3/0x292 May 16 08:30:12 Tower kernel: kthread+0x111/0x119 May 16 08:30:12 Tower kernel: ? kthread_create_on_node+0x3a/0x3a May 16 08:30:12 Tower kernel: ? call_usermodehelper_exec_async+0x116/0x11d May 16 08:30:12 Tower kernel: ret_from_fork+0x35/0x40 May 16 08:30:12 Tower kernel: Code: ff 86 e8 02 00 00 48 89 c7 e8 52 fc 3a 00 48 8b 03 45 85 ed be 03 00 00 00 48 8b 78 10 75 05 be 04 00 00 00 e8 9e 95 fd ff eb 02 <0f> ff 48 8b 83 90 00 00 00 44 8b a8 5c 02 00 00 45 85 ed 74 0b May 16 08:30:12 Tower kernel: ---[ end trace 4497dd8cdf1a55c8 ]--- May 16 08:30:12 Tower kernel: ------------[ cut here ]------------ May 16 08:30:12 Tower kernel: WARNING: CPU: 8 PID: 79 at fs/btrfs/scrub.c:2044 scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:30:12 Tower kernel: Modules linked in: xfs nfsd lockd grace sunrpc md_mod ipmi_devintf nct6775 hwmon_vid mlx4_en mlx4_core igb ptp pps_core ipmi_ssif sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd glue_helper ast ttm drm_kms_helper cryptd drm intel_cstate intel_uncore intel_rapl_perf i2c_i801 agpgart i2c_algo_bit i2c_core syscopyarea sysfillrect cdc_acm sysimgblt fb_sys_fops ahci libahci wmi acpi_power_meter ipmi_si button [last unloaded: mlx4_core] May 16 08:30:12 Tower kernel: CPU: 8 PID: 79 Comm: kworker/u24:3 Tainted: G W 4.14.16-unRAID #1 May 16 08:30:12 Tower kernel: Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0b 06/12/2017 May 16 08:30:12 Tower kernel: Workqueue: btrfs-scrub btrfs_scrub_helper May 16 08:30:12 Tower kernel: task: ffff881038769c00 task.stack: ffffc90006574000 May 16 08:30:12 Tower kernel: RIP: 0010:scrub_bio_end_io_worker+0x237/0x3d4 May 16 08:30:12 Tower kernel: RSP: 0018:ffffc90006577df0 EFLAGS: 00010246 May 16 08:30:12 Tower kernel: RAX: 000000ffff880fd8 RBX: ffff880eb66ef000 RCX: 0000000000000001 May 16 08:30:12 Tower kernel: RDX: ffff880eb51f5480 RSI: 0001000000000000 RDI: ffff88103ec03200 May 16 08:30:12 Tower kernel: RBP: ffff880fec71f140 R08: 0000000000000001 R09: ffffffff8122d300 May 16 08:30:12 Tower kernel: R10: ffffea003ad9bb80 R11: ffff88103f2a0901 R12: ffff880fe99da800 May 16 08:30:12 Tower kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000003 May 16 08:30:12 Tower kernel: FS: 0000000000000000(0000) GS:ffff88103f400000(0000) knlGS:0000000000000000 May 16 08:30:12 Tower kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 16 08:30:12 Tower kernel: CR2: 00000000006517e0 CR3: 0000000001c0a004 CR4: 00000000001606e0 May 16 08:30:12 Tower kernel: Call Trace: May 16 08:30:12 Tower kernel: ? check_preempt_wakeup+0x12b/0x179 May 16 08:30:12 Tower kernel: ? check_preempt_curr+0x2a/0x71 May 16 08:30:12 Tower kernel: btrfs_worker_helper+0xc2/0x185 May 16 08:30:12 Tower kernel: process_one_work+0x14c/0x23f May 16 08:30:12 Tower kernel: ? rescuer_thread+0x258/0x258 May 16 08:30:12 Tower kernel: worker_thread+0x1c3/0x292 May 16 08:30:12 Tower kernel: kthread+0x111/0x119 May 16 08:30:12 Tower kernel: ? kthread_create_on_node+0x3a/0x3a May 16 08:30:12 Tower kernel: ? call_usermodehelper_exec_async+0x116/0x11d May 16 08:30:12 Tower kernel: ret_from_fork+0x35/0x40 May 16 08:30:12 Tower kernel: Code: ff 86 e8 02 00 00 48 89 c7 e8 52 fc 3a 00 48 8b 03 45 85 ed be 03 00 00 00 48 8b 78 10 75 05 be 04 00 00 00 e8 9e 95 fd ff eb 02 <0f> ff 48 8b 83 90 00 00 00 44 8b a8 5c 02 00 00 45 85 ed 74 0b May 16 08:30:12 Tower kernel: ---[ end trace 4497dd8cdf1a55c9 ]--- May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4956, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4955, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4954, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4953, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4952, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4951, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4950, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4949, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4948, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4947, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4946, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4945, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4944, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4943, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4942, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4941, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4940, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4939, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4938, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4937, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4936, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4935, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4934, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4933, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4932, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4931, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4930, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4929, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4928, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4927, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4926, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4925, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4924, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4923, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4922, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4883, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4875, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798496768 on dev /dev/sde1, sector 647604640, root 4810, inode 259, offset 15611043840, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS error (device sdf1): bdev /dev/sde1 errs: wr 0, rd 0, flush 0, corrupt 3, gen 0 May 16 08:31:35 Tower kernel: BTRFS error (device sdf1): unable to fixup (regular) error at logical 4868798496768 on dev /dev/sde1 May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4956, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4955, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4954, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4953, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4952, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4951, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4950, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4949, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4948, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4947, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4946, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4945, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4944, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4943, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4942, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4941, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4940, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4939, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4938, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4937, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4936, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4935, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4934, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4933, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4932, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4931, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4930, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4929, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4928, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4927, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4926, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4925, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4924, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4923, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4922, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4883, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4875, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS warning (device sdf1): checksum error at logical 4868798500864 on dev /dev/sde1, sector 647604648, root 4810, inode 259, offset 15611047936, length 4096, links 1 (path: vDesk-Scratch/vdisk1.img) May 16 08:31:35 Tower kernel: BTRFS error (device sdf1): bdev /dev/sde1 errs: wr 0, rd 0, flush 0, corrupt 4, gen 0 May 16 08:31:35 Tower kernel: BTRFS error (device sdf1): unable to fixup (regular) error at logical 4868798500864 on dev /dev/sde1 May 16 08:32:18 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 16 08:32:19 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 16 08:40:02 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 16 08:40:03 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 16 08:47:54 Tower emhttpd: req (2): csrf_token=****************&title=System+Log&cmd=%2FwebGui%2Fscripts%2Ftail_log&arg1=syslog May 16 08:47:54 Tower emhttpd: cmd: /usr/local/emhttp/plugins/dynamix/scripts/tail_log syslog May 16 08:48:23 Tower emhttpd: req (3): csrf_token=****************&title=System+Log&cmd=%2FwebGui%2Fscripts%2Ftail_log&arg1=syslog May 16 08:48:23 Tower emhttpd: cmd: /usr/local/emhttp/plugins/dynamix/scripts/tail_log syslog May 16 08:49:16 Tower kernel: pcieport 0000:00:1c.7: Enabling MPC IRBNCE May 16 08:49:16 Tower kernel: pcieport 0000:00:1c.7: Intel PCH root port ACS workaround enabled May 16 08:51:08 Tower emhttpd: req (4): csrf_token=****************&title=System+Log&cmd=%2FwebGui%2Fscripts%2Ftail_log&arg1=syslog May 16 08:51:08 Tower emhttpd: cmd: /usr/local/emhttp/plugins/dynamix/scripts/tail_log syslog
  2. Thanks! Diags after reboot attached. tower-diagnostics-20180516-0805.zip Scrub running now
  3. Keen to get comments before I make things worse! Check btrfs file system in readonly mode gives me this. checking extents bad key ordering 101 102 bad block 4364604653568 ERROR: errors found in extent allocation tree or chunk allocation checking free space cache checking fs roots bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4941 inode 302 errors 500, file extent discount, nbytes wrong Found file extent holes: start: 0, len: 64424509440 root 4941 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4941 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4941 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4941 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4941 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4942 inode 302 errors 500, file extent discount, nbytes wrong Found file extent holes: start: 0, len: 64424509440 root 4942 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4942 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4942 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4942 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4942 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4943 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4943 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4943 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4943 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4943 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4944 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4944 inode 304 errors 500, file extent discount, nbytes wrong Found file extent holes: start: 0, len: 28244508672 root 4944 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4944 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4944 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4944 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4945 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4945 inode 304 errors 500, file extent discount, nbytes wrong Found file extent holes: start: 0, len: 28244508672 root 4945 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4945 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4945 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4945 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4946 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4946 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4946 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4946 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4946 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4947 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4947 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4947 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4947 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4947 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4948 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4948 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4948 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4948 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4948 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4949 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4949 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4949 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4949 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4949 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4950 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4950 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4950 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4950 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4950 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4951 inode 302 errors 500, file extent discount, nbytes wrong Found file extent holes: start: 0, len: 64424509440 root 4951 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4951 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4951 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4951 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4951 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4952 inode 302 errors 500, file extent discount, nbytes wrong Found file extent holes: start: 0, len: 64424509440 root 4952 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4952 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4952 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4952 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4952 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4953 inode 302 errors 500, file extent discount, nbytes wrong Found file extent holes: start: 0, len: 64424509440 root 4953 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4953 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4953 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4953 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4953 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4954 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4954 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4954 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4954 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4954 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4955 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4955 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4955 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4955 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4955 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 bad key ordering 101 102 root 4956 inode 303 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 6 namelen 3 name Ha2 filetype 2 errors 4, no inode ref root 4956 inode 305 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 7 namelen 10 name desk-audio filetype 2 errors 4, no inode ref root 4956 inode 309 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 8 namelen 5 name vDesk filetype 2 errors 4, no inode ref root 4956 inode 311 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 9 namelen 11 name vDesk-Admin filetype 2 errors 4, no inode ref root 4956 inode 315 errors 2001, no inode item, link count wrong unresolved ref dir 256 index 12 namelen 12 name Mikrotik CHR filetype 2 errors 4, no inode ref ERROR: errors found in fs roots Checking filesystem on /dev/sde1 UUID: 6110ce92-70ca-4bac-be5d-15972207af53 found 640056541184 bytes used, error(s) found total csum bytes: 26273224 total tree bytes: 979714048 total fs tree bytes: 353976320 total extent tree bytes: 584417280 btree space waste bytes: 177109926 file data blocks allocated: 1306020298752 referenced 50241048576
  4. Just noticed these errors in the log. sdf is one SSD out of 2 in my cache pool. From other threads I think I need to run BTRFS scrub. I have stopped all VMs and docker. Before I did that I tried to take a backup of the cache drive to an unassigned disk, however some files failed with "cannot access source file" I have daily snapshots of my VMs scripted and my VMs are in a subvolume. Trying to copy one of the vm snapshots also resulted in "cannot access source file" Should I run the scrub? or try another way to copy? or reboot, or something else? Diagnostics attached. Thanks! May 10 16:27:50 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 10 16:27:50 Tower kernel: BTRFS info (device sdf1): no csum found for inode 256620 start 9863168 May 10 16:27:50 Tower kernel: BTRFS warning (device sdf1): csum failed root 5 ino 256620 off 9863168 csum 0x48a1ad1c expected csum 0x00000000 mirror 1 May 10 16:27:50 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 10 16:27:50 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 10 16:27:51 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 10 16:27:51 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 10 16:27:51 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 10 16:27:51 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 10 16:30:01 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 10 16:30:01 Tower kernel: __btrfs_lookup_bio_sums: 6 callbacks suppressed May 10 16:30:01 Tower kernel: BTRFS info (device sdf1): no csum found for inode 256620 start 9863168 May 10 16:30:01 Tower kernel: btrfs_print_data_csum_error: 6 callbacks suppressed May 10 16:30:01 Tower kernel: BTRFS warning (device sdf1): csum failed root 5 ino 256620 off 9863168 csum 0x48a1ad1c expected csum 0x00000000 mirror 1 May 10 16:30:01 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 10 16:30:01 Tower kernel: BTRFS info (device sdf1): no csum found for inode 256620 start 9863168 May 10 16:30:01 Tower kernel: BTRFS warning (device sdf1): csum failed root 5 ino 256620 off 9863168 csum 0x48a1ad1c expected csum 0x00000000 mirror 2 May 10 16:32:50 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 10 16:32:50 Tower kernel: BTRFS info (device sdf1): no csum found for inode 256620 start 9863168 May 10 16:32:50 Tower kernel: BTRFS warning (device sdf1): csum failed root 5 ino 256620 off 9863168 csum 0x48a1ad1c expected csum 0x00000000 mirror 1 May 10 16:32:50 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 10 16:32:50 Tower kernel: BTRFS info (device sdf1): no csum found for inode 256620 start 9863168 May 10 16:32:50 Tower kernel: BTRFS warning (device sdf1): csum failed root 5 ino 256620 off 9863168 csum 0x48a1ad1c expected csum 0x00000000 mirror 2 May 10 16:32:50 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 10 16:32:50 Tower kernel: BTRFS info (device sdf1): no csum found for inode 256620 start 9863168 May 10 16:32:50 Tower kernel: BTRFS warning (device sdf1): csum failed root 5 ino 256620 off 9863168 csum 0x48a1ad1c expected csum 0x00000000 mirror 2 May 10 16:32:50 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 10 16:32:50 Tower kernel: BTRFS info (device sdf1): no csum found for inode 256620 start 9863168 May 10 16:32:50 Tower kernel: BTRFS warning (device sdf1): csum failed root 5 ino 256620 off 9863168 csum 0x48a1ad1c expected csum 0x00000000 mirror 1 May 10 16:32:50 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 10 16:32:50 Tower kernel: BTRFS info (device sdf1): no csum found for inode 256620 start 9863168 May 10 16:32:50 Tower kernel: BTRFS warning (device sdf1): csum failed root 5 ino 256620 off 9863168 csum 0x48a1ad1c expected csum 0x00000000 mirror 2 May 10 16:32:50 Tower kernel: BTRFS critical (device sdf1): corrupt leaf, bad key order: block=4364604653568, root=1, slot=101 May 10 16:32:50 Tower kernel: BTRFS info (device sdf1): no csum found for inode 256620 start 9863168 May 10 16:32:50 Tower kernel: BTRFS warning (device sdf1): csum failed root 5 ino 256620 off 9863168 csum 0x48a1ad1c expected csum 0x00000000 mirror 2 tower-diagnostics-20180515-2227.zip
  5. I'll repeat JB's words because they apply to me as well! The script needs the 1st 2 snapshots already created. It shutsdown any running VMs, tests that they are shutdown. This bit was cribbed from somewhere else. It does not force a shutdown. It starts back up any VMs set to "autostart" It ran for the 1st time on Sunday, and I haven't had time to check that the snapshots created are correct. There's very little error checking in it. cd /mnt/cache/appdata/snapshots sd=$(echo VMs_Off* | awk '{print $1}') ps=$(echo VMs_Off* | awk '{print $2}') if [ "$ps" == "VMs_Offline_$(date '+%Y%m%d')" ] then echo "There's already a snapshot from today" else for i in `virsh list | grep running | awk '{print $2}'`; do virsh shutdown $i; done # Wait until all domains are shut down or timeout has reached. END_TIME=$(date -d "300 seconds" +%s) while [ $(date +%s) -lt $END_TIME ]; do # Break while loop when no domains are left. test -z "`virsh list | grep running | awk '{print $2}'`" && break # Wait a little, we don't want to DoS libvirt. sleep 1 done echo "shutdown completed" virsh list | grep running | awk '{print $2}' btrfs sub snap -r /mnt/cache/appdata/VMs /mnt/cache/appdata/snapshots/VMs_Offline_$(date '+%Y%m%d') for i in `virsh list --all --autostart|awk '{print $2}'|grep -v Name`; do virsh start $i; done sync btrfs send -p /mnt/cache/appdata/snapshots/$ps /mnt/cache/appdata/snapshots/VMs_Offline_$(date '+%Y%m%d') | btrfs receive /mnt/disks/unRAIDBackup_BTRFS/snapshots if [[ $? -eq 0 ]]; then /usr/local/emhttp/webGui/scripts/notify -i normal -s "Send/Receive complete" btrfs sub del /mnt/cache/appdata/snapshots/$sd #btrfs sub del /mnt/disks/unRAIDBackup_BTRFS/snapshots/$sd else /usr/local/emhttp/webGui/scripts/notify -i warning -s "Send/Receive failed" fi fi
  6. I have this working now to an unassigned drive in my main server. Nightly snapshots with the VMs runnning. Weekly snapshots with using a modified version of your script. It shuts down the VMs, snapshots them, restarts them and then Sends the snapshot to the destination drive. Thanks for your help JB. Has anyone got BTRFS send and receive working to another unRAID server mounted via NFS through Unassigned Devices? A search appears to say that NFS won't work - the other server needs to be connected via SSH, but I havent' worked out how to do that yet.
  7. Thanks, much appreciated, I'll use these to create my own bodged script :-) I'm more worried abou the speed of my cache. I'd expect to be getting a copy rate of a few hundred MB/s. I'll create a separate thread for it.
  8. I'm moving a 50GB VM across to the new subvolume called VMs on the same 2 x 1TB SSD cache pool using MC RenMov from /mnt/cache/appdata/KVM/vm1/vdisk.img to /mnt/cache/appdata/VMs/vm1/vdisk.img The copy is taking a long time. Started at 200MB/s and quickly dropped to 40MB/s, and everything else on the server has slowed to a crawl Is that normal?
  9. I've done some initial testing on this and it looks good. Johnnie, would you be willing to share your scripts please that I can use as a starting point to get the Snapshot rotation etc. in place, and any error checking you've put in? Thanks.
  10. Would you expect there to be a problem accessing a Nextcloud docker from a windows VM also running on the same host but on a different VLAN and subnet? I have latest NextCloud docker on unRAID 6.3.5. I have changed the access port from 443 to 4437 in the docker config. I have not added any certificates to Nextcloud. I have not tried to add any VLANs to the docker. https://tower:4437 works fine from PCs on the same subnet as Tower. It also works fine from a windows VM running on the same host and in the same vlan and subnet as Tower. It does not work from a windows VM running on Tower, but on a different subnet and VLAN. in Firefox, I get a rapid succession of TLS handshake message in the bottom left status bar, and then a "Secure connection failed The connection to the server was reset while the page was loading." The routing and default gateway for both VLANs are done by an external router. No firewall rules currently restricting traffic between either VLAN. Not sure whether this is a problem in my own network, a general docker/network restriction on 6.3.5, or a problem with Nextcloud. How do I enable non-https access to the docker? I tried just adding a mapping from 8089 to port 80 on the docker container but I don't think http is enabled by default.
  11. bump - anyone done anything in this area?
  12. Hi Johnnie, I'm thinking of trying the BTRFS send and receive to probably an array drive. I'll upgrade from 6.3.5 to 6.4.1 1st. Are there any more gotchas or issues since your guide below a year ago? I'm thinking of having 2 Subvolumes on the target disk. One will be updated daily with the VMs running. The 2nd will be updated weekly after a scripted VM shutdown. The weekly subvolumes will then be backed up offsite using crashplan. If either source or target drives are encrypted does that cause any additional probems? The source will be the SSD cache pool. cheers, Al
  13. It occurred to me that I have my entire email history stored at the mercy of a 3rd party. Approx 10GB. The supplier is great, I've been with them for years and I've only good things to say about them (Fastmail) but I'd like an independent copy somewhere, in case something happens. I'm also slightly nervous about having all the history online. I don't want to run my own full mailserver, so I'd keep Fastmail, but I'm looking at whether I can run a docker as an email client? 1. Run a docker on UnRAID that will backup my entire fastmail account using IMAP. 2. and optionally provide a web client that I can use from other PCs on my LAN to search history and write emails etc. This would mean I don't need to store my full history in Fastmail. I do use the NextCloud docker and I backup my local unRAID using CrashPlan pro (will be Duplicati and BackBlaze when Crashplan gets expensive). I know there is a mail app for NextCloud. Anyone else gone down this route?
  14. Hi, yes already tried shorting the power switch pins on the MB directly. Already tried 2 other different PSUs. Already replaced the battery. Looks like the MB may be toast, which is annoying as it isn't that old.
  15. The Seasonic Platinum is fanless. The other PSUs don't spin up their fans. The LEDs on the MB are the BMC which is working, the "standby power" led which is on, and the power status LED which I think is RED (power failed), but it might be yellow (power on standby)
  16. My test server has been switched off in the garage for about 3 months. It is dry in there, and would have varied between 2 and 20 degrees C in that time. It was working fine when I switched it off. It will be 3 years old in a couple of days. I just transplanted it to a new case with a Seasonic modular Platinum PSU (from another working machine) and now it won't switch on. I did not check that it worked before I removed it from the old case. Symptoms are Power Fail LED is lit on front panel. Overheat/Fan fail LED is NOT lit. BMC led is blinking green normally. LE3 - standby power LED is lit green LE6 - Power status LED is red but seems to have some yellow in it... IPMI is accessible over the network, but trying to power on the host generates a fail message after a few seconds. Power button does nothing. No Fans switch on, no beeps. I have tried the following Unplugged all peripherals, so only the main PSU cable and the CPU power cables are plugged in - no change Replaced the battery. - no change Tried the original power supply - no change Tried another Corsair power supply - no change Cleared the CMOS by shorting the contacts on the JBT1 - no change Removed the motherboard from the new case and powered it up - no change Removed the 4 sticks of RAM - no change Removed the CPU and reseated it - no change I've now removed the motherboard and yelled at it for 5 minutes. It is now in the house warming up on the radiator. Anyone any other suggestions on what to try next. I don't have another CPU to try unfortunately. Thanks!
  17. Found the culprit - it was the Duplicati docker. Not sure why, because it was set to use HDD shares on the array not on the SSD cache. I'll recreate the docker.
  18. Here's the latest, taken during the write which lasted around 10 minutes. This is now grouped into Processes not threads, so just one entry at the top. I think this is saying that it has written 33GB. The process finished at 57.3 GB. By comparison I can see the Xemoa process slowing incrementing consistently as it writes video files at around 4GB per hour. Total DISK READ : 915.70 K/s | Total DISK WRITE : 105.78 M/s Actual DISK READ: 904.71 K/s | Actual DISK WRITE: 10.94 M/s PID PRIO USER DISK READ DISK WRITE> SWAPIN IO COMMAND 13281 be/4 root 55.53 M 33.20 G 0.00 % 0.02 % shfs /mnt/user -disks 15 51200000000 -o noatime,big_writes,allow_other -o remember=330 1548 be/4 root 160.00 K 3.31 G 0.00 % 0.01 % xeoma -core -service -log -startdelay 5 10076 be/4 root 844.48 M 1259.86 M 0.00 % 0.03 % qemu-system-x86_64 -name guest=Ha2,debug-threads=on -S -object secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/~,vgamem_mb=16,max_outputs=1,bus=pci.0,addr=0x2 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x6 -msg timestamp=on 13187 be/4 root 2.80 M 423.52 M 0.00 % 0.04 % [btrfs-transacti] 31246 be/4 root 104.00 K 416.83 M 0.00 % 0.14 % qemu-system-x86_64 -name guest=Ha,debug-threads=on -S -object secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/d~ci,host=00:1b.0,id=hostdev0,bus=pci.0,addr=0x6 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x8 -msg timestamp=on 16438 be/0 root 20.58 M 269.14 M 0.00 % 0.03 % [loop0] 16461 be/4 root 432.00 K 180.48 M 0.00 % 0.03 % [btrfs-transacti] 8816 be/4 nobody 396.00 K 49.64 M 0.00 % 0.01 % mono-sgen --optimize=all /usr/lib/emby-server/bin/MediaBrowser.Server.Mono.exe -programdata /config -restartpath /usr/lib/emby-server/restart.sh 27912 be/4 root 904.00 K 40.93 M 0.00 % 0.01 % qemu-system-x86_64 -name guest=vDesk,debug-threads=on -S -object secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qem~tbus=1,hostaddr=2,id=hostdev0,bus=usb.0,port=1 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x6 -msg timestamp=on 5840 be/4 nobody 4.17 M 19.66 M 0.00 % 0.00 % mono --debug NzbDrone.exe -nobrowser -data=/config 14997 be/4 root 828.00 K 16.11 M 0.00 % 0.03 % [kworker/u24:1] 3361 be/4 root 916.00 K 13.27 M 0.00 % 0.02 % [kworker/u24:4] 18707 be/4 root 740.00 K 7.42 M 0.00 % 0.07 % [kworker/u24:8] 15795 be/4 root 836.00 K 7.20 M 0.00 % 0.11 % [kworker/u24:0] 15637 be/4 root 396.00 K 6.51 M 0.00 % 0.00 % java -Dfile.encoding=UTF-8 -Dapp=CrashPlanService -DappBaseName=CrashPlan -Xms20m -Xmx1024m -Dsun.net.inetaddr.ttl=300 -Dn~alse -classpath /usr/local/crashplan/lib/com.backup42.desktop.jar:/usr/local/crashplan/lang com.backup42.service.CPService 18706 be/4 root 576.00 K 5.83 M 0.00 % 0.10 % [kworker/u24:3] 19970 be/4 root 128.00 K 4.45 M 0.00 % 0.03 % [kworker/u24:6] 19971 be/4 root 168.00 K 4.44 M 0.00 % 0.04 % [kworker/u24:7] 16472 be/4 root 0.00 B 4.02 M 0.00 % 0.00 % dockerd -p /var/run/docker.pid --storage-driver=btrfs --storage-driver=btrfs 19969 be/4 root 360.00 K 2.83 M 0.00 % 0.03 % [kworker/u24:5] 9861 be/4 aladmin 0.00 B 1660.00 K 0.00 % 0.00 % dropbox 22974 be/4 nobody 0.00 B 712.00 K 0.00 % 0.00 % java -Djava.awt.headless=true -Xmx768m -XX:+UseAdaptiveSizePolicy -XX:MaxGCPauseMillis=25 -XX:GCTimeRatio=24 -XX:+UseG1GC ~r:JARs/thetvdbapi-1.8.jar:JARs/tunerpreroll.jar:JARs/vecmath.jar:JARs/webui-3.3.jar sage.Sage 0 0 x sagetv Sage.properties 18708 be/4 root 76.00 K 656.00 K 0.00 % 0.03 % [kworker/u24:9] 24763 be/4 nobody 0.00 B 200.00 K 0.00 % 0.00 % Plex Media Server 15796 be/4 root 24.00 K 128.00 K 0.00 % 0.01 % [kworker/u24:2] 13186 be/4 root 0.00 B 48.00 K 0.00 % 0.00 % [btrfs-cleaner] 5310 be/4 nobody 84.00 K 36.00 K 0.00 % 0.00 % rslsync --nodaemon --config /config/sync.conf 18905 be/4 root 16.00 K 0.00 B 0.00 % 0.00 % syslog-ng -F -p /var/run/syslog-ng.pid --no-caps 11176 be/4 root 0.00 B 0.00 B 0.00 % 0.04 % emhttp 17729 be/4 root 584.00 K 0.00 B 0.00 % 0.00 % cadvisor -logtostderr 7593 be/4 root 13.88 M 0.00 B 0.00 % 0.00 % find /mnt/disk3/Backups -noleaf 22062 be/4 nobody 3.16 G 0.00 B 0.00 % 0.00 % mono Duplicati.Server.exe --webservice-interface=any --server-datafolder=/config 16025 be/4 root 128.00 K 0.00 B 0.00 % 0.00 % [xfsaild/sdj1]
  19. I've dug into iotop a little and now have it running showing accumulating values. The following is a paste of the top few threads after running it for about 30 minutes. These entries started all at once incremented up to this value over the course of a few minutes, and then stopped. It happened the hour before as well. Cron is set to run hourly jobs at 47 minutes past the hour, so I don't think it is being triggered by that. How can I find out what it is? I am unsure whether this is showing a total write of 5.8GB or a total write of 5.8GB on each line ie. 60GB. TID PRIO USER DISK READ DISK WRITE> SWAPIN IO COMMAND 12604 be/4 root 11.92 M 5.77 G 0.00 % 0.05 % shfs /mnt/user -disks 15 51200000000 -o noatime,big_writes,allow_other -o remember=330 13043 be/4 root 7.54 M 5.77 G 0.00 % 0.03 % shfs /mnt/user -disks 15 51200000000 -o noatime,big_writes,allow_other -o remember=330 12714 be/4 root 1003.00 K 5.77 G 0.00 % 0.04 % shfs /mnt/user -disks 15 51200000000 -o noatime,big_writes,allow_other -o remember=330 12717 be/4 root 9.09 M 5.76 G 0.00 % 0.03 % shfs /mnt/user -disks 15 51200000000 -o noatime,big_writes,allow_other -o remember=330 12719 be/4 root 12.77 M 5.76 G 0.00 % 0.03 % shfs /mnt/user -disks 15 51200000000 -o noatime,big_writes,allow_other -o remember=330 12689 be/4 root 11.50 M 5.76 G 0.00 % 0.04 % shfs /mnt/user -disks 15 51200000000 -o noatime,big_writes,allow_other -o remember=330 13049 be/4 root 6.25 M 5.75 G 0.00 % 0.05 % shfs /mnt/user -disks 15 51200000000 -o noatime,big_writes,allow_other -o remember=330 12712 be/4 root 17.30 M 5.74 G 0.00 % 0.04 % shfs /mnt/user -disks 15 51200000000 -o noatime,big_writes,allow_other -o remember=330 13048 be/4 root 7.87 M 5.74 G 0.00 % 0.06 % shfs /mnt/user -disks 15 51200000000 -o noatime,big_writes,allow_other -o remember=330 12718 be/4 root 7.16 M 5.73 G 0.00 % 0.04 % shfs /mnt/user -disks 15 51200000000 -o noatime,big_writes,allow_other -o remember=330
  20. Plex and emby do not use a RAMDRIVE for transcoding based upon the last time I read a thread about it, which discouraged it. Having said that I do have 64GB and am using about half of it, so enough room for a ramdrive if necessary. The config directories for both are on the SSD. Has the recommendation changed? They're only used for about an hour per day in total, and probably half of that time the playback does not need transcoding. We use SageTV docker now but that records directly to the array. At this point I don't know whether it is something that is writing continuously at a lowish rate, or whether it is a scheduled process that kicks in and burst writes once a day for example.
  21. Fair enough, I guess I've been lucky! Recommendation for anyone making a mobile rack then is to always spin down the drives before moving the rack. For mine, I can do most of what I might need to do without moving it. The server is on rails and pulls out (after spindown)
  22. To report back - the drive is nearly 3 months old now, and LBAs written is now 41808232224 which is 21TB In the last 21 hours it has written 0.45TB. I think this is way too high - but struggling to anrrow it down. Anyone any advice? Is there a logging version of iotop? I'd like to capture IO by process and destination for a 24 hour period. HellDiver, apologies I've only just seen your comment. Is there any particular make/model you'd recommend? Here are a few iotop screenshots. The Xeoma writes are (should be) to an Unassigned Device, not the cache. Hmm, I assume it writes directly to that device and not to the cache 1st.
  23. It is an easy decision for me - most houses don't have or need aircon in the UK, and the garage is the coldest place I have, so that is where the server goes! I had it in the house beforehand and HDD temps were getting into the high 40s and SSD temps a few degrees C above that in the summer, which was not good. I've only had this server case set up for a few months, and it has taken a while to get the SuperMicro IPMI fan control to play nicely with UnRaid. I'll report back on temps next Summer! I havent seen any dust inside the server yet, but it is only a few months old. I try and do any sawing or sanding outside. Tonight will be colder than yesterday, so will be interesting to see if the rack temp holds.
  24. It is on rubbery castors (from Ikea) on a quite smooth plastic tiled floor surface so I have moved it without spinning down. To my mind it is less shock than moving a PC across a desk while still powered up. Ideally though yes I'd probably spin down.
  25. Thought I'd post this as the idea generated some interest in another thread earlier this year. I've had this running for the last few months. Here is my GarageRack! Air flow is in at the lower front through the mesh filters on the fan and out at the top rear. Arduino controls the PWM for the rack fans, but takes the power from a fan connector on the motherboard. Importantly, the Arduino also cuts the power to the rack fans below 16 deg C using a relay. The CPU and HDD fans inside the server case are all triggered from the HDD temperatures using the IPMI plugin. Temp inside the cab seems to vary between 16 and 18 deg C. Drive temps are set to centre around 30 deg C. Temp within garage has between around 0 and 15 deg C. Outside temperature has varied between -2 and 20. During the warmer months I remove the back panel, so warm air goes straight out, and I still get some filtration benefit from the mesh in front of the fans. The rack rolls back into the space next to the bench. The chopsaw is then about 3m away and has a dust hood with extraction around it. Even then, sawdust particles collect on the rack filter a day after using the chopsaw. There is a 750VA APC non-rack mount UPS underneath the server. Even at 0 DegC in the garage the fans are still coming on regularly so this will be fine for anything reasonably forseeable on the UK South coast. The side panels are screwed to the frame, and the top, front and back panels are simply velcroed at the moment. For colder temps it would be easy enough to improve the sealing and cover up one of the fans if necessary. Hopefully the small amount of heat exhausted to the garage will help to reduce any condensation forming in the garage in the winter. Total power consumption within the rack is 115W FRONT BACK INSIDE Here are the temps inside the rack, in the garage, and outside over the last few days. Blue is the temp within the cab. I think that sensor only has a resolution of 0.5Deg C. Green is the temp in the garage, Yellow is the outside temp. Temps are in Celsius.