Skip to content
View in the app

A better way to browse. Learn more.

Unraid

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.

(SOLVED) RAID5 Cache extremly slow after losing a disk

Featured Replies

I have 6 SSDs as Cache pool, runing with RAID5 setup as they have different sizes.

One disk failed and the Cache seems fine. So I wanted to move all the data to the array and create a new Cache without the failed Disk.

I set all the shares from cache only/prefer to yes and started the mover.

 

Now I can see read/write rates at about 1~10mb/sec. With about 700GB of data, this is going to take forever :(

 

What I can see on the log are millions of those lines:

 

Apr 30 11:48:17 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:18 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:18 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:18 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:19 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:21 Knowlage kernel: btrfs_print_data_csum_error: 5 callbacks suppressed
Apr 30 11:48:21 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:21 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:21 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:22 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:22 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:22 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:23 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:23 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:23 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:24 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:26 Knowlage kernel: btrfs_print_data_csum_error: 5 callbacks suppressed
Apr 30 11:48:26 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:26 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:26 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:27 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:27 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:27 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:28 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:28 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:28 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:29 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:31 Knowlage kernel: btrfs_print_data_csum_error: 5 callbacks suppressed
Apr 30 11:48:31 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:31 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:31 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:32 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:32 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:32 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:33 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:33 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:33 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:34 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:36 Knowlage kernel: btrfs_print_data_csum_error: 5 callbacks suppressed
Apr 30 11:48:36 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:36 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:36 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:37 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:37 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:37 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:38 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:38 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:38 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:39 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:41 Knowlage kernel: btrfs_print_data_csum_error: 5 callbacks suppressed
Apr 30 11:48:41 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:41 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:41 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:42 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:42 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:42 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:43 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:43 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:43 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:44 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:46 Knowlage kernel: btrfs_print_data_csum_error: 5 callbacks suppressed
Apr 30 11:48:46 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:46 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:46 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:47 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:47 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:47 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:48 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:48 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:48 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:49 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:51 Knowlage kernel: btrfs_print_data_csum_error: 5 callbacks suppressed
Apr 30 11:48:51 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:51 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:51 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:52 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:52 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:52 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:53 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:53 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4469 off 0 csum 0xcdd97a28 expected csum 0xb7fa4f66 mirror 1
Apr 30 11:48:53 Knowlage kernel: BTRFS warning (device loop2): csum failed root 648 ino 4477 off 253952 csum 0x229daa44 expected csum 0x7b2e6f15 mirror 1
Apr 30 11:48:54 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1
Apr 30 11:48:56 Knowlage kernel: btrfs_print_data_csum_error: 5 callbacks suppressed
Apr 30 11:48:56 Knowlage kernel: BTRFS warning (device loop2): csum failed root 661 ino 12668 off 0 csum 0xd6257a90 expected csum 0x1d6d842a mirror 1

 

Can I rebuild the cache pool in a different/better/FASTER way?

Edited by Jaster

  • Community Expert

loop2 is likely the docker image, which can't be corrected if it's on a NOCOW share (default), but should not make a great difference in the copy speed, see if stopping docker service makes a difference.

  • Author

Stopping docker, stopped the log flood. But the speed isn't getting any better and I keep receiving tons of warnings/errors. Here is some of it:

 

Apr 30 12:10:03 Knowlage kernel: repair_io_failure: 201 callbacks suppressed
Apr 30 12:10:03 Knowlage kernel: BTRFS info (device sdp1): read error corrected: ino 6126139 off 0 (dev /dev/sdd1 sector 16880)
Apr 30 12:10:03 Knowlage kernel: BTRFS info (device sdp1): read error corrected: ino 6126145 off 0 (dev /dev/sdd1 sector 17160)
Apr 30 12:10:03 Knowlage kernel: BTRFS info (device sdp1): read error corrected: ino 6126145 off 4096 (dev /dev/sdd1 sector 17168)
Apr 30 12:10:07 Knowlage kernel: BTRFS info (device sdp1): read error corrected: ino 6130255 off 0 (dev /dev/sdd1 sector 20256)
Apr 30 12:10:21 Knowlage kernel: btrfs_print_data_csum_error: 33 callbacks suppressed
Apr 30 12:10:21 Knowlage kernel: BTRFS warning (device sdp1): csum failed root 5 ino 6132477 off 0 csum 0x14cf0262 expected csum 0x1a4d8ece mirror 1
Apr 30 12:10:21 Knowlage kernel: BTRFS warning (device sdp1): csum failed root 5 ino 6132477 off 4096 csum 0x1a8bb2ce expected csum 0xf79dbcb9 mirror 1
Apr 30 12:10:21 Knowlage kernel: BTRFS warning (device sdp1): csum failed root 5 ino 6132477 off 0 csum 0x14cf0262 expected csum 0x1a4d8ece mirror 1
Apr 30 12:10:21 Knowlage kernel: BTRFS warning (device sdp1): csum failed root 5 ino 6132477 off 4096 csum 0x1a8bb2ce expected csum 0xf79dbcb9 mirror 1
Apr 30 12:10:21 Knowlage kernel: BTRFS info (device sdp1): read error corrected: ino 6132477 off 0 (dev /dev/sdd1 sector 45208)
Apr 30 12:10:21 Knowlage kernel: BTRFS info (device sdp1): read error corrected: ino 6132477 off 4096 (dev /dev/sdd1 sector 45216)

 

  • Community Expert

Those errors are being corrected, it's normal for the performance to be reduced since it's calculating the correct data, no much more you can do but wait.

  • Author

Fine :(

Thanks for the clarification.

Archived

This topic is now archived and is closed to further replies.

Account

Navigation

Search

Search

Configure browser push notifications

Chrome (Android)
  1. Tap the lock icon next to the address bar.
  2. Tap Permissions → Notifications.
  3. Adjust your preference.
Chrome (Desktop)
  1. Click the padlock icon in the address bar.
  2. Select Site settings.
  3. Find Notifications and adjust your preference.