March 2, 20197 yr Hello, After finally getting my server at a temperature that it can work at. I have tried to do huge imports of data from my older running server. I am talking about 500 gigs at a copy and paste, where part of that seem to stick in the cache disk and won't clear. Any idea's I read a different thread but I am not sure if it matches my layout. ruinfocus-diagnostics-20190302-1455.zip
March 3, 20197 yr Community Expert I recommend not caching when transferring such large amounts of data. Though in your case since you have 2TB cache maybe it's OK. But copying so much data that mover never gets a chance to move it all before more starts coming in is just going to slow things down and make things worse. Ideally, mover would run and move everything during a period when nothing was being written to the server, since the moves and the new writes would just be competing with each other for the same disks.
March 3, 20197 yr Mar 2 14:00:46 RUInFocus move: move: file /mnt/cache/Movies/ACTION/Biker Boyz/VIDEO_TS/VTS_01_2.VOB Mar 2 14:00:47 RUInFocus kernel: BTRFS warning (device sdf1): csum failed root 5 ino 5774 off 139001856 csum 0x01219a40 expected csum 0xdc49f3d0 mirror 1 You've got some filesystem problems on the cache drive. Personally, I'm not a fan of BTRFS on a cache drive without a cache-pool present. XFS seems to be far more stable in handling things like unclean shutdowns, etc. This is why files are getting stuck on the cache drive. Mar 2 11:06:35 RUInFocus move: move: skip /mnt/disk1/system/docker/docker.img Mar 2 11:06:35 RUInFocus move: move: skip /mnt/disk1/system/libvirt/libvirt.img Not that this is directly related, but your docker (and libvirt) image are currently stored on disk1. The system cannot move them to the cache drive while they are in use. After you sort out the main problem, you have to stop the docker service and the VM service (do both in the settings tab), and then run mover
March 3, 20197 yr Community Expert 23 minutes ago, Squid said: csum failed These are checksum errors, i.e., data corruption, not filesystem issues, and would suggest there are other problems with the server, like for example bad RAM, these would go undetected with XFS.
March 3, 20197 yr ok Is the I/O error consistent with that? Mar 2 14:09:26 RUInFocus kernel: BTRFS warning (device sdf1): csum failed root 5 ino 4537 off 684122112 csum 0x0f6ab604 expected csum 0x6ec8d294 mirror 1 ### [PREVIOUS LINE REPEATED 3 TIMES] ### Mar 2 14:09:26 RUInFocus move: move_object: /mnt/cache/Movies/SCI-FI/ERAGON/VIDEO_TS/VTS_01_4.VOB Input/output error
March 3, 20197 yr Community Expert ok Is the I/O error consistent with that? Yes, btrfs and all other checksummed filesystems will give you an I/O error when trying to read/copy a corrupt file, so you know there's a problem, and are not unknowingly fed corrupted data.
Archived
This topic is now archived and is closed to further replies.