Cache Mover not working


Recommended Posts

Got back to my PC this morning to find the cache drive full and nothing moving from it. When I click 'Move NOw' I just get this message in the syslog, nothing else happes:

 

emhttp: shcmd (70): /usr/local/sbin/mover |& logger &

 

Here a syslog from the last few hours from when it got full to now. The Min Free Space for thecache is set to 40GB so I don't understand why it got so full. The shares which need to be written to both have over 2TB free space. The mover is supposed to run at the default time.

 

Apr 17 08:07:13 Tower shfs/user: cache disk full
Apr 17 08:07:46 Tower last message repeated 429 times
Apr 17 08:10:43 Tower last message repeated 9 times
Apr 17 08:11:46 Tower last message repeated 830 times
Apr 17 08:11:54 Tower last message repeated 111 times
Apr 17 08:11:54 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 08:11:54 Tower shfs/user: cache disk full
Apr 17 08:11:54 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 08:11:54 Tower shfs/user: cache disk full
Apr 17 08:11:54 Tower shfs/user: cache disk full
Apr 17 08:11:54 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 08:11:54 Tower shfs/user: cache disk full
Apr 17 08:13:49 Tower last message repeated 64 times
Apr 17 08:14:50 Tower last message repeated 872 times
Apr 17 08:16:22 Tower last message repeated 384 times
Apr 17 08:17:23 Tower last message repeated 870 times
Apr 17 08:19:09 Tower last message repeated 812 times
Apr 17 08:19:24 Tower last message repeated 217 times
Apr 17 08:19:24 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 08:19:24 Tower shfs/user: cache disk full
Apr 17 08:19:24 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 08:19:24 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 08:19:24 Tower shfs/user: cache disk full
Apr 17 08:19:55 Tower last message repeated 357 times
Apr 17 08:21:35 Tower last message repeated 808 times
Apr 17 08:22:36 Tower last message repeated 876 times
Apr 17 08:23:54 Tower last message repeated 676 times
Apr 17 08:24:55 Tower last message repeated 827 times
Apr 17 08:26:09 Tower last message repeated 549 times
Apr 17 08:26:54 Tower last message repeated 659 times
Apr 17 08:26:54 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 08:26:54 Tower shfs/user: cache disk full
Apr 17 08:26:54 Tower shfs/user: cache disk full
Apr 17 08:26:54 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 08:26:54 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 08:26:54 Tower shfs/user: cache disk full
Apr 17 08:27:25 Tower last message repeated 436 times
Apr 17 08:28:46 Tower last message repeated 671 times
Apr 17 08:29:47 Tower last message repeated 872 times
Apr 17 08:30:48 Tower last message repeated 845 times
Apr 17 08:31:49 Tower last message repeated 524 times
Apr 17 08:32:50 Tower last message repeated 832 times
Apr 17 08:33:06 Tower last message repeated 211 times
Apr 17 08:33:06 Tower shfs/user: shfs_write: write: (28) No space left on device
Apr 17 08:33:07 Tower shfs/user: cache disk full
Apr 17 08:33:38 Tower last message repeated 220 times
Apr 17 08:34:24 Tower last message repeated 679 times
Apr 17 08:34:25 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 08:34:25 Tower shfs/user: cache disk full
Apr 17 08:34:25 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 08:34:25 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 08:34:25 Tower shfs/user: cache disk full
Apr 17 08:34:57 Tower last message repeated 367 times
Apr 17 08:35:32 Tower last message repeated 439 times
Apr 17 08:35:32 Tower shfs/user: shfs_write: write: (28) No space left on device
Apr 17 08:35:32 Tower shfs/user: cache disk full
Apr 17 08:36:03 Tower last message repeated 287 times
Apr 17 08:37:04 Tower last message repeated 790 times
Apr 17 08:37:52 Tower last message repeated 653 times
Apr 17 08:37:52 Tower shfs/user: shfs_write: write: (28) No space left on device
Apr 17 08:37:52 Tower shfs/user: cache disk full
Apr 17 08:38:23 Tower last message repeated 330 times
Apr 17 08:39:24 Tower last message repeated 746 times
Apr 17 08:40:05 Tower last message repeated 545 times
Apr 17 08:40:05 Tower shfs/user: shfs_write: write: (28) No space left on device
Apr 17 08:40:05 Tower shfs/user: cache disk full
Apr 17 08:40:36 Tower last message repeated 386 times
Apr 17 08:41:37 Tower last message repeated 884 times
Apr 17 08:41:55 Tower last message repeated 259 times
Apr 17 08:41:55 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 08:41:55 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 08:41:55 Tower shfs/user: cache disk full
Apr 17 08:41:55 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 08:41:55 Tower shfs/user: cache disk full
Apr 17 08:42:02 Tower last message repeated 108 times
Apr 17 08:42:02 Tower shfs/user: shfs_write: write: (28) No space left on device
Apr 17 08:42:02 Tower shfs/user: cache disk full
Apr 17 08:42:33 Tower last message repeated 419 times
Apr 17 08:43:34 Tower last message repeated 715 times
Apr 17 08:44:00 Tower last message repeated 333 times
Apr 17 08:44:00 Tower shfs/user: shfs_write: write: (28) No space left on device
Apr 17 08:44:00 Tower shfs/user: cache disk full
Apr 17 08:44:31 Tower last message repeated 395 times
Apr 17 08:45:32 Tower last message repeated 799 times
Apr 17 08:46:13 Tower last message repeated 535 times
Apr 17 08:46:13 Tower shfs/user: shfs_write: write: (28) No space left on device
Apr 17 08:46:13 Tower shfs/user: cache disk full
Apr 17 08:46:44 Tower last message repeated 405 times
Apr 17 08:47:45 Tower last message repeated 715 times
Apr 17 08:48:11 Tower last message repeated 378 times
Apr 17 08:48:11 Tower shfs/user: shfs_write: write: (28) No space left on device
Apr 17 08:48:12 Tower shfs/user: cache disk full
Apr 17 08:48:43 Tower last message repeated 360 times
Apr 17 08:49:25 Tower last message repeated 554 times
Apr 17 08:49:25 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 08:49:25 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 08:49:25 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 08:49:25 Tower shfs/user: cache disk full
Apr 17 08:49:56 Tower last message repeated 443 times
Apr 17 08:50:23 Tower last message repeated 354 times
Apr 17 08:50:23 Tower shfs/user: shfs_write: write: (28) No space left on device
Apr 17 08:50:23 Tower shfs/user: cache disk full
Apr 17 08:50:24 Tower last message repeated 6 times
Apr 17 08:50:27 Tower shfs/user: shfs_rmdir: rmdir: /mnt/cache/Downloads/Incomplete/Lost.S03.720p.BluRay.DTS.x264-ESiR/__ADMIN__ (39) Directory not empty
Apr 17 08:50:27 Tower shfs/user: shfs_rmdir: rmdir: /mnt/disk3/Downloads/Incomplete/Lost.S03.720p.BluRay.DTS.x264-ESiR/__ADMIN__ (39) Directory not empty
Apr 17 08:50:27 Tower shfs/user: shfs_rmdir: rmdir: /mnt/cache/Downloads/Incomplete/Lost.S03.720p.BluRay.DTS.x264-ESiR (39) Directory not empty
Apr 17 08:50:44 Tower shfs/user: cache disk full
Apr 17 08:51:16 Tower last message repeated 122 times
Apr 17 08:52:17 Tower last message repeated 365 times
Apr 17 08:53:18 Tower last message repeated 366 times
Apr 17 08:54:19 Tower last message repeated 369 times
Apr 17 08:55:24 Tower last message repeated 215 times
Apr 17 08:56:25 Tower last message repeated 238 times
Apr 17 08:56:54 Tower last message repeated 141 times
Apr 17 08:56:55 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 08:56:55 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 08:56:55 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 08:56:56 Tower shfs/user: cache disk full
Apr 17 08:57:34 Tower last message repeated 50 times
Apr 17 08:58:35 Tower last message repeated 434 times
Apr 17 08:59:38 Tower last message repeated 205 times
Apr 17 09:00:41 Tower last message repeated 324 times
Apr 17 09:01:46 Tower last message repeated 538 times
Apr 17 09:02:49 Tower last message repeated 580 times
Apr 17 09:03:52 Tower last message repeated 582 times
Apr 17 09:04:25 Tower last message repeated 270 times
Apr 17 09:04:25 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 09:04:25 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 09:04:25 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 09:04:26 Tower shfs/user: cache disk full
Apr 17 09:04:59 Tower last message repeated 322 times
Apr 17 09:06:00 Tower last message repeated 674 times
Apr 17 09:07:01 Tower last message repeated 766 times
Apr 17 09:08:02 Tower last message repeated 560 times
Apr 17 09:09:03 Tower last message repeated 653 times
Apr 17 09:10:04 Tower last message repeated 496 times
Apr 17 09:11:11 Tower last message repeated 600 times
Apr 17 09:11:51 Tower last message repeated 462 times
Apr 17 09:11:56 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 09:11:56 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 09:11:56 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 09:11:58 Tower shfs/user: cache disk full
Apr 17 09:12:30 Tower last message repeated 221 times
Apr 17 09:13:36 Tower last message repeated 697 times
Apr 17 09:14:38 Tower last message repeated 651 times
Apr 17 09:15:39 Tower last message repeated 646 times
Apr 17 09:16:40 Tower last message repeated 587 times
Apr 17 09:17:41 Tower last message repeated 721 times
Apr 17 09:18:42 Tower last message repeated 748 times
Apr 17 09:19:26 Tower last message repeated 538 times
Apr 17 09:19:26 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 09:19:26 Tower shfs/user: cache disk full
Apr 17 09:19:26 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 09:19:26 Tower shfs/user: cache disk full
Apr 17 09:19:26 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 09:19:26 Tower shfs/user: cache disk full
Apr 17 09:19:58 Tower last message repeated 378 times
Apr 17 09:20:59 Tower last message repeated 657 times
Apr 17 09:22:00 Tower last message repeated 659 times
Apr 17 09:23:01 Tower last message repeated 836 times
Apr 17 09:24:02 Tower last message repeated 712 times
Apr 17 09:25:07 Tower last message repeated 610 times
Apr 17 09:26:09 Tower last message repeated 735 times
Apr 17 09:26:56 Tower last message repeated 663 times
Apr 17 09:26:56 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 09:26:56 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 09:26:56 Tower shfs/user: cache disk full
Apr 17 09:26:56 Tower shfs/user: cache disk full
Apr 17 09:26:56 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 09:26:56 Tower shfs/user: cache disk full
Apr 17 09:27:27 Tower last message repeated 322 times
Apr 17 09:28:29 Tower last message repeated 751 times
Apr 17 09:29:30 Tower last message repeated 591 times
Apr 17 09:30:32 Tower last message repeated 795 times
Apr 17 09:31:35 Tower last message repeated 765 times
Apr 17 09:32:43 Tower last message repeated 673 times
Apr 17 09:33:44 Tower last message repeated 618 times
Apr 17 09:34:25 Tower last message repeated 528 times
Apr 17 09:34:26 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 09:34:26 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 09:34:26 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 09:34:26 Tower shfs/user: cache disk full
Apr 17 09:34:57 Tower last message repeated 402 times
Apr 17 09:35:58 Tower last message repeated 624 times
Apr 17 09:37:01 Tower last message repeated 660 times
Apr 17 09:38:02 Tower last message repeated 790 times
Apr 17 09:39:04 Tower last message repeated 733 times
Apr 17 09:40:05 Tower last message repeated 843 times
Apr 17 09:41:06 Tower last message repeated 606 times
Apr 17 09:41:52 Tower last message repeated 497 times
Apr 17 09:41:56 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 09:41:56 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 09:41:57 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 09:41:57 Tower shfs/user: cache disk full
Apr 17 09:42:28 Tower last message repeated 422 times
Apr 17 09:43:29 Tower last message repeated 744 times
Apr 17 09:44:31 Tower last message repeated 720 times
Apr 17 09:45:32 Tower last message repeated 587 times
Apr 17 09:46:34 Tower last message repeated 754 times
Apr 17 09:47:35 Tower last message repeated 790 times
Apr 17 09:48:36 Tower last message repeated 713 times
Apr 17 09:49:27 Tower last message repeated 503 times
Apr 17 09:49:27 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 09:49:27 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 09:49:27 Tower shfs/user: cache disk full
Apr 17 09:49:27 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 09:49:27 Tower shfs/user: cache disk full
Apr 17 09:49:58 Tower last message repeated 293 times
Apr 17 09:50:59 Tower last message repeated 855 times
Apr 17 09:52:00 Tower last message repeated 831 times
Apr 17 09:53:01 Tower last message repeated 612 times
Apr 17 09:54:02 Tower last message repeated 839 times
Apr 17 09:55:03 Tower last message repeated 592 times
Apr 17 09:56:04 Tower last message repeated 792 times
Apr 17 09:56:56 Tower last message repeated 562 times
Apr 17 09:56:57 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 09:56:57 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 09:56:57 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 09:57:02 Tower shfs/user: cache disk full
Apr 17 09:57:33 Tower last message repeated 291 times
Apr 17 09:58:34 Tower last message repeated 668 times
Apr 17 09:58:48 Tower last message repeated 196 times
Apr 17 09:59:48 Tower emhttp: shcmd (63): /usr/local/sbin/mover |& logger &
Apr 17 10:02:01 Tower emhttp: shcmd (64): /usr/local/sbin/mover |& logger &
Apr 17 10:04:27 Tower dhcpcd[991]: eth0: renewing lease of 10.181.7.86
Apr 17 10:04:27 Tower dhcpcd[991]: eth0: acknowledged 10.181.7.86 from 10.181.0.1
Apr 17 10:04:27 Tower dhcpcd[991]: eth0: leased 10.181.7.86 for 900 seconds
Apr 17 10:05:43 Tower emhttp: shcmd (65): /usr/local/sbin/mover |& logger &
Apr 17 10:06:49 Tower emhttp: shcmd (66): :>/etc/samba/smb-shares.conf
Apr 17 10:06:49 Tower emhttp: Restart SMB...
Apr 17 10:06:49 Tower emhttp: shcmd (67): killall -HUP smbd
Apr 17 10:06:49 Tower emhttp: shcmd (68): ps axc | grep -q rpc.mountd
Apr 17 10:06:49 Tower emhttp: _shcmd: shcmd (68): exit status: 1
Apr 17 10:06:49 Tower emhttp: shcmd (69): /usr/local/sbin/emhttp_event svcs_restarted
Apr 17 10:06:49 Tower emhttp_event: svcs_restarted
Apr 17 10:07:06 Tower emhttp: shcmd (70): /usr/local/sbin/mover |& logger &
Apr 17 10:08:08 Tower shfs/user: cache disk full
Apr 17 10:08:39 Tower last message repeated 54 times
Apr 17 10:09:41 Tower last message repeated 297 times
Apr 17 10:10:42 Tower last message repeated 302 times

 

Link to comment

Have noticed I don't have a user0 share for some reason, which I imagine is causing the problem. Still don't know why the cache has allowed itself to get so full? If I restart the array will user 0 be recreated?

It should be...

 

It did create itself fine on a reboot, and the mover is now working. Still absolutely clueless as to why it wasn't created and why my min free space was seemingly ignored.

Link to comment
  • 2 weeks later...
  • 5 months later...

Just wanted to add to this, since this can still happen in 5.0-rc8a. Sorry if I should have made a thread in the beta sub-forum instead.

 

Copied a huge amount of data (approx 1.2 times the size of the cache disk) to the array and ended up with a completely full cache disk, after which the mover script would not actually do anything. All it left in the syslog was a message saying it had started, just like OP mentions. For the record; the "Min. free space" attribute for the cache drive was set to the default value of 2000000.

 

Tried running the script with the following command:

/bin/bash -x /usr/local/sbin/mover

 

This showed that the script exited with code 0 after the first test:

if [ ! -d /mnt/cache -o ! -d /mnt/user0 ]; then
  exit 0

 

Can't really say for sure whether or not I had a user0 share at the time, but what I tried to do (instead of simply rebooting) was stop the SMB service from the GUI.

After this, the mover script worked like it should once again.

 

Now, I don't know exactly what steps are executed with the stopping of the SMB service, so I don't know what actually resolved the issue. I just figured you guys would appreciate the extra info.

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.