wgstarks Posted August 11, 2015 Share Posted August 11, 2015 I think I figured out the kill command. Doesn't look like it did any good though. I believe what's happening is that it's moving on to the next item and stalling again. I think I need to kill the rsync, but not sure how, or what other problems that will cause. Quote Link to comment
jbrodriguez Posted August 11, 2015 Author Share Posted August 11, 2015 You can kill the unbalance process itself. `ps aux | grep unbalance` then kill the unbalance process and do the same for the rsync process again. Not sure why it's stalling, maybe you should try manually with midnight commander (`mc`) to find out if there's anything else going on. Quote Link to comment
wgstarks Posted August 11, 2015 Share Posted August 11, 2015 Thanks. I'll try that. This whole thing was just testing unbalance with moving a small folder so that I could be sure the email settings were working. Looks like I'm going to have a problem with duplicates as well. Files already copied haven't been deleted from the original location. Quote Link to comment
jbrodriguez Posted August 11, 2015 Author Share Posted August 11, 2015 Yes, I think the files not being deleted "issue" is by design of diskmv. If in use, diskmv won't delete them. In any case, you can check the log, it details all the operations performed. Sorry it didn't work for you. I'm not really sure what could have been the problem Quote Link to comment
Freddie Posted August 11, 2015 Share Posted August 11, 2015 Yes, I think the files not being deleted "issue" is by design of diskmv. If in use, diskmv won't delete them. Not exactly. If in use, diskmv won't do anything with a file. So duplicate files will not result from in use files. Killing the rsync will likely result in a duplicate file and the file on the destination disk might be a partial copy. Quote Link to comment
wgstarks Posted August 11, 2015 Share Posted August 11, 2015 Yes, I think the files not being deleted "issue" is by design of diskmv. If in use, diskmv won't delete them. Not exactly. If in use, diskmv won't do anything with a file. So duplicate files will not result from in use files. Killing the rsync will likely result in a duplicate file and the file on the destination disk might be a partial copy. My Kodi machine does a daily update on a cron schedule. That would probably have been the only "in use". I wonder if a file scan of the user share could have caused this behavior? Edit: Maybe Mover. Does Mover need to be disabled when using unBalance? Quote Link to comment
wgstarks Posted August 11, 2015 Share Posted August 11, 2015 I'm going to play around with this more in the next few days and see if I continue to have problems. I notice for the email settings SMTP is specified for outgoing mail. Will it only work with SMTP or can I use an Exchange server as well? Quote Link to comment
wgstarks Posted August 12, 2015 Share Posted August 12, 2015 unBalance seems to be working now. I seeing this error code repeating though- rsync: failed to set times on "/mnt/disk9/Media/XBMC": Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.0] What does it mean? Quote Link to comment
jbrodriguez Posted August 12, 2015 Author Share Posted August 12, 2015 Yes, I think the files not being deleted "issue" is by design of diskmv. If in use, diskmv won't delete them. Not exactly. If in use, diskmv won't do anything with a file. So duplicate files will not result from in use files. Killing the rsync will likely result in a duplicate file and the file on the destination disk might be a partial copy. Thanks for clearing that up Freddie Quote Link to comment
jbrodriguez Posted August 12, 2015 Author Share Posted August 12, 2015 unBalance seems to be working now. I seeing this error code repeating though- rsync: failed to set times on "/mnt/disk9/Media/XBMC": Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.0] What does it mean? I've seen that some times when the file date is way back in the past or something similar. Quote Link to comment
wgstarks Posted August 12, 2015 Share Posted August 12, 2015 unBalance seems to be working now. I seeing this error code repeating though- rsync: failed to set times on "/mnt/disk9/Media/XBMC": Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.0] What does it mean? I've seen that some times when the file date is way back in the past or something similar. I guessing this error is what prevented these files from being deleted from the "From" disk? Not an exact match? Quote Link to comment
jbrodriguez Posted August 15, 2015 Author Share Posted August 15, 2015 unBalance seems to be working now. I seeing this error code repeating though- rsync: failed to set times on "/mnt/disk9/Media/XBMC": Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.0] What does it mean? I've seen that some times when the file date is way back in the past or something similar. I guessing this error is what prevented these files from being deleted from the "From" disk? Not an exact match? Yeah, probably that has something to do with it. Quote Link to comment
indy5 Posted August 15, 2015 Share Posted August 15, 2015 So, I am using this docker to move data off an old 1.5tb drive that I will decommission. Previously, I have followed this post to move data, zero out the drive, and then remove the disk from the config. http://lime-technology.com/forum/index.php?topic=37431.0 My question is this: If I move the data off this old drive and spread out to the rest of the array, would I still need to zero out the drive when the data is moved? Using this docker is updating parity, correct? If so, once the copy is done can I just follow the usual steps to remove the disk from my config? Thanks! Quote Link to comment
jbrodriguez Posted August 15, 2015 Author Share Posted August 15, 2015 So, I am using this docker to move data off an old 1.5tb drive that I will decommission. Previously, I have followed this post to move data, zero out the drive, and then remove the disk from the config. http://lime-technology.com/forum/index.php?topic=37431.0 My question is this: If I move the data off this old drive and spread out to the rest of the array, would I still need to zero out the drive when the data is moved? Using this docker is updating parity, correct? If so, once the copy is done can I just follow the usual steps to remove the disk from my config? Thanks! Hello indy5, yes ... parity is being updated as per unRAID's standard operating procedures Quote Link to comment
trurl Posted August 16, 2015 Share Posted August 16, 2015 So, I am using this docker to move data off an old 1.5tb drive that I will decommission. Previously, I have followed this post to move data, zero out the drive, and then remove the disk from the config. http://lime-technology.com/forum/index.php?topic=37431.0 My question is this: If I move the data off this old drive and spread out to the rest of the array, would I still need to zero out the drive when the data is moved? Using this docker is updating parity, correct? If so, once the copy is done can I just follow the usual steps to remove the disk from my config? Thanks! The steps in the linked post are not exactly the "usual" steps, so I'm not sure what you mean. The usual way to remove a drive is to new config without the drive and rebuild parity. The ultimate answer to your question you can perhaps figure out by understanding that an empty filesystem is not the same thing as a zeroed drive, so if you move all the data off you still won't have a zeroed drive and removing it will affect parity. Quote Link to comment
wickedathletes Posted August 17, 2015 Share Posted August 17, 2015 I am using unRAID 6.1RC4 and my install just shows this: The array is not operational. Please start the array first. I will report my log after i finish a manual file copy and reboot, one of my drives hit 0 bytes and it was causing some issues, which is why I enabled unBALANCE to begin with, but its not loading. Wanted to check if maybe its an issue with 6.1 and nothing I can do? Quote Link to comment
jbrodriguez Posted August 17, 2015 Author Share Posted August 17, 2015 I am using unRAID 6.1RC4 and my install just shows this: The array is not operational. Please start the array first. I will report my log after i finish a manual file copy and reboot, one of my drives hit 0 bytes and it was causing some issues, which is why I enabled unBALANCE to begin with, but its not loading. Wanted to check if maybe its an issue with 6.1 and nothing I can do? Hi wickedathletes, not sure if the version is an issue, but I'm on 6.0.1. I'll try to upgrade to 6.1 at the earliest possible. If you can send the logs, I'll check if there's something there. Quote Link to comment
wickedathletes Posted August 17, 2015 Share Posted August 17, 2015 I am using unRAID 6.1RC4 and my install just shows this: The array is not operational. Please start the array first. I will report my log after i finish a manual file copy and reboot, one of my drives hit 0 bytes and it was causing some issues, which is why I enabled unBALANCE to begin with, but its not loading. Wanted to check if maybe its an issue with 6.1 and nothing I can do? Hi wickedathletes, not sure if the version is an issue, but I'm on 6.0.1. I'll try to upgrade to 6.1 at the earliest possible. If you can send the logs, I'll check if there's something there. will do, 6.1 has some issues with dockers not able to restart, so I deleted my logs/config to start it over but of course the only way it will recreate them is on reboot, once my copy finishes though I should be good to get you the log Unless of course it fixes itself and the 0 byte drive was causing everything. Quote Link to comment
wickedathletes Posted August 18, 2015 Share Posted August 18, 2015 Mine just says this: I: 2015/08/17 22:52:21 boot.go:48: unBALANCE v0.7.3-157.f2ebeef starting up ... W: 2015/08/17 22:52:21 settings.go:69: Config file /config/config.json doesn't exist. Creating one ... I: 2015/08/17 22:52:21 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:52:21 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:52:21 settings.go:54: Config file loaded from (/config) as: ReservedSpace=450000000 Folders=[] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:52:21 socket.go:71: starting service Socket ... I: 2015/08/17 22:52:21 server.go:30: Starting service Server ... I: 2015/08/17 22:52:21 server.go:42: Serving files from /usr/local/share/unbalance I: 2015/08/17 22:52:21 server.go:68: started listening on :6237 I: 2015/08/17 22:52:21 core.go:68: starting service Core ... I: 2015/08/17 22:52:21 boot.go:63: Press Ctrl+C to stop ... I: 2015/08/17 22:54:27 core.go:100: Sending config I: 2015/08/17 22:54:27 unraid.go:224: Unraid Box Condition: &{NumDisks:0 NumProtected:0 Synced:0001-01-01 00:00:00 +0000 UTC SyncErrs:0 Resync:0 ResyncPrcnt:0 ResyncPos:0 State: Size:0 Free:0 NewFree:0} I: 2015/08/17 22:54:27 unraid.go:225: Unraid Box SourceDiskName: I: 2015/08/17 22:54:27 unraid.go:226: Unraid Box BytesToMove: 0 I: 2015/08/17 22:54:43 core.go:106: Saving config I: 2015/08/17 22:54:43 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:54:55 core.go:106: Saving config I: 2015/08/17 22:54:55 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:55:02 core.go:106: Saving config I: 2015/08/17 22:55:02 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos Movies] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:55:05 core.go:106: Saving config I: 2015/08/17 22:55:05 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos Movies Music] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:55:13 core.go:106: Saving config I: 2015/08/17 22:55:13 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos Movies Music Other] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:55:22 core.go:106: Saving config I: 2015/08/17 22:55:22 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos Movies Music Other Photography] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:55:26 core.go:106: Saving config I: 2015/08/17 22:55:26 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos Movies Music Other Photography TV Series] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:55:28 core.go:106: Saving config I: 2015/08/17 22:55:28 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos Movies Music Other Photography TV Series] DryRun=false Notifications=true [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:56:03 core.go:106: Saving config I: 2015/08/17 22:56:03 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos Movies Music Other Photography TV Series] DryRun=false Notifications=true [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false [email protected] I: 2015/08/17 22:56:08 unraid.go:224: Unraid Box Condition: &{NumDisks:0 NumProtected:0 Synced:0001-01-01 00:00:00 +0000 UTC SyncErrs:0 Resync:0 ResyncPrcnt:0 ResyncPos:0 State: Size:0 Free:0 NewFree:0} I: 2015/08/17 22:56:08 unraid.go:225: Unraid Box SourceDiskName: I: 2015/08/17 22:56:08 unraid.go:226: Unraid Box BytesToMove: 0 I: 2015/08/17 22:56:12 unraid.go:224: Unraid Box Condition: &{NumDisks:0 NumProtected:0 Synced:0001-01-01 00:00:00 +0000 UTC SyncErrs:0 Resync:0 ResyncPrcnt:0 ResyncPos:0 State: Size:0 Free:0 NewFree:0} I: 2015/08/17 22:56:12 unraid.go:225: Unraid Box SourceDiskName: I: 2015/08/17 22:56:12 unraid.go:226: Unraid Box BytesToMove: 0 I: 2015/08/17 22:56:18 unraid.go:224: Unraid Box Condition: &{NumDisks:0 NumProtected:0 Synced:0001-01-01 00:00:00 +0000 UTC SyncErrs:0 Resync:0 ResyncPrcnt:0 ResyncPos:0 State: Size:0 Free:0 NewFree:0} I: 2015/08/17 22:56:18 unraid.go:225: Unraid Box SourceDiskName: I: 2015/08/17 22:56:18 unraid.go:226: Unraid Box BytesToMove: 0 Could this have anything to do with this in 6.1? http://lime-technology.com/forum/index.php?topic=42146.0 Quote Link to comment
jbrodriguez Posted August 18, 2015 Author Share Posted August 18, 2015 Mine just says this: ... Could this have anything to do with this in 6.1? http://lime-technology.com/forum/index.php?topic=42146.0 Yes, 6.1 changed some things around, which makes unBALANCE fail. It seems like a very simple change, so I should have an update very soon. Quote Link to comment
jbrodriguez Posted August 18, 2015 Author Share Posted August 18, 2015 I updated the app to support 6.1 A new volume is required to be mounted ("/usr/local/sbin"). I installed the docker with the Community Applications plugin. I hadn't used the plugin before, nice little app Quote Link to comment
wickedathletes Posted August 18, 2015 Share Posted August 18, 2015 I updated the app to support 6.1 A new volume is required to be mounted ("/usr/local/sbin"). I installed the docker with the Community Applications plugin. I hadn't used the plugin before, nice little app thanks, looks good to go for me! Now onto the miserable process of getting all my drives to xfs. Quote Link to comment
hernandito Posted August 18, 2015 Share Posted August 18, 2015 thanks, looks good to go for me! Now onto the miserable process of getting all my drives to xfs. Is this worth the effort? What are the benefits? Also when I add a new drive to the array, will unrRAID give me the option for which file system to format the drive? In a different format than the other array drives? My 5+ year old unraid server has been plugging along with reiserfs array drives. I have not added a new drive to the array since the beginning; I have been up-sizing my array drives (and rebuilding the drive) to increase capacity. I am on the latest 6.1rc release and my cache is btrfs... all dockers, only use basic plugins like swapfile, community apps, nerdtools, shutdown, pre-clear, etc. For me to go to XFS, I would have to transfer close to 20TB of data. Thaks. Quote Link to comment
wickedathletes Posted August 18, 2015 Share Posted August 18, 2015 thanks, looks good to go for me! Now onto the miserable process of getting all my drives to xfs. Is this worth the effort? What are the benefits? Also when I add a new drive to the array, will unrRAID give me the option for which file system to format the drive? In a different format than the other array drives? My 5+ year old unraid server has been plugging along with reiserfs array drives. I have not added a new drive to the array since the beginning; I have been up-sizing my array drives (and rebuilding the drive) to increase capacity. I am on the latest 6.1rc release and my cache is btrfs... all dockers, only use basic plugins like swapfile, community apps, nerdtools, shutdown, pre-clear, etc. For me to go to XFS, I would have to transfer close to 20TB of data. Thaks. I am just switching to switch, figure its future proofing it. New drives can be created as XFS, its under Settings->Disk Settings "Default file system." Although keep in mind, if you are replacing drives and not adding new ones, when it builds the drive from parity it will use whatever it was. The reason I am doing it is this tool lets me do it easy, I don't have to think about it or write commands and remember what I did. I have about 15TB total, but 3 drives are already at XFS, so I have about 7TB left to move around. My biggest issue is I have 4.05TB left of space and a 4TB drive that has to move, so I am hoping it will all fit Quote Link to comment
hernandito Posted August 18, 2015 Share Posted August 18, 2015 I am just switching to switch, figure its future proofing it. New drives can be created as XFS, its under Settings->Disk Settings "Default file system." Although keep in mind, if you are replacing drives and not adding new ones, when it builds the drive from parity it will use whatever it was. The reason I am doing it is this tool lets me do it easy, I don't have to think about it or write commands and remember what I did. I have about 15TB total, but 3 drives are already at XFS, so I have about 7TB left to move around. My biggest issue is I have 4.05TB left of space and a 4TB drive that has to move, so I am hoping it will all fit Thank you Wicked... I think the risk vs reward for me would be to stay at reiserfs with what I have. I really do not have more room in my case for new drives, or sata slots, or pci slots for additional sata cards... I am maxed out on all fronts at 12 drives. I have a 4TB parity and still have two 2TB drives and two 3TB drives that I can replace for an additional 6TB of storage. Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.