August 11, 201510 yr I think I figured out the kill command. Doesn't look like it did any good though. I believe what's happening is that it's moving on to the next item and stalling again. I think I need to kill the rsync, but not sure how, or what other problems that will cause.
August 11, 201510 yr Author You can kill the unbalance process itself. `ps aux | grep unbalance` then kill the unbalance process and do the same for the rsync process again. Not sure why it's stalling, maybe you should try manually with midnight commander (`mc`) to find out if there's anything else going on.
August 11, 201510 yr Thanks. I'll try that. This whole thing was just testing unbalance with moving a small folder so that I could be sure the email settings were working. Looks like I'm going to have a problem with duplicates as well. Files already copied haven't been deleted from the original location.
August 11, 201510 yr Author Yes, I think the files not being deleted "issue" is by design of diskmv. If in use, diskmv won't delete them. In any case, you can check the log, it details all the operations performed. Sorry it didn't work for you. I'm not really sure what could have been the problem
August 11, 201510 yr Yes, I think the files not being deleted "issue" is by design of diskmv. If in use, diskmv won't delete them. Not exactly. If in use, diskmv won't do anything with a file. So duplicate files will not result from in use files. Killing the rsync will likely result in a duplicate file and the file on the destination disk might be a partial copy.
August 11, 201510 yr Yes, I think the files not being deleted "issue" is by design of diskmv. If in use, diskmv won't delete them. Not exactly. If in use, diskmv won't do anything with a file. So duplicate files will not result from in use files. Killing the rsync will likely result in a duplicate file and the file on the destination disk might be a partial copy. My Kodi machine does a daily update on a cron schedule. That would probably have been the only "in use". I wonder if a file scan of the user share could have caused this behavior? Edit: Maybe Mover. Does Mover need to be disabled when using unBalance?
August 11, 201510 yr I'm going to play around with this more in the next few days and see if I continue to have problems. I notice for the email settings SMTP is specified for outgoing mail. Will it only work with SMTP or can I use an Exchange server as well?
August 12, 201510 yr unBalance seems to be working now. I seeing this error code repeating though- rsync: failed to set times on "/mnt/disk9/Media/XBMC": Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.0] What does it mean?
August 12, 201510 yr Author Yes, I think the files not being deleted "issue" is by design of diskmv. If in use, diskmv won't delete them. Not exactly. If in use, diskmv won't do anything with a file. So duplicate files will not result from in use files. Killing the rsync will likely result in a duplicate file and the file on the destination disk might be a partial copy. Thanks for clearing that up Freddie
August 12, 201510 yr Author unBalance seems to be working now. I seeing this error code repeating though- rsync: failed to set times on "/mnt/disk9/Media/XBMC": Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.0] What does it mean? I've seen that some times when the file date is way back in the past or something similar.
August 12, 201510 yr unBalance seems to be working now. I seeing this error code repeating though- rsync: failed to set times on "/mnt/disk9/Media/XBMC": Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.0] What does it mean? I've seen that some times when the file date is way back in the past or something similar. I guessing this error is what prevented these files from being deleted from the "From" disk? Not an exact match?
August 15, 201510 yr Author unBalance seems to be working now. I seeing this error code repeating though- rsync: failed to set times on "/mnt/disk9/Media/XBMC": Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.0] What does it mean? I've seen that some times when the file date is way back in the past or something similar. I guessing this error is what prevented these files from being deleted from the "From" disk? Not an exact match? Yeah, probably that has something to do with it.
August 15, 201510 yr So, I am using this docker to move data off an old 1.5tb drive that I will decommission. Previously, I have followed this post to move data, zero out the drive, and then remove the disk from the config. http://lime-technology.com/forum/index.php?topic=37431.0 My question is this: If I move the data off this old drive and spread out to the rest of the array, would I still need to zero out the drive when the data is moved? Using this docker is updating parity, correct? If so, once the copy is done can I just follow the usual steps to remove the disk from my config? Thanks!
August 15, 201510 yr Author So, I am using this docker to move data off an old 1.5tb drive that I will decommission. Previously, I have followed this post to move data, zero out the drive, and then remove the disk from the config. http://lime-technology.com/forum/index.php?topic=37431.0 My question is this: If I move the data off this old drive and spread out to the rest of the array, would I still need to zero out the drive when the data is moved? Using this docker is updating parity, correct? If so, once the copy is done can I just follow the usual steps to remove the disk from my config? Thanks! Hello indy5, yes ... parity is being updated as per unRAID's standard operating procedures
August 16, 201510 yr So, I am using this docker to move data off an old 1.5tb drive that I will decommission. Previously, I have followed this post to move data, zero out the drive, and then remove the disk from the config. http://lime-technology.com/forum/index.php?topic=37431.0 My question is this: If I move the data off this old drive and spread out to the rest of the array, would I still need to zero out the drive when the data is moved? Using this docker is updating parity, correct? If so, once the copy is done can I just follow the usual steps to remove the disk from my config? Thanks! The steps in the linked post are not exactly the "usual" steps, so I'm not sure what you mean. The usual way to remove a drive is to new config without the drive and rebuild parity. The ultimate answer to your question you can perhaps figure out by understanding that an empty filesystem is not the same thing as a zeroed drive, so if you move all the data off you still won't have a zeroed drive and removing it will affect parity.
August 17, 201510 yr I am using unRAID 6.1RC4 and my install just shows this: The array is not operational. Please start the array first. I will report my log after i finish a manual file copy and reboot, one of my drives hit 0 bytes and it was causing some issues, which is why I enabled unBALANCE to begin with, but its not loading. Wanted to check if maybe its an issue with 6.1 and nothing I can do?
August 17, 201510 yr Author I am using unRAID 6.1RC4 and my install just shows this: The array is not operational. Please start the array first. I will report my log after i finish a manual file copy and reboot, one of my drives hit 0 bytes and it was causing some issues, which is why I enabled unBALANCE to begin with, but its not loading. Wanted to check if maybe its an issue with 6.1 and nothing I can do? Hi wickedathletes, not sure if the version is an issue, but I'm on 6.0.1. I'll try to upgrade to 6.1 at the earliest possible. If you can send the logs, I'll check if there's something there.
August 17, 201510 yr I am using unRAID 6.1RC4 and my install just shows this: The array is not operational. Please start the array first. I will report my log after i finish a manual file copy and reboot, one of my drives hit 0 bytes and it was causing some issues, which is why I enabled unBALANCE to begin with, but its not loading. Wanted to check if maybe its an issue with 6.1 and nothing I can do? Hi wickedathletes, not sure if the version is an issue, but I'm on 6.0.1. I'll try to upgrade to 6.1 at the earliest possible. If you can send the logs, I'll check if there's something there. will do, 6.1 has some issues with dockers not able to restart, so I deleted my logs/config to start it over but of course the only way it will recreate them is on reboot, once my copy finishes though I should be good to get you the log Unless of course it fixes itself and the 0 byte drive was causing everything.
August 18, 201510 yr Mine just says this: I: 2015/08/17 22:52:21 boot.go:48: unBALANCE v0.7.3-157.f2ebeef starting up ... W: 2015/08/17 22:52:21 settings.go:69: Config file /config/config.json doesn't exist. Creating one ... I: 2015/08/17 22:52:21 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:52:21 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:52:21 settings.go:54: Config file loaded from (/config) as: ReservedSpace=450000000 Folders=[] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:52:21 socket.go:71: starting service Socket ... I: 2015/08/17 22:52:21 server.go:30: Starting service Server ... I: 2015/08/17 22:52:21 server.go:42: Serving files from /usr/local/share/unbalance I: 2015/08/17 22:52:21 server.go:68: started listening on :6237 I: 2015/08/17 22:52:21 core.go:68: starting service Core ... I: 2015/08/17 22:52:21 boot.go:63: Press Ctrl+C to stop ... I: 2015/08/17 22:54:27 core.go:100: Sending config I: 2015/08/17 22:54:27 unraid.go:224: Unraid Box Condition: &{NumDisks:0 NumProtected:0 Synced:0001-01-01 00:00:00 +0000 UTC SyncErrs:0 Resync:0 ResyncPrcnt:0 ResyncPos:0 State: Size:0 Free:0 NewFree:0} I: 2015/08/17 22:54:27 unraid.go:225: Unraid Box SourceDiskName: I: 2015/08/17 22:54:27 unraid.go:226: Unraid Box BytesToMove: 0 I: 2015/08/17 22:54:43 core.go:106: Saving config I: 2015/08/17 22:54:43 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:54:55 core.go:106: Saving config I: 2015/08/17 22:54:55 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:55:02 core.go:106: Saving config I: 2015/08/17 22:55:02 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos Movies] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:55:05 core.go:106: Saving config I: 2015/08/17 22:55:05 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos Movies Music] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:55:13 core.go:106: Saving config I: 2015/08/17 22:55:13 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos Movies Music Other] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:55:22 core.go:106: Saving config I: 2015/08/17 22:55:22 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos Movies Music Other Photography] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:55:26 core.go:106: Saving config I: 2015/08/17 22:55:26 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos Movies Music Other Photography TV Series] DryRun=false Notifications=false [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:55:28 core.go:106: Saving config I: 2015/08/17 22:55:28 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos Movies Music Other Photography TV Series] DryRun=false Notifications=true [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false User=myaccount I: 2015/08/17 22:56:03 core.go:106: Saving config I: 2015/08/17 22:56:03 settings.go:124: Config file saved as: ReservedSpace=450000000 Folders=[backup Home Videos Movies Music Other Photography TV Series] DryRun=false Notifications=true [email protected] [email protected] Host=smtp.gmail.com Port=465 Encrypt=false [email protected] I: 2015/08/17 22:56:08 unraid.go:224: Unraid Box Condition: &{NumDisks:0 NumProtected:0 Synced:0001-01-01 00:00:00 +0000 UTC SyncErrs:0 Resync:0 ResyncPrcnt:0 ResyncPos:0 State: Size:0 Free:0 NewFree:0} I: 2015/08/17 22:56:08 unraid.go:225: Unraid Box SourceDiskName: I: 2015/08/17 22:56:08 unraid.go:226: Unraid Box BytesToMove: 0 I: 2015/08/17 22:56:12 unraid.go:224: Unraid Box Condition: &{NumDisks:0 NumProtected:0 Synced:0001-01-01 00:00:00 +0000 UTC SyncErrs:0 Resync:0 ResyncPrcnt:0 ResyncPos:0 State: Size:0 Free:0 NewFree:0} I: 2015/08/17 22:56:12 unraid.go:225: Unraid Box SourceDiskName: I: 2015/08/17 22:56:12 unraid.go:226: Unraid Box BytesToMove: 0 I: 2015/08/17 22:56:18 unraid.go:224: Unraid Box Condition: &{NumDisks:0 NumProtected:0 Synced:0001-01-01 00:00:00 +0000 UTC SyncErrs:0 Resync:0 ResyncPrcnt:0 ResyncPos:0 State: Size:0 Free:0 NewFree:0} I: 2015/08/17 22:56:18 unraid.go:225: Unraid Box SourceDiskName: I: 2015/08/17 22:56:18 unraid.go:226: Unraid Box BytesToMove: 0 Could this have anything to do with this in 6.1? http://lime-technology.com/forum/index.php?topic=42146.0
August 18, 201510 yr Author Mine just says this: ... Could this have anything to do with this in 6.1? http://lime-technology.com/forum/index.php?topic=42146.0 Yes, 6.1 changed some things around, which makes unBALANCE fail. It seems like a very simple change, so I should have an update very soon.
August 18, 201510 yr Author I updated the app to support 6.1 A new volume is required to be mounted ("/usr/local/sbin"). I installed the docker with the Community Applications plugin. I hadn't used the plugin before, nice little app
August 18, 201510 yr I updated the app to support 6.1 A new volume is required to be mounted ("/usr/local/sbin"). I installed the docker with the Community Applications plugin. I hadn't used the plugin before, nice little app thanks, looks good to go for me! Now onto the miserable process of getting all my drives to xfs.
August 18, 201510 yr thanks, looks good to go for me! Now onto the miserable process of getting all my drives to xfs. Is this worth the effort? What are the benefits? Also when I add a new drive to the array, will unrRAID give me the option for which file system to format the drive? In a different format than the other array drives? My 5+ year old unraid server has been plugging along with reiserfs array drives. I have not added a new drive to the array since the beginning; I have been up-sizing my array drives (and rebuilding the drive) to increase capacity. I am on the latest 6.1rc release and my cache is btrfs... all dockers, only use basic plugins like swapfile, community apps, nerdtools, shutdown, pre-clear, etc. For me to go to XFS, I would have to transfer close to 20TB of data. Thaks.
August 18, 201510 yr thanks, looks good to go for me! Now onto the miserable process of getting all my drives to xfs. Is this worth the effort? What are the benefits? Also when I add a new drive to the array, will unrRAID give me the option for which file system to format the drive? In a different format than the other array drives? My 5+ year old unraid server has been plugging along with reiserfs array drives. I have not added a new drive to the array since the beginning; I have been up-sizing my array drives (and rebuilding the drive) to increase capacity. I am on the latest 6.1rc release and my cache is btrfs... all dockers, only use basic plugins like swapfile, community apps, nerdtools, shutdown, pre-clear, etc. For me to go to XFS, I would have to transfer close to 20TB of data. Thaks. I am just switching to switch, figure its future proofing it. New drives can be created as XFS, its under Settings->Disk Settings "Default file system." Although keep in mind, if you are replacing drives and not adding new ones, when it builds the drive from parity it will use whatever it was. The reason I am doing it is this tool lets me do it easy, I don't have to think about it or write commands and remember what I did. I have about 15TB total, but 3 drives are already at XFS, so I have about 7TB left to move around. My biggest issue is I have 4.05TB left of space and a 4TB drive that has to move, so I am hoping it will all fit
August 18, 201510 yr I am just switching to switch, figure its future proofing it. New drives can be created as XFS, its under Settings->Disk Settings "Default file system." Although keep in mind, if you are replacing drives and not adding new ones, when it builds the drive from parity it will use whatever it was. The reason I am doing it is this tool lets me do it easy, I don't have to think about it or write commands and remember what I did. I have about 15TB total, but 3 drives are already at XFS, so I have about 7TB left to move around. My biggest issue is I have 4.05TB left of space and a 4TB drive that has to move, so I am hoping it will all fit Thank you Wicked... I think the risk vs reward for me would be to stay at reiserfs with what I have. I really do not have more room in my case for new drives, or sata slots, or pci slots for additional sata cards... I am maxed out on all fronts at 12 drives. I have a 4TB parity and still have two 2TB drives and two 3TB drives that I can replace for an additional 6TB of storage.
Archived
This topic is now archived and is closed to further replies.