[Plugin] unbalanced

[kizer]

It either showed up after rebooting or starting stopping the plugin.

Its there for me now.

[jbrodriguez]

Not sure why it doesn't pick up the latest version, unless you reboot or start/stop the plugin.

 

I'll check the install/upgrade code.

[kizer]

Another silly question I have is I told it to move a drive and selected all the available drives. The folder was my tv show folder with 1.1 TB of files. It was composed of the following structure.

 

TV/Shows/BreakingBad/Season1

 

It kept telling me there wasn't enough room when between all my drives I had at least 2.59TB

 

This was before 1.30.

 

I have all drives setup as TV included shares and HighWater.

 

Ok it appears if I pick TV/Shows opposed to TV it seems to not complain. lol

[kizer]

Another silly question. Does it copy first then Delete? I noticed earlier I had two of the same files on two different shares. The plugin timed out or something and I simply deleted the dupes.

[jbrodriguez]

Another silly question. Does it copy first then Delete? I noticed earlier I had two of the same files on two different shares. The plugin timed out or something and I simply deleted the dupes.

 

Yes, it copies then deletes.

 

diskmv has a clobber option (-c "clobber, duplicates on destination will be overwritten"), but I'm not sure how sensible it would be to use it in the general case.

[kizer]

Exactly. I'd rather copy then delete. It ran then timed out or something and I noticed I had dupes when i looked in my shares folder. I had several folders worth and thought that was odd behavior. It's like it never came back and deleted, but then I realized it wasn't doing anything at all any more.

 

Not a serious big deal, but thought it was odd since its worked flawlessly all weekend. 

[JimPhreak]

Just installed this plugin for the first time.  Seems like a super useful plugin so thanks very much for creating it.

 

I tried to do a dry run for the first time.  Selected a specific TV show within my Videos share so the folder selected is Videos/TV/House.  The folder is 210GB and I've selected 4 disks in my array to move the folder to.  Each folder has over 2TB worth of free space however when I do a dry run it spits the following error:

 

"There isn't available space in any of the target disks, to move the folders you selected.

Check more disks in the TO column or go to the Settings page, to review the folders selected for moving or to change the amount of reserved space."

 

Thoughts?

 

EDIT: Stopping and starting the plugin seems to have fixed my issue.

[gswarriorfan]

I just installed this plugin after using the docker version last month.  I removed the docker a few weeks ago, and installed the plugin.  When I go to the IP:6237 I am greeted to a blank page.  I tried stopping/starting the plugin to no success.  I installed using Community Apps. 

 

edit:

 

It's working now.  I just restated my unraid box and it started working.

[huladaddy]

I just installed this plugin after using the docker version last month.  I removed the docker a few weeks ago, and installed the plugin.  When I go to the IP:6237 I am greeted to a blank page.  I tried stopping/starting the plugin to no success.  I installed using Community Apps. 

 

edit:

 

It's working now.  I just restated my unraid box and it started working.

I have the same problem -- blank page. Is there another way of getting unBalance to run? I am currently preclearing four disks and can't restart unraid.

[lishpy]

Thanks for this, seems to work great.

 

One suggestion.

 

In my case, when I tried to open unBALANCE from the plugins page, I clicked "Open webUI 1.30" and it took me to "tower:6237" which didn't load.

 

Unfortunately on OS X, to access my server over the network you need to type in tower.local, not just tower. Would it be easy for you to change this link to access via the unRAID IP address instead of via hostname? That way regardless of hostname it will just load the IP:port and should work on any OS.

[jbrodriguez]

I just installed this plugin after using the docker version last month.  I removed the docker a few weeks ago, and installed the plugin.  When I go to the IP:6237 I am greeted to a blank page.  I tried stopping/starting the plugin to no success.  I installed using Community Apps. 

 

edit:

 

It's working now.  I just restated my unraid box and it started working.

I have the same problem -- blank page. Is there another way of getting unBalance to run? I am currently preclearing four disks and can't restart unraid.

 

Hi huladaddy, not sure why you come up with a blank page.

 

If the plugin is running (it shows the green Open Web ui link), you should be able to access it via either http://ip:6237/ or http://hostname:6237/, following whatever addressing scheme you have in your network.

 

Does the log show that it's actually running (/boot/logs/unbalance.log) ?

[jbrodriguez]

Thanks for this, seems to work great.

 

One suggestion.

 

In my case, when I tried to open unBALANCE from the plugins page, I clicked "Open webUI 1.30" and it took me to "tower:6237" which didn't load.

 

Unfortunately on OS X, to access my server over the network you need to type in tower.local, not just tower. Would it be easy for you to change this link to access via the unRAID IP address instead of via hostname? That way regardless of hostname it will just load the IP:port and should work on any OS.

 

Thanks for the comments lishpy !

 

I'll take a look at the link opening code, to see if I can use ip address rather than hostname (probably, that's what's happening to huladaddy too).

 

I'm a bit tied up until the end of next week, but I'll look into it.

[Squid]

Thanks for this, seems to work great.

 

One suggestion.

 

In my case, when I tried to open unBALANCE from the plugins page, I clicked "Open webUI 1.30" and it took me to "tower:6237" which didn't load.

 

Unfortunately on OS X, to access my server over the network you need to type in tower.local, not just tower. Would it be easy for you to change this link to access via the unRAID IP address instead of via hostname? That way regardless of hostname it will just load the IP:port and should work on any OS.

 

Thanks for the comments lishpy !

 

I'll take a look at the link opening code, to see if I can use ip address rather than hostname (probably, that's what's happening to huladaddy too).

 

I'm a bit tied up until the end of next week, but I'll look into it.

no idea what the webUI page is, but if you just have it as another .page file, then reference it as Settings/webUI and dynamix will handle everything for you...  (turn on help, and look at the link for CA's manual, and look at caHelp.page

[Unqualified Spectator]

Would it be possible to have an option added so unBalance would simply CLONE all the targeted shares to a new drive and not delete the original file?  I have several drives I would like to consolidate onto a new larger disk - but i would like to leave all the original disks intact for storage.

 

Even if not - thanks for an awesome means to safely move files without dealing with the command line - this plugin is brilliant.

[PhAzE]

Looks like a promising plugin. Quick question, sorry if it's the wrong thread, if I have 4 disks formatted as RiserFS and I want to change them to XFS, (one being parity) can I use this plugin to move files off one disk, format it to XFS and copy files back to it and format the next?  Will the newly formatted disk still be part of the array even though it's a different format than the remaining disks?

 

Cause if so, then this is what i was looking for. A time saving plugin

[trurl]

Looks like a promising plugin. Quick question, sorry if it's the wrong thread, if I have 4 disks formatted as RiserFS and I want to change them to XFS, (one being parity) can I use this plugin to move files off one disk, format it to XFS and copy files back to it and format the next?  Will the newly formatted disk still be part of the array even though it's a different format than the remaining disks?

 

Cause if so, then this is what i was looking for. A time saving plugin

Yes. You can format any disk at any time to any filesystem simply by stopping the array and going to that drive's page and change the filesystem. Then when you Start the drive will be formatted to the new filesystem. Formatting a drive is simply writing an empty filesystem to the disk, which is treated just like any other write as far as parity is concerned. And you can mix filesystems as much as you want as long it is one of the supported 3, ReiserFS, XFS, btrfs. (And of course parity doesn't have a filesystem.)

[PhAzE]

Ok I wasn't sure about the mixing and matching. Thanks!

[CRD]

This seems to be working well, thank you! Currently moving all files from one disk at a time. I originally thought that I could move multiple shares from multiple disks to one disks but it wouldn't let me. For example I have a share called "Movies" on Disk 1, 2, and 3", another share called "Backup" on Disk 1 and 4, and "Anime" on Disk 2 and Disk 3. All of which can fit in Disk 5, the intention is to then format Disk 1  and 2 to XFS, then for the remaining drives I don't have to move as much but it would let me. But at least it allows me to move the shares from one disk, so I'll stick with that.

 

Question: I just realised this moves user shares to Disk. So in order to move files back to the original drives (in this case, one at a time is probably safest), could I just create a "Temp" share on my "Destination" disk and move my files inside this share after every "Move" so that when I want to move them back to their original and newly formatted XFS disks, I could select this "Temp" share and move to "Original Disk"? And in order to retain it's share structure, could I just move all files and folders from the way "Temp" share had created them to retain their original structure from their original disk?  Thank you.

 

Update: I used rsync instead to move over my files back:

rsync -av --progress --remove-source-files /mnt/diskX/ /mnt/diskY

[JonathanM]

Update: I used rsync instead to move over my files back:

rsync -av --progress --remove-source-files /mnt/diskX/ /mnt/diskY

No point in using remove-source-files if you are planning on formatting the disk anyway. Copying vs moving is much faster.

[CRD]

Update: I used rsync instead to move over my files back:

rsync -av --progress --remove-source-files /mnt/diskX/ /mnt/diskY

No point in using remove-source-files if you are planning on formatting the disk anyway. Copying vs moving is much faster.

 

I have:

Parity

Disk1 - XFS

Disk2 - RFS

Disk3 - RFS

Disk4 - RFS

Disk5 - XFS (New drive, no user shares)

 

I've just done Disk1, my plan is to use Disk 5 as a placeholder while I empty RFS drives followed by reformatting. So I'm using unBalance to move files from the RFS disk to my placeholder. Then I reformat it to XFS. Since there are no user shares on the placeholder, I can't use unBalance. I have a specific requirement for having a certain type of file/shares on certain disks, otherwise I wouldn't be moving them back. Should I use the diskmv script

diskmv -f "" disk1 disk2

instead or maybe just mv

mv /mnt/disk1/ /mnt/disk2

?

 

 

[smashingtool]

I tried to use this to empty a disk so I could format it. It should have finished overnight, but didn't. It stopped at 120 gigs. So this morning I set it to run again, and it stopped at 116 gigs, but ~120 gigs disappeared from my array. I checked my disk shares, and sure enough, the drive that was supposed to be emptied had copies of files that were also on other disks. So now I'm paranoid that I have a bunch of copies of files on various disks.

 

Is that something that the built in unraid mover would ultimately fix? Or am I doomed to have to compare files over my 4 disks for a while?

[itimpi]

I tried to use this to empty a disk so I could format it. It should have finished overnight, but didn't. It stopped at 120 gigs. So this morning I set it to run again, and it stopped at 116 gigs, but ~120 gigs disappeared from my array. I checked my disk shares, and sure enough, the drive that was supposed to be emptied had copies of files that were also on other disks. So now I'm paranoid that I have a bunch of copies of files on various disks.

 

Is that something that the built in unraid mover would ultimately fix? Or am I doomed to have to compare files over my 4 disks for a while?

You may find the unRAIDFindDuplicates.sh script I wrote some time ago to be of use.  It can very quickly find duplicates based on filenames and timestamps, and also has the option to do (much slower) binary compares.  I regularly use it after moving files around just to check there are no duplicates left behind on different disks.

 

[smashingtool]

You may find the unRAIDFindDuplicates.sh script I wrote some time ago to be of use.  It can very quickly find duplicates based on filenames and timestamps, and also has the option to do (much slower) binary compares.  I regularly use it after moving files around just to check there are no duplicates left behind on different disks.

 

Thanks, It's great that you made that, I'll give it a shot.

 

My only other question now is whether it's possible to pause or stop unBALANCE after you start it.

[jbrodriguez]

Thanks for this, seems to work great.

 

One suggestion.

 

In my case, when I tried to open unBALANCE from the plugins page, I clicked "Open webUI 1.30" and it took me to "tower:6237" which didn't load.

 

Unfortunately on OS X, to access my server over the network you need to type in tower.local, not just tower. Would it be easy for you to change this link to access via the unRAID IP address instead of via hostname? That way regardless of hostname it will just load the IP:port and should work on any OS.

 

Thanks for the comments lishpy !

 

I'll take a look at the link opening code, to see if I can use ip address rather than hostname (probably, that's what's happening to huladaddy too).

 

I'm a bit tied up until the end of next week, but I'll look into it.

no idea what the webUI page is, but if you just have it as another .page file, then reference it as Settings/webUI and dynamix will handle everything for you...  (turn on help, and look at the link for CA's manual, and look at caHelp.page

 

Squid, in the settings page, when the app is started, there's a link to the app's user interface ... it's opens a new window/tab with the server's hostname, rather than ip address, I'm not sure if there's an env variable that holds the ip address

[jbrodriguez]

Would it be possible to have an option added so unBalance would simply CLONE all the targeted shares to a new drive and not delete the original file?  I have several drives I would like to consolidate onto a new larger disk - but i would like to leave all the original disks intact for storage.

 

Even if not - thanks for an awesome means to safely move files without dealing with the command line - this plugin is brilliant.

 

Hi Unqualified Spectator, thanks for your kind words !

 

I really haven't thought about a use case where you're just copying files, not moving them.

 

I'd like to share how I came up with the idea for this app/plugin

 

The thing is .... I regularly deleted low quality content that I replaced with higher quality stuff or even deleted some content that I found uninteresting.

 

This made some disks in my array to get some free space, which was wasted.

 

But manually calculating which folders I could move from other disks to use that space was not scalable. I think I half did it one time

 

And so ... unBALANCE was born !

 

I'll take a look at the idea over the weekend, but it does seem like a different concept.