trurl Posted February 11 Share Posted February 11 Just quit using Split Level for this right now, since what you need it to do right now is disobey split level. Quote Link to comment
malaki86 Posted February 11 Author Share Posted February 11 Well, being that split level doesn't work the way it's supposed to, I guess I don't have much choice, do I? Quote Link to comment
itimpi Posted February 11 Share Posted February 11 Just now, malaki86 said: Well, being that split level doesn't work the way it's supposed to, I guess I don't have much choice, do I It works perfectly well for me and as far as I know others who use it. That was why we were looking to see if there was something we could spot in your setup that would stop it working for you. Still puzzled as to why it is not working for you. Quote Link to comment
malaki86 Posted February 11 Author Share Posted February 11 It's not working because it's not using any logic prior to moving pre-existing files. That's easy to see. If it was only brand new files that were growing as it's downloaded, I could see why it would be a problem. NOT for files that are already 100% existing on the server. Quote Link to comment
malaki86 Posted February 11 Author Share Posted February 11 BTW - I just stopped the Mover, changed EVERY share to "split any", started the Mover. Guess what? It's ALL going to the empty drive, not to the one with the most free space as it's configured. Quote Link to comment
JorgeB Posted February 11 Share Posted February 11 Post a screenshot of the share settings for the share you are using and new diags. Quote Link to comment
malaki86 Posted February 11 Author Share Posted February 11 screenshot & diagnostics attached neo-diagnostics-20240211-1416.zip Quote Link to comment
JorgeB Posted February 11 Share Posted February 11 2 hours ago, malaki86 said: It's ALL going to the empty drive, not to the one with the most free space as it's configured. If I'm reading the diags correctly these are the same, disk12, where is the data going? Quote Link to comment
trurl Posted February 11 Share Posted February 11 4 hours ago, malaki86 said: the empty drive I don't see any empty drives Quote Link to comment
malaki86 Posted February 11 Author Share Posted February 11 10 minutes ago, trurl said: I don't see any empty drives I meant fullest drive. I don't have any empty drives. I posted a SS of my array showing the drives Quote Link to comment
JorgeB Posted February 12 Share Posted February 12 12 hours ago, JorgeB said: where is the data going? Quote Link to comment
malaki86 Posted February 12 Author Share Posted February 12 Disk 10 - the 8Tb drive Quote Link to comment
malaki86 Posted February 12 Author Share Posted February 12 Trying a different share to move stuff to - TV shows, with a split level of top two, 200Gb minimum free and allocated by Most Free. It seems to be working for the most part, but I do see it sending stuff to Drive 10 once in awhile, which has 300Gb free, instead of the drives with 1.25Tb+ free. Quote Link to comment
malaki86 Posted February 12 Author Share Posted February 12 It is definitely behaving itself with moving the TV shows. It's sending the files to the drives with the most free space, while still keeping the episodes for each season in its own folder like it's supposed to. Quote Link to comment
malaki86 Posted February 14 Author Share Posted February 14 Just wanted to post a follow-up I've been moving both TV shows (split level of top 2) and movies (split the top level) and haven't had another issue. I have the array set to 200Gb free space, and allocation set to "Most Free". It's spreading everything out across the different drives, but it's also keeping the TV series season and Movies in the correct folders. I have no clue why it was all messed up before, but it seems to have sorted itself. Quote Link to comment
malaki86 Posted February 14 Author Share Posted February 14 Ok - I know exactly what was causing the issue: When using File Manager and selecting a large group of items to move, it's moving everything to one drive. If you only more one or two things at a time, you can see that it's using the allocation method to decide where to put those files. Assuming that File Manager uses rsync for the actual file operations, I'm guessing that File Manager dumps an entire list to rsync, which just sends it to the location that File Manager says to, without checking the allocation method once the operation has started. I've been using Sonarr to move the TV series to the new location vs File Manager. Sonarr is spreading them out perfect because it's doing it file by file, versus one huge group to move at once. When I move a large group of movies in File Manager, I can see that entire group being moved to a single drive. Quote Link to comment
JorgeB Posted February 14 Share Posted February 14 1 hour ago, malaki86 said: rsync Rsync will create all folders before starting the data transfer, so all of them would be created on the first available disk for that share, and then split level would take precedence. Quote Link to comment
malaki86 Posted February 14 Author Share Posted February 14 6 minutes ago, JorgeB said: Rsync will create all folders before starting the data transfer, so all of them would be created on the first available disk for that share, and then split level would take precedence. You understand what I'm saying about the entire "all at once vs one at a time thing", though? That's what is causing the issue. Rsync creates the folders on a specific drive and at that time, hell or high water, it's going to try to shove everything in it. Some sort of file transfer queue would alleviate the issue. Instead of an all at once, it would do file by file. Quote Link to comment
JorgeB Posted February 14 Share Posted February 14 3 minutes ago, malaki86 said: Rsync creates the folders on a specific drive Like mentioned it will create the folders for the complete transfer. 3 minutes ago, malaki86 said: and at that time, hell or high water, it's going to try to shove everything in it. Correct, according to the split level set, if split level is set to any using rsync is not a problem, it can be if not, as you found out. Quote Link to comment
malaki86 Posted February 14 Author Share Posted February 14 But, how to solve the issue, allowing both split level AND allocation methods to be fully utilized short of moving a single folder at a time? Yes, Sonarr is doing it in a way that works correctly, but the File Manager should also be able to deal with bulk moves, queues per file/folder, etc. Quote Link to comment
JorgeB Posted February 14 Share Posted February 14 You'd need to use a different way of transferring the files, like midnight commander for example, or manually use rsync with this script (not tested by me). I usually just use Windows explorer, even for copying data inside the server, since it will use Samba's server side copy, copy will still be done locally, no data will transverse the network. Quote Link to comment
itimpi Posted February 14 Share Posted February 14 4 minutes ago, JorgeB said: rsync with this script (not tested by me). Maybe something like this needs to be incorporated into the Dynamix File Manager? Quote Link to comment
malaki86 Posted February 14 Author Share Posted February 14 3 minutes ago, itimpi said: Maybe something like this needs to be incorporated into the Dynamix File Manager? Exactly what I was getting at. The file transfer method in File Manager definitely needs a rework. Quote Link to comment
JorgeB Posted February 14 Share Posted February 14 3 minutes ago, malaki86 said: The file transfer method in File Manager definitely needs a rework. I agree if that could be changed it would be great, but that's a plugin, not part of the OS. Quote Link to comment
itimpi Posted February 14 Share Posted February 14 2 minutes ago, JorgeB said: I agree if that could be changed it would be great, but that's a plugin, not part of the OS. ... but I thought I remember reading it will be part of the OS at the 6.13 release? Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.