DovahDovolom 0 Posted Tuesday at 06:07 PM Share Posted Tuesday at 06:07 PM IM trying to use this plugin to transfer a large amount of data and it seems we've hit a wall at 150GB of data. I've tried creating a new user and creating a new folder with the new user by including it in the user description. We have moved two files over ~60-70gb each and the third files keeps stopping on the exact same amount of data every time. Any fix for this that I'm just not seeing? Quote Link to post
SlrG 26 Posted Tuesday at 06:40 PM Author Share Posted Tuesday at 06:40 PM @DovahDovolom Are there any error messages in the syslog when the transfer stops for the third file? What happens if you try to transfer only the third file? What happens if you transfer the files one by one? What happens if you run a linux vm or another machine, with proftpd installed and copy the files using that? Quote Link to post
itimpi 876 Posted Tuesday at 06:43 PM Share Posted Tuesday at 06:43 PM Have you checked exactly which drive the file is going to? It is possible there is not enough space on the drive chosen to actually hold the file. Once a drive has been selected for a file unRaid will not switch it to another one so you can get the file transfer failing when the drive runs out of free space. Quote Link to post
DovahDovolom 0 Posted Tuesday at 07:01 PM Share Posted Tuesday at 07:01 PM (edited) So what have done so far is we transfer the first two files totaling 135 GB. After every successful transfer it would time out but files were okay. When transferring the third it would always stop at like 13,806,064kb. We tried the third multiple times all with the exact same amount left. I even transferred the first two to another share, deleted them from the folder and resend the 3rd file over ftp and would stop at the exact same place 13,806,064kb. We even tried multiple different large files all stopping at the same amount. There is plenty of space on cache for the files, over 300gb. When i say "a file" each file is like a folder and in the folder there is a 1kb readme and 1 massive video. Edit: Ill have to try the VM later and as for logs i was unable to generate any, what would i need to add to the config? Edited Tuesday at 07:03 PM by DovahDovolom Quote Link to post
jonathanm 1211 Posted Tuesday at 10:30 PM Share Posted Tuesday at 10:30 PM 3 hours ago, DovahDovolom said: We tried the third multiple times all with the exact same amount left. I even transferred the first two to another share, deleted them from the folder and resend the 3rd file over ftp and would stop at the exact same place 13,806,064kb. We even tried multiple different large files all stopping at the same amount. There is plenty of space on cache for the files, over 300gb. Check the free space on all the array drives before you start the transfer, while you are doing the transfer, and after you get the error. Also, if you have a cache pool with multiple devices, there are situations where the drives get fully allocated even though the GUI shows free space. It's a BTRFS file system bug, not something Unraid can fix. Attach the diagnostics zip file to your next post if you want assistance figuring out if that could be the issue. Quote Link to post
SlrG 26 Posted Tuesday at 10:54 PM Author Share Posted Tuesday at 10:54 PM @DovahDovolom Are these three files all the same file for testing purposes, or are there differences? Above I asked you to change the order of the files you try to transfer. If the "third" file always stops, please try to transfer that as the first file and the other ones later. Does it work then or does it still fail? Is it possible to copy the file to another location in a shell without using proftpd without problems? To enable debug logging see here. Quote Link to post
soder 0 Posted Friday at 09:12 PM Share Posted Friday at 09:12 PM (edited) Hmm, I did a pretty stupid thing today. In my array I got 5 disks, but for my share "media" I only use two disks. For many years I've had ProFTTd installed, and for my user I had the path /mnt/user/FTP and the FTP folder was a share called FTP. That shared was set to "prefer" for the cache, but also that it was for all the disks. I today changed that setting to yes, meaning that when mover started, and it didn't fit on the cache, it started to move the stuff in FTP (that is, my media) in to new disks... I had to stop the mover, and then with unbalance get the folders back the disks where media should be. So, what is the best way for me to have this FTP? I want the user to get to my media. Should I set that folder as my user path then? EDIT: What I now did was to umount my media I had to the /mnt/user/FTP folder, and then removed the share FTP. I can now again just add the FTP folder on /mnt/cache I guess.. But is there a way for my to have the FTP folder as a smb share without have an unraid share like I had before? EDIT2: It's now clear for my that when I create a folder in /mnt/cache, there is also a share in unraid created. What's the best way then for me if I don't want to risk the same thing again, with different cache pool settings for FTP and media share? /Söder Edited yesterday at 04:10 PM by soder more info Quote Link to post
732 posts in this topic Last Reply
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.