ProFTPD Plugin for unRAID v6.8.x

[DovahDovolom 0]

IM trying to use this plugin to transfer a large amount of data and it seems we've hit a wall at 150GB of data. I've tried creating a new user and creating a new folder with the new user by including it in the user description. We have moved two files over ~60-70gb each and the third files keeps stopping on the exact same amount of data every time. Any fix for this that I'm just not seeing?

[SlrG 26]

@DovahDovolom

Are there any error messages in the syslog when the transfer stops for the third file?

What happens if you try to transfer only the third file?

What happens if you transfer the files one by one?

What happens if you run a linux vm or another machine, with proftpd installed and copy the files using that?

 

 

[itimpi 876]

Have you checked exactly which drive the file is going to?     It is possible there is not enough space on the drive chosen to actually hold the file.   Once a drive has been selected for a file unRaid will not switch it to another one so you can get the file transfer failing when the drive runs out of free space.

[DovahDovolom 0]

So what have done so far is we transfer the first two files totaling 135 GB. After every successful transfer it would time out but files were okay. When transferring the third it would always stop at like 13,806,064kb. We tried the third multiple times all with the exact same amount left. I even transferred the first two to another share, deleted them from the folder and resend the 3rd file over ftp and would stop at the exact same place 13,806,064kb. We even tried multiple different large files all stopping at the same amount. There is plenty of space on cache for the files, over 300gb.

When i say "a file" each file is like a folder and in the folder there is a 1kb readme and 1 massive video.

 

Edit: Ill have to try the VM later and as for logs i was unable to generate any, what would i need to add to the config?

 

 

Edited Tuesday at 07:03 PM by DovahDovolom

[jonathanm 1211]

3 hours ago, DovahDovolom said:

We tried the third multiple times all with the exact same amount left. I even transferred the first two to another share, deleted them from the folder and resend the 3rd file over ftp and would stop at the exact same place 13,806,064kb. We even tried multiple different large files all stopping at the same amount. There is plenty of space on cache for the files, over 300gb.

Check the free space on all the array drives before you start the transfer, while you are doing the transfer, and after you get the error. Also, if you have a cache pool with multiple devices, there are situations where the drives get fully allocated even though the GUI shows free space. It's a BTRFS file system bug, not something Unraid can fix. Attach the diagnostics zip file to your next post if you want assistance figuring out if that could be the issue.

[SlrG 26]

@DovahDovolom

Are these three files all the same file for testing purposes, or are there differences?

 

Above I asked you to change the order of the files you try to transfer. If the "third" file always stops, please try to transfer that as the first file and the other ones later. Does it work then or does it still fail? Is it possible to copy the file to another location in a shell without using proftpd without problems?

 

To enable debug logging see here.

[soder 0]

Hmm, I did a pretty stupid thing today.

 

In my array I got 5 disks, but for my share "media" I only use two disks. For many years I've had ProFTTd installed, and for my user I had the path /mnt/user/FTP and the FTP folder was a share called FTP.

 

That shared was set to "prefer" for the cache, but also that it was for all the disks. I today changed that setting to yes, meaning that when mover started, and it didn't fit on the cache, it started to move the stuff in FTP (that is, my media) in to new disks...

 

I had to stop the mover, and then with unbalance get the folders back the disks where media should be.

 

So, what is the best way for me to have this FTP? I want the user to get to my media. Should I set that folder as my user path then?

 

EDIT: What I now did was to umount my media I had to the /mnt/user/FTP folder, and then removed the share FTP. I can now again just add the FTP folder on /mnt/cache I guess..

 

But is there a way for my to have the FTP folder as a smb share without have an unraid share like I had before?

 

EDIT2: It's now clear for my that when I create a folder in /mnt/cache, there is also a share in unraid created.

 

What's the best way then for me if I don't want to risk the same thing again, with different cache pool settings for FTP and media share?

 

/Söder

Edited yesterday at 04:10 PM by soder
more info