ProFTPD Plugin for unRAID v6.8.x


SlrG

732 posts in this topic Last Reply

Recommended Posts

IM trying to use this plugin to transfer a large amount of data and it seems we've hit a wall at 150GB of data. I've tried creating a new user and creating a new folder with the new user by including it in the user description. We have moved two files over ~60-70gb each and the third files keeps stopping on the exact same amount of data every time. Any fix for this that I'm just not seeing?

Link to post
  • Replies 731
  • Created
  • Last Reply

Top Posters In This Topic

Top Posters In This Topic

Popular Posts

ProFTPd Support the plugin?   This is the support thread for my ProFTPD Plugin for unRAID v6.8.x   To install it: If you have installed the Community Applications

@188pilas For 6.7.0-rc you need to install the beta version plugin from here: http://sdevel.de/ProFTPd.plg Once 6.7.0 is released, I'll work on a new version of the plugin which should be availab

for anyone who wants to turn on the appending of file transfers (you'll get the error "Append/Restart not permitted, try again" you need to add the following to the config file proftpd.confg Allow

Posted Images

@DovahDovolom

Are there any error messages in the syslog when the transfer stops for the third file?

What happens if you try to transfer only the third file?

What happens if you transfer the files one by one?

What happens if you run a linux vm or another machine, with proftpd installed and copy the files using that?

 

 

Link to post

Have you checked exactly which drive the file is going to?     It is possible there is not enough space on the drive chosen to actually hold the file.   Once a drive has been selected for a file unRaid will not switch it to another one so you can get the file transfer failing when the drive runs out of free space.

Link to post

So what have done so far is we transfer the first two files totaling 135 GB. After every successful transfer it would time out but files were okay. When transferring the third it would always stop at like 13,806,064kb. We tried the third multiple times all with the exact same amount left. I even transferred the first two to another share, deleted them from the folder and resend the 3rd file over ftp and would stop at the exact same place 13,806,064kb. We even tried multiple different large files all stopping at the same amount. There is plenty of space on cache for the files, over 300gb.


When i say "a file" each file is like a folder and in the folder there is a 1kb readme and 1 massive video.

 

Edit: Ill have to try the VM later and as for logs i was unable to generate any, what would i need to add to the config?

 

 

Edited by DovahDovolom
Link to post
3 hours ago, DovahDovolom said:

We tried the third multiple times all with the exact same amount left. I even transferred the first two to another share, deleted them from the folder and resend the 3rd file over ftp and would stop at the exact same place 13,806,064kb. We even tried multiple different large files all stopping at the same amount. There is plenty of space on cache for the files, over 300gb.

Check the free space on all the array drives before you start the transfer, while you are doing the transfer, and after you get the error. Also, if you have a cache pool with multiple devices, there are situations where the drives get fully allocated even though the GUI shows free space. It's a BTRFS file system bug, not something Unraid can fix. Attach the diagnostics zip file to your next post if you want assistance figuring out if that could be the issue.

Link to post

@DovahDovolom

Are these three files all the same file for testing purposes, or are there differences?

 

Above I asked you to change the order of the files you try to transfer. If the "third" file always stops, please try to transfer that as the first file and the other ones later. Does it work then or does it still fail? Is it possible to copy the file to another location in a shell without using proftpd without problems?

 

To enable debug logging see here.

Link to post

Hmm, I did a pretty stupid thing today.

 

In my array I got 5 disks, but for my share "media" I only use two disks. For many years I've had ProFTTd installed, and for my user I had the path /mnt/user/FTP and the FTP folder was a share called FTP.

 

That shared was set to "prefer" for the cache, but also that it was for all the disks. I today changed that setting to yes, meaning that when mover started, and it didn't fit on the cache, it started to move the stuff in FTP (that is, my media) in to new disks...

 

I had to stop the mover, and then with unbalance get the folders back the disks where media should be.

 

So, what is the best way for me to have this FTP? I want the user to get to my media. Should I set that folder as my user path then?

 

EDIT: What I now did was to umount my media I had to the /mnt/user/FTP folder, and then removed the share FTP. I can now again just add the FTP folder on /mnt/cache I guess..

 

But is there a way for my to have the FTP folder as a smb share without have an unraid share like I had before?

 

EDIT2: It's now clear for my that when I create a folder in /mnt/cache, there is also a share in unraid created.

 

What's the best way then for me if I don't want to risk the same thing again, with different cache pool settings for FTP and media share?

 

/Söder

Edited by soder
more info
Link to post

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.