JarDo

So, do you think that there may be an issue with User Shares in the new version?

Well, I am using user shares. But it wasn't a problem until v4.3. Here's the cron job I'm running once per day: #!/bin/bash # # Title: *_blacky_rsync.sh # # Summary: # The purpose of this script is to 'PULL' a backup off of a remote rsync server to a local destination on the client. # # rsync source sSrc="blacky::fs1" # rsync destination sDest="/mnt/user/backup/fs1" # rsync parameters sParms="-amv --delete" # -a archive mode; same as -rlptgoD (no -H preserve hard links) # -rlptgoD # -r recurss into directories # -l copy symlinks as symlinks # -p preserve permissions # -t preserve times # -g preserve group # -o preserve owner (super-user only) # -D same as --devices --specials # --devices preserve device files (super-user only) # --specials preserve special files # -m prune empty directory chains from the file-list # --delete delete files that don't exist on the sending side # Here's the magic: rsync $sParms $sSrc $sDest # My job here is done exit For the record I do not have the cache drive enabled at all. However, I did test with a cache drive enabled and it did work however with the same exact error messages. The files even went to the cache drive as their first stop prior to being written to the RAID volumes. That was a good thing as it seems that the new cache feature might speed up my rsync's if I can fix the 'chown error' introduced with v4.3.

Can someone help me understand this please. My rsync backups appear to be working with the new v4.3b6 release but I receive the following error for every file that is copied during the rsync session: rsync: chown "/mnt/user/backup/fs1/projects/nas/unraid/flash/user/packages/.readme.rtf.hx5pS6" failed: No such file or directory Some observations: 1) I do not receive these errors if I roll back to v4.2 (I tested this today) 2) The dot in front of the file name doesn't really exist in the source or destination file, only in the error message 3) The dot.6 characters (".hx5pS6" in the example above) don't appear in the source or destination file, only in the error message 4) The dot.6 characters are unique for every file error message 5) I do not have a cache drive enabled in my configuration It appears to me that v4.3 clearly handles files in a manner different from v4.2 and it is tripping up rsync. I just don't understand enough about the changes from v4.2 to v4.3 to diagnose the issue. Any info/insight is appreciated.

I don't know if this is an issue with beta6. I believe it is an issue related to the new Cache feature. I currently have rsync running to on my unraid server to 'pull' a backup from another machine on my network once per day. It's been working great for months. Since rsync is executing on the unraid side I have the rsync destination configured as "/mnt/user/backup/fs1". 'Backup' is a user share and I have the cache disk enabled for this share. Rsync appears to be copying the files correctly from the source to the destination on my unraid server, but at the end of the rsync operation I get hundred of errors, one for each file and directory, that look like this: rsync: chown "/mnt/user/backup/fs1/temp" failed: no such file or directory I never received these errors before and I'm assuming it has something to do with a change in how permissions (or some other thing) are handled with the /mnt/user/ directory now that we have a /mnt/user0/ directory. What are your thoughts. Should I change my rsync destination from "/mnt/user/backup/fs1" to "/mnt/user0/backup/fs1" ? I thought maybe If I changed my rsync destination to "/mnt/config/backup/fs1" that it might speed the copy process up a bit but after further thought my guess is that once the mover had moved the cached files to the array the next day when rsync ran rsync would think that the destination is empty and would attempt to back up every file from the source side. This would not be good. In my mind I can't see how the new cache feature can benefit my rsync process unless I changed to a 'push' model where files are pushed to my unraid server. Any thoughts?

Have you gotten anywhere on the email front??? I finally got rsync upgraded and working as I need. Next for me is email. And, next after that is FTP. I want email first so that I have a solid way for my unraid server to communicate status updates (rsync failures, drive failures, weekly "I'm still alive" notifications, etc...). Using netcat to send email only 'kind of' works for me. http://lime-technology.com/forum/index.php?topic=1340.0 If you've made any progress with email I'd love to hear about it. If your trying to implement sendmail like me I'd love to help (and be helped). I've come to the sorry conclusion that I'm not going to be able to do this on my own.

Well, suffice to say my hope was to figure this out on my own and then post here how I did it. If folks will help me with the process the end result would be the same. I'm attempting to install sendmail on a licensed copy of unraid 4.2. My goal is to configure sendmail as a SMTP nullclient that sends mail through my Comcast account (or Gmail, Yahoo, fastmail, whatever works). I don't need for sendmail to be able to receive email (MSP) I just want it to be able to send email from my unraid server (MTA). I would use this capibility to send status reports and the like to myself because at some point my server will be headless and I need to know when my unraid server needs attention. I'm installing the following via the go script and there doesn't appear to be any installation issues: # Install all custom packages installpkg /boot/user/packages/openssl-0.9.8g-i486-1.tgz installpkg /boot/user/packages/openssh-4.7p1-i486-2.tgz # install MTA installpkg /boot/user/packages/sendmail-8.14.2-i486-1.tgz installpkg /boot/user/packages/sendmail-cf-8.14.2-noarch-1.tgz installpkg /boot/user/packages/m4-1.4.9-i486-1.tgz installpkg /boot/user/packages/procmail-3.22-i486-2.tgz I got all these packages from http://packages.slackware.it/. I probably don't need all the crap above, but right now I'm working on 'capibility' - just get the damn thing to work. Later I'll worry about cleaning up the install and documenting the process. I've got 2 primary issues I'm trying to solve. I'm focusing on #2 below first because I think that it is getting in the way of my trouble-shooting #1: #1 - Configuration of 'submit.mc' to create a nullclient MTA. It seems my biggest difficulty is with authenticating with the remote SMTP server. #2 - linux (slackware) and/or sendmail configuration - user/group permissions or something else - to eliminate the following error (from /var/log/syslog) when attempting to send email: "low on space (smtp.comcast.net needs 15 bytes + 0 blocks in /var/spool/clientmqueue), max avail:0" So, I've been focusing on #2 lately because it seems to be an issue with my machine - not with sendmail. For some reason sendmail is not able to write email to the message queue which it wants to be able to do before it attempts to send. To sendmail it appears as if there is no more space on the disk where /var/spool/clientmqueue resides. My bet is that it has something to do with having the file system in RAM, but I'm not sure. The issue could also be with user/group permissions, but since the package install process is what added the /var/spool/clientmqueue directory I'm assuming that same process set the user/group permissions to what they need to be.

I've been trying for over a solid month to get sendmail to function on unraid because sending email with netcat just isn't doing the trick for me. I figured if I got a real MSP up and functioning all my email issues would go away. I'm begging for help. Someone, please anyone, who'd be willing to lend a hand. I really tried to not come here for help because I know asking for linux help is off topic, but I REALLY want solid email functionality on my unraid server. I have never before not been able to figure something like this out, but I'm not a linux guy. I believe the solution is simple to the linux savy, but I'm fighting so many little problems that I'm just chaseing my tail now.

Well, I've verified that my script is written exactly as above, but I still can't figure out why the email I receive does not contain line-feeds. At first I thought it was an Outlook problem, but when I view the email on the web-based email client I'm missing line-feeds there too. Is it possible that I need to run the script in a shell other than the bash shell? It seems that it is the sed command that isn't running as advertised but everything else about the script seems to be working properly for me.

Is it possible to upgrade the rsync version to 2.6.9?? Has anyone done this on their unraid??

Can someone please help me find where rsync keeps its logs on the unraid server? I can't figure out why rsync is failing to delete files from the backup when they've been deleted from the source.

MORE PROGRESS!! Everything seems to work as advertised now (more testing required). The backup seems to span all four (disk2, disk3, disk4, & disks) drives now. Recap: I want to backup to a subdirectory called "fs1" on a User Share called "backup". What I did was to add the directory tree "\backup\fs1" to each of the four drives in the User Share before running rsync. This seemed to do the trick. On my first attempt (see previous post) I had thought that unRaid would automatically add these directories, as needed, to each of the drives. unRaid did fine adding the directories to the first of the four drives, but once that first drive was full unRaid didn't know enough to move to the next drive if the required path didn't already exist. By adding the directory tree (\backup\fs1) to each of the four drives in the User Share ahead of time, unRaid seems to function properly allocating (High-Water) all the files across all four drives while also respecting the Split-Level setting (3) of the User Share. CURRENT ISSUE: When I run TOP, I've noticed that unRaid uses very little of the available system memory during normal use. While rsync is running almost all the system memory is used. That's fine, I suppose. However, when the rsync job is finished the memory is not released. Is there some unix command I can run to clean up the system memory? I'm thinking that rsync is leaving some junk behind, but I'm not smart enough (yet) to know how to fix this.

Well, I'm making a little progress. I made a shell script that seems to run fine if I place it in one of the /etc/cron.* folders. It looks something like this: #!/bin/bash # # Title: *_blacky_rsync.sh # # Summary: # The purpose of this script is to 'PULL' a backup off of a remote rsync server to a local destination on the client. # # rsync source sSrc="blacky::fs1" # rsync destination sDest="/mnt/user/backup/fs1" # rsync parameters sParms="-amv --delete" # -a archive mode; same as -rlptgoD (no -H preserve hard links) # -rlptgoD # -r recurss into directories # -l copy symlinks as symlinks # -p preserve permissions # -t preserve times # -g preserve group # -o preserve owner (super-user only) # -D same as --devices --specials # --devices preserve device files (super-user only) # --specials preserve special files # -m prune empty directory chains from the file-list # --delete delete files that don't exist on the sending side # Here's the magic: rsync $sParms $sSrc $sDest # My job here is done: exit The issue I'm trying to figure out right now is how to configure the 'destination' as a User Share. Right now I have my destination configured as "/mnt/user/backup/fs1". "backup" is a User Share that spans disk2, disk3, disk4, & disk7 with a Split Level of 3. When I run the script, files do copy over from my rsync server to my unRaid box. That is a good sign of progress. However, they are only being copied onto disk2. When disk 2 fills up rsync starts throwing 'disk full' errors and craps out on me without copying anything onto disk3, disk4, or disk7. I'm trying to work this bug out before trying anything else.

Ok, I'll be patient. In the mean-time I am still trying myself to find the answer, but shell script syntax and rSync are foreign to me and I will reallly appreciate any help at all. I've been reading a lot of example shell scripts on the web that use rSync, but it's difficult for me to sift through all the SSH stuff (which I don't care about at this point) and all the rotateing & incremental backup code. For my first implementation I just want to pull a backup of a single subdirectory off of a windows machine running cygwin and an rSync server (all that stuff I've got figured out already. I just can't figure out the rSync client side stuff yet.

I'm on my own with this one, huh?

I have searched and found info on configuring UnRaid as an Rsync server, but I'd like to configure UnRaid as an Rsync CLIENT to pull backup data from a network machine configured as an Rsync server. I currently do this with Infrant NAS's and it works great. I've got the server side figured out, but on the client side the Infrant NAS provides a UI to cofigure the client side. I've searched the forums and WIKI and can't find a single clue about configuring Unraid as an Rsync client. From what I can tell, Unraid has the capability built in with the current release and I imagine I'd have to configure a cron job to run against a config file, but that is as far as my imagination has taken me. I'd very much appreciate some help from anyone with more knowledge than I.

Joe, You are a "Hero Member". What a great reply. Thank you. I had been planning on purchasing 2 pro keys. One for production and one for development. Now, you have me thinking I should stick with the 1gb key I already have and just activate it.

I read the "how to" on the WIKI prior to posting, but the instructions are so terse that I wasn't sure if they were complete. So, If I assume that they are complete then I should only have to copy the 'config/super.dat' and 'config/disk.cfg' from my old key to my new, shiny, pro version key and everything will work??? It just seems too simple.

I am currently experimenting with the free version on my own usb key. I'm at the point now where I've made modifications to the config like adding "unmenu" and email notifications. I need now to play with user level security and rsync capability to see if Unraid capabilities meet my requirements. (Unfortunatly I have to spend money just to test user level security capibilities and that sucks very very much). Anyhow, my question is if I were to purchase a USB key from Limetech, what files do I want to copy from my trial key and what files do I not want to copy from my trial key to the new USB key? Any help appreciated.

Thanks to everyone for this info. I read the whole thread (several times) and got the hourly email notifications working on first attempt. There are a couple of bugs I could use some help with. I have two email addresses configured for receipt of the notifications. The first email in the list receives the notification without the email body and the second email in the list receives the notification with body text. Both recepients receive output from /proc/mdcmd. Unless the script recreates a new email for each recepient, I can't imagine how this is happening. The second issue I have is that the output from /proc/mdcmd has no carraige returns or line feeds like I see when I cat /proc/mdcmd in a telnet window. This behavior is the same for both email recepients so I don't think that it is a problem on the receiving end. Also, I beilve I've rulled out the possibility of the email client affecting the format of the displayed message. I've tried viewing the email in both web-based clients and in Outlook. No change.