July 1, 201313 yr If this goes in another location please move it... I'm trying to figure out how to, move files from my qnap to unraid From everything I read, the best/fastest way to do this is rsync But what I want to do is transfer QNAP 192.168.0.182/share/MD0_DATA/Download/Transfer to Unraid 192.168.0.191/New If anyone could help I would appreciate..
July 1, 201313 yr I don't use rsync, but I assume you simply type a command in the form "rsync <source> <dest> on either of the boxes (QNap or UnRAID) and, as long as they're properly formed, it should do the topies. http://rsync.samba.org/ftp/rsync/rsync.html HOWEVER ... assuming you have parity enabled on the UnRAID box AND that you're running a Gb network, it should be just as fast to simply do the copy from a Windows client using Windows Explorer, since the network is more than twice as fast as the UnRAID write speeds. ... unless you're using a cache drive. But even then it will still be pretty fast.
July 1, 201313 yr Author I don't use rsync, but I assume you simply type a command in the form "rsync <source> <dest> on either of the boxes (QNap or UnRAID) and, as long as they're properly formed, it should do the topies. http://rsync.samba.org/ftp/rsync/rsync.html HOWEVER ... assuming you have parity enabled on the UnRAID box AND that you're running a Gb network, it should be just as fast to simply do the copy from a Windows client using Windows Explorer, since the network is more than twice as fast as the UnRAID write speeds. ... unless you're using a cache drive. But even then it will still be pretty fast. Yea... no more desktops in the house so wireless-n at 54mbps... when using teracopy gives me 2mbps lol
July 1, 201313 yr Yea... no more desktops in the house so wireless-n at 54mbps... when using teracopy gives me 2mbps lol Ahh ... that would be a problem. I assumed you'd have at least one hard-wired client (desktop or laptop) with a Gb NIC. Obviously if that's not the case, my comment r.e. the speed isn't correct, as you have another bottleneck in the path (the wireless data rate).
July 1, 201313 yr Author Yea... no more desktops in the house so wireless-n at 54mbps... when using teracopy gives me 2mbps lol Ahh ... that would be a problem. I assumed you'd have at least one hard-wired client (desktop or laptop) with a Gb NIC. Obviously if that's not the case, my comment r.e. the speed isn't correct, as you have another bottleneck in the path (the wireless data rate). Yup, that's why it looks like rsync is the onlyway.. so rsync on qnap is enabled.. but not sure about unraid.. looks like I may need to add on rsyncd script?
July 1, 201313 yr Yea... no more desktops in the house so wireless-n at 54mbps... when using teracopy gives me 2mbps lol Ahh ... that would be a problem. I assumed you'd have at least one hard-wired client (desktop or laptop) with a Gb NIC. Obviously if that's not the case, my comment r.e. the speed isn't correct, as you have another bottleneck in the path (the wireless data rate). Yup, that's why it looks like rsync is the onlyway.. so rsync on qnap is enabled.. but not sure about unraid.. looks like I may need to add on rsyncd script? As I noted, I don't use it, so I'm not sure => but there IS an rsync package listed in UnMenu's Package Manager ... so I suspect that needs to be installed so the rsync clients on the two boxes can "talk" to each. I suspect you know more about rsync than I do ... and hopefully somebody who knows it well can help you with the setup details if it's more complex than just installing the package.
July 1, 201313 yr is the qnap expecting to use rsync over ssh or rsync to an rsync server? The rsync command line program is already installed on unRAID. you have to enable the server via daemon or via inetd or install openssh to go that route.
July 1, 201313 yr Here is how I enable it via script. #!/bin/bash if ! grep ^rsync /etc/inetd.conf > /dev/null ; then cat <<-EOF >> /etc/inetd.conf rsync stream tcp nowait root /usr/sbin/tcpd /usr/bin/rsync --daemon EOF read PID < /var/run/inetd.pid kill -1 ${PID} fi
July 1, 201313 yr This describes my method: http://lime-technology.com/forum/index.php?topic=28299.msg251317#msg251317
July 1, 201313 yr Author is the qnap expecting to use rsync over ssh or rsync to an rsync server? The rsync command line program is already installed on unRAID. you have to enable the server via daemon or via inetd or install openssh to go that route. it's expecting rysnc.. where do I put that script? #!/bin/bash if ! grep ^rsync /etc/inetd.conf > /dev/null ; then cat <<-EOF >> /etc/inetd.conf rsync stream tcp nowait root /usr/sbin/tcpd /usr/bin/rsync --daemon EOF read PID < /var/run/inetd.pid kill -1 ${PID} fi
July 1, 201313 yr I like to put it in /boot/local/etc/rc.d ( I have a better one that I just found ). I have not used or tested this one in a long time. However it handles the stopping/starting and syncing of the rsyncd.conf file also. you can call it from go with /boot/local/etc/rc.d/rc.rsyncd start #!/bin/sh # Start/stop/restart rsyncd # Start rsync: rsync_start() { rsync /boot/local/etc/rsyncd.conf /etc/rsyncd.conf if [ -x /usr/sbin/rsync ]; then echo "Starting Internet super-server daemon: /usr/sbin/rsync" /usr/sbin/rsync --daemon return fi if ! grep ^rsync /etc/inetd.conf > /dev/null ; then cat <<-EOF >> /etc/inetd.conf rsync stream tcp nowait root /usr/sbin/tcpd /usr/bin/rsync --daemon EOF read PID < /var/run/inetd.pid kill -1 ${PID} fi } # Stop rsync: rsync_stop() { killall rsync rsync /etc/rsyncd.conf /boot/local/etc/rsyncd.conf } # Restart rsync: rsync_restart() { rsync_stop sleep 1 rsync_start } case "$1" in 'start') rsync_start ;; 'stop') rsync_stop ;; 'restart') rsync_restart ;; *) echo "usage $0 start|stop|restart" esac and my basic rsyncd.conf You can disable the log if you like. comment it out. uid = root gid = root use chroot = no max connections = 4 timeout = 600 pid file = /var/run/rsyncd.pid log file = /var/log/rsyncd.log [mnt] path = /mnt comment = /mnt files read only = FALSE
July 1, 201313 yr Author I like to put it in /boot/local/etc/rc.d ( I have a better one that I just found ). I have not used or tested this one in a long time. However it handles the stopping/starting and syncing of the rsyncd.conf file also. you can call it from go with /boot/local/etc/rc.d/rc.rsyncd start #!/bin/sh # Start/stop/restart rsyncd # Start rsync: rsync_start() { rsync /boot/local/etc/rsyncd.conf /etc/rsyncd.conf if [ -x /usr/sbin/rsync ]; then echo "Starting Internet super-server daemon: /usr/sbin/rsync" /usr/sbin/rsync --daemon return fi if ! grep ^rsync /etc/inetd.conf > /dev/null ; then cat <<-EOF >> /etc/inetd.conf rsync stream tcp nowait root /usr/sbin/tcpd /usr/bin/rsync --daemon EOF read PID < /var/run/inetd.pid kill -1 ${PID} fi } # Stop rsync: rsync_stop() { killall rsync rsync /etc/rsyncd.conf /boot/local/etc/rsyncd.conf } # Restart rsync: rsync_restart() { rsync_stop sleep 1 rsync_start } case "$1" in 'start') rsync_start ;; 'stop') rsync_stop ;; 'restart') rsync_restart ;; *) echo "usage $0 start|stop|restart" esac and my basic rsyncd.conf You can disable the log if you like. comment it out. uid = root gid = root use chroot = no max connections = 4 timeout = 600 pid file = /var/run/rsyncd.pid log file = /var/log/rsyncd.log [mnt] path = /mnt comment = /mnt files read only = FALSE Once this is all done upon restart does it start? and... for some reason I don't have /boot/local/etc/rc.d just config and pacakges
July 1, 201313 yr Once this is all done upon restart does it start? and... for some reason I don't have /boot/local/etc/rc.d just config and pacakges you can make the directory mkdir -vp /boot/local/etc/rc.d Then place the script there. put your rsyncd.conf file in /boot/local/etc ( it's expecting the file to be in unix LF delimited format. You may need to convert it with fromdos.) run it once to make sure there are no errors /boot/local/etc/rc.d/rc.rsyncd start If it's good, put that line in your go script. I used to use /boot/custom These days I use /boot/local This stems more from working on so many different systems at work. We tend to make common tree based on facility. which tends to be /(service)/local/etc,bin,var/log,tmp,lib So that's why I choose local vs custom.
July 1, 201313 yr Author Once this is all done upon restart does it start? and... for some reason I don't have /boot/local/etc/rc.d just config and pacakges you can make the directory mkdir -vp /boot/local/etc/rc.d Then place the script there. put your rsyncd.conf file in /boot/local/etc ( it's expecting the file to be in unix LF delimited format. You may need to convert it with fromdos.) run it once to make sure there are no errors /boot/local/etc/rc.d/rc.rsyncd start If it's good, put that line in your go script. I used to use /boot/custom These days I use /boot/local This stems more from working on so many different systems at work. We tend to make common tree based on facility. which tends to be /(service)/local/etc,bin,var/log,tmp,lib So that's why I choose local vs custom. want to first of say thanks for the help I'm getting somewhere.. so I did... root@Tower:~# mkdir -vp /boot/local/etc/rc.d mkdir: created directory `/boot/local' mkdir: created directory `/boot/local/etc' mkdir: created directory `/boot/local/etc/rc.d' root@Tower:~# /boot/local/etc/rc.d/rc.rsyncd start -bash: /boot/local/etc/rc.d/rc.rsyncd: No such file or directory root@Tower:~# /boot/local/etc/rc.d/rc.rsyncd start -bash: /boot/local/etc/rc.d/rc.rsyncd: No such file or directory root@Tower:~# /flash/local/etc/rc.d/rc.rsyncd start -bash: /flash/local/etc/rc.d/rc.rsyncd: No such file or directory root@Tower:~# /flash/local/etc/rc.d/rsyncd start -bash: /flash/local/etc/rc.d/rsyncd: No such file or directory So What I noticed... is boot.. became flash.. not a big deal so I adjusted.. so I changed directory and dropped in the rsyncd... what am I missing?
July 1, 201313 yr /boot/local/etc/rc.d/rc.rsyncd: No such file or directory says you did not bring the script over to that name. do ls -l /boot/local/etc/rc.d/ rsyncd.conf goes in /boot/local/etc
July 1, 201313 yr Author /boot/local/etc/rc.d/rc.rsyncd: No such file or directory says you did not bring the script over to that name. do ls -l /boot/local/etc/rc.d/ rsyncd.conf goes in /boot/local/etc Linux 3.9.6p-unRAID. root@Tower:~# ls -l /boot/local/etc/rc.d/ total 4 -rwxrwxrwx 1 root root 265 2013-07-01 11:41 rsyncd.conf*
July 1, 201313 yr /boot/local/etc/rc.d/rc.rsyncd: No such file or directory says you did not bring the script over to that name. do ls -l /boot/local/etc/rc.d/ rsyncd.conf goes in /boot/local/etc Linux 3.9.6p-unRAID. root@Tower:~# ls -l /boot/local/etc/rc.d/ total 4 -rwxrwxrwx 1 root root 265 2013-07-01 11:41 rsyncd.conf* put rsyncd.conf in /boot/local/etc put rc.rsyncd in /boot/local/etc/rc.d
July 1, 201313 yr Author /boot/local/etc/rc.d/rc.rsyncd: No such file or directory says you did not bring the script over to that name. do ls -l /boot/local/etc/rc.d/ rsyncd.conf goes in /boot/local/etc Linux 3.9.6p-unRAID. root@Tower:~# ls -l /boot/local/etc/rc.d/ total 4 -rwxrwxrwx 1 root root 265 2013-07-01 11:41 rsyncd.conf* put rsyncd.conf in /boot/local/etc put rc.rsyncd in /boot/local/etc/rc.d For some reason still getting root@Tower:~# /boot/local/etc/rc.d/rc.rsyncd start -bash: /boot/local/etc/rc.d/rc.rsyncd: No such file or directory
July 1, 201313 yr telnet in and try the following. fromdos < /boot/local/etc/rc.d/rc.rsyncd > /tmp/rc.rsyncd mv /tmp/rc.rsyncd /boot/local/etc/rc.d/rc.rsyncd ls -l /boot/local/etc/rc.d/rc.rsyncd head /boot/local/etc/rc.d/rc.rsyncd
July 1, 201313 yr Author telnet in and try the following. fromdos < /boot/local/etc/rc.d/rc.rsyncd > /tmp/rc.rsyncd mv /tmp/rc.rsyncd /boot/local/etc/rc.d/rc.rsyncd ls -l /boot/local/etc/rc.d/rc.rsyncd head /boot/local/etc/rc.d/rc.rsyncd can't get past first without same error no such file or directory i'm assuming even if the coding format on the inside was wrong it would give me an error based on that. not no file/directory
July 1, 201313 yr In the image it looks like you put the /boot/local/etc/rc.d/rc.rsyncd script as rc.rsyncd.conf At least it says type CONF and it should not.
July 1, 201313 yr Author In the image it looks like you put the /boot/local/etc/rc.d/rc.rsyncd script as rc.rsyncd.conf At least it says type CONF and it should not. yea I was actually just playing with that... let me try and remove
July 1, 201313 yr Author In the image it looks like you put the /boot/local/etc/rc.d/rc.rsyncd script as rc.rsyncd.conf At least it says type CONF and it should not. So I.. removed the extension.. obviously a file won't with a two periods.. Tower login: root Password: Linux 3.9.6p-unRAID. root@Tower:~# /boot/local/etc/rc.d/rc.rsyncd start -bash: /boot/local/etc/rc.d/rc.rsyncd: /bin/sh^M: bad interpreter: No such file or directory root@Tower:~# fromdos < /boot/local/etc/rc.d/rc.rsyncd > /tmp/rc.rsyncd root@Tower:~# mv /tmp/rc.rsyncd /boot/local/etc/rc.d/rc.rsyncd root@Tower:~# ls -l /boot/local/etc/rc.d/rc.rsyncd -rwxrwxrwx 1 root root 823 2013-07-01 13:11 /boot/local/etc/rc.d/rc.rsyncd* root@Tower:~# head /boot/local/etc/rc.d/rc.rsyncd #!/bin/sh # Start/stop/restart rsyncd # Start rsync: rsync_start() { rsync /boot/local/etc/rsyncd.conf /etc/rsyncd.conf if [ -x /usr/sbin/rsync ]; then echo "Starting Internet super-server daemon: /usr/sbin/rsync" /usr/sbin/rsync --daemon root@Tower:~#
July 1, 201313 yr Author First of thanks so much! So rsync is up and running.. I just tested on qnap and now it gives me success.. along with in log Tower rsync[2984]: connect from 192.168.0.182 (192.168.0.182) <--- My Qnap Problem is.. no folders are listed? It shows connecting... then it disappears and I see nothing
Archived
This topic is now archived and is closed to further replies.