how do i avoid this rsync issue


comet424

Recommended Posts

47 minutes ago, comet424 said:

I appreciate the help

Sorry for being the bad cop.

 

I will just leave everything where it is. You can link back here from the other thread if you want to refer to anything said before.

 

50 minutes ago, comet424 said:

I installed all 3 OpenVPN

They aren't all clients. OpenVPNas docker is a server. There are separate client and server plugins supported on that other thread you went to. The server accepts connections from a client, and the client makes connections to a server. So you need a server at one end and a client at the other.

 

 

One other thing FYI. Your attempt to tag me earlier (@trurl) didn't work. You have to actually begin typing starting with the @ and then it will present matches for you to select from. You must actually choose from the selections for it to work correctly, like this: @comet424

Link to comment

@trurl   did that work??

and ok  still learning this forum  still new to unraid better then freenas in most issues I had with freenas.. couple things I like better in freenas but theres here say..

 

as for OpenVPN as    when I did search  OpenVPN client.... all 3 show up  and then in red text for the "AS" said OpenVPN client so I figured they all the same.. plus all 3 programs written by 3 different people..  so gets confusing...

as I trying to connect to PFsense OpenVPN  but I thinking  in the end OpenVPN is not written by 1 person  and I thinking  OpenVPN Unraid can not connect to OpenVPN PFsense… just another Unraid…  but I posted in the OpenVPN Client ?  mark one by peter_sm  

as I think the other 2 are combo packs has client and server built in.. 

 

but fingers crossed  peter guy can figure it out

 

Link to comment

@Hoopster   still having issues everytime I reboot I gotta type "yes"  as it says it cant establish a connect... it copies the files at boot up  and here you see I did it manually...  but its not connecting do you know why

 

I re did a new phrase on tower...  then copied the towers    Flash/config/sshroot folder to  the mitchsservers     flash/config/FromTower/sshroot  folder on the usb 

 

but its not saving

unraid issue4.PNG

Link to comment

and on the tower (main server)  I typed 

ssh-keygen -t rsa -b 2048 -f /root/.ssh/id_rsa
cp /root/.ssh/id_rsa /boot/FromTower/sshroot/TowerKey
cp /root/.ssh/* /boot/config/sshroot/

 

 

and then I copied  Towers    Flash\config\sshroot     to  mitchsservers       Flash\FromTower\sshroot

 

and I still cant connect

Link to comment

@Hoopster  I also slimmed the code down  but it still gives me the damn cant connect

 

Initial Key making (one time  On Tower Main Server)

---------------------------------

    ssh-keygen -t rsa -b 2048 -f /root/.ssh/id_rsa
    cp /root/.ssh/* /boot/config/sshroot/

 

 

Main Server Go File

--------------------------

#Tower Server Copy SSH

#!/bin/bash
# Start the Management Utility
/usr/local/sbin/emhttp &
    mkdir -p /root/.ssh
    cp /boot/config/sshroot/* /root/.ssh/
    chmod g-rwx,o-rwx -R /root/.ssh

 

2nd Server Go file

------------------------------

#!/bin/bash
# Start the Management Utility
/usr/local/sbin/emhttp &

#Mitchs Server Copy SSH    
    mkdir -p /root/.ssh
    cp /boot/FromTower/sshroot/* /root/.ssh/
    cat /boot/FromTower/sshroot/id_rsa.pub > /root/.ssh/authorized_keys
    chmod g-rwx,o-rwx -R /root/.ssh

 

 

 

so it does all this but still cant connectk

Link to comment

@comet424

Your problem is easy to fix

You also need to backup the known_hosts file from .ssh folder.

It's generated and update whenever you connect to a new ssh server and answer yes to the prompt.

Its a security function, so that the server you are connecting to is something you actually know and recognize and not some MITM attack.

 

So when you made the initial key, you need a step before you backup the .ssh folder

ssh-keygen -t rsa -b 2048 -f /root/.ssh/id_rsa
ssh-keyscan server2 > /root/.ssh/known_hosts
cp /root/.ssh/* /boot/config/sshroot/

Once this file has been backup, it only needs to be updated if server2 host keys are regenerated (deleting/corrupting the ssh_host_*_key files from /boot/config/ssh then restarting the server will do this) or you start connecting to new servers.

Edited by ken-ji
Link to comment
1 hour ago, ken-ji said:

You also need to backup the known_hosts file from .ssh folder.

It's generated and update whenever you connect to a new ssh server and answer yes to the prompt.

@comet424 Sorry, I have only been on the forums briefly in the past several days.  I am usually more active, but, life gets in the way sometimes.

 

When you have updated known_hosts by regenerating the key or answering 'yes' to authenticate a new host, you have to make sure known_hosts gets updated on the flash drive to reflect what is in the .ssh folder in RAM.  If you don't do that, then the file on the flash drive does not have the host authentication information and a reboot will wipe it out.

 

You don't have to change anything in your 'go' files.  You just have to make sure (doing what ken-ji said) that you get the right information written to the known_hosts on the flash drive before you reboot.

Link to comment

@ken-ji @Hoopster ok ill try that... that 2nd line. as that's not in any instructions for rysnc 

ssh-keyscan server2 > /root/.ssh/known_hosts

 

 

as I followed

and 

http://troy.jdmz.net/rsync/index.html

 

so how come theres worked and mine didn't???  

so do I replace server2  with "mitchsserver"   as either way i wanna be able to run rsync from mitchsserver or tower  to do the syncing

 

so what does ssh-keyscan do

 

Edited by comet424
Link to comment

ok so that didn't work 

that command you gave worked for whatever it did 3 things

 

then I copied in windows  Towers  sshroot folder (Flash )  to  mitchsserver (FromTower) (Flash)    

 

and then I ran the commands that the go file would run... and it doesn't work also  chmod doesn't exist now too

as I wanna be able to run rysnc either from Tower  or from Mitchserver  and I currently trying to run from my sisters server...

 

unraid5.PNG

unraid6.PNG

Edited by comet424
Link to comment

Sorry if I wasn't clear. I thought you were trying to run rsync in only one direction.

You ran ssh-keyscan on tower, so tower can now run rsync to mitchsserver without getting prompted.

You should also run ssh-keyscan tower on mitchsserver, which would let you run rsync to tower without getting prompted.

root@mitchsserver:~# ssh-keyscan tower > /root/.ssh/known_hosts

root@tower:~# ssh-keyscan mitchsserver > /root/.ssh/known_hosts

 

Link to comment

the only reason I started doing  bi directional was I was pre clearing  2  12TB drives  and I was doing web termainals things  and well when I tried doing web terminal  I was locked out   connection lost.. and I didn't wanna reboot computer as Preclear doesn't like to resume so I had to wait 6 days before I could reboot...  so I been trying from the mitchsserver to rysnc    data to my sisters server..  

and I find  windows copy doesn't always work.. and im finding  running a VM of Windows 2016   and copying from one unraid to another unraid  so tower to mitchsserver .  is usless..  network connection in VM  constantly fails   sooo anoying

 

so whats a keyscan… and what happened to chmod  its gone???

 

ill try that too  just a sec...  now if this works now id like to know  few other things about rsync  and if scripts can handle IF ELSE statements  and if you know anything about OpenVPN  as its not working for me 

 

but ill try this just a sec

 

Link to comment

ssh-keyscan is a command to fetching the host keys before you actually connect.

In a really strict security environment, the keyscan command is run and compared to the expected host keys (either pre generated, or compared to a local access). It also allows automation to run without having ssh to a new server block with the authenticity prompt you've been blocked with.

 

You're current screen indicates that the id_rsa file in mitchsserver is not considered valid in tower.

if you are using the same id_rsa file on both tower and mitchsserver, then the same id_rsa.pub should be used (copied into authorized_keys file)

Link to comment

I not sure??? 

when I ran  the keygen and key scan  and the cp  first

on tower

 

then in windows Share  I copyed  the sshroot from Towers Flash to mitchsserver fromtower folder so they both exactly the same  soo not sure what I missing and now chmod is missing

this stuff gets frustrating  

unraid8.PNG

Link to comment

so now I tried from tower to push the files to mitchsserver 

rsync -avzu -s --stats --numeric-ids --progress -e "ssh -i /root/.ssh/id_rsa -T -o Compression=no -x"  /mnt/user/Documents/ root@mitchsserver:/mnt/user/Mikes\ Files/Documents
 

 

it does the same error    says cant establish  and need to yes no  ugh  this frustrating  what am I doing wrong?

unraid9.PNG

Link to comment

there has to be something wrong.. so I decided to go back do what I showed  and what you said keyscan…    I re did a new key  I copied to mitchsserver

 I ran  one direction from tower to mitchsserver and the damn friging thing still not working it cant find it...I getting frustrated with this rysnc stuff

 

unraid10.PNG

unraid11.PNG

Edited by comet424
Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.