Jump to content

phyzical

Members
  • Posts

    79
  • Joined

  • Last visited

Posts posted by phyzical

  1. well its been running for 12 hours without a hitch so i guess ill mark this as closed.

     

    still not sure what caused the connection closing via a direct rsync.

     

    But if you stumble across this and think you have a similar issue just try mounting the remote resource and rsync that mount instead.

     

    Thanks again @testdasi

  2. just a followup incase anyone else runs into this.

     

    Jenkins supports private keys but there is nowhere to upload the public key, so what you need to do is either copy the private and public keys in question onto the container or just run

    Quote

    pacman -S openssh

    then generate an ssh key on the container, then upload that private key into jenkins

  3. haha so looks like i spoke too soon. although this time it may be unrelated thought i would mention it just incase..

     

    my script threw "Transport endpoint is not connected", and i was unable to ls the /mnt/user folder with it returning the same error. googling suggested checking the filesystem so i ran xfs_repair on all the disk mounts. nothing needed fixing.

     

    rebooted and it was all back and the script rsyncing with the mount method is continuing on

  4. so a quick update.

     

    i decided to try mounting the smb share of the files im trying to rsync and the issue seems to have stopped occuring although i have noticing every now and then i see

     

    Quote

    WARNING FILE.ext failed verification -- update discarded (will try again)

     

    so i guess whatever it is is still occurring but nowhere near as much as it was with an rsync via ssh

  5. hey @testdasi,

     

    so i tried the pci NIC, the rsync kept repeating the same issue, so i tried disabling the onboard NIC and still the issue occured.

     

    So tried a different lan cord for the destination pc  to the first switch and another lan cord for the host pc to the other switch still no change.do you know of a way i can test the NIC external of the rsync command so i can try to rule out the data

     

    So if its not the NIC do you happen to have any more suggestions as to what could be causing this issue?

     

    Thanks!

  6. aw fack,

     

    it has already been restarted multiple times since this issue started occuring so i think it may be busted.

     

    checking the syslog again it has only done the double up and down once in the last hour.

     

    But i do have a spare pci NIC so i will chuck that in tommorow morning and see if the problem goes away.

     

    fingers crossed!

     

    Thanks again!

  7. so i tried checking all the cabls, power cycled my router and two switches between the two pcs

     

    below is the syslog summary, i do see mentions to NIC but i am not too familiar on if anything is wrong in it

     

    Quote

    Jan 31 23:18:46 Mediabox kernel: e1000e: eth0 NIC Link is Down
    Jan 31 23:18:46 Mediabox kernel: bond0: link status definitely down for interface eth0, disabling it
    Jan 31 23:18:46 Mediabox kernel: device eth0 left promiscuous mode
    Jan 31 23:18:46 Mediabox kernel: bond0: now running without any active interface!
    Jan 31 23:18:46 Mediabox kernel: br0: port 1(bond0) entered disabled state
    Jan 31 23:19:05 Mediabox kernel: e1000e: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: Rx/Tx
    Jan 31 23:19:05 Mediabox kernel: bond0: link status definitely up for interface eth0, 1000 Mbps full duplex
    Jan 31 23:19:05 Mediabox kernel: bond0: making interface eth0 the new active one
    Jan 31 23:19:05 Mediabox kernel: device eth0 entered promiscuous mode
    Jan 31 23:19:05 Mediabox kernel: bond0: first active interface up!
    Jan 31 23:19:05 Mediabox kernel: br0: port 1(bond0) entered blocking state
    Jan 31 23:19:05 Mediabox kernel: br0: port 1(bond0) entered forwarding state
    Jan 31 23:19:09 Mediabox kernel: e1000e: eth0 NIC Link is Down
    Jan 31 23:19:10 Mediabox kernel: bond0: link status definitely down for interface eth0, disabling it
    Jan 31 23:19:10 Mediabox kernel: device eth0 left promiscuous mode
    Jan 31 23:19:10 Mediabox kernel: bond0: now running without any active interface!
    Jan 31 23:19:10 Mediabox kernel: br0: port 1(bond0) entered disabled state
    Jan 31 23:19:13 Mediabox kernel: e1000e: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: Rx/Tx
    Jan 31 23:19:13 Mediabox kernel: bond0: link status definitely up for interface eth0, 1000 Mbps full duplex
    Jan 31 23:19:13 Mediabox kernel: bond0: making interface eth0 the new active one
    Jan 31 23:19:13 Mediabox kernel: device eth0 entered promiscuous mode
    Jan 31 23:19:13 Mediabox kernel: bond0: first active interface up!
    Jan 31 23:19:13 Mediabox kernel: br0: port 1(bond0) entered blocking state
    Jan 31 23:19:13 Mediabox kernel: br0: port 1(bond0) entered forwarding state

     

  8. hey again dasi,

     

    thanks for the reply.

     

    in regards to just brute forcing it, i tried playing back a couple of the files that took 3-4 --partial rsyncs to make it across and they seem okay. Shouldnt rsync see files differ anyway and just recopy or is there still a risk that it think 100% made it across and just didnt?

     

    yeah i had a feeling it was network related. it is about 40tb of content the first time i rsynced it went fine not this issues once from a -> b back when a was just a windows box. now i am going b -> a and this issue didnt start occuring until about 25% of the way through.

     

    i did check a few cables reset one of the switches thinking it might have been the cause. i will try cycling all the network and giving all the cables a check.

     

    If it was an overheating NIC would the syslog reveal this? if not how would i go about diagnosing this.

     

    Thanks again!

  9. after trying to resolve this trying various weird things for the last 3-4 days my current budge is to brute force it :D while i continue trying to find a soultion..

     

    Quote

    #!/bin/bash

    while true

    do

         if  RSYNCCOMMAND; then

                 echo "rsync completed normally"

                exit

           else

               echo "rsync failure. Retrying..."

              sleep 1

          fi

    done

     

    bit by bit its getting through the files....

     

  10. Hey there,

     

    i am having a weird issue with an rsync of files from one unraid box to another,

     

    below is the command i am running

     

    Quote

    rsync -av --progress -e "ssh -o StrictHostKeyChecking=no" "$fromFolder" "$toFolder" --log-file="$toFolder/rsync-log.txt"

     

    and the error i receive is

     

    Quote

    rsync: connection unexpectedly closed (7188736497 bytes received so far) [receiver]
    rsync error: error in rsync protocol data stream (code 12) at io.c(226) [receiver=3.1.3]
    rsync: connection unexpectedly closed (99373 bytes received so far) [generator]
    rsync error: unexplained error (code 255) at io.c(226) [generator=3.1.3]

     

    its weird though re-running it will make it progress a little further, sometimes i will run it twice and it will progress another file, sometimes it will take 6 tries to progress to the next file. the size of the files range from 800mb to 6gb.

     

    my googlefu has again let me down does anyone have any suggestions of what could be the cause of this issue?

     

    Thanks in advance!

     

    edit: also attached diagnostics report incase it helps

    mediabox-diagnostics-20200131-2044.zip

  11. well i figured it out kind of... feel silly now haha...

     

    i must have a firefox addon causing issues or some sort of cache issue (which i know firefox tries reallly hard to do).

     

    an incognito window and everything is fine, netdata is super responsive.

     

    before i close this does anyone else get this issue? ive tried disabling all my firefox addons and doesnt seem to help.

     

  12. Hey there,

     

    I have slowly been getting my main server unraid ready after wiping it. i installed a windows vm, a bunch of docker apps and had been rsyncing my content via my user script from another unraid box. Last night i started getting rsync unexpected connection closes sometimes it would get a few more files before giving up. After trying various things i relised i had not rebooted the system since the rsync errors occurred, but that is when my troubles started.

     

    After the reboot the system and unraid ui became alot slower to serve various things, my docker apps struggled to keep up for example a userscript  that just echos "hi" would take about 20 seconds to "start" and then not even echo, my netdata app would either not update or take a few minutes to log some cpu changes and would requires 5-10 minutes for any other categories if i was to scroll further. Before this specific reboot everything was running perfectly fine netdata would pull info a okay.

     

    At this point i wondered if something was going wrong with the windows vm or maybe one of the docker apps was chewing up the pc resources so i switched them all to not startup with the pool and shutdown the system and turned it back on. This didnt seem to change a thing, i then wondered if it was simply being throttled maybe temp wise so i installed dymanix and it seemed to show 40-60 c. just incase the temp readings were not correct i left the machine off for 24h.

     

    Apon turning it back on nothing had changed so i even went as far to shutdown the pool and load up the system.

     

    After all of this doing things like the info modal takes ~10 seconds and attempting to run a user script that is just `echo "hi"` takes bewteen 5-20 seconds to bring up the modal and just never runs.

     

    i must have something defective as it was working perfectly for about a week, could it be the usb that unraid is running on has just started to cark it? i will start researching how to test the flash drive in the mean time

     

    attached is my diagnostics.

     

    Any tips to help diagnose this would be much appreciated

     

    Thanks in advance!!

     

    edit: just to be clear this was not the first reboot since installing the vms and docker apps when my problems occured

    mediabox-diagnostics-20200130-1808.zip

  13. 18 hours ago, binhex said:

    ive never used ssh key for access to github, i tend to use personal access tokens, which are then defined as a 'username with password' in jenkins, see link below for how to generate one if you want to go down that route:-

     

    https://help.github.com/en/github/authenticating-to-github/creating-a-personal-access-token-for-the-command-line

    hey thanks for the reply!

     

    unfortunately github is only 1 step for me, i then need to checkout a bitbucket repo for my common infrastructure (which access tokens may also work) and then i will need to be able to deploy to my host box so i will still need ssh keys to work :( guessing your normal usecase is just for testing and not deployment?

     

     i will keep tinkering and see if i can get it to work. worse case i suppose i can fall back to the vm solution for a build agent, just trying to avoid it if i can at this time.

     

    i will post back when i get to a solution incase it helps someone in the future.

     

    Thanks again!

  14. Hey there!

     

    Love the apps.

     

    This is my first time setting up a jenkins server and this is more of a general jenkins question so feel free to say sorry cant help but after a couple of days of googling and trying various things im just at a loss so i thought i would try here also,

     

    Im trying to add an ssh key via the credentials plugin, to checkout my private github repos for testing and ci deployments but no matter what i try it seems to think my private key is invalid. You wouldnt happen to know where the hell i enter the public key for a private key? as the plugin wants a username not the public key (i also tried my username for github juust incase). Ive seen many mentions of using an ssh agent but that just seem a weird way to go about it.

     

    Thanks in advance!

     

    edit: infact re-reading the responses in this thread am i actually supposed to have say a ubuntu vm running and use that as an agent rather than relying on the docker image as the agent?

  15. 18 minutes ago, testdasi said:

    That is controller by the motherboard (i.e. BIOS), not Unraid.

    Turning on iGPU, on its own, doesn't mean the motherboard will let Unraid boot with the iGPU if there's another GPU in the primary slot.

    As far as I know, only Gigabyte mobo gives you full flexibility to pick what Unraid (or any OS) boots with initially.

    Ah damn, thats what i kinda thought. thanks for the confirmation.

     

    luckily i had that spare low power gt  5 something so ive done the usual use that for os and just passthrough without rom. i only need it for 4k media center usage anyways.

    as after trying the matching rom on tech power up  and failing to dump the bios again as it runs into the input/output error.

     

    as always thanks guys  @testdasi @Frank1940

     

    marking as resolved 👍

  16. @Frank1940 thanks for all that 👍 normally i would upload it but assumed it wouldn't have been needed, i will in the future to save someone asking.

     

    Doh i just assumed on at startup was a default option >.>. easy fix :D

     

    So if anyone comes along i only have an issue with the first dot point now.

     

    Thanks in advance!

  17. 46 minutes ago, aptalca said:

    ?? Php-fpm is just a processor. Your index file and root directive tell nginx where the necessary files are. When php files are called, they are sent to the processor.

     

    What exactly are you trying to accomplish here? What are these apps you're referring to?

    so what i mean is i want to have a seperate pool per nginx server directive. so one pool for be website-a and another for website-b. im just trying to acheive separation of envs through php-fpm.

     

    so i add a new pool for [website-a] how does it line up with website-a server directive

     

    sorry if my not being clear enough

     

    thanks!

  18. Hey!

     

    So i finaly got around to converting my main server over to unraid but i am having a couple of issues

     

    * The gfx i have in this as the primary card is a gtx 760 and the mobo is a ASRock Z270 Extreme4, ive never been able to get a rom to work for primary passthough with this card in the past, But this mobo does have onboard gfx. For some reason i cant seem to get unraid OS to boot on the iGPU so that i can just passthrough the 760 straight to a windows box. i have enabled integrated graphics/ multiscreen in bios, i have also tried plugging in a dvi to hdmi cable as i have read it should prefer older gens over newer but think this only relates to the inputs of the gfx itself not the onboard. Does anyone know if there are additonal tricks to force it to boot on the iGPU?

     

    * When i reboot the box the array does not seem to manually startup, i think this is due to it seeing some smart errors on two of the drives.
    My cache drive an nmve ssd is at 35 reallocated sectors im guessing its starting to get past its life as it is a few years old and was my download drive that whole time and so is starting to lose its writes on parts of the drive.
    and one of my array drives throws UDMA CRC error count 3823. but giving a google this is a non issue error a "once off" as far as i can tell
    Is there a way to tell unraid these are okay and to startup anyway? or are either of these smart warnings worse than i think they are?

     

    Thanks in advance!

  19. 8 hours ago, aptalca said:

    Just replicate that php block for any server blocks you need

    i figured it was that simple but the part that i dont know is how does each block line up with a particular app.

     

    but.. now that i think about it, what i remember from when i used guis ispconfig ect. The blocks line up with a user not a nginx server directive.

     

    or am i wrong on that?

     

    thanks!

  20. hey there all,

     

    @roland love the plugin just works and docs are very detailed.

     

    One thing im stuck on if anyone can help im trying to integrate nginx for example and need to edit the python.d/nginx.conf https://docs.netdata.cloud/collectors/python.d.plugin/nginx/

     

    if i add a python.d/nginx.conf to the overrides folder it doesnt seem to take effect? does anyone know if i have to edit this file directly on the docker image?

     

    thanks!

×
×
  • Create New...