Wob76

Members
  • Posts

    194
  • Joined

  • Last visited

Posts posted by Wob76

  1. Hi,

     

    Has there been another change to the plexreport docker? seems to have broken with the last update, I got the error;

    /usr/local/sbin/plexreport:374:in `initialize': No such file or directory - /config/web_email_body.erb (Errno::ENOENT)                                                from /usr/local/sbin/plexreport:374:in `new'
            from /usr/local/sbin/plexreport:374:in `main'
            from /usr/local/sbin/plexreport:390:in `<main>'


    I copied my old email_body.erb to web_email_body.erb and it seems to be working again.

     

    Is there a difference with the new file, should I be removing my config files and re-running the ./initial_setup.sh?

     

    I don't want to be critical, but it would be nice if you could flag any changes that will need user intervention, I really only notice this docker is broken when my scheduled email doesn't show up.

     

    Thanks,

    Beau

  2. Just wanted to say I gave this a test, manually set my IP reported to tracker under settings to the VPN External IP.

     

    I have seen a significant improvement in upload speeds. I just thought it must have been the speeds I was going to be getting via a VPN, but it has jumped 3-4 times per hour since I made the change.

     

    Very good find kas123tt, and I look forward to your fix binhex.

     

    Wob76

  3. Hi binhex,

     

    Just a question re privoxy, I have it running and it works fine from my network, but I can't seem to get other containers to work through it. I have tried pointing Jackett and Cardigann at it but both fail. I might be missing a config, but I just had a thought that it might be a network issue. Does Privoxy see the network from the host or from the container IP?

     

    Can I enable logging in the privoxy config file to diagnose, and if so do you know what config level I would need?

     

    Thanks,

    Wob

     

     

    Update: Still not luck with the above but I just testing with sickrage and it does work, but I have another issue, with sickrage it is all or nothing, and it can't access the local seachers (Jackett\Cardigann) via privoxy, so, can I set up privoxy to redirect local requests to go direct?

  4. Hi Binhex,

     

    I still had privileged on, but pipeworks uses some "magic" I don't fully understand, you need to set the docker network to "none" and then set an ip via an extra setting. "-e 'pipework_cmd=br0 @CONTAINER_NAME@ 192.168.0.251/[email protected]'" pipeworks detects that via the docker.socks and configures the network accordingly. It is working fine with plex, also requires privileged run, but there must be a limit to how network is passed through the pipeworks container and openvpn's access needs.

     

    I'll file it in the too hard basket.

     

    You did trip me up for quite awhile with the latest update. I had tested out the flood interface, but went back to rutorrent as I use allot of the plugins, originally they both ran together, but I see the latest version disabled rutorrent if flood is enabled, the coincided with my testing pipeworks, when I switched back i couldn't work out why I couldn't get to the web interface anymore. Took me a good while to spot the problem.

     

    Thanks anyway.

    Wob

     

    Hi,

     

    I was thinking of moving this container to use pipeworks, moving it onto it's own IP will enable me to monitor its bandwidth usage on my router.

     

    But if I do so I get the following errors in my log and it doesn't work.

     

    2016-11-28 09:21:37,744 DEBG 'start-script' stdout output:

    Mon Nov 28 09:21:37 2016 write UDPv4: Operation not permitted (code=1)

     

    Any Ideas on if there is a way to make it play nice with pipeworks?

     

    Cheers,

    Wob

     

    i know nothing about pipework, but operation not permitted sounds like your missing the --privileged=true flag.

  5. Hi,

     

    I was thinking of moving this container to use pipeworks, moving it onto it's own IP will enable me to monitor its bandwidth usage on my router.

     

    But if I do so I get the following errors in my log and it doesn't work.

     

    2016-11-28 09:21:37,744 DEBG 'start-script' stdout output:

    Mon Nov 28 09:21:37 2016 write UDPv4: Operation not permitted (code=1)

     

    Any Ideas on if there is a way to make it play nice with pipeworks?

     

    Cheers,

    Wob

  6.  

    Indeed - When using User Scripts you can just run the script in the background :)

     

    I was actually able to recreate the "Transport endpoint is not connected" - But i can only recreate it when i close down the mount script incorrectly for example in your case closing screen before unmounting. Also i could fix it by unmounting correctly and then remounting, without restarting.

    This also made me discover that i can still browse the mount from my dockers even when it's unmounted and cant be browsed from neither cmd line or my samba share. I can even playback media. It seems the mount somehow survives inside the dockers even when unmounted from the system.

     

    Thanks for the info, at the moment I think I will leave mine running under screen as it is working nicely :)

     

    I have moved my rclone mount to under a union-fs mount, it is now the lower layer, with RO access and my local data as the upper layer. This seems to have resolved my issue with dockers for now.

     

    Interesting, what happens when you attempt to access some data from the mount?

  7. Hi,

     

    A Couple of questions.

     

    Just looking at your scripts, with your mount I note you are calling rclone as normal.

    I had issues with this, it would time out, usually after my terminal ended. Is this not an issue when calling from user scripts?

    My solution was to call rclone via screen.

     

    as such.

    screen -S rclone -d -m rclone mount --allow-other --dir-cache-time 60m --max-read-ahead 200M --uid 99 --gid 100 secret:media /mnt/disks/cloud/rclone

     

    Also on the point of using /mnt/disks/ to help with dockers, this doesn't seem to work as well with rclone as it was for acd_cli. If I remount rclone for some reason I then get and error "Transport endpoint is not connected" when I try and access the mount \ volume mapping inside my docker, a restart fixes it. I have the volume set as Slave:RW as I did with acd_cli. Anyone else seeing that?

     

    Thanks,

    Wob

  8. Try clearing the browser cache - I have downsized the icon, so either its not getting overwritten with the new 48px icon or your browser cached the old one :)

     

    I just reopened the web interface it and its fine now.

     

    Thanks

  9. Great work,

     

    I haven't tested the scripts yet, I already have some working once, but it is a good step forward for new users.

     

    Only issue I did spot is that your icon seems to be a different size to the others.

     

    rclone_beta.PNG.45ba804c96333c80a42d6a4e379645f3.PNG

  10. Hi,

     

    All of a sudden I am seeing a heap of messages in my logs.

     

    2016-11-10 10:17:29,520 INFO reaped unknown pid 1176

    2016-11-10 10:17:29,520 DEBG received SIGCLD indicating a child quit

     

    repeats every few seconds with different pid. seems to have started 2 days ago. Everything still seems to be working, but the logs are getting big.

     

    Any ideas?

     

    Thanks,

    Wob

     

    Same here. +1

     

    is this straight away or is there always a delay before this occurs?

     

    Happens straight away for me. See logs below. The errors then repeat a number of times per min.

     

    Created by...
    ___.   .__       .__                   
    \_ |__ |__| ____ |  |__   ____ ___  ___
    | __ \|  |/    \|  |  \_/ __ \\  \/  /
    | \_\ \  |   |  \   Y  \  ___/ >    < 
    |___  /__|___|  /___|  /\___  >__/\_ \
         \/        \/     \/     \/      \/
       https://hub.docker.com/u/binhex/
    
    2016-11-10 10:17:17.964695 [info] Host is running unRAID
    2016-11-10 10:17:17.994220 [info] Show system information
    Linux 7e6bd1fa59ce 4.4.30-unRAID #1 SMP PREEMPT Sun Nov 6 19:10:12 GMT 2016 x86_64 GNU/Linux
    2016-11-10 10:17:18.052175 [info] PUID defined as '99'
    2016-11-10 10:17:18.100010 [info] PGID defined as '100'
    2016-11-10 10:17:18.180062 [info] Permissions already set for /config and /data
    2016-11-10 10:17:18.223047 [info] VPN_ENABLED defined as 'yes'
    2016-11-10 10:17:18.262309 [info] VPN_PROV defined as 'pia'
    2016-11-10 10:17:18.298943 [info] VPN_REMOTE defined as 'swiss.privateinternetaccess.com'
    2016-11-10 10:17:18.334833 [info] VPN_PORT defined as '1197'
    2016-11-10 10:17:18.374275 [info] VPN_PROTOCOL defined as 'udp'
    2016-11-10 10:17:18.411580 [info] LAN_NETWORK defined as '192.168.0.0/24'
    2016-11-10 10:17:18.448698 [warn] NAME_SERVERS not defined (via -e NAME_SERVERS), defaulting to Google and FreeDNS name servers
    2016-11-10 10:17:18.486199 [info] VPN_USER defined as '********'
    2016-11-10 10:17:18.521301 [info] VPN_PASS defined as '********'
    2016-11-10 10:17:18.557833 [warn] VPN_DEVICE_TYPE not defined (via -e VPN_DEVICE_TYPE), defaulting to 'tun'
    2016-11-10 10:17:18.594113 [info] STRONG_CERTS defined as 'yes'
    2016-11-10 10:17:18.633413 [info] ENABLE_PRIVOXY defined as 'yes'
    chsh: Shell not changed.
    Changing shell for nobody.
    2016-11-10 10:17:19,098 CRIT Set uid to user 0
    2016-11-10 10:17:19,098 INFO Included extra file "/etc/supervisor/conf.d/rtorrent.conf" during parsing
    2016-11-10 10:17:19,102 INFO supervisord started with pid 1
    2016-11-10 10:17:20,104 INFO spawned: 'start-script' with pid 105
    2016-11-10 10:17:20,105 INFO spawned: 'rtorrent-script' with pid 106
    2016-11-10 10:17:20,107 INFO spawned: 'webui-script' with pid 107
    2016-11-10 10:17:20,109 INFO spawned: 'privoxy-script' with pid 108
    2016-11-10 10:17:20,114 DEBG 'start-script' stdout output:
    [info] VPN is enabled, beginning configuration of VPN
    
    2016-11-10 10:17:20,115 INFO success: start-script entered RUNNING state, process has stayed up for > than 0 seconds (startsecs)
    2016-11-10 10:17:20,115 INFO success: rtorrent-script entered RUNNING state, process has stayed up for > than 0 seconds (startsecs)
    2016-11-10 10:17:20,115 INFO success: webui-script entered RUNNING state, process has stayed up for > than 0 seconds (startsecs)
    2016-11-10 10:17:20,115 INFO success: privoxy-script entered RUNNING state, process has stayed up for > than 0 seconds (startsecs)
    2016-11-10 10:17:20,118 DEBG 'rtorrent-script' stdout output:
    [info] rTorrent config file already exists, skipping copy
    
    2016-11-10 10:17:20,122 DEBG 'rtorrent-script' stdout output:
    [info] Removing any rtorrent session lock files left over from the previous run...
    
    2016-11-10 10:17:20,129 DEBG 'start-script' stdout output:
    [info] VPN strong certs defined, copying to /config/openvpn/...
    
    2016-11-10 10:17:20,134 DEBG 'start-script' stdout output:
    [info] VPN config file (ovpn extension) is located at /config/openvpn/openvpn.ovpn
    
    2016-11-10 10:17:20,163 DEBG 'rtorrent-script' stdout output:
    [info] VPN is enabled, checking VPN tunnel local ip is valid
    
    2016-11-10 10:17:20,189 DEBG 'start-script' stdout output:
    [info] Default route for container is 172.17.0.1
    [info] Setting permissions recursively on /config/openvpn...
    
    2016-11-10 10:17:20,200 DEBG 'start-script' stdout output:
    [info] Adding 8.8.8.8 to /etc/resolv.conf
    
    2016-11-10 10:17:20,204 DEBG 'start-script' stdout output:
    [info] Adding 37.235.1.174 to /etc/resolv.conf
    
    2016-11-10 10:17:20,209 DEBG 'start-script' stdout output:
    [info] Adding 8.8.4.4 to /etc/resolv.conf
    
    2016-11-10 10:17:20,212 DEBG 'start-script' stdout output:
    [info] Adding 37.235.1.177 to /etc/resolv.conf
    
    2016-11-10 10:17:20,216 DEBG 'start-script' stdout output:
    [info] Adding 192.168.0.0/24 as route via docker eth0
    
    2016-11-10 10:17:20,218 DEBG 'start-script' stdout output:
    [info] ip route defined as follows...
    --------------------
    
    2016-11-10 10:17:20,218 DEBG 'start-script' stdout output:
    default via 172.17.0.1 dev eth0 
    172.17.0.0/16 dev eth0  proto kernel  scope link  src 172.17.0.9 
    192.168.0.0/24 via 172.17.0.1 dev eth0 
    
    2016-11-10 10:17:20,219 DEBG 'start-script' stdout output:
    --------------------
    
    2016-11-10 10:17:20,224 DEBG 'start-script' stdout output:
    [info] iptable_mangle support detected, adding fwmark for tables
    
    2016-11-10 10:17:20,293 DEBG 'start-script' stdout output:
    [info] iptables defined as follows...
    --------------------
    
    2016-11-10 10:17:20,294 DEBG 'start-script' stdout output:
    -P INPUT DROP
    -P FORWARD ACCEPT
    -P OUTPUT DROP
    -A INPUT -i tun0 -j ACCEPT
    -A INPUT -s 172.17.0.0/16 -d 172.17.0.0/16 -j ACCEPT
    -A INPUT -i eth0 -p udp -m udp --sport 1197 -j ACCEPT
    -A INPUT -i eth0 -p tcp -m tcp --dport 9080 -j ACCEPT
    -A INPUT -i eth0 -p tcp -m tcp --sport 9080 -j ACCEPT
    -A INPUT -i eth0 -p tcp -m tcp --dport 9443 -j ACCEPT
    -A INPUT -i eth0 -p tcp -m tcp --sport 9443 -j ACCEPT
    -A INPUT -i eth0 -p tcp -m tcp --dport 8118 -j ACCEPT
    -A INPUT -i eth0 -p tcp -m tcp --sport 8118 -j ACCEPT
    -A INPUT -s 192.168.0.0/24 -i eth0 -p tcp -m tcp --dport 5000 -j ACCEPT
    -A INPUT -p udp -m udp --sport 53 -j ACCEPT
    -A INPUT -p icmp -m icmp --icmp-type 0 -j ACCEPT
    -A INPUT -i lo -j ACCEPT
    -A OUTPUT -o tun0 -j ACCEPT
    -A OUTPUT -s 172.17.0.0/16 -d 172.17.0.0/16 -j ACCEPT
    -A OUTPUT -o eth0 -p udp -m udp --dport 1197 -j ACCEPT
    -A OUTPUT -o eth0 -p tcp -m tcp --dport 9080 -j ACCEPT
    -A OUTPUT -o eth0 -p tcp -m tcp --sport 9080 -j ACCEPT
    -A OUTPUT -o eth0 -p tcp -m tcp --dport 9443 -j ACCEPT
    -A OUTPUT -o eth0 -p tcp -m tcp --sport 9443 -j ACCEPT
    -A OUTPUT -o eth0 -p tcp -m tcp --dport 8118 -j ACCEPT
    -A OUTPUT -o eth0 -p tcp -m tcp --sport 8118 -j ACCEPT
    -A OUTPUT -d 192.168.0.0/24 -o eth0 -p tcp -m tcp --sport 5000 -j ACCEPT
    -A OUTPUT -p udp -m udp --dport 53 -j ACCEPT
    -A OUTPUT -p icmp -m icmp --icmp-type 8 -j ACCEPT
    -A OUTPUT -o lo -j ACCEPT
    
    2016-11-10 10:17:20,295 DEBG 'start-script' stdout output:
    --------------------
    [info] Starting OpenVPN...
    
    2016-11-10 10:17:20,306 DEBG 'start-script' stdout output:
    Thu Nov 10 10:17:20 2016 OpenVPN 2.3.11 x86_64-unknown-linux-gnu [sSL (OpenSSL)] [LZO] [EPOLL] [MH] [iPv6] built on May 12 2016
    Thu Nov 10 10:17:20 2016 library versions: OpenSSL 1.0.2h  3 May 2016, LZO 2.09
    Thu Nov 10 10:17:20 2016 WARNING: file 'credentials.conf' is group or others accessible
    
    2016-11-10 10:17:20,471 DEBG 'start-script' stdout output:
    Thu Nov 10 10:17:20 2016 UDPv4 link local: [undef]
    Thu Nov 10 10:17:20 2016 UDPv4 link remote: [AF_INET]179.43.176.130:1197
    
    2016-11-10 10:17:22,176 DEBG 'start-script' stdout output:
    Thu Nov 10 10:17:22 2016 [359a3199665c74055229f1f10bfac4af] Peer Connection Initiated with [AF_INET]179.43.176.130:1197
    
    2016-11-10 10:17:25,050 DEBG 'start-script' stdout output:
    Thu Nov 10 10:17:25 2016 TUN/TAP device tun0 opened
    Thu Nov 10 10:17:25 2016 do_ifconfig, tt->ipv6=0, tt->did_ifconfig_ipv6_setup=0
    Thu Nov 10 10:17:25 2016 /usr/bin/ip link set dev tun0 up mtu 1500
    
    2016-11-10 10:17:25,051 DEBG 'start-script' stdout output:
    Thu Nov 10 10:17:25 2016 /usr/bin/ip addr add dev tun0 local 10.17.10.6 peer 10.17.10.5
    
    2016-11-10 10:17:25,055 DEBG 'start-script' stdout output:
    Thu Nov 10 10:17:25 2016 Initialization Sequence Completed
    
    2016-11-10 10:17:25,078 DEBG 'privoxy-script' stdout output:
    [info] Configuring Privoxy...
    
    2016-11-10 10:17:25,141 DEBG 'rtorrent-script' stdout output:
    [info] rTorrent not running, marking as first run
    
    2016-11-10 10:17:25,328 DEBG 'privoxy-script' stdout output:
    [info] All checks complete, starting Privoxy...
    
    2016-11-10 10:17:25,338 DEBG 'privoxy-script' stderr output:
    2016-11-10 10:17:25.337 2b80ce5ebdc0 Info: Privoxy version 3.0.24
    2016-11-10 10:17:25.337 2b80ce5ebdc0 Info: Program name: /usr/bin/privoxy
    
    2016-11-10 10:17:27,925 DEBG 'rtorrent-script' stdout output:
    [info] All checks complete, starting rTorrent...
    
    2016-11-10 10:17:27,929 DEBG 'rtorrent-script' stdout output:
    Script started, file is /home/nobody/typescript
    
    2016-11-10 10:17:27,958 DEBG 'rtorrent-script' stdout output:
    Script done, file is /home/nobody/typescript
    
    2016-11-10 10:17:28,061 DEBG 'webui-script' stdout output:
    [info] rtorrent started, setting up webui...
    
    2016-11-10 10:17:28,062 DEBG 'webui-script' stdout output:
    [info] Setting PHP timezone to Australia/Sydney...
    
    2016-11-10 10:17:28,076 DEBG 'webui-script' stdout output:
    [info] nginx cert files already exists, skipping copy
    
    2016-11-10 10:17:28,076 DEBG 'webui-script' stdout output:
    [info] nginx security file already exists, skipping copy
    
    2016-11-10 10:17:28,077 DEBG 'webui-script' stdout output:
    [info] nginx config file already exists, skipping copy
    
    2016-11-10 10:17:28,079 DEBG 'webui-script' stdout output:
    [info] rutorrent conf folder already exists, skipping copy
    
    2016-11-10 10:17:28,080 DEBG 'webui-script' stdout output:
    [info] rutorrent share folder already exists, skipping copy
    
    2016-11-10 10:17:28,084 DEBG 'webui-script' stdout output:
    [info] rutorrent plugins folder already exists, skipping copy
    
    2016-11-10 10:17:28,224 DEBG 'webui-script' stdout output:
    [info] starting php-fpm...
    
    2016-11-10 10:17:28,300 DEBG 'webui-script' stderr output:
    [NOTICE] [pool www] 'user' directive is ignored when FPM is not running as root
    [NOTICE] [pool www] 'group' directive is ignored when FPM is not running as root
    
    2016-11-10 10:17:28,305 DEBG 'webui-script' stdout output:
    [info] starting nginx...
    
    2016-11-10 10:17:29,520 INFO reaped unknown pid 1176
    2016-11-10 10:17:29,520 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:17:48,031 INFO reaped unknown pid 1249
    2016-11-10 10:17:48,031 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:18:00,031 INFO reaped unknown pid 1251
    2016-11-10 10:18:00,031 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:18:03,033 INFO reaped unknown pid 1253
    2016-11-10 10:18:03,033 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:18:18,034 INFO reaped unknown pid 1255
    2016-11-10 10:18:18,034 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:18:30,034 INFO reaped unknown pid 1257
    2016-11-10 10:18:30,034 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:18:33,153 INFO reaped unknown pid 1259
    2016-11-10 10:18:33,153 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:18:49,051 INFO reaped unknown pid 1275
    2016-11-10 10:18:49,051 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:19:04,050 INFO reaped unknown pid 1277
    2016-11-10 10:19:04,051 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:19:13,049 INFO reaped unknown pid 1279
    2016-11-10 10:19:13,050 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:19:19,049 INFO reaped unknown pid 1281
    2016-11-10 10:19:19,049 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:19:34,050 INFO reaped unknown pid 1283
    2016-11-10 10:19:34,051 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:19:43,032 INFO reaped unknown pid 1285
    2016-11-10 10:19:43,032 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:19:49,032 INFO reaped unknown pid 1287
    2016-11-10 10:19:49,032 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:20:04,051 INFO reaped unknown pid 1289
    2016-11-10 10:20:04,051 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:20:13,050 INFO reaped unknown pid 1291
    2016-11-10 10:20:13,050 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:20:19,050 INFO reaped unknown pid 1293
    2016-11-10 10:20:19,050 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:20:34,051 INFO reaped unknown pid 1295
    2016-11-10 10:20:34,051 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:20:43,051 INFO reaped unknown pid 1297
    2016-11-10 10:20:43,051 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:20:49,030 INFO reaped unknown pid 1299
    2016-11-10 10:20:49,030 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:21:04,033 INFO reaped unknown pid 1301
    2016-11-10 10:21:04,033 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:21:13,042 INFO reaped unknown pid 1303
    2016-11-10 10:21:13,043 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:21:19,051 INFO reaped unknown pid 1305
    2016-11-10 10:21:19,051 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:21:34,048 INFO reaped unknown pid 1307
    2016-11-10 10:21:34,049 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:21:43,052 INFO reaped unknown pid 1309
    2016-11-10 10:21:43,052 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:21:49,032 INFO reaped unknown pid 1311
    2016-11-10 10:21:49,032 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:22:04,033 INFO reaped unknown pid 1313
    2016-11-10 10:22:04,033 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:22:13,035 INFO reaped unknown pid 1315
    2016-11-10 10:22:13,036 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:22:19,047 INFO reaped unknown pid 1317
    2016-11-10 10:22:19,048 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:22:34,053 INFO reaped unknown pid 1319
    2016-11-10 10:22:34,053 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:22:43,051 INFO reaped unknown pid 1321
    2016-11-10 10:22:43,051 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:22:49,051 INFO reaped unknown pid 1323
    2016-11-10 10:22:49,051 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:23:04,033 INFO reaped unknown pid 1325
    2016-11-10 10:23:04,033 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:23:13,034 INFO reaped unknown pid 1327
    2016-11-10 10:23:13,034 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:23:19,032 INFO reaped unknown pid 1329
    2016-11-10 10:23:19,032 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:23:34,052 INFO reaped unknown pid 1331
    2016-11-10 10:23:34,053 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:23:43,053 INFO reaped unknown pid 1333
    2016-11-10 10:23:43,053 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:23:49,053 INFO reaped unknown pid 1335
    2016-11-10 10:23:49,053 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:24:04,053 INFO reaped unknown pid 1337
    2016-11-10 10:24:04,053 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:24:13,035 INFO reaped unknown pid 1339
    2016-11-10 10:24:13,035 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:24:19,034 INFO reaped unknown pid 1341
    2016-11-10 10:24:19,034 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:24:34,031 INFO reaped unknown pid 1343
    2016-11-10 10:24:34,031 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:24:43,049 INFO reaped unknown pid 1345
    2016-11-10 10:24:43,049 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:24:49,048 INFO reaped unknown pid 1347
    2016-11-10 10:24:49,048 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:25:04,336 INFO reaped unknown pid 1349
    2016-11-10 10:25:04,336 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:25:13,160 INFO reaped unknown pid 1351
    2016-11-10 10:25:13,161 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:25:19,027 INFO reaped unknown pid 1353
    2016-11-10 10:25:19,028 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:25:34,032 INFO reaped unknown pid 1355
    2016-11-10 10:25:34,033 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:25:43,034 INFO reaped unknown pid 1357
    2016-11-10 10:25:43,034 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:25:49,152 INFO reaped unknown pid 1359
    2016-11-10 10:25:49,152 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:26:04,033 INFO reaped unknown pid 1361
    2016-11-10 10:26:04,034 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:26:13,036 INFO reaped unknown pid 1363
    2016-11-10 10:26:13,036 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:26:19,033 INFO reaped unknown pid 1365
    2016-11-10 10:26:19,033 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:26:34,034 INFO reaped unknown pid 1367
    2016-11-10 10:26:34,034 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:26:43,048 INFO reaped unknown pid 1369
    2016-11-10 10:26:43,048 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:26:49,032 INFO reaped unknown pid 1371
    2016-11-10 10:26:49,032 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:27:04,032 INFO reaped unknown pid 1373
    2016-11-10 10:27:04,032 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:27:13,034 INFO reaped unknown pid 1375
    2016-11-10 10:27:13,034 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:27:19,032 INFO reaped unknown pid 1377
    2016-11-10 10:27:19,033 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:27:51,033 INFO reaped unknown pid 1401
    2016-11-10 10:27:51,033 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:28:06,032 INFO reaped unknown pid 1403
    2016-11-10 10:28:06,033 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:28:07,035 INFO reaped unknown pid 1405
    2016-11-10 10:28:07,035 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:28:21,044 INFO reaped unknown pid 1407
    2016-11-10 10:28:21,045 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:28:36,042 INFO reaped unknown pid 1409
    2016-11-10 10:28:36,043 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:28:37,048 INFO reaped unknown pid 1411
    2016-11-10 10:28:37,049 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:28:51,042 INFO reaped unknown pid 1413
    2016-11-10 10:28:51,043 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:29:06,033 INFO reaped unknown pid 1415
    2016-11-10 10:29:06,033 DEBG received SIGCLD indicating a child quit
    2016-11-10 10:29:07,033 INFO reaped unknown pid 1417
    2016-11-10 10:29:07,033 DEBG received SIGCLD indicating a child quit

  11. Hi,

     

    I am seeing a bunch of these messages, is there an easy way to work out which docker they may relate to?

     

    Most of them seem to relate to ld-musl-x86_64.so.1 if that helps?

     

    Example:  python[48043]: segfault at 7261726e8d ip 00002affbd98b61c sp 00002affccbe45a8 error 6 in ld-musl-x86_64.so.1[2affbd968000+88000]

     

    Thanks,

    Wob

  12. So you are getting similar speeds using rclone to mount and encfs to encrypt as you are with using rclone for both mounting and encrypting? Is anyone else getting similar results? Hopefully I'll be able to help test soon. Just too busy lately. That would be very telling because if it is the encryption layer, I don't know if much can be done to improve the performance as doing so would likely have serious repercussions on existing setups. Maybe I'm wrong about that. If it is mounting, I think there is room for improvement. Personally, even if acd_cli/encfs is better now, I still might bank on the fact that rclone is able to improve performance.  acd_cli and encfs being two separate projects, I don't expect much to change in relation to each other.

     

    Edit: One of posts I mentioned earlier, I forget which thread I mention it in, seems to indicate it is indeed crypt causing the issue.

     

    https://forum.rclone.org/t/plex-server-with-amazon-drive-rclone-crypt-vs-encfs-speed/106/17

     

    The author of rclone is looking into it. Just based on the fact that the performance is decent enough and the fact that there is active and significant work being done on rclone, I think I'll stick with that. I'm fairly confident the performance issues are just due to how new this is and will be resolved eventually.

     

    Hi,

     

    Yep, for me at lest using encfs on top of rclone or using crypt in rclone results in the same speeds, both slightly slower than acd_cli/encfs. So at least for my config, and with my testing process the encryption layer is not having any effect, it seems to be rclone. The post you linked seems to think the fix was introduced in a 1.33 beta, so I assume it's included in the 1.34 beta I am using. I have posted on the rclone forum, so hopefully I can assist in some improvement.

     

    I tend to agree with your statement, I will most likely lean with rclone as the development seems much faster, and once I choose an encryption layer swapping will be a pain (re-uploading will be needed).

     

    I think I'll just continue with some stability testing before I choose an option, I have both mounted at the moment, so will see if the mounts remain stable and playback smooth from both sources.

     

    Wob

  13. That's was my exact plan too!

    Have an 'Archived Movies' and 'Archived TV Shows' Library's, and older items that people don't watch as much move to ACD.

    Newer popular content stay's local. SO when people do want to watch those older movies/tv they still can and just deal with the extra load times I figure is an ok trade off.

     

    I was going to make a quip about great minds thinking alike, but not sure i can claim that at the moment ;)

     

    I server doesn't get allot of hits on older content, so I think I can safety base my "move" to the could on dates or number of seasons, then hits to ACD should be limited and not impact on the WAF factor too much.

     

    My only real concern is with ACD and its terms, I need to work out a "backup" for things stored in ACD, at least till I am confident they won't just "purge" my collection on a whim. Weather that is a offline storage device locally or another cloud providers I have yet to determine.

     

    Wob

  14. Hi,

     

    All of a sudden I am seeing a heap of messages in my logs.

     

    2016-11-10 10:17:29,520 INFO reaped unknown pid 1176

    2016-11-10 10:17:29,520 DEBG received SIGCLD indicating a child quit

     

    repeats every few seconds with different pid. seems to have started 2 days ago. Everything still seems to be working, but the logs are getting big.

     

    Any ideas?

     

    Thanks,

    Wob

  15. @ninthwalker, seems your tests reflect mine.

     

    I think at this stage I'll stick with acd_cli and encfs. But I might hold off on bulk uploading for a month or two to see if rclone can catch up. changing encryption system at this point would require a re-upload.

     

    I am still looking to keep a large chunk of data local anyway, it would only be older data (say older than 3-5 years). That way most content would be local, and just watching older stuff would pull from ACD.

     

  16. I have tried with a setting of 50Mb but no luck.

     

    As another test I also mounted rclone under my encfs (replacing acd_cli) and I still get similar speeds starting playback, so it doesn't appear to be the encryption layer. Trying to use verbose to debug, but I might need to post on the rclone logs for help with that.

     

    Thanks,

    Wob

  17. There's some discussion about setting the --max-read-ahead option which might give you some performance boost with rclone:

    https://forum.rclone.org/t/acd-fuse-mount-still-not-working-with-plex/170/20

     

    Hi Waseh,

     

    Thanks for the link, I have tried that, current settings I am using are --max-read-ahead 1024k --transfers 20 --checkers 40, that gave me the above results.

     

    bobbinitb linked here (https://forum.rclone.org/t/plex-server-with-amazon-drive-rclone-crypt-vs-encfs-speed/106/15) on another thread, I might try using rclone under my encfs mounts to see if that effects speed.

     

    Wob.

     

     

    Edit: I just noticed in that thread they are going into M read ahead, I'll give that a try.

  18. I also found this:

    https://forum.rclone.org/t/plex-server-with-amazon-drive-rclone-crypt-vs-encfs-speed/106/2

     

    One of the comments posits that it might be the FUSE mounting, not rclone itself, as cause for the performance hit.

     

    Thanks for the link, interesting read, but all on older versions, so he might still be working on a fix. Reading the issues/fixes it would seem rclone is being developed faster, but like you I want to commit to a solution before bulk uploaded encrypted data. I could look at replacing acd_cli with rclone (unencrypted) and still using encfs, the need to run a sync with acd_cli to see changes is a bit of a sticking point.

  19. I am using the rclone plugin but I am interested in how this compares performance wise. Always good to have options. I am also wondering if there is any compatibility between options. I'm just worried about committing to one way and uploading a bunch of data only to have to switch for some reason and start from scratch because the encryption is different.

     

    EDIT: It looks like rclone might be including a compatibility mode for encfs.

     

    Yeah, I did read that, or you could alternatively overlay a encfs mount over rclone and do the encryption outside of rlcone. BUT, the internal rclone encryption is newer and avoids some of the issue with encfs.

  20. OK, re my speed tests, I am on a 100Mbps Down and 40Mbps Up internet connection.

     

    Repeated tests with playing content (no sync tests at this stage).

     

    Times are from hitting the play button to the video starting. All the same episode, h264 encoded, no transcoding happening on the server. both ACD options are being encrypted, acd_cli via encfs and rclone using its internal crypt.

     

    local content

    3-4 secconds

     

    acd_cli mount

    6-8 seconds

     

    rclone mount

    10-12 seconds

     

    I don't want anyone to think I am complaining, I am just comparing options, and for the moment acd_cli seems faster (for me). I am trying to chose my option before I do a bulk upload a choose my encryption option.

     

    Cheers,

    Wob

     

    Edit:

     

    Also of note, I am not seeing heavy link utilisation on my connection during playback, downloading burst to about 20Mpbs very breifly at the start of play, then drops to sit around 5Mpbs. Also data doesn't appear to start till after the delays above, so it would appear to be some internal process to the apps causing the delay, not the downloading.