Jump to content
cheesemarathon

[Support] cheesemarathons repo

452 posts in this topic Last Reply

Recommended Posts

Thats all what should be supported: https://github.com/uklans/cache-domains

 

Tweaking Cache sizes

Two environment variables are available to manage both the memory and disk cache for a particular container, and are set to the following defaults.

CACHE_MEM_SIZE 500m
CACHE_DISK_SIZE 500000m

In addition, there is an environment variable to control the max cache age

CACHE_MAX_AGE 3650d
Edited by nuhll

Share this post


Link to post
Thats all what should be supported: https://github.com/uklans/cache-domains
 

Tweaking Cache sizes

Two environment variables are available to manage both the memory and disk cache for a particular container, and are set to the following defaults.

CACHE_MEM_SIZE 500mCACHE_DISK_SIZE 500000m

In addition, there is an environment variable to control the max cache age

CACHE_MAX_AGE 3650d

Fantastic! Thanks for finding that. I'll add that to the instructions when I get a chance!

Sent from my Pixel using Tapatalk

Share this post


Link to post

I found it. But i dont know how to use it in your docker.. xD 

 

BTW i got my first greens, so i guess its working :D

Edited by nuhll

Share this post


Link to post
I found it. But i dont know how to use it in your docker..  
On the docker tab. Click the docker name aka "steamcache" to edit it. At the bottom click "Add another path port or variable". In the new window that open, in the drop down select path. In the name and key box put "CACHE_MAX_AGE" or one of the other keys. In the value box but "365d" or whatever the required value is. Repeat for other variables you require. This should work but I've not tested this.

Sent from my Pixel using Tapatalk

Share this post


Link to post
Ill test. Thanks, didnt thouight it woudl be taht easy.
Sorry just noticed an error I typed. In the drop down select variable not path!

Sent from my Pixel using Tapatalk

Share this post


Link to post

Yea, i thought that and took it the right way.

 

edit1: But i dont know. Maybe its because i added the variables or ur docker is not correct working.

 

I let SSH open to look what i see, but it just spams

 

Quote

 


HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER

 

with nearly 10Mbit/s (only putty) complete destroying my server :D

 

Putty cant even keep up im at 23:30 but its already a hour later... xD

 

edit2: And steam is not downloading, was downloading till 53mb or somethign then stopped 0kbs.

 

edit3: okay, without variable its also not working. It must have to do with the dns, but thats the dns they providerd Oo ??!

Edited by nuhll

Share this post


Link to post
Yea, i thought that and took it the right way.
 
edit1: But i dont know. Maybe its because i added the variables or ur docker is not correct working.
 
I let SSH open to look what i see, but it just spams
 
 

HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
(none) 172.17.0.1 - - [08/Dec/2017:23:34:37 +0000] "GET /serverlist/90/20/ HTTP/1.0" 400 249 "-" "Valve/Steam HTTP Client 1.0" OTHER
 
with nearly 10Mbit/s (only putty) complete destroying my server
 
Putty cant even keep up im at 23:30 but its already a hour later...
 
edit2: And steam is not downloading, was downloading till 53mb or somethign then stopped 0kbs.
 
edit3: okay, without variable its also not working. It must have to do with the dns, but thats the dns they providerd Oo ??!
Ok I'd suggest forgetting all the extra stuff you want to do for now. Get it working with their DNS with out the extra variables. Then work your way up. Post your configs for both docker containers. I'm away this weekend so I'll post when I can.

Sent from my Pixel using Tapatalk

Share this post


Link to post

Yea, i edited it. I tried without variables, if i add the domains they list, its not working. If i only add the one domain, its not caching much. (53mb from 1,5gb)

 

Riot doenst seem to work also. (u cant even start game :D) And then theres this weired get serverlist thingy. Might it be that the docker isnt correct implemented/updated?!

Edited by nuhll

Share this post


Link to post
On 09/12/2017 at 7:24 PM, nuhll said:
Yea, i edited it. I tried without variables, if i add the domains they list, its not working. If i only add the one domain, its not caching much. (53mb from 1,5gb)
 
Riot doenst seem to work also. (u cant even start game :D) And then theres this weired get serverlist thingy. Might it be that the docker isnt correct implemented/updated?!

I'm sorry I'm confused as to where you are at and what your trying at the moment. Delete your containers for now and use my installation instructions for both containers. That should get you to a working state. Then we can go from there. If you have trouble let me know at what point.

Sent from my Pixel using Tapatalk
 

Edited by cheesemarathon

Share this post


Link to post

Im currently at the stage u provided, no extra variables and just one dns redirected. But like i said it only cache very few data because there are many many more dns which should be redirected

Share this post


Link to post

Okay, id ont know why, but if i use the dns docker, it seems to work (atleast better). Before i redirected the dns myself with my router.


Just to be sure, are all games/services enabled on both container? Like Steam, Riot, Windows Update, Origin? Or do i need to make any adjustments?

 

I wanted to reinstall now i get:

Pulling image: https://hub.docker.com/r/steamcache/steamcache-dns/

TOTAL DATA PULLED: 0 B

Command:
root@localhost:# /usr/local/emhttp/plugins/dynamix.docker.manager/scripts/docker run -d --name="Steamcache" --net="br0" --ip="192.168.86.2" -e TZ="Europe/Berlin" -e HOST_OS="unRAID" https://hub.docker.com/r/steamcache/steamcache-dns/
/usr/bin/docker: invalid reference format.
See '/usr/bin/docker run --help'.

The command failed.

 

 

Pulling image: https://hub.docker.com/r/steamcache/generic/


TOTAL DATA PULLED: 0 B

 

 

Command:root@localhost:# /usr/local/emhttp/plugins/dynamix.docker.manager/scripts/docker run -d --name="SteamCache" --net="br0" --ip="192.168.86.2" -e TZ="Europe/Berlin" -e HOST_OS="unRAID" https://hub.docker.com/r/steamcache/generic/

/usr/bin/docker: invalid reference format.
See '/usr/bin/docker run --help'.

The command failed.

 

Other containers seem to work just fine:

Pulling image: hurricane/sonarr:latest

IMAGE ID [latest]: Pulling from hurricane/sonarr. 
IMAGE ID [73fbde4ef9a4]: Pulling fs layer. 
IMAGE ID [28e8cff6e8e8]: Pulling fs layer. 
IMAGE ID [ddd5baf81b29]: Pulling fs layer. 
IMAGE ID [0338b83240d4]: Pulling fs layer. 

Edited by nuhll

Share this post


Link to post
18 hours ago, nuhll said:

Okay, id ont know why, but if i use the dns docker, it seems to work (atleast better). Before i redirected the dns myself with my router.


Just to be sure, are all games/services enabled on both container? Like Steam, Riot, Windows Update, Origin? Or do i need to make any adjustments?

 

I wanted to reinstall now i get:

Pulling image: https://hub.docker.com/r/steamcache/steamcache-dns/

TOTAL DATA PULLED: 0 B

Command:
root@localhost:# /usr/local/emhttp/plugins/dynamix.docker.manager/scripts/docker run -d --name="Steamcache" --net="br0" --ip="192.168.86.2" -e TZ="Europe/Berlin" -e HOST_OS="unRAID" https://hub.docker.com/r/steamcache/steamcache-dns/
/usr/bin/docker: invalid reference format.
See '/usr/bin/docker run --help'.

The command failed.

 

 

Pulling image: https://hub.docker.com/r/steamcache/generic/


TOTAL DATA PULLED: 0 B

 

 

Command:root@localhost:# /usr/local/emhttp/plugins/dynamix.docker.manager/scripts/docker run -d --name="SteamCache" --net="br0" --ip="192.168.86.2" -e TZ="Europe/Berlin" -e HOST_OS="unRAID" https://hub.docker.com/r/steamcache/generic/

/usr/bin/docker: invalid reference format.
See '/usr/bin/docker run --help'.

The command failed.

 

Other containers seem to work just fine:

Pulling image: hurricane/sonarr:latest

IMAGE ID [latest]: Pulling from hurricane/sonarr. 
IMAGE ID [73fbde4ef9a4]: Pulling fs layer. 
IMAGE ID [28e8cff6e8e8]: Pulling fs layer. 
IMAGE ID [ddd5baf81b29]: Pulling fs layer. 
IMAGE ID [0338b83240d4]: Pulling fs layer. 

11

 

Ok the steamcache-dns container should work for all game services as far as I can tell from the info on the steamcache github pages. I have not tried this though.  However, the steamcache container I have made available in community apps uses the steamcache/steamcache image. In order to use services other than steam you need to use the steamcache/generic image. I have plans to change this but I have not had time to as of yet. Basic instructions on how to set this up are described here: https://github.com/steamcache/generic Before you try that though I suggest that you start from scratch and try to get my templates working from community applications.

 

A few questions to try work out what is going wrong:

1. What unRAID version are you running?

2. What containers do you have installed and working?

3. When you got the errors you posted above, did you install from terminal or community apps?

4. Can you post an image of your Docker tab in the unRAID GUI with advanced turned on?

 

The error you are getting above is because of the format of the image at the end of the comand. It should not be a URL. It should be steamcache/steamcache or steamcahce/generic or steamcache/steamcache-dns. For example, a command that should work:

docker run -d --name="SteamCache" --net="br0" --ip="192.168.86.2" -e TZ="Europe/Berlin" -e HOST_OS="unRAID" steamcache/generic/

 

Share this post


Link to post

I dont know what changed, but now its working again.

 

Im feeling lucky and just tried replacing steamcache/steamcache:latest with steamcache/generic:latest (and it seems to work!?)

 

1. What unRAID version are you running?

newest 6.4

2. What containers do you have installed and working?

you mean Dockers?

 

Couchpotato

 

nzbget

 

PlexMediaServer

 

Sonarr

 

SteamCache

 

SteamCache-DNS

 

TeamSpeak (disabled)

 

 

Do you have an idea how i can setup this:

Caching Multiple Services

If you want to cache multiple game services then you should run multiple instances of the cache and use different IP addresses on the host machine. The first thing is to add an extra IP to your network interface.

You should then create a second data directory on the host and then run the container for the service you want to cache:

docker run \
  --restart unless-stopped \
  --name cache-blizzard \
  -v /cache/blizzard/data:/data/cache \
  -v /cache/blizzard/logs:/data/logs \
  -p 192.168.1.11:80:80 \
  steamcache/generic:latest

Repeat this for as many services as you want to cache. It is best practice to keep the caches separate for each service to prevent the possibility of overwriting the same data.

 

With your current container? 


Btw, this seems to work just fine with your DNS Container:

generic dns cache.png

Edited by nuhll

Share this post


Link to post

Wooohooo.

 

Okay.

 

News!

 

I got it working, i could test:

- Windows Update,

- Riot (LoL) and

- Steam. Its caching. Its working!

 

Many many, thanks!

steam.png

 

Origin does not work, because i dont know how to do the SSL thingy.... 


Cool would be a logfile analyser which shows how many misses/matches and how many traffic was saved. :)


I have slow internet and many family (and pcs) so this is a  huge thing for me!

Edited by nuhll

Share this post


Link to post
Wooohooo.
 
Okay.
 
News!
 
I got it working, i could test:
- Windows Update,
- Riot (LoL) and
- Steam. Its caching. Its working!
 
Many many, thanks!
steam.png.f6218c98f552afc1b02cffcb86982d38.png
 
Origin does not work, because i dont know how to do the SSL thingy.... 
If the only thing you changed was the image to steamcache/general then It might not survive a restart. It looks like from the github that each service is cached to a separate folder. One for steam, one for origin etc. If you don't map those folders then the cached data won't survive the docker container being restarted. I believe that's how steamcache/generic is working anyway.

Sent from my Pixel using Tapatalk

Share this post


Link to post

Nop. It just creates random folders /fs/ud/uf/ds/aj and so on. Like i said, also changed the other options above in the screenshot. If u have questions, tell me!

Share this post


Link to post

To be sure, i restartet the docker, and it still works. 90MB/s ... Thank god!

 

Only question is, if the variables for max age and max memory and max size works. But i will report back.

 

Edit:

Blizzard also works!

Edited by nuhll

Share this post


Link to post
18 hours ago, nuhll said:

Origin does not work, because i dont know how to do the SSL thingy.... 

5

 

I believe this is as easy as running the steamcache/sniproxy on your unRAID machine. You can find info on that here but it should be as simple as running this command:

docker run --name sniproxy -p 443:443 steamcache/sniproxy:latest

You cant change the ports so if you have conflicts they will have to be fixed in the conflicting container, not in sniproxy. Give it a try if you can!

Share this post


Link to post
On 11/12/2017 at 9:11 PM, nuhll said:

Only question is, if the variables for max age and max memory and max size works. But i will report back.

 

 

They should do - I authored the Pull Request for them. :)

 

They will only take effect on a 'docker run'.  Once they have been set for a container, they won't be changed if the environment variables subsequently change, unless you pull down a new copy of the container (i.e. do a docker rm, and another docker run rather than a docker stop / start)

Share this post


Link to post

What do you mean with "only on a docker run". You mean only when i restart the docker?

Share this post


Link to post

Hmm how do i tell steacmache dns that origin has another ip?

How do i tell sipproxy which ip the steamcache has? :D

Share this post


Link to post
Hmm how do i tell steacmache dns that origin has another ip?
How do i tell sipproxy which ip the steamcache has?
If I understand what your asking, you want to know how to specify the IP to forward origin requests to. If so you add a variable like I explained before but it should be for ORIGINCACHE_IP
For your second question just run the container like in the instructions on its github page on the same machine you are running the origin cache on. It will receive requests over https and forward them correctly. I believe that's how it works anyway but I have not tested any of this. It's just from reading the documentation.

Sent from my Pixel using Tapatalk

Share this post


Link to post

"same" machine?

 

As Steamcache or as Steamcache DNS? And with machine, u mean IP? 

Share this post


Link to post

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.