[Support] ich777 - Application Dockers


ich777

Recommended Posts

1 hour ago, aterfax said:

Is the ich777/ubuntu-mirror docker working correctly?

AFAIK yes.

 

What is not working for you?

 

1 hour ago, aterfax said:

Edit: Following the instructions above to grab the cnf directory seems to have resolved the issue.

Can you please go a bit more into detail? Are any changes necessary to the container?

Link to comment
7 minutes ago, ich777 said:

AFAIK yes.

 

What is not working for you?

 

Can you please go a bit more into detail? Are any changes necessary to the container?


By default the apt mirroring seems to be missing the cnf directory. This caused my ubuntu machines to throw the 'Failed to fetch' error from my original post.

I added the cnf.sh linked from above to the config directory, edited it to support "jammy" then ran it from inside the running container to download the missing files.

Script as follows:
 

#!/bin/bash
cd /ubuntu-mirror/data/mirror/
for p in "${1:-jammy}"{,-{security,updates}}\
/{main,restricted,universe,multiverse};do >&2 echo "${p}"
wget -q -c -r -np -R "index.html*"\
 "http://archive.ubuntu.com/ubuntu/dists/${p}/cnf/Commands-amd64.xz"
wget -q -c -r -np -R "index.html*"\
 "http://archive.ubuntu.com/ubuntu/dists/${p}/cnf/Commands-i386.xz"
done


This resolved the 'Failed to fetch'  problem.

This could be added to the container in one way or another I suspect, but it does not appear to be something that needs to be ran regularly according to the link above.

Edited by aterfax
Link to comment
1 hour ago, Botler85 said:

Hello, my Thunderbird Docker dont save Filters, why 😛 ?

Please create you filters and then exit the application once from within Thunderbird "File -> Quit/Exit".

If you are restarting the container from the Docker page within the Unraid WebGUI it won't save it.

  • Like 1
Link to comment

I'm having a problem with the Lancache-Prefill container. The pre-fill container is looking at the Lancache container at 192.168.0.249, rather than the Lancache-DNS container at 192.168.0.248. I have --dns=192.168.0.248 in Extra Parameters.

 

The downloads fail, then continue to retry. I can't see any files in the cache directory when it tries to download either.

 

Is there a config inside the container that I can change to point it as 192.168.0.248?

lancache.png

Link to comment
1 minute ago, dGG2uA said:

I'm having a problem with the Lancache-Prefill container. The pre-fill container is looking at the Lancache container at 192.168.0.249, rather than the Lancache-DNS container at 192.168.0.248. I have --dns=192.168.0.248 in Extra Parameters.

This seems like a DNS issue to me if it doesn't detect the LANCache DNS.

May I ask if you already have PiHole or Adguard running too? Why not make a rewrite to the LANCache Monoithic in PiHole or AdGuard, with that you don't need the DNS container.

 

3 minutes ago, dGG2uA said:

The downloads fail, then continue to retry. I can't see any files in the cache directory when it tries to download either.

Do you have a screenshot from that?

I already had a report about such an issue, what container are you using and how have you configured them?

Link to comment

I do have pi-hole, but it's not running as a DHCP server, only connects to a few devices manually with static IPs. It's not configured for my PC or server. I do have my DNS servers to 8.8.8.8 and 8.8.4.4 in unraid's network settings, as PiHole wasn't always set up like this. I just haven't changed it back yet. Could this be the issue? I can set unraid back to DHCP as I've just set my router to give my server a static IP.

 

I attached a screenshot in my original post of the "Retrying" part, along with the wrong IP. Attached an image of my container set up and my lancache directory.

lancache-containers.png

lancache2.png

Link to comment
10 minutes ago, dGG2uA said:

I just haven't changed it back yet. Could this be the issue?

No, this is not an issue at all.

 

10 minutes ago, dGG2uA said:

I attached a screenshot in my original post of the "Retrying" part, along with the wrong IP. Attached an image of my container set up and my lancache directory.

But if you set the --dns manually to LANCache-DNS it works or does it also fail?

AFAIK it should display the IP from LANCache Monolithic so this seems correct to me.

Have you set a valid upstream DNS server in your LANCache-DNS container?

 

EDIT: What does the LANCache access.log when it's retrying? Maybe open up a container console and type in:

tail -f /PATH/TO/access.log

of course replace /PATH/TO with the path to the access.log within the LANCache Monolithic container.

Link to comment
1 minute ago, ich777 said:

But if you set the --dns manually to LANCache-DNS it works or does it also fail?

AFAIK it should display the IP from LANCache Monolithic so this seems correct to me.

If i set --dns manually it doesn't work.

 

3 minutes ago, ich777 said:

Have you set a valid upstream DNS server in your LANCache-DNS container?

I have not, I only have the default parameters filled in inside the container. Attached a screenshot.

 

As a side note - Lancache does work by itself with just the 2 containers. I just can't get the pre-fill to work.

lancache3.png

Link to comment
9 minutes ago, dGG2uA said:

If i set --dns manually it doesn't work.

This is really strange! It should work definitely if you set it to 192.168.0.248.

 

Please also make sure that you set a Upstream DNS with a variable with the Key: UPSTREAM_DNS and as the Value the upstream DNS of you choice, maybe 1.1.1.1

 

9 minutes ago, dGG2uA said:

I have not, I only have the default parameters filled in inside the container. Attached a screenshot.

It should by default use 8.8.8.8 but maybe try another one.

 

9 minutes ago, dGG2uA said:

As a side note - Lancache does work by itself with just the 2 containers. I just can't get the pre-fill to work.

What IP did you assign to the prefill container? I can only think of an issue with prefill not respecting the --dns variable and therefore it can't find the lancache.

Link to comment
12 minutes ago, ich777 said:

EDIT: What does the LANCache access.log when it's retrying? Maybe open up a container console and type in:

tail -f /PATH/TO/access.log

of course replace /PATH/TO with the path to the access.log within the LANCache Monolithic container.

Data from log when "Downloading...":

[steam] 192.168.0.246 / - - - [30/Nov/2022:18:54:30 +0000] "GET /depot/1/chunk/0a98ca153d0b406288e3d606c5a1181be7d3d977 HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache8-iad1.steamcontent.com" "-"

 

Data from log when "Retrying...":

[steam] 192.168.0.246 / - - - [30/Nov/2022:18:55:39 +0000] "GET /depot/1/chunk/3348068e2413ad6d52e6f24c63bc53c6d9059866 HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache4-iad1.steamcontent.com" "-"

 

Basically shows the same info while downloading and retrying.

Link to comment
3 minutes ago, dGG2uA said:

Data from log when "Retrying...":

[steam] 192.168.0.246 / - - - [30/Nov/2022:18:55:39 +0000] "GET /depot/1/chunk/3348068e2413ad6d52e6f24c63bc53c6d9059866 HTTP/1.1" 200 0 "-" "Valve/Steam HTTP Client 1.0" "MISS" "cache4-iad1.steamcontent.com" "-"

This means basically that the steam server is not answering and that the file is not found in the LANCache because it shows MISS but it tries to download but somehow fails.

Link to comment
3 minutes ago, ich777 said:

This is really strange! It should work definitely if you set it to 192.168.0.248.

 

Please also make sure that you set a Upstream DNS with a variable with the Key: UPSTREAM_DNS and as the Value the upstream DNS of you choice, maybe 1.1.1.1

 

I've tried setting upstream DNS to 1.1.1.1 and got an error - attached. Going to try with 8.8.8.8 and 8.8.4.4.

lancache4.png

Link to comment
2 minutes ago, dGG2uA said:

I had the same thought, it was only Half Life! Also, I have nowhere near a 162.54Mbit/s connection. More like 60-70Mbit/s

Do you have Allow Host Access on in the Docker settings?

If yes, try to switch the container to bridge mode and set the DNS manually to the LAN Cache DNS container.

Link to comment
3 minutes ago, dGG2uA said:

Host access to custom networks is set to Disabled. I can enable it?

Yes, this will only enable communication between br0 containers, the host and bridge containers. By default br0 container can not communicate with the host or other container networks.

This would also be an issue if you for example set the DNS server from your Unraid box to the LANCache DNS IP, that won't work because the host and br0 can't communicate without Allow Host Access.

Link to comment
5 minutes ago, ich777 said:

Yes, this will only enable communication between br0 containers, the host and bridge containers. By default br0 container can not communicate with the host or other container networks.

This would also be an issue if you for example set the DNS server from your Unraid box to the LANCache DNS IP, that won't work because the host and br0 can't communicate without Allow Host Access.

I've enabled it, doesn't seem to have made a difference though. All lancache containers are in the br0 network anyway..

 

PiHole is in the br0 network aswell, but as mentioned earlier my PiHole set up shouldn't be causing any issues.

Link to comment
1 minute ago, dGG2uA said:

I've enabled it, doesn't seem to have made a difference though. All lancache containers are in the br0 network anyway..

I really can't explain why this is happening on your system, I've also got the retrying errors sometimes but after it got the CDNs it starts pulling data and filling LANCache:

---Checking if UID: 99 matches user---
---Checking if GID: 100 matches user---
---Setting umask to 000---
---Checking for optional scripts---
---No optional script found, continuing---
---Starting cron---
---Taking ownership of data...---
---Starting...---
---BattleNetPrefill enabled!---
---Version Check!---
---BattleNetPrefill v1.4.2 up-to-date---
---SteamPrefill enabled!---
---Version Check!---
---SteamPrefill v1.8.1 up-to-date---
---Prepare Server---

Your global defined cron schedule is: 0 2 * * *

---Container fully started, waiting for next cron job to start!---

==> /lancacheprefill/logs/battlenet_prefill.log <==

==> /lancacheprefill/logs/steam_prefill.log <==

==> /lancacheprefill/logs/battlenet_prefill.log <==
[2022-11-30] Starting BattleNetPrefill
[1:00:01 AM] Prefilling 5 products 

Detecting Lancache server...
[1:00:02 AM] Detected Lancache server at level3.blizzard.com!
[1:00:02 AM] Starting Diablo 3   Up to date!
[1:00:02 AM] Starting Starcraft Remastered   Up to date!
[1:00:03 AM] Starting Starcraft 2   Up to date!
[1:00:04 AM] Starting Warcraft 3: Reforged   Up to date!
[1:00:04 AM] Starting WoW Classic   Up to date!
[1:00:05 AM] Prefill complete! Prefilled 5 apps in 03.38

==> /lancacheprefill/logs/steam_prefill.log <==
[2022-11-30] Starting SteamPrefill
[1:00:05 AM] Starting login!
Connecting to Steam...
Logging into Steam...
[1:00:06 AM] Logged into Steam
Saving Steam session...
Retrieving owned apps...
[1:00:06 AM] Steam session initialization complete!
Retrieving latest App metadata...

[1:00:08 AM] Starting Wreckfest
 Getting available CDN Servers... 
 Getting available CDN Servers...  Retrying 1
 Getting available CDN Servers...  Retrying 2
 Getting available CDN Servers...  Retrying 3
Fetching depot manifests...
[1:00:12 AM] Downloading 26.91 GiB
Detecting Lancache server...
[1:00:12 AM] Detected Lancache server at lancache.steamcontent.com [10.0.0.3]
Downloading..: 0%
Downloading..: 7%
Downloading..: 15%
Downloading..: 22%
Downloading..: 25%
Downloading..: 32%
Downloading..: 39%
Downloading..: 46%
Downloading..: 50%
Downloading..: 57%
Downloading..: 64%
Downloading..: 71%
Downloading..: 75%
Downloading..: 82%
Downloading..: 89%
Downloading..: 95%
Downloading..: 96%
Downloading..: 97%
Downloading..: 98%
Downloading..: 99%
[1:07:04 AM] Finished in 06:51.83 - 561.36 Mbit/s

[1:07:04 AM] Prefill complete!
────────────────────────────────────────────────────────────────────────────────
  Prefilled 17 apps in 06:59.17 
                                
   Updated │ Up To Date         
  ━━━━━━━━━┿━━━━━━━━━━━━        
      1    │     16             
                                
Disconnecting
[1:07:04 AM] Disconnected from Steam!

 

Link to comment
6 minutes ago, ich777 said:

I really can't explain why this is happening on your system, I've also got the retrying errors sometimes but after it got the CDNs it starts pulling data and filling LANCache:

---Checking if UID: 99 matches user---
---Checking if GID: 100 matches user---
---Setting umask to 000---
---Checking for optional scripts---
---No optional script found, continuing---
---Starting cron---
---Taking ownership of data...---
---Starting...---
---BattleNetPrefill enabled!---
---Version Check!---
---BattleNetPrefill v1.4.2 up-to-date---
---SteamPrefill enabled!---
---Version Check!---
---SteamPrefill v1.8.1 up-to-date---
---Prepare Server---

Your global defined cron schedule is: 0 2 * * *

---Container fully started, waiting for next cron job to start!---

==> /lancacheprefill/logs/battlenet_prefill.log <==

==> /lancacheprefill/logs/steam_prefill.log <==

==> /lancacheprefill/logs/battlenet_prefill.log <==
[2022-11-30] Starting BattleNetPrefill
[1:00:01 AM] Prefilling 5 products 

Detecting Lancache server...
[1:00:02 AM] Detected Lancache server at level3.blizzard.com!
[1:00:02 AM] Starting Diablo 3   Up to date!
[1:00:02 AM] Starting Starcraft Remastered   Up to date!
[1:00:03 AM] Starting Starcraft 2   Up to date!
[1:00:04 AM] Starting Warcraft 3: Reforged   Up to date!
[1:00:04 AM] Starting WoW Classic   Up to date!
[1:00:05 AM] Prefill complete! Prefilled 5 apps in 03.38

==> /lancacheprefill/logs/steam_prefill.log <==
[2022-11-30] Starting SteamPrefill
[1:00:05 AM] Starting login!
Connecting to Steam...
Logging into Steam...
[1:00:06 AM] Logged into Steam
Saving Steam session...
Retrieving owned apps...
[1:00:06 AM] Steam session initialization complete!
Retrieving latest App metadata...

[1:00:08 AM] Starting Wreckfest
 Getting available CDN Servers... 
 Getting available CDN Servers...  Retrying 1
 Getting available CDN Servers...  Retrying 2
 Getting available CDN Servers...  Retrying 3
Fetching depot manifests...
[1:00:12 AM] Downloading 26.91 GiB
Detecting Lancache server...
[1:00:12 AM] Detected Lancache server at lancache.steamcontent.com [10.0.0.3]
Downloading..: 0%
Downloading..: 7%
Downloading..: 15%
Downloading..: 22%
Downloading..: 25%
Downloading..: 32%
Downloading..: 39%
Downloading..: 46%
Downloading..: 50%
Downloading..: 57%
Downloading..: 64%
Downloading..: 71%
Downloading..: 75%
Downloading..: 82%
Downloading..: 89%
Downloading..: 95%
Downloading..: 96%
Downloading..: 97%
Downloading..: 98%
Downloading..: 99%
[1:07:04 AM] Finished in 06:51.83 - 561.36 Mbit/s

[1:07:04 AM] Prefill complete!
────────────────────────────────────────────────────────────────────────────────
  Prefilled 17 apps in 06:59.17 
                                
   Updated │ Up To Date         
  ━━━━━━━━━┿━━━━━━━━━━━━        
      1    │     16             
                                
Disconnecting
[1:07:04 AM] Disconnected from Steam!

 

My container logs are different from yours...

 

---Checking if UID: 99 matches user---
usermod: no changes
---Checking if GID: 100 matches user---
usermod: no changes
---Setting umask to 000---
---Checking for optional scripts---
---No optional script found, continuing---
---Starting cron---
---Taking ownership of data...---
---Starting...---
---SteamPrefill enabled!---
---Version Check!---
---SteamPrefill v1.8.1 up-to-date---
---Prepare Server---

Your cron schedule for SteamPrefill is: 0 2 * * *

---Container fully started, waiting for next cron job to start!---

 

If we can't find a fix for this I can come back to it tomorrow, don't want to spend all night on this.. Thinking I might try an older container if you have one in Docker Hub.  What do you think?

 

 

Link to comment
1 minute ago, dGG2uA said:

If we can't find a fix for this I can come back to it tomorrow, don't want to spend all night on this.. Thinking I might try an older container if you have one in Docker Hub.  What do you think?

No, the container updates itself always to the latest version, there is only on container in my Docker repo.

 

3 minutes ago, dGG2uA said:

My container logs are different from yours...

Why, looking similar to me.

You actually have to wait for a sync to start, maybe let the container run over night and let it do it's job and post your logs tomorrow.

Link to comment
4 minutes ago, ich777 said:

Why, looking similar to me.

You actually have to wait for a sync to start, maybe let the container run over night and let it do it's job and post your logs tomorrow.

I just meant that I don't get any output when trying to download something in the log. I'll set a schedule and check it in a while, I'll report back with any updates.

Link to comment
1 minute ago, dGG2uA said:

I just meant that I don't get any output when trying to download something in the log. I'll set a schedule and check it in a while, I'll report back with any updates.

I don't usually force a sync or do a manual sync because it just works in my case and let cron do it's job. :D

The logs are only written if a cron job is run or you force the sync on container start.

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.