Support thread for masterwishx/browserless   playwright-chrome  -  browserless/chrome docker image. 

https://hub.docker.com/r/browserless/chrome/

 

browserless is a web-service that allows for remote clients to connect, drive, and execute headless work; all inside of docker. It offers first-class integrations for puppeteer, playwright, selenium's webdriver, and a slew of handy REST APIs for doing more common work. On top of all that it takes care of other common issues such as missing system-fonts, missing external libraries, and performance improvements. We even handle edge-cases like downloading files, managing sessions, and have a fully-fledged documentation site.

If you've been struggling to get Chrome up and running docker, or scaling out your headless workloads, then browserless was built for you.

 

This docker is needed for changedetection.io  , you can find it in Ca Apps .  its like Distill.io tool .

more read here https://github.com/dgtlmoon/changedetection.io/wiki/Fetching-pages-with-WebDriver

and here https://github.com/dgtlmoon/changedetection.io/wiki/Playwright-content-fetcher

 

Docker size about 910Mb !!!

I'm only made a template for it.

 

https://docs.browserless.io/v1/Docker/docker-quickstart

 

add this var to after install to your changedetection.io:

 

PLAYWRIGHT_DRIVER_URL=ws://yourIP:yourPORT/?stealth=1&--disable-web-security=true

 

 

Edited April 5, 20242 yr by Masterwishx

In my changedetection.io docker, i get the error No module named 'playwright'.  I have added PLAYWRIGHT_DRIVER_URL=ws://yourIP:yourPORT/?stealth=1&--disable-web-security=true as a variable in the docker settings for changedetection.  Any ideas??

10 hours ago, KillerVette42 said:

In my changedetection.io docker, i get the error No module named 'playwright'.  I have added PLAYWRIGHT_DRIVER_URL=ws://yourIP:yourPORT/?stealth=1&--disable-web-security=true as a variable in the docker settings for changedetection.  Any ideas??

Are you using the LinuxServer version? You have to pull it from the dgtlmoon docker hub image.

On 1/2/2023 at 6:21 PM, KillerVette42 said:

In my changedetection.io docker, i get the error No module named 'playwright'.  I have added PLAYWRIGHT_DRIVER_URL=ws://yourIP:yourPORT/?stealth=1&--disable-web-security=true as a variable in the docker settings for changedetection.  Any ideas??

 

Like @PopRockRoll said you should use official docker from dgtlmoon, Becouse Linuxserver Docker don't support playwright if I remember correctly. 

Edited January 3, 20233 yr by Masterwishx

Perfect, thanks!

I'm getting an error when I connect through the GUI

Couldn't establish a connection "ws://192.168.1.186:3000/". Is your browser running?

But when I use  changedetection.io and connect and use the connection. It works fine.

Edited February 14, 20233 yr by rainmanjam

3 hours ago, rainmanjam said:

I'm getting an error when I connect through the GUI

 

Thanks for let me know ,checked and also have this problem, i think its after last update, i opened issue on they github. 

https://github.com/browserless/chrome/issues/3023

you can also write about error ....

just change container to get version befor this or wait when they fix it ,if you really need the GUI....

@rainmanjam you can try change to  browserless/chrome:1.53-chrome-stable for container this should work fine ...

 

@rainmanjam checked  browserless/chrome:1-chrome-stable same as browserless/chrome:1.57-chrome-stable working fine in WebUI and they both pushed to dockerhub repo after latest ...

@rainmanjam checked the latest version for now and its working again in WebGui , please confirm if possible ...

 

On 2/14/2023 at 9:13 AM, Masterwishx said:

you can try change to  browserless/chrome:1.53-chrome-stable for container this should work fine ...

 

 

@Masterwishx Made an account here on Unraid to say thanks for your suggestion on using an older version of Browser-less Chrome. Prior to coming across your post, I too had been experiencing connection errors between ChangeDetection and Chrome. I also noticed Chrome wasn't getting an IP address (turns out Playwright Chrome had been crashing at the start). Took your suggestion about downgrading and voila!-- Playwright Chrome began functioning properly, and Changedetection communicated with Playwright

 

Pretty darn happy right now, after spending 3 hours attempting to get Changedetection to function properly. Again, many thanks.

@unraid_dumdedumda

You are welcome, if I understand right that your containers not in Unraid? 

 

Becose In Unraid I didn't saw problem or communication between changedetection and browserless, only if you are using Linuxserver changedetection container, they don't have playwright on it. 

 

The problem here is was for WebUI using of browserless, they fixed after that and then newer versions also was errors like today with lasted, but only for WebUI using. 

 

Anyway browserless/chrome:X.XX-chrome-stable is better to use for no errors. 

I'm glad that it's helps in your case also. 

Edited April 20, 20233 yr by Masterwishx

Greetings, thank you for your work!

 

I really like the Browserless / Changedetection setup but recently i run into some problems:

Most of my queries throw an error because they fail at the browserless "CONNECTION_TIMEOUT" limit (default 300sec / 300000ms) . Changedetection prints this as

Quote

"Navigation failed because page was closed! =========================== logs =========================== navigating to "https://store.analogue.co/", waiting until "load" ============================================================"

 

and "Last fetch time" in Stats matches the Connection Timeout limit. I also switched between some of the stable chrome releases with no success.

 

Sometimes they succeed and some other seem to work, then the fetch time is way below 30 seconds, so it could work. But for some reason, the "load" never finishes successfully. Two example pages:

https://www.rebuy.de/i,12937/nintendo-game-boy-advance/pokmon-smaragd-edition
https://store.analogue.co/

 

Do you have any idea, what could be wrong with my setup? Browserless and Changedetection are in the same subnet, container settings are on default (besides the ws://172.20.0.3:3000/?stealth=1&--disable-web-security=true url) and some of the checks are working fine and some do from time to time and some of them always fail.

 

I think there is something happening on the browserless side that prevents to signal that the page load has been finished successfully.

6 hours ago, Bronzing said:

I think there is something happening on the browserless side that prevents to signal that the page load has been finished successfully

 

I have also this problem sometime on some checks but didn't digged into it, not sure if it browserless issue, but I think you should open issue on github in changedetection.io.

 

Also I'm using 192.168.0.199 not internal docker address 172.x.x.x

But it's not related to this issue. 

If it works in you case at all. 

On 11/1/2023 at 2:32 AM, Bronzing said:

I think there is something happening on the browserless side that prevents to signal that the page load has been finished successfully.

 

please set `DEFAULT_BLOCK_ADS=false` should fix the issue

23 hours ago, Masterwishx said:

 

please set `DEFAULT_BLOCK_ADS=false` should fix the issue

Yes, thank you, that worked and did not break the detection. Finally, with the ads loaded, the browserless docker recognized the end of the page loading and the detection finishes without failures.

On 10/26/2022 at 8:47 AM, Masterwishx said:

Warning:

Please use A75G's repository template for official changedetection.io container from https://hub.docker.com/r/dgtlmoon/changedetection.io .

image by linuxserver container does NOT contain Playwright content fetcher .

Is this still necessary? It looks like the Linuxserver version has since updated Playwright. 
 

Quote

2024-03-09

Build Playwright from source because Microsoft's build and packaging process is awful.

2024-03-08

Build Playwright-python from source, add libjpeg.

 

9 hours ago, Zer0Nin3r said:

Is this still necessary? It looks like the Linuxserver version has since updated Playwright. 

 

Thanks for the info, Fixed

This might be a changedetection.io issue, but is there a way to:

 

A) Respond to prompts from the browser itself (in this case, a location prompt)

and/or
B) Set some sort of location (X,Y geo location) for the browser to be acting in?

 

Just trying to setup some stock monitors that operate in my area, but different webpages make this very difficult if you can't share your location.

Thanks!