Skip to content
View in the app

A better way to browse. Learn more.

Unraid

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.

[Support] Nodiaque - Calibre-Web-Automated-Book-Downloader

Featured Replies

Summary: Support Thread for Nodiaque Calibre-Web-Automated-Book-Downloader

Application: Calibre-Web-Automated-Book-Downloader

Github: https://github.com/calibrain/calibre-web-automated-book-downloader/

 

This template use the official image from calibrain (ghcr.io/calibrain/calibre-web-automated-book-downloader:latest)

I only provide a template for the docker image, I do not maintain the image. For any issue with the software itself, please go to the official github.

 

If you don't have a AA Donator Key and want to use cloudflare bypass, you must set USE_CF_BYPASS to true (default).

If you set USE_CF_BYPASS to false, it will either try to use the AA Donator Key (if present) or Alternative URL (if present). If none are present, it will use other alternative like zlib that have way less books, which will often result in finding books in the search but failing to download.

Discontinued

This app was rebranded and replaced by a new one called shelfmark. Support thread available here: https://forums.unraid.net/topic/196495-support-nodiaque-shelfmark/. Please use the new shelfmark template

Edited by Nodiaque

Does this require a separate cloudflare bypass container?  Or is it included?

  • Author

If you already have one, you can change the ip and port for it in the variable. I run it as is and it seems to work (as per the doc on github, it seems to have it's own).

On github I use the docker-compose that has a separate CF bypass container.  When i run it currently it will only download from an alternative site not the main one - is yours downloading from the main site?

  • Author

It's exactly the one from ghcr that is linked on the github. It's just a template, I'm using the already existing docker made by calibrain.

 

ghcr.io/calibrain/calibre-web-automated-book-downloader:latest

 

True, I do see in the docker-compose that he put another docker, ghcr.io/sarperavci/cloudflarebypassforscraping:latest. It's not the same configuration based on the readme.md (readme put localhost as address for cloudfarebypass and the other one put the actual cf bypass docker).

 

I can spin a second template just for the bypass if you want, shouldn't be long

  • Author

Ok I've checked the log and with the current template, it faile to bypass CF because it cannot find the bypass container. Then it goes to an alternate website. I'll check what happen if I disable CF bypass

 

edit: I'm also in talk with calibrain. I added a new value in the template for appdata that point to container /var/logs/cwa-book-downloader and on your unraid server into appdata folder you normally use i.e. /mnt/user/appdata/calibre-web-automated-book-downloader/

 

edit: ok, without CF bypass, it just failed cause I'm not a donator. I'll create a template for the cd bypass and test

Edited by Nodiaque

  • Author

it seems the cf scrapper doesn't work. I see it receiving the request for slow download but it does nothing. I won't publish it since it's not working. I've open a bug report on it

  • Author

I've put up the template for the scraper. But according to login, with or without the scrapper, it still goes to alternate download website. Bug ticket open on the github.

 

I've also updated the template a bit, you might want to redownload the template

Edited by Nodiaque

Nodiaque,

 

Thanks very much for this.  However, Almost all of my attempted downloads fail. Is there still work to be done on the container to be more successful, or am I doing something wrong?  Thanks,

  • Author

Hello, I'm using it without any problem. What are the problem you are getting? I didn't create the docker container itself, it's the official one, I purely made a template so we don't have to do docker compose. But it is used by a lot of people. 

 

I can try to help or you can also check on the Github and post your issue. The dev are very responsive

@Nodiaque Hope you can help me out. I need to change the port for this container as I have a another container using 8084. I tried changing the ports to 10084 but the web GUI is not accessible. If I run it with 8084 it works as expected. Looking at the template not sure what I need to change as the comment on the last variable appears cutoff and didn't see any info on github. Appreciate any insight you or others may have. 

 

It works like this:

 

image.thumb.png.b3afe6927cdd0046c67d119249da0291.png

 

Can't access the gui with this change:

 

image.thumb.png.bc50e0b62b14f13dfbcfc3d13ee37877.png

  • Author

Try changing only FLASK PORT. I haven't really tried to change port but this should work. 

 

If you change FLASK_PORT, you must change other parameter too. 

  • 5 weeks later...

I just installed via Community Applications and get only an error message in response to any search. I removed and recreated the container several times with the same result each time. Not sure if this is an issue with the template, my install, or the software itself. I created an issue on the upstream github repo.

On 1/12/2025 at 1:47 AM, Twinkie0101 said:

@Nodiaque Hope you can help me out. I need to change the port for this container as I have a another container using 8084. I tried changing the ports to 10084 but the web GUI is not accessible. If I run it with 8084 it works as expected. Looking at the template not sure what I need to change as the comment on the last variable appears cutoff and didn't see any info on github. Appreciate any insight you or others may have. 

 

It works like this:

 

image.thumb.png.b3afe6927cdd0046c67d119249da0291.png

 

Can't access the gui with this change:

 

image.thumb.png.bc50e0b62b14f13dfbcfc3d13ee37877.png

 

 

This appears to work for me, I can access on 9076 on my LAN.

 

image.thumb.png.9565c3f71186c2155853b8968ced37fe.png

On 2/10/2025 at 11:30 AM, mikedm139 said:

I just installed via Community Applications and get only an error message in response to any search. I removed and recreated the container several times with the same result each time. Not sure if this is an issue with the template, my install, or the software itself. I created an issue on the upstream github repo.

Turns out that my pi-hole instance was blocking the CDN domain for an important script when loading the page

cdn.jsdelivr.net

For anyone else who might run into this issue, white list the listed domain (identified in the browser console on page load) and everything should work as expected.

Edited by mikedm139

  • 1 month later...
On 10/4/2023 at 6:07 AM, Tim Knowlden said:

Thank you, run the script and reduced the docker image significantly.  

 

On 2/11/2025 at 1:49 PM, SirKelsALot said:

 

 

This appears to work for me, I can access on 9076 on my LAN.

 

image.thumb.png.9565c3f71186c2155853b8968ced37fe.png

@SirKelsALot - Thanks - i had the same access issue and this fixed it for me! Cheers!

 

Love this combo of dockers! One question on the CF Solver though. It seems to be a huge image (over 1GB) and constantly chews up almost 1% CPU even when nothing is using it while consuming over 500MB RAM. In comparison the regular "flaresolverr" docker only seems to use 250MB RAM and 0% CPU at idle. Can I use the flaresolverr docker with CWA or is there a way to reduce the size and idle CPU usage of the CF solver docker from CWA?

  • Author

I cannot say to be honest. I know when I did this docker, it was how the original software was supported but the dev said he was working on something else. I haven't visited back since it's working. Might want to check on the project page

  • 3 months later...
On 1/8/2025 at 12:28 PM, Nodiaque said:

OK so I talked with Calibrain. What happen is aa doesn't host book directly, they are all hosted somewhere like libgen / zlib. The CF bypass work with the installation of my template. You must also change the variable for the cf proxy url to your server ip.

 

https://github.com/calibrain/calibre-web-automated-book-downloader/issues/45#issuecomment-2576954564

Could you clarify something, as I am having some issues, the CLOUDFLARE_PROXY_URL variable should point to the [IPADDRESS]:[PORT] of the CloudflareBypassForScraping container?

  • Author
10 hours ago, mayberts said:

Could you clarify something, as I am having some issues, the CLOUDFLARE_PROXY_URL variable should point to the [IPADDRESS]:[PORT] of the CloudflareBypassForScraping container?

Exactly. I'm looking at the original website and it seems it's not used anymore. I would have to test without the container if it's still working. I know my current installation does work, but it might not be using that container anymore (the scrapper)

thanks. Mine is not working, no matter what I try

Edited by mayberts
spelling

3 hours ago, mayberts said:

thanks. Mine is not working, no matter what I try

The combo of the 3 dockers is working for me. I can search for and download books via the download docker using the scrapper docker and then calibrate-web-automated showing the books.

  • Author
4 hours ago, mayberts said:

thanks. Mine is not working, no matter what I try

What is not working? What does the log says? Do you have the 3 dockers install cause this is an add-on to calibre-web-automated

Just noticed this is failing to download for me now as well. The cloudflarebypass seems to just fail? This same set up has been working until recently.

2025-07-31 14:54:10,402 - backend - INFO - backend.py:68 - Book queued: The Ministry of Time

2025-07-31 14:54:10,739 - downloader - INFO - downloader.py:44 - GET: https://annas-archive.org/slow_download/a77823bd2ade21b4f83ba71a9c5eed3a/0/0

2025-07-31 14:54:10,968 - downloader - WARNING - downloader.py:64 - 403 detected for URL: https://annas-archive.org/slow_download/a77823bd2ade21b4f83ba71a9c5eed3a/0/0. Should retry using cloudflare bypass.

2025-07-31 14:54:10,969 - downloader - INFO - downloader.py:36 - GET Using Cloudflare Bypasser for: https://annas-archive.org/slow_download/a77823bd2ade21b4f83ba71a9c5eed3a/0/0

2025-07-31 14:54:10,969 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:163 - SB_GET: https://annas-archive.org/slow_download/a77823bd2ade21b4f83ba71a9c5eed3a/0/0

2025-07-31 14:54:10,969 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:199 - Getting driver...

2025-07-31 14:54:11,022 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:205 - Display started

2025-07-31 14:54:32,364 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:97 - Bypass attempt 1 / 3

2025-07-31 14:54:32,365 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:102 - Waiting 0s before trying...

2025-07-31 14:54:46,611 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:108 - Bypass failed.

2025-07-31 14:54:46,642 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:97 - Bypass attempt 2 / 3

2025-07-31 14:54:46,643 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:102 - Waiting 5s before trying...

2025-07-31 14:55:05,801 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:108 - Bypass failed.

2025-07-31 14:55:05,831 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:97 - Bypass attempt 3 / 3

2025-07-31 14:55:05,831 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:102 - Waiting 10s before trying...

From the bypass docker:

INFO: Started server process [8]

INFO: Waiting for application startup.

INFO: Application startup complete.

INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)

INFO: Started server process [8]

INFO: Waiting for application startup.

INFO: Application startup complete.

INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)

INFO: 192.168.1.124:59490 - "GET / HTTP/1.1" 404 Not Found

INFO: 192.168.1.124:59491 - "GET / HTTP/1.1" 404 Not Found

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

Account

Navigation

Search

Search

Configure browser push notifications

Chrome (Android)
  1. Tap the lock icon next to the address bar.
  2. Tap Permissions → Notifications.
  3. Adjust your preference.
Chrome (Desktop)
  1. Click the padlock icon in the address bar.
  2. Select Site settings.
  3. Find Notifications and adjust your preference.