Skip to content
View in the app

A better way to browse. Learn more.

Unraid

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.

[Support] Nodiaque - Calibre-Web-Automated-Book-Downloader

Featured Replies

  • Author

Weird, just tried on my side and no problem

2025-07-31 10:28:00,707 - downloader - INFO - downloader.py:44 - GET: https://annas-archive.org/search?index=&page=1&display=table&acc=aa_download&acc=external_download&ext=epub&ext=mobi&ext=azw3&ext=fb2&ext=djvu&ext=cbz&ext=cbr&q=dungeon%20crawler%20carl&lang=en

2025-07-31 10:28:04,869 - downloader - INFO - downloader.py:44 - GET: https://annas-archive.org/md5/ecc11c5da4e45a320d46a58b28c2b8eb

2025-07-31 10:28:06,594 - backend - INFO - backend.py:68 - Book queued: Dungeon Crawler Carl

2025-07-31 10:28:07,415 - downloader - INFO - downloader.py:44 - GET: https://annas-archive.org/slow_download/ecc11c5da4e45a320d46a58b28c2b8eb/0/2

2025-07-31 10:28:07,482 - downloader - WARNING - downloader.py:64 - 403 detected for URL: https://annas-archive.org/slow_download/ecc11c5da4e45a320d46a58b28c2b8eb/0/2. Should retry using cloudflare bypass.

2025-07-31 10:28:07,483 - downloader - INFO - downloader.py:36 - GET Using Cloudflare Bypasser for: https://annas-archive.org/slow_download/ecc11c5da4e45a320d46a58b28c2b8eb/0/2

2025-07-31 10:28:07,483 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:162 - SB_GET: https://annas-archive.org/slow_download/ecc11c5da4e45a320d46a58b28c2b8eb/0/2

2025-07-31 10:28:07,483 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:198 - Getting driver...

2025-07-31 10:28:07,665 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:204 - Display started

2025-07-31 10:28:28,921 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:97 - Bypass attempt 1 / 3

2025-07-31 10:28:28,921 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:102 - Waiting 0s before trying...

2025-07-31 10:28:36,611 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:168 - Bypass successful.

2025-07-31 10:28:36,660 - book_manager - INFO - book_manager.py:331 - Downloading Dungeon Crawler Carl from https://momot.rs/d3/y/1753979314/10000/g4/libgenli_fiction/libgenli_fiction/2821000/ecc11c5da4e45a320d46a58b28c2b8eb.epub~/Rx9L7dwouGT-iJCPYJfNeA/Dungeon%20Crawler%20Carl%20--%20Dinniman%2C%20Matt%20--%202020%20--%20Dandy%20House%20--%20ecc11c5da4e45a320d46a58b28c2b8eb%20--%20Anna%E2%80%99s%20Archive.epub

2025-07-31 10:28:36,661 - downloader - INFO - downloader.py:84 - Downloading from: https://momot.rs/d3/y/1753979314/10000/g4/libgenli_fiction/libgenli_fiction/2821000/ecc11c5da4e45a320d46a58b28c2b8eb.epub~/Rx9L7dwouGT-iJCPYJfNeA/Dungeon%20Crawler%20Carl%20--%20Dinniman%2C%20Matt%20--%202020%20--%20Dandy%20House%20--%20ecc11c5da4e45a320d46a58b28c2b8eb%20--%20Anna%E2%80%99s%20Archive.epub

Downloading: 100%|█████████▉| 1.15M/1.15M [01:01<00:00, 18.7kB/s]

2025-07-31 10:29:39,598 - book_manager - INFO - book_manager.py:336 - Download finished. Writing to /tmp/cwa-book-downloader/ecc11c5da4e45a320d46a58b28c2b8eb.epub

2025-07-31 10:29:39,599 - book_manager - INFO - book_manager.py:339 - Writing Dungeon Crawler Carl successfully

2025-07-31 10:29:39,600 - backend - INFO - backend.py:143 - Moving book to ingest directory then renaming: /tmp/cwa-book-downloader/ecc11c5da4e45a320d46a58b28c2b8eb.epub -> /cwa-book-ingest/ecc11c5da4e45a320d46a58b28c2b8eb.crdownload -> /cwa-book-ingest/ecc11c5da4e45a320d46a58b28c2b8eb.epub

2025-07-31 10:29:39,603 - backend - INFO - backend.py:150 - Renaming book: /cwa-book-ingest/ecc11c5da4e45a320d46a58b28c2b8eb.crdownload -> /cwa-book-ingest/ecc11c5da4e45a320d46a58b28c2b8eb.epub

2025-07-31 10:29:39,604 - backend - INFO - backend.py:178 - Book ecc11c5da4e45a320d46a58b28c2b8eb download successful

But I just made a test. I close the scraper docker and downloaded another book. And it work, even the bypass worked:

2025-07-31 10:32:46,495 - downloader - INFO - downloader.py:44 - GET: https://annas-archive.org/md5/9f03951ed3eca60c23430c21fe317007

2025-07-31 10:32:48,038 - backend - INFO - backend.py:68 - Book queued: This Inevitable Ruin: Dungeon Crawler Carl Book 7

2025-07-31 10:32:48,937 - downloader - INFO - downloader.py:44 - GET: https://annas-archive.org/slow_download/9f03951ed3eca60c23430c21fe317007/0/2

2025-07-31 10:32:48,999 - downloader - WARNING - downloader.py:64 - 403 detected for URL: https://annas-archive.org/slow_download/9f03951ed3eca60c23430c21fe317007/0/2. Should retry using cloudflare bypass.

2025-07-31 10:32:48,999 - downloader - INFO - downloader.py:36 - GET Using Cloudflare Bypasser for: https://annas-archive.org/slow_download/9f03951ed3eca60c23430c21fe317007/0/2

2025-07-31 10:32:48,999 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:162 - SB_GET: https://annas-archive.org/slow_download/9f03951ed3eca60c23430c21fe317007/0/2

2025-07-31 10:32:49,000 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:198 - Getting driver...

2025-07-31 10:32:59,326 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:168 - Bypass successful.

2025-07-31 10:32:59,372 - book_manager - INFO - book_manager.py:331 - Downloading This Inevitable Ruin: Dungeon Crawler Carl Book 7 from https://momot.rs/d3/y/1753979569/10000/g6/zlib3_files/20241217/annas_archive_data__aacid__zlib3_files__20241217T170647Z--20241217T170648Z/aacid__zlib3_files__20241217T170647Z__40331984__aiZQucgoWg6pvqbE6tsFiG~/HFSL2VS9DoXgt7-64dyx8A/This%20Inevitable%20Ruin%3A%20Dungeon%20Crawler%20Carl%20Book%207%20--%20Matt%20Dinniman%20--%20Dungeon%20Crawler%20Carl%2C%202024%20--%20Dandy%20House%20--%209f03951ed3eca60c23430c21fe317007%20--%20Anna%E2%80%99s%20Archive.epub

2025-07-31 10:32:59,372 - downloader - INFO - downloader.py:84 - Downloading from: https://momot.rs/d3/y/1753979569/10000/g6/zlib3_files/20241217/annas_archive_data__aacid__zlib3_files__20241217T170647Z--20241217T170648Z/aacid__zlib3_files__20241217T170647Z__40331984__aiZQucgoWg6pvqbE6tsFiG~/HFSL2VS9DoXgt7-64dyx8A/This%20Inevitable%20Ruin%3A%20Dungeon%20Crawler%20Carl%20Book%207%20--%20Matt%20Dinniman%20--%20Dungeon%20Crawler%20Carl%2C%202024%20--%20Dandy%20House%20--%209f03951ed3eca60c23430c21fe317007%20--%20Anna%E2%80%99s%20Archive.epub

Downloading: 34%|███▍ | 1.17M/3.46M [00:57<01:55, 19.9kB/s]

When looking at the github, there's no mention of the scrapper anymore. I remember that I opened a case a long time ago and the creator was saying it was working on removing the scrapper. I must revisit the template for that docker, the scrapper seems useless now

Edited by Nodiaque

So do you just set CLOUDFLARE_PROXY_URL to an empty field then? What about  USE_CF_BYPASS?

If you search for the book in my query (one page back: The Ministry of Time) does it work for you?

Edited by SteamedLobster

  • Author

Unsure if it's the exact same but it's downloading:

2025-07-31 21:27:07,109 - backend - INFO - backend.py:68 - Book queued: The Ministry of Time

2025-07-31 21:27:09,878 - downloader - INFO - downloader.py:44 - GET: https://annas-archive.org/slow_download/a77823bd2ade21b4f83ba71a9c5eed3a/0/2

2025-07-31 21:27:09,923 - downloader - WARNING - downloader.py:64 - 403 detected for URL: https://annas-archive.org/slow_download/a77823bd2ade21b4f83ba71a9c5eed3a/0/2. Should retry using cloudflare bypass.

2025-07-31 21:27:09,924 - downloader - INFO - downloader.py:36 - GET Using Cloudflare Bypasser for: https://annas-archive.org/slow_download/a77823bd2ade21b4f83ba71a9c5eed3a/0/2

2025-07-31 21:27:09,924 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:162 - SB_GET: https://annas-archive.org/slow_download/a77823bd2ade21b4f83ba71a9c5eed3a/0/2

2025-07-31 21:27:09,924 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:198 - Getting driver...

2025-07-31 21:27:10,118 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:204 - Display started

2025-07-31 21:27:31,401 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:97 - Bypass attempt 1 / 3

2025-07-31 21:27:31,402 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:102 - Waiting 0s before trying...

2025-07-31 21:27:38,925 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:168 - Bypass successful.

2025-07-31 21:27:38,961 - book_manager - INFO - book_manager.py:331 - Downloading The Ministry of Time from https://momot.rs/d3/y/1754018857/10000/g3/zlib3_files/20240807/annas_archive_data__aacid__zlib3_files__20240807T222128Z--20240807T222129Z/aacid__zlib3_files__20240807T222128Z__28542083__4D4gwcaVXYxTRSiiGMLpgs~/qflLY91fU_cVO-gp9oMYOw/The%20Ministry%20of%20Time%20--%20Kaliane%20Bradley%20--%202024%20--%20Avid%20Reader%20Press%20%2F%20Simon%20%26%20Schuster%20--%20a77823bd2ade21b4f83ba71a9c5eed3a%20--%20Anna%E2%80%99s%20Archive.epub

2025-07-31 21:27:38,961 - downloader - INFO - downloader.py:84 - Downloading from: https://momot.rs/d3/y/1754018857/10000/g3/zlib3_files/20240807/annas_archive_data__aacid__zlib3_files__20240807T222128Z--20240807T222129Z/aacid__zlib3_files__20240807T222128Z__28542083__4D4gwcaVXYxTRSiiGMLpgs~/qflLY91fU_cVO-gp9oMYOw/The%20Ministry%20of%20Time%20--%20Kaliane%20Bradley%20--%202024%20--%20Avid%20Reader%20Press%20%2F%20Simon%20%26%20Schuster%20--%20a77823bd2ade21b4f83ba71a9c5eed3a%20--%20Anna%E2%80%99s%20Archive.epub

Downloading: 65%|██████▍ | 2.91M/4.51M [01:18<00:42, 37.2kB/s]

I'm checking the original project. The bypass is now built-in. I still have the CLOUDFLARE_PROXY_URL set and USE_CF_BYPASS to true. If USE_CF_BYPASS: is set to false, it will use alternative address (for when you are member of AA). I'll check the new config and update my template. Also, I'll remove the scrapper docker which isn't needed anymore (mine is offline currently and download work no problem)

  • Author

I've updated the template and added a note to remove the cloudfare bypass scrapper docker. I also added the new variable now available for the docker

Edited by Nodiaque

Same issue for me - I disabled the use of the cloudfare bypass but book still doesn't download. From your log above looks like you're still using a cloudfare bypass?

2025-08-01 08:41:33,781 - backend - INFO - backend.py:159 - Starting download loop

2025-08-01 08:42:08,515 - downloader - INFO - downloader.py:44 - GET: https://annas-archive.org/search?index=&page=1&display=table&acc=aa_download&acc=external_download&ext=epub&ext=mobi&ext=azw3&ext=fb2&ext=djvu&ext=cbz&ext=cbr&q=ministry%20of%20time&lang=en

2025-08-01 08:42:17,666 - downloader - INFO - downloader.py:44 - GET: https://annas-archive.org/md5/a77823bd2ade21b4f83ba71a9c5eed3a

2025-08-01 08:42:19,608 - backend - INFO - backend.py:68 - Book queued: The Ministry of Time

2025-08-01 08:42:23,843 - downloader - INFO - downloader.py:44 - GET: https://z-lib.fm/md5/a77823bd2ade21b4f83ba71a9c5eed3a

2025-08-01 08:42:25,900 - book_manager - INFO - book_manager.py:331 - Downloading The Ministry of Time from https://z-lib.fm/dl/28542083/dea65c

2025-08-01 08:42:25,901 - downloader - INFO - downloader.py:84 - Downloading from: https://z-lib.fm/dl/28542083/dea65c

2025-08-01 08:42:27,148 - downloader - WARNING - downloader.py:107 - Failed to download content for https://z-lib.fm/dl/28542083/dea65c. Found HTML content instead.

2025-08-01 08:42:27,151 - backend - INFO - backend.py:178 - Book a77823bd2ade21b4f83ba71a9c5eed3a download failed

Edited by SteamedLobster

I set the BYPASS value back to TRUE with the cloudfare bypass docker being used and now it worked. I think the bypass docker is still needed and the template still needs the option to point to that docker (looks like the new template has removed it)....

2025-08-01 08:46:39,199 - backend - INFO - backend.py:159 - Starting download loop

2025-08-01 08:50:06,589 - downloader - INFO - downloader.py:44 - GET: https://annas-archive.org/search?index=&page=1&display=table&acc=aa_download&acc=external_download&ext=epub&ext=mobi&ext=azw3&ext=fb2&ext=djvu&ext=cbz&ext=cbr&q=ministry%20of%20time&lang=en

2025-08-01 08:50:13,134 - downloader - INFO - downloader.py:44 - GET: https://annas-archive.org/md5/a77823bd2ade21b4f83ba71a9c5eed3a

2025-08-01 08:50:15,103 - backend - INFO - backend.py:68 - Book queued: The Ministry of Time

2025-08-01 08:50:19,403 - downloader - INFO - downloader.py:44 - GET: https://annas-archive.org/slow_download/a77823bd2ade21b4f83ba71a9c5eed3a/0/2

2025-08-01 08:50:19,639 - downloader - WARNING - downloader.py:64 - 403 detected for URL: https://annas-archive.org/slow_download/a77823bd2ade21b4f83ba71a9c5eed3a/0/2. Should retry using cloudflare bypass.

2025-08-01 08:50:19,640 - downloader - INFO - downloader.py:36 - GET Using Cloudflare Bypasser for: https://annas-archive.org/slow_download/a77823bd2ade21b4f83ba71a9c5eed3a/0/2

2025-08-01 08:50:19,640 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:162 - SB_GET: https://annas-archive.org/slow_download/a77823bd2ade21b4f83ba71a9c5eed3a/0/2

2025-08-01 08:50:19,641 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:198 - Getting driver...

2025-08-01 08:50:19,768 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:204 - Display started

2025-08-01 08:50:40,992 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:97 - Bypass attempt 1 / 3

2025-08-01 08:50:40,992 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:102 - Waiting 0s before trying...

2025-08-01 08:50:48,653 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:168 - Bypass successful.

2025-08-01 08:50:48,694 - book_manager - INFO - book_manager.py:331 - Downloading The Ministry of Time from https://momot.rs/d3/y/1754041847/10000/g3/zlib3_files/20240807/annas_archive_data__aacid__zlib3_files__20240807T222128Z--20240807T222129Z/aacid__zlib3_files__20240807T222128Z__28542083__4D4gwcaVXYxTRSiiGMLpgs~/ogEhOYdV7UzmpUhPUf9QSQ/The%20Ministry%20of%20Time%20--%20Kaliane%20Bradley%20--%202024%20--%20Avid%20Reader%20Press%20%2F%20Simon%20%26%20Schuster%20--%20a77823bd2ade21b4f83ba71a9c5eed3a%20--%20Anna%E2%80%99s%20Archive.epub

2025-08-01 08:50:48,694 - downloader - INFO - downloader.py:84 - Downloading from: https://momot.rs/d3/y/1754041847/10000/g3/zlib3_files/20240807/annas_archive_data__aacid__zlib3_files__20240807T222128Z--20240807T222129Z/aacid__zlib3_files__20240807T222128Z__28542083__4D4gwcaVXYxTRSiiGMLpgs~/ogEhOYdV7UzmpUhPUf9QSQ/The%20Ministry%20of%20Time%20--%20Kaliane%20Bradley%20--%202024%20--%20Avid%20Reader%20Press%20%2F%20Simon%20%26%20Schuster%20--%20a77823bd2ade21b4f83ba71a9c5eed3a%20--%20Anna%E2%80%99s%20Archive.epub

  • Author

The value for use cloud flare bypass must be true if you don't have AA key. What is not needed is the scrapper docker. The current version of downloader have a cloud flare bypass include.

If you check the information in the template, it says that if you put bypass off, it will use the AA donator key or the alternate url that you can put in another key. If you have neither of those, you must put the value to true.

But the scrapper docker isn't needed. There's not even a value anymore used to point to it.

Edit

Also if cloud flare bypass isn't enable, you don't have a AA donator key nor alternative url, it by default tried zlib and a other website as alternative. These have way less stuff and you'll get often error.

Edited by Nodiaque

Thanks - Yes I don't have a AA donator key....

Confirming that works. I stopped the CloudflareBypassForScraping docker and then edited the template to completely remove the "CLOUDFLARE_PROXY_URL" variable while keeping the "USE_CF_BYPASS" to "true" and looks like its still doing the bypass and working!

2025-08-01 12:43:57,439 - backend - INFO - backend.py:159 - Starting download loop

2025-08-01 12:45:09,069 - downloader - INFO - downloader.py:44 - GET: https://annas-archive.org/search?index=&page=1&display=table&acc=aa_download&acc=external_download&ext=epub&ext=mobi&ext=azw3&ext=fb2&ext=djvu&ext=cbz&ext=cbr&q=The%20Housemaid&lang=en

2025-08-01 12:45:18,076 - downloader - INFO - downloader.py:44 - GET: https://annas-archive.org/md5/3b6f9c0f1665c4ba6e3214d43c37e1de

2025-08-01 12:45:20,105 - backend - INFO - backend.py:68 - Book queued: The Housemaid: An absolutely addictive psychological thriller with a jaw-dropping twist

2025-08-01 12:45:22,526 - downloader - INFO - downloader.py:44 - GET: https://annas-archive.org/slow_download/3b6f9c0f1665c4ba6e3214d43c37e1de/1/2

2025-08-01 12:45:22,758 - downloader - WARNING - downloader.py:64 - 403 detected for URL: https://annas-archive.org/slow_download/3b6f9c0f1665c4ba6e3214d43c37e1de/1/2. Should retry using cloudflare bypass.

2025-08-01 12:45:22,759 - downloader - INFO - downloader.py:36 - GET Using Cloudflare Bypasser for: https://annas-archive.org/slow_download/3b6f9c0f1665c4ba6e3214d43c37e1de/1/2

2025-08-01 12:45:22,760 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:162 - SB_GET: https://annas-archive.org/slow_download/3b6f9c0f1665c4ba6e3214d43c37e1de/1/2

2025-08-01 12:45:22,760 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:198 - Getting driver...

2025-08-01 12:45:22,887 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:204 - Display started

2025-08-01 12:45:44,089 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:97 - Bypass attempt 1 / 3

2025-08-01 12:45:44,090 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:102 - Waiting 0s before trying...

2025-08-01 12:45:51,728 - cloudflare_bypasser - INFO - cloudflare_bypasser.py:168 - Bypass successful.

2025-08-01 12:45:51,764 - book_manager - INFO - book_manager.py:331 - Downloading The Housemaid: An absolutely addictive psychological thriller with a jaw-dropping twist from https://momot.rs/d3/y/1754055950/10000/g4/libgenli_fiction/libgenli_fiction/3487000/3b6f9c0f1665c4ba6e3214d43c37e1de.epub~/GJRkZIIvR6jOi_XCjYWtAw/The%20Housemaid%3A%20An%20absolutely%20addictive%20psychological%20--%20Freida%20McFadden%20--%20London%2C%202022%20--%20Bookouture%20--%209781803144375%20--%203b6f9c0f1665c4ba6e3214d43c37e1de%20--%20Anna%E2%80%99s%20Archive.epub

2025-08-01 12:45:51,765 - downloader - INFO - downloader.py:84 - Downloading from: https://momot.rs/d3/y/1754055950/10000/g4/libgenli_fiction/libgenli_fiction/3487000/3b6f9c0f1665c4ba6e3214d43c37e1de.epub~/GJRkZIIvR6jOi_XCjYWtAw/The%20Housemaid%3A%20An%20absolutely%20addictive%20psychological%20--%20Freida%20McFadden%20--%20London%2C%202022%20--%20Bookouture%20--%209781803144375%20--%203b6f9c0f1665c4ba6e3214d43c37e1de%20--%20Anna%E2%80%99s%20Archive.epub

Downloading: 420kB [00:16, 25.4kB/s]

2025-08-01 12:46:09,308 - book_manager - INFO - book_manager.py:336 - Download finished. Writing to /tmp/cwa-book-downloader/3b6f9c0f1665c4ba6e3214d43c37e1de.epub

2025-08-01 12:46:09,309 - book_manager - INFO - book_manager.py:339 - Writing The Housemaid: An absolutely addictive psychological thriller with a jaw-dropping twist successfully

2025-08-01 12:46:09,309 - backend - INFO - backend.py:143 - Moving book to ingest directory then renaming: /tmp/cwa-book-downloader/3b6f9c0f1665c4ba6e3214d43c37e1de.epub -> /cwa-book-ingest/3b6f9c0f1665c4ba6e3214d43c37e1de.crdownload -> /cwa-book-ingest/3b6f9c0f1665c4ba6e3214d43c37e1de.epub

2025-08-01 12:46:09,311 - backend - INFO - backend.py:150 - Renaming book: /cwa-book-ingest/3b6f9c0f1665c4ba6e3214d43c37e1de.crdownload -> /cwa-book-ingest/3b6f9c0f1665c4ba6e3214d43c37e1de.epub

2025-08-01 12:46:09,312 - backend - INFO - backend.py:178 - Book 3b6f9c0f1665c4ba6e3214d43c37e1de download successful

  • 5 weeks later...

Hi everyone. I had this docker working fine and now it crashes on startup. I've attached logs below. Anyone have any ideas? I checked all of my paths and everything looks AOK

text error warn system array login

[2025-08-30 10:55:40 -0700] [52] [INFO] Starting gunicorn 23.0.0

[2025-08-30 10:55:40 -0700] [52] [INFO] Listening at: http://0.0.0.0:8084 (52)

[2025-08-30 10:55:40 -0700] [52] [INFO] Using worker: sync

[2025-08-30 10:55:40 -0700] [53] [INFO] Booting worker with pid: 53

[2025-08-30 10:55:40 -0700] [53] [ERROR] Exception in worker process

Traceback (most recent call last):

File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 608, in spawn_worker

worker.init_process()

File "/usr/local/lib/python3.10/site-packages/gunicorn/workers/base.py", line 135, in init_process

self.load_wsgi()

File "/usr/local/lib/python3.10/site-packages/gunicorn/workers/base.py", line 147, in load_wsgi

self.wsgi = self.app.wsgi()

File "/usr/local/lib/python3.10/site-packages/gunicorn/app/base.py", line 66, in wsgi

self.callable = self.load()

File "/usr/local/lib/python3.10/site-packages/gunicorn/app/wsgiapp.py", line 57, in load

return self.load_wsgiapp()

File "/usr/local/lib/python3.10/site-packages/gunicorn/app/wsgiapp.py", line 47, in load_wsgiapp

return util.import_app(self.app_uri)

File "/usr/local/lib/python3.10/site-packages/gunicorn/util.py", line 370, in import_app

mod = importlib.import_module(module)

File "/usr/local/lib/python3.10/importlib/__init__.py", line 126, in import_module

return bootstrap.gcd_import(name[level:], package, level)

File "<frozen importlib._bootstrap>", line 1050, in gcdimport

File "<frozen importlib._bootstrap>", line 1027, in findand_load

File "<frozen importlib._bootstrap>", line 1006, in findand_load_unlocked

File "<frozen importlib._bootstrap>", line 688, in loadunlocked

File "<frozen importlib._bootstrap_external>", line 883, in exec_module

File "<frozen importlib._bootstrap>", line 241, in callwith_frames_removed

File "/app/app.py", line 17, in <module>

import backend

File "/app/backend.py", line 14, in <module>

import book_manager

File "/app/book_manager.py", line 9, in <module>

import downloader

File "/app/downloader.py", line 16, in <module>

import cloudflare_bypasser

File "/app/cloudflare_bypasser.py", line 13, in <module>

from seleniumbase import Driver

ImportError: cannot import name 'Driver' from 'seleniumbase' (/usr/local/lib/python3.10/site-packages/seleniumbase/__init__.py)

[2025-08-30 10:55:40 -0700] [53] [INFO] Worker exiting (pid: 53)

[2025-08-30 10:55:40 -0700] [52] [ERROR] Worker (pid:53) exited with code 3

[2025-08-30 10:55:40 -0700] [52] [ERROR] Shutting down: Master

[2025-08-30 10:55:40 -0700] [52] [ERROR] Reason: Worker failed to boot.

Changing ownership of /app to appuser:100

Changing ownership of /var/log/cwa-book-downloader to appuser:100

Changing ownership of /tmp/cwa-book-downloader to appuser:100

Test write to /cwa-book-ingest by appuser: true

Folder /cwa-book-ingest is writable, no need to change ownership

Test write to /cwa-book-ingest by appuser: true

Verifying /tmp has enough space

Success: /tmp is writable

Running command: 'gunicorn -t 300 -b 0.0.0.0:8084 app:app' as 'appuser' in 'prod' mode

2025-08-30 10:55:40,493 - config - INFO - config.py:15 - os: <module 'os' from '/usr/local/lib/python3.10/os.py'>

2025-08-30 10:55:40,493 - config - INFO - config.py:15 - Path: <class 'pathlib.Path'>

2025-08-30 10:55:40,494 - config - INFO - config.py:15 - string_to_bool: <function string_to_bool at 0x14a9b1e7e7a0>

2025-08-30 10:55:40,494 - config - INFO - config.py:15 - CWA_DB: None

2025-08-30 10:55:40,495 - config - INFO - config.py:15 - CWA_DB_PATH: None

2025-08-30 10:55:40,495 - config - INFO - config.py:15 - LOG_ROOT: /var/log

2025-08-30 10:55:40,495 - config - INFO - config.py:15 - LOG_DIR: /var/log/cwa-book-downloader

2025-08-30 10:55:40,495 - config - INFO - config.py:15 - TMP_DIR: /tmp/cwa-book-downloader

2025-08-30 10:55:40,496 - config - INFO - config.py:15 - INGEST_DIR: /cwa-book-ingest

2025-08-30 10:55:40,496 - config - INFO - config.py:15 - STATUS_TIMEOUT: 3600

2025-08-30 10:55:40,496 - config - INFO - config.py:15 - USE_BOOK_TITLE: False

2025-08-30 10:55:40,496 - config - INFO - config.py:15 - MAX_RETRY: 3

2025-08-30 10:55:40,496 - config - INFO - config.py:15 - DEFAULT_SLEEP: 5

2025-08-30 10:55:40,497 - config - INFO - config.py:15 - USE_CF_BYPASS: True

2025-08-30 10:55:40,497 - config - INFO - config.py:15 - HTTP_PROXY:

2025-08-30 10:55:40,497 - config - INFO - config.py:15 - HTTPS_PROXY:

2025-08-30 10:55:40,498 - config - INFO - config.py:15 - AA_DONATOR_KEY:

2025-08-30 10:55:40,498 - config - INFO - config.py:15 - FLASK_HOST: 0.0.0.0

2025-08-30 10:55:40,498 - config - INFO - config.py:15 - FLASK_PORT: 8084

2025-08-30 10:55:40,498 - config - INFO - config.py:15 - DEBUG: False

2025-08-30 10:55:40,498 - config - INFO - config.py:15 - LOG_LEVEL: INFO

2025-08-30 10:55:40,499 - config - INFO - config.py:15 - ENABLE_LOGGING: True

2025-08-30 10:55:40,499 - config - INFO - config.py:15 - MAIN_LOOP_SLEEP_TIME: 5

2025-08-30 10:55:40,499 - config - INFO - config.py:15 - DOCKERMODE: True

2025-08-30 10:55:40,499 - config - INFO - config.py:15 - USE_DOH: False

2025-08-30 10:55:40,500 - config - INFO - config.py:15 - BYPASS_RELEASE_INACTIVE_MIN: 5

2025-08-30 10:55:40,500 - config - INFO - config.py:15 - APP_ENV: prod

2025-08-30 10:55:40,500 - config - INFO - config.py:15 - LOG_FILE: /var/log/cwa-book-downloader/cwa-book-downloader.log

2025-08-30 10:55:40,500 - config - INFO - config.py:15 - USING_TOR: False

2025-08-30 10:55:40,501 - config - INFO - config.py:22 - BASE_DIR: /app

2025-08-30 10:55:40,501 - config - INFO - config.py:31 - STAT TMP_DIR: os.stat_result(st_mode=16877, st_ino=25849, st_dev=127, st_nlink=1, st_uid=99, st_gid=100, st_size=0, st_atime=1755622823, st_mtime=1755622823, st_ctime=1756576538)

2025-08-30 10:55:40,501 - config - INFO - config.py:32 - STAT INGEST_DIR: os.stat_result(st_mode=16895, st_ino=12666373952199551, st_dev=47, st_nlink=1, st_uid=99, st_gid=100, st_size=0, st_atime=1751807727, st_mtime=1756576538, st_ctime=1756576538)

2025-08-30 10:55:40,502 - config - INFO - config.py:33 - CROSS_FILE_SYSTEM: True

2025-08-30 10:55:40,502 - config - INFO - config.py:53 - CUSTOM_DNS: []

2025-08-30 10:55:40,502 - config - INFO - config.py:59 - DOH_SERVER:

2025-08-30 10:55:40,502 - config - INFO - config.py:67 - PROXIES: {}

2025-08-30 10:55:40,503 - config - INFO - config.py:77 - SUPPORTED_FORMATS: ['epub', 'mobi', 'azw3', 'fb2', 'djvu', 'cbz', 'cbr']

2025-08-30 10:55:40,624 - network - INFO - network.py:337 - AA_BASE_URL: https://annas-archive.org

Press ANY KEY to close this window

  • Author

Hello,

I suggest you go at the Github since this docker is not maintained by me. Sometime the owner does update that break stuff.

I also updated the template sometime ago. I think I posted the changes either in the beginning or somewhere in the thread.

I know there was a bug with cloudflare not long ago the owner created and fixed.

  • 3 months later...

downloaded book not importing

I think I have everything set up correctly. CW and CWA both installed and we interface working. CWABD searches work and files download but they don't get imported. I see them in an "available" list and i can click the link to download to my PC, but they are not being imported into the Calibre library.

Log say files are downloaded to /tmp/cwa-book-downloader but if i look in that directory, they are not there.


What am i missing?

  • Author

The path /tmp/cwa-book-downloader isn't used by the container. Maybe during the download process, but file once downloaded are put in the container folder /cwa-book-ingest which should align with the import path from Calibre-Web-Automated (which is also mapped to /cwa-book-ingest). If you import manually a book in the webgui of Calibre-Web-Automated, does it work? If yes, if you add a book into the import folder, does it work?

Just to be sure, you say you have CW and CWA (so Calibre-Web and Calibre-Web-Automated)? You don't need both, Calibre-Web-Automated have a WebGUI. You do need Calibre for the database and then CWA to automate stuff on top of it, and that CWA Book Download to automate book download and import.

16 hours ago, Nodiaque said:

The path /tmp/cwa-book-downloader isn't used by the container. Maybe during the download process, but file once downloaded are put in the container folder /cwa-book-ingest which should align with the import path from Calibre-Web-Automated (which is also mapped to /cwa-book-ingest). If you import manually a book in the webgui of Calibre-Web-Automated, does it work? If yes, if you add a book into the import folder, does it work?

Just to be sure, you say you have CW and CWA (so Calibre-Web and Calibre-Web-Automated)? You don't need both, Calibre-Web-Automated have a WebGUI. You do need Calibre for the database and then CWA to automate stuff on top of it, and that CWA Book Download to automate book download and import.

Ah - ok, I thought all three were needed (CW, CWA and CWABD) - i'll get rid of CW and take a look at the folders. Thanks for your input.

  • 5 weeks later...

Hey, Forgive me if i am missing something completely obvious trying to set up the settings but cannot add the config volume, I am probably missing the obvious but if there is any advice that would be great.

  • Author

What do you mean you cannot add the config volume?

When I go to settings in the app it says to add the config volume to the docker compose so the settings can be saved. I tried to add a path in the container settings but it appears then deletes itself.

Screenshot 2026-01-02 231832.png

And what host path did you give to that volume? Something valid e.g. a subfolder of your appdata share?

I gave it the same appdata folder that the downloader is set as with an extra folder for the config so it would be

/mnt/user/appdata/calibre-web-automated-book-downloader/config

Screenshot 2026-01-02 233526.png

  • Author

All mapping and config are in the template. What config are you trying to change that is not available in the template? This template use the environment variable to set all the available settings that was available at creation time.

Edit: the reason why it's appearing and disappearing is because the path is already mounted. You need to change the first path in the template called appdata folder. This folder is used for the logging and the apps might be deleting everything in it at startup for clean log. Put it in a subfolder like you did with config instead. I think the program changed, there's was no settings file in the beginning. But using dockers with templates that use env var, you should use the env var.

Edited by Nodiaque

Thank you, I got it to work now, I wasn't trying to change the config just add it as there was no spot in the template and it kept showing a permission error but I moved the first location that was app data to /calibre-web-automated-book-downloader/logs/ and then added a new path config to /calibre-web-automated-book-downloader/config/ and now I have settings that work. Now to work on why it isn't reading my app.db but I will investigate that further. Thank you again for the help I do appreciate it.

  • 2 weeks later...

They released a 1.0 update, and it is now known as Shelfmark will this template be updated, or will there be a new one created for CA?

  • Author
20 hours ago, ignitionnight said:

They released a 1.0 update, and it is now known as Shelfmark will this template be updated, or will there be a new one created for CA?

I'll check but I'll probably publish a new one and discontinued. Since it's another name, it require a new template.

edit: technically, it still work under this name per the release doc:

image.png

I do see many new features added and new mount point. I currently have my original working (it show as shelfmark 1.0.0 in my webgui) so it does update like calibrain said. I'll still make a new updated one that so it follow the new naming scheme

Edited by Nodiaque

  • Author

A new app was created called shelfmark. Support thread here:

While this template is still working and supported by calibrain as a legacy configuration, I strongly suggest moving to the new template. It isn't a direct migration (while you can migrate directly and copying the env var, I suggest looking at the updated way of doing things).

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

Account

Navigation

Search

Search

Configure browser push notifications

Chrome (Android)
  1. Tap the lock icon next to the address bar.
  2. Tap Permissions → Notifications.
  3. Adjust your preference.
Chrome (Desktop)
  1. Click the padlock icon in the address bar.
  2. Select Site settings.
  3. Find Notifications and adjust your preference.