October 12, 20241 yr After the certificate on my mailcow expired, I renewed it and since that, my paperless does not fetch any mails anymore. in the mail of I always get this error: [ERROR] [paperless_mail] Error while retrieving mailbox mailcow: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1006) It seems, that paperless does not notice that the mailcow certificate was renewed already. What can I do? Edited October 14, 20241 yr by ulischultz
October 28, 20241 yr On 4/5/2024 at 7:33 AM, Wallace0815 said: Hello, I installed Paperless NGX under Unraid. Now I get an import error when importing certain PDFs. They are probably signed PDFs. What can I change? Gutschrift-GVG521754.pdf: Error occurred while consuming document Gutschrift-GVG521754.pdf: DigitalSignatureError: Input PDF has a digital signature. OCR would alter the document, invalidating the signature. Did you or anyone else figure this out? I found links elsewhere suggesting we need to add this to our docker compose: PAPERLESS_OCR_USER_ARGS: '{"invalidate_digital_signatures": true}' But as we don't use docker compose with Unraid apps I added it as a variable, both with and without single quotes, but to no avail. Has anyone succeeded in getting this working?
October 28, 20241 yr 16 minutes ago, polishprocessors said: Did you or anyone else figure this out? I found links elsewhere suggesting we need to add this to our docker compose: PAPERLESS_OCR_USER_ARGS: '{"invalidate_digital_signatures": true}' But as we don't use docker compose with Unraid apps I added it as a variable, both with and without single quotes, but to no avail. Has anyone succeeded in getting this working? this is what i have: Config Type: Variable Name: PAPERLESS_OCR_USER_ARGS Key: PAPERLESS_OCR_USER_ARGS Value: {"invalidate_digital_signatures": true, "continue_on_soft_render_error": true}
October 28, 20241 yr Just to make sure I am doing everything right before I change anything: When I want to enable barcode scanning in paperless I can simply edit the docker and add "PAPERLESS_CONSUMER_ENABLE_BARCODES" as a container variable and write "true" in there. Is that how it works?
October 29, 20241 yr Hey ya'll. This is more of a general docker question, but the problem I am having is on paperless-ngx, so here I am. Anyway, I had a working paperless-ngx docker container running. I then when to "edit" the template, and I put in some extra parameters. This caused the updates to fail when I clicked "apply". Now the container is not running, and it is not in the "stopped" state. It's just gone. I know that the data is stored elsewhere, but how do I instantiate the container again without having to re-input all the parameters I had before (since I've now forgotten them).
October 31, 20241 yr Does anyone know how to start the container to make Oauth2 working for Gmail and Office 365 in the new version 2.13?
October 31, 20241 yr Evening All, I went to login to paperless for the fist time in a couple of weeks this evening, and i noticed that the service was stopped. After starting and seeing that the container is stopping almost immediatly, I had a look at the logs, any idea what I can do to fix this? Traceback (most recent call last): File "/usr/src/paperless/src/manage.py", line 10, in <module> execute_from_command_line(sys.argv) File "/usr/local/lib/python3.12/site-packages/django/core/management/__init__.py", line 442, in execute_from_command_line utility.execute() File "/usr/local/lib/python3.12/site-packages/django/core/management/__init__.py", line 436, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/usr/local/lib/python3.12/site-packages/django/core/management/base.py", line 413, in run_from_argv self.execute(*args, **cmd_options) File "/usr/local/lib/python3.12/site-packages/django/core/management/base.py", line 459, in execute output = self.handle(*args, **options) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/django/core/management/base.py", line 107, in wrapper res = handle_func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/django/core/management/commands/migrate.py", line 357, in handle post_migrate_state = executor.migrate( ^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/django/db/migrations/executor.py", line 135, in migrate state = self._migrate_all_forwards( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/django/db/migrations/executor.py", line 167, in _migrate_all_forwards state = self.apply_migration( ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/django/db/migrations/executor.py", line 252, in apply_migration with self.connection.schema_editor( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/django/db/backends/sqlite3/schema.py", line 39, in __exit__ self.connection.check_constraints() File "/usr/local/lib/python3.12/site-packages/django/db/backends/sqlite3/base.py", line 267, in check_constraints violations = cursor.execute("PRAGMA foreign_key_check").fetchall() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/django/db/backends/utils.py", line 79, in execute return self._execute_with_wrappers( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/django/db/backends/utils.py", line 92, in _execute_with_wrappers return executor(sql, params, many, context) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/django/db/backends/utils.py", line 99, in _execute self.db.validate_no_broken_transaction() File "/usr/local/lib/python3.12/site-packages/django/db/backends/base/base.py", line 521, in validate_no_broken_transaction raise TransactionManagementError( django.db.transaction.TransactionManagementError: An error occurred in the current transaction. You can't execute queries until the end of the 'atomic' block. It looks like a database migration issue. but I'm not sure, and have no clue how to fix this. Any help would be appreciated.
November 2, 20241 yr Hello all, is there any chance this program can benefit from Cuda acceleration? I've got a GPU with plenty of spare cycles and a ton of documents to import. CPU-only takes my batches days to process, and it'd be cool to speed it up. Has anyone tried this?
November 3, 20241 yr Is anyone supporting this now? I could really do with fixing the issue. Got a ton of documents to scan, and no way I can see of getting the container to start. Edit: I found getting support much quicker on github. https://github.com/paperless-ngx/ Edited November 5, 20241 yr by karldonteljames
November 8, 20241 yr I set up paperless ngx a while ago and uploaded and categorized quite a lot of docs. for some reason, while the OCR-data and my manual input is still there, the thumbnails aren't and the original files are not. that means. 1. i cannot find them on my share, they are neither in /usr/src/paperless/media (which is my Media-path, but this folder is completely empty in Krusader after clicking on src) ... nor in /mnt/user/appdata/paperless-ngx/data (which is my Data-path) 2. when i try to re-upload the original pdfs, paperless ngx tells me, that they are duplicates of the ones already in my database 3. when i try to download the files in the paperless-entry, I get this error: GET /api/documents/45/download/ HTTP 404 Not Found Allow: GET, HEAD, OPTIONS Content-Type: application/json Vary: Accept { "detail": "Not found." } any suggestions what I might have done wrong or where I could find those darn files or how to re-upload them without having to do all the manual input again? Edited November 8, 20241 yr by besux
November 12, 20241 yr On 10/28/2024 at 11:52 PM, Amr0d said: Just to make sure I am doing everything right before I change anything: When I want to enable barcode scanning in paperless I can simply edit the docker and add "PAPERLESS_CONSUMER_ENABLE_BARCODES" as a container variable and write "true" in there. Is that how it works? Tried that and unfortunately that does abosutly nothing for me On 6/24/2024 at 10:46 AM, Tuetenk0pp said: Do you mean ASN Barcodes as in https://docs.paperless-ngx.com/advanced_usage/#archive-serial-number-assignment? Just set `PAPERLESS_CONSUMER_ENABLE_ASN_BARCODE=TRUE` in your Docker .env file or compose file. You will have to use a supported barcode type (listed here: https://docs.paperless-ngx.com/advanced_usage/#barcodes). I wrote a script to generate some barcodes that I could print on a piece of avery labels (see here: https://github.com/tuetenk0pp/asn-barcodes) and while it works, I am not particularly proud of it I mean the ASN Barcodes (I am not sure if te website to generate my barcodes uses your script) but i printed a few to test them and so far no luck. i did the following: And no where in the config menu i find anything about barcodes, moreover if i scan a document with an ASN Barcode (they start at ASN00001) i can not even find it when i seach for ASN ( this is how my barcode looks scanned in paperless nxg - i [2024-11-12 18:04:29,951] [DEBUG] [paperless.barcodes] Scanning for barcodes using PYZBAR [2024-11-12 18:04:29,963] [DEBUG] [paperless.barcodes] PDF has 10 pages [2024-11-12 18:04:29,965] [DEBUG] [paperless.barcodes] Processing page 0 [2024-11-12 18:04:30,456] [DEBUG] [paperless.barcodes] Image is at /tmp/paperless/tmpz8trx3m9/barcode0m_vynwe/2f44446c-3a9b-4f2e-81b1-0809a1510240-01.ppm [2024-11-12 18:04:30,816] [DEBUG] [paperless.barcodes] Barcode of type QRCODE found: ASN00001 [2024-11-12 18:04:30,830] [DEBUG] [paperless.barcodes] Processing page 1 [2024-11-12 18:04:31,285] [DEBUG] [paperless.barcodes] Image is at /tmp/paperless/tmpz8trx3m9/barcode0m_vynwe/1398c1de-bf26-4dce-be36-bf9fc772c047-02.ppm [2024-11-12 18:04:31,595] [DEBUG] [paperless.barcodes] Processing page 2 [2024-11-12 18:04:32,070] [DEBUG] [paperless.barcodes] Image is at /tmp/paperless/tmpz8trx3m9/barcode0m_vynwe/fd82ac0b-3138-4916-be55-68c0ca9c7bb5-03.ppm [2024-11-12 18:04:32,378] [DEBUG] [paperless.barcodes] Processing page 3 [2024-11-12 18:04:32,819] [DEBUG] [paperless.barcodes] Image is at /tmp/paperless/tmpz8trx3m9/barcode0m_vynwe/5769e749-7f5a-48f8-b44f-3133f9d09baa-04.ppm [2024-11-12 18:04:33,090] [DEBUG] [paperless.barcodes] Processing page 4 [2024-11-12 18:04:33,553] [DEBUG] [paperless.barcodes] Image is at /tmp/paperless/tmpz8trx3m9/barcode0m_vynwe/85e5a079-dc1a-48ea-b2ff-f3c76c093478-05.ppm [2024-11-12 18:04:33,873] [DEBUG] [paperless.barcodes] Barcode of type QRCODE found: ASN00002 [2024-11-12 18:04:33,888] [DEBUG] [paperless.barcodes] Processing page 5 [2024-11-12 18:04:34,293] [DEBUG] [paperless.barcodes] Image is at /tmp/paperless/tmpz8trx3m9/barcode0m_vynwe/27895f78-b551-401f-b86b-953fcc4bb5c5-06.ppm [2024-11-12 18:04:34,462] [DEBUG] [paperless.barcodes] Processing page 6 [2024-11-12 18:04:34,908] [DEBUG] [paperless.barcodes] Image is at /tmp/paperless/tmpz8trx3m9/barcode0m_vynwe/259827d0-7c72-4699-8bce-b70824ba9adb-07.ppm [2024-11-12 18:04:35,152] [DEBUG] [paperless.barcodes] Processing page 7 [2024-11-12 18:04:35,543] [DEBUG] [paperless.barcodes] Image is at /tmp/paperless/tmpz8trx3m9/barcode0m_vynwe/8cbc9e88-0c00-4fc4-8da9-06aa7c567982-08.ppm [2024-11-12 18:04:35,709] [DEBUG] [paperless.barcodes] Processing page 8 [2024-11-12 18:04:36,143] [DEBUG] [paperless.barcodes] Image is at /tmp/paperless/tmpz8trx3m9/barcode0m_vynwe/e2404032-7dfc-4e36-aab9-655603b45fa4-09.ppm [2024-11-12 18:04:36,391] [DEBUG] [paperless.barcodes] Barcode of type QRCODE found: ASN00003 [2024-11-12 18:04:36,406] [DEBUG] [paperless.barcodes] Processing page 9 [2024-11-12 18:04:36,823] [DEBUG] [paperless.barcodes] Image is at /tmp/paperless/tmpz8trx3m9/barcode0m_vynwe/f357a339-4b03-468b-8bbd-5c923c5c87e3-10.ppm [2024-11-12 18:04:36,995] [INFO] [paperless.tasks] BarcodePlugin completed with no message The weird thing is the logs tell me they have found the barcode..... but have not split the document....why not? <<insert zoidberg.gif>> Edited November 12, 20241 yr by Zeze21 Zoidberg
November 12, 20241 yr 4 hours ago, Zeze21 said: I mean the ASN Barcodes 4 hours ago, Zeze21 said: i did the following: And no where in the config menu i find anything about barcodes, moreover if i scan a document with an ASN Barcode (they start at ASN00001) i can not even find it when i seach for ASN ( this is how my barcode looks scanned in paperless nxg - i @Zeze21 you got confused with two different settings: you enabled document splitting but not the ASN assignment. From the official documentation: Quote Document Splitting When enabled, Paperless will look for a barcode with the configured value and create a new document starting from the next page. The page with the barcode on it will not be retained. It is expected to be a page existing only for triggering the split. Archive Serial Number Assignment When enabled, the value of the barcode (as an integer) will be used to set the document's archive serial number, allowing quick reference back to the original, paper document. If document splitting via barcode is also enabled, documents will be split when an ASN barcode is located. However, differing from the splitting, the page with the barcode will be retained. This allows application of a barcode to any page, including one which holds data to keep in the document. So there is actually two different settings for the two different functionalities. They are explained in the configuration documentation: You need to enable both settings for them to a) split documents and b) assign ASN with the same barcode. PAPERLESS_CONSUMER_ENABLE_BARCODES=true PAPERLESS_CONSUMER_ENABLE_ASN_BARCODE=true
December 9, 20241 yr Hi everyone I have a problem with the Barcode Splitting functionality. In the Docker settings, I enabled the following variables: PAPERLESS_CONSUMER_ENABLE_BARCODES: PAPERLESS_CONSUMER_BARCODE_STRING: I then tried to scan the documents with a PATCH T barcode, and with a QR code i found on this page: https://github.com/paperless-ngx/paperless-ngx/discussions/2678 With the PATCH T code, i entered "PATCHT" in the barcode string variable, with the QR Code i entered "paperless:separator". I then tested with 2 documents, but the strange thing is that paperless only consumes the first document, the second document is nowhere. In the Docker Logs i can see the following: [2024-12-09 17:20:16,859] [INFO] [paperless.management.consumer] Adding /usr/src/paperless/consume/Document_20241209_0001.pdf to the task queue. [2024-12-09 17:20:16,922] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[02aec755-4ab6-4221-ada6-b89bd79c0788] received [2024-12-09 17:20:18,446] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[c27d131f-bb0b-45f2-8682-e2376af5a181] received [2024-12-09 17:20:18,446] [INFO] [paperless.barcodes] Created new task c27d131f-bb0b-45f2-8682-e2376af5a181 for Document_20241209_0001_document_0.pdf [2024-12-09 17:20:18,461] [INFO] [paperless.barcodes] Created new task e9a17693-f4d1-4581-b9df-196897d315c9 for Document_20241209_0001_document_1.pdf [2024-12-09 17:20:18,464] [INFO] [paperless.tasks] BarcodePlugin requested task exit: Barcode splitting complete! [2024-12-09 17:20:18,479] [INFO] [celery.app.trace] Task documents.tasks.consume_file[02aec755-4ab6-4221-ada6-b89bd79c0788] succeeded in 1.5541348340921104s: 'Barcode splitting complete!' [2024-12-09 17:20:19,681] [INFO] [paperless.tasks] BarcodePlugin completed with no message [2024-12-09 17:20:19,684] [INFO] [paperless.tasks] WorkflowTriggerPlugin completed with: [2024-12-09 17:20:19,692] [INFO] [paperless.consumer] Consuming Document_20241209_0001_document_0.pdf [2024-12-09 17:20:19,708] [INFO] [paperless.parsing.tesseract] pdftotext exited 0 [2024-12-09 17:20:20,939] [INFO] [ocrmypdf._pipeline] page is facing ⇧, confidence 8.90 - no change [2024-12-09 17:20:22,979] [INFO] [ocrmypdf._pipelines.ocr] Postprocessing... [2024-12-09 17:20:24,901] [INFO] [ocrmypdf._pipeline] Image optimization ratio: 1.00 savings: 0.0% [2024-12-09 17:20:24,902] [INFO] [ocrmypdf._pipeline] Total file size ratio: 0.27 savings: -270.2% [2024-12-09 17:20:24,904] [INFO] [ocrmypdf._pipelines._common] Output file is a PDF/A-2B (as expected) [2024-12-09 17:20:25,624] [INFO] [paperless.parsing] convert exited 0 [2024-12-09 17:20:26,090] [INFO] [paperless.handlers] Assigning correspondent "redacted" to 2022-12-29 Document_20241209_0001_document_0 [2024-12-09 17:20:26,095] [INFO] [paperless.handlers] Assigning document type Rechnung to 2022-12-29 "redacted" Document_20241209_0001_document_0 [2024-12-09 17:20:26,191] [INFO] [paperless.consumer] Document 2022-12-29 "redacted" Document_20241209_0001_document_0 consumption finished [2024-12-09 17:20:26,193] [INFO] [paperless.tasks] ConsumeTaskPlugin completed with: Success. New document id 109 created [2024-12-09 17:20:26,206] [INFO] [celery.app.trace] Task documents.tasks.consume_file[c27d131f-bb0b-45f2-8682-e2376af5a181] succeeded in 7.4470139590557665s: 'Success. New document id 109 created' As far as i understand, the Barcode is being recogniszed, the first document is consumed and created, but with the second document, theres nothing happenig. Does anyone have an idea why this is happening? thank you!
December 10, 20241 yr 20 hours ago, b_tob said: Hi everyone I have a problem with the Barcode Splitting functionality. In the Docker settings, I enabled the following variables: PAPERLESS_CONSUMER_ENABLE_BARCODES: PAPERLESS_CONSUMER_BARCODE_STRING: I then tried to scan the documents with a PATCH T barcode, and with a QR code i found on this page: https://github.com/paperless-ngx/paperless-ngx/discussions/2678 With the PATCH T code, i entered "PATCHT" in the barcode string variable, with the QR Code i entered "paperless:separator". I then tested with 2 documents, but the strange thing is that paperless only consumes the first document, the second document is nowhere. In the Docker Logs i can see the following: [2024-12-09 17:20:16,859] [INFO] [paperless.management.consumer] Adding /usr/src/paperless/consume/Document_20241209_0001.pdf to the task queue. [2024-12-09 17:20:16,922] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[02aec755-4ab6-4221-ada6-b89bd79c0788] received [2024-12-09 17:20:18,446] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[c27d131f-bb0b-45f2-8682-e2376af5a181] received [2024-12-09 17:20:18,446] [INFO] [paperless.barcodes] Created new task c27d131f-bb0b-45f2-8682-e2376af5a181 for Document_20241209_0001_document_0.pdf [2024-12-09 17:20:18,461] [INFO] [paperless.barcodes] Created new task e9a17693-f4d1-4581-b9df-196897d315c9 for Document_20241209_0001_document_1.pdf [2024-12-09 17:20:18,464] [INFO] [paperless.tasks] BarcodePlugin requested task exit: Barcode splitting complete! [2024-12-09 17:20:18,479] [INFO] [celery.app.trace] Task documents.tasks.consume_file[02aec755-4ab6-4221-ada6-b89bd79c0788] succeeded in 1.5541348340921104s: 'Barcode splitting complete!' [2024-12-09 17:20:19,681] [INFO] [paperless.tasks] BarcodePlugin completed with no message [2024-12-09 17:20:19,684] [INFO] [paperless.tasks] WorkflowTriggerPlugin completed with: [2024-12-09 17:20:19,692] [INFO] [paperless.consumer] Consuming Document_20241209_0001_document_0.pdf [2024-12-09 17:20:19,708] [INFO] [paperless.parsing.tesseract] pdftotext exited 0 [2024-12-09 17:20:20,939] [INFO] [ocrmypdf._pipeline] page is facing ⇧, confidence 8.90 - no change [2024-12-09 17:20:22,979] [INFO] [ocrmypdf._pipelines.ocr] Postprocessing... [2024-12-09 17:20:24,901] [INFO] [ocrmypdf._pipeline] Image optimization ratio: 1.00 savings: 0.0% [2024-12-09 17:20:24,902] [INFO] [ocrmypdf._pipeline] Total file size ratio: 0.27 savings: -270.2% [2024-12-09 17:20:24,904] [INFO] [ocrmypdf._pipelines._common] Output file is a PDF/A-2B (as expected) [2024-12-09 17:20:25,624] [INFO] [paperless.parsing] convert exited 0 [2024-12-09 17:20:26,090] [INFO] [paperless.handlers] Assigning correspondent "redacted" to 2022-12-29 Document_20241209_0001_document_0 [2024-12-09 17:20:26,095] [INFO] [paperless.handlers] Assigning document type Rechnung to 2022-12-29 "redacted" Document_20241209_0001_document_0 [2024-12-09 17:20:26,191] [INFO] [paperless.consumer] Document 2022-12-29 "redacted" Document_20241209_0001_document_0 consumption finished [2024-12-09 17:20:26,193] [INFO] [paperless.tasks] ConsumeTaskPlugin completed with: Success. New document id 109 created [2024-12-09 17:20:26,206] [INFO] [celery.app.trace] Task documents.tasks.consume_file[c27d131f-bb0b-45f2-8682-e2376af5a181] succeeded in 7.4470139590557665s: 'Success. New document id 109 created' As far as i understand, the Barcode is being recogniszed, the first document is consumed and created, but with the second document, theres nothing happenig. Does anyone have an idea why this is happening? thank you! I only added these two in my .env file, then it worked. PAPERLESS_CONSUMER_ENABLE_BARCODES=true PAPERLESS_CONSUMER_BARCODE_STRING="PATCHT" Don't know what you meen with "... with the QR Code i entered "paperless:separator". "
January 13, 20251 yr On 4/17/2022 at 6:28 PM, fk_muck1 said: I installed these 2 containers: Repository: gotenberg/gotenberg Repository: apache/tika In Paperless i added these 3 varibles: Name / Key: PAPERLESS_TIKA_ENABLED Value: 1 Name / Key: PAPERLESS_TIKA_ENDPOINT Value: http://IP-of-tika-container:9998 Name / Key: PAPERLESS_TIKA_GOTENBERG_ENDPOINT Value: http://IP-of-gotenberg-container:3000/forms/libreoffice/convert# http:// before IP seems to be important. Only IP didnt work for me. Hope this helpes Hi there, I know it is not the most up to date post, but I ran into issues setting up Gotenberg and TIka and so I thought I just post here what helped me. I used all Containers from the Community Application Add-on. In the end what made thinks work it was the shorter version of the URL for Gotenberg. I followed the offical advice on: https://docs.paperless-ngx.com/configuration/#PAPERLESS_TIKA_GOTENBERG_ENDPOINT but formatted according to Unraid, so I needed to insert my IP of the server instead of "local host" and used the variable PAPERLESS_TIKA_GOTENBERG_ENDPOINT: (as above) instead of PAPERLESS_TIKA_GOTENBERG_ENDPOINT=<url> (as in offical documenttion). So changing to this instead of the longer URL (http://IP-of-gotenberg-container:3000/forms/libreoffice/convert#) was all that is needed.
January 24, 20251 yr Dear forum members, I'm unsure if this is where I need to start, and if not, I hope someone can point me in the right direction as I am at my wits end. I installed TubeArchivist and both associated Docker Containers, TubeArchivist-ES and TubeArchivist-RedisJSON. I already had Redis running as a Docker Container on port 6379 for Paperless-NGX. I did all that I thought necessary to add TubeArchivist-RedisJSON on a separate port, 6389, so there wouldn't be any conflict between the two versions of Redis. I also recently activated two 4TB NVMe drives as cache to my ZFS3 array on Unraid 7.0.0 to speed things up and I did notice an improvement in Paperless-NGX when searching and pulling up documents. After getting TubeArchivist running, everytime I logged into TubeArchivist Web UI, I would get logged out of Paperless-NGX and vice versa. I assume this means that I have done something wrong and that they are both using the same database despite following instructions to install TubeArchivist-RedisJSON on another port. Now, my Paperless-NGX is running much slower that it was before installing TubeArchivist. I uninstalled all 3 TubeArchivist Docker Containers and it is still slow. Please help me get back to the way things were performing before, or better. I am unsure if I even have things setup properly as I overbuilt this system to handle everything that I could possibly throw at it and I feel that I shouldn't have noticed any performance issues. I say this because doing research before building the system with ZFS, I understood to need about 1 gig of RAM per TB of storage, I have 200TB raw disk storage (10 x 20TB) and 2 x 4TB NVMe SSDs for caching, so I installed 256GB of RAM. At this moment, I have 26.6TB of data in my pool and RAM usage is as follows: System: 5.18 GiB ZFS cache: 5.36 GiB Docker: 2.60 GiB Free: 238 GiB I will provide any requested "non-private" information. Thank you for any and all help. Sincerely, Everette Golding
February 18, 20251 yr Hi there, was someone able to add a pre_consume.sh I want to delete empty pages with this script: #!/bin/bash #set -x -e -o pipefail set -e -o pipefail export LC_ALL=C #IN="$1" IN="$DOCUMENT_WORKING_PATH" # Check for PDF format TYPE=$(file -b "$IN") if [ "${TYPE%%,*}" != "PDF document" ]; then >&2 echo "Skipping $IN - non PDF [$TYPE]." exit 0 fi # PDF file - proceed #PAGES=$(pdfinfo "$IN" | grep ^Pages: | tr -dc '0-9') PAGES=$(pdfinfo "$IN" | awk '/Pages:/ {print $2}') >&2 echo Total pages $PAGES # Threshold for HP scanners # THRESHOLD=1 # Threshold for Canon MX925 THRESHOLD=1 non_blank() { for i in $(seq 1 $PAGES) ; do PERCENT=$(gs -o - -dFirstPage=${i} -dLastPage=${i} -sDEVICE=ink_cov "${IN}" | grep CMYK | nawk 'BEGIN { sum=0; } {sum += $1 + $2 + $3 + $4;} END { printf "%.5f\n", sum } ') >&2 echo -n "Color-sum in page $i is $PERCENT: " if awk "BEGIN { exit !($PERCENT > $THRESHOLD) }"; then echo $i >&2 echo "Page added to document" else >&2 echo "Page removed from document" fi done } NON_BLANK=$(non_blank) if [ -n "$NON_BLANK" ]; then NON_BLANK=$(echo $NON_BLANK | tr ' ' ",") qpdf "$IN" --replace-input --pages . $NON_BLANK -- fi but i cannot add this to my docker. Tried several ways but everytime i got errors cannot find the file etc.
February 18, 20251 yr 5 hours ago, Cryd said: Hi there, was someone able to add a pre_consume.sh I want to delete empty pages with this script: #!/bin/bash #set -x -e -o pipefail set -e -o pipefail export LC_ALL=C #IN="$1" IN="$DOCUMENT_WORKING_PATH" # Check for PDF format TYPE=$(file -b "$IN") if [ "${TYPE%%,*}" != "PDF document" ]; then >&2 echo "Skipping $IN - non PDF [$TYPE]." exit 0 fi # PDF file - proceed #PAGES=$(pdfinfo "$IN" | grep ^Pages: | tr -dc '0-9') PAGES=$(pdfinfo "$IN" | awk '/Pages:/ {print $2}') >&2 echo Total pages $PAGES # Threshold for HP scanners # THRESHOLD=1 # Threshold for Canon MX925 THRESHOLD=1 non_blank() { for i in $(seq 1 $PAGES) ; do PERCENT=$(gs -o - -dFirstPage=${i} -dLastPage=${i} -sDEVICE=ink_cov "${IN}" | grep CMYK | nawk 'BEGIN { sum=0; } {sum += $1 + $2 + $3 + $4;} END { printf "%.5f\n", sum } ') >&2 echo -n "Color-sum in page $i is $PERCENT: " if awk "BEGIN { exit !($PERCENT > $THRESHOLD) }"; then echo $i >&2 echo "Page added to document" else >&2 echo "Page removed from document" fi done } NON_BLANK=$(non_blank) if [ -n "$NON_BLANK" ]; then NON_BLANK=$(echo $NON_BLANK | tr ' ' ",") qpdf "$IN" --replace-input --pages . $NON_BLANK -- fi but i cannot add this to my docker. Tried several ways but everytime i got errors cannot find the file etc. Can you specify the steps you've taken? When looking at the documentation here https://docs.paperless-ngx.com/advanced_usage/#consume-hooks it sounds pretty straightforward... 1. add a mount to the scripts folder. 2. add a environment variable for the pre-consume script.
February 24, 20251 yr Hello everyone, I have a problem with my Docker container Paperless-NGX since the last update. The error messages are either “Authentication Required” or “Invalid username, password pair, or user is disabled.” I have already tried the following: • Restored from my Paperless backup • Updated Redis, also using a different repository • Set and reverted passwords for Redis and Paperless Additionally, I have tried: Changing redis://redis:[email protected]:6390 to redis://192.168.10.254:6390 (This has always been my default setup) However, the container still won’t start. Does anyone have an idea what could be causing this issue? Attached are the log file from Paperless and some screenshots of my Docker settings. I’m really desperate at this point and hope that someone here can help me. Thank you in advance! Paperless-ngx docker container starting... Installing languages... Package tesseract-ocr-deu already installed! Package tesseract-ocr-eng already installed! Mapping UID and GID for paperless:paperless to 99:100 Creating directory scratch directory /tmp/paperless mkdir: created directory '/tmp/paperless' Adjusting permissions of paperless files. This may take a while. Waiting for Redis... Redis ping #0 failed. Error: invalid username-password pair or user is disabled.. Waiting 5s Redis ping #1 failed. Error: invalid username-password pair or user is disabled.. Waiting 5s Redis ping #2 failed. Error: invalid username-password pair or user is disabled.. Waiting 5s Redis ping #3 failed. Error: invalid username-password pair or user is disabled.. Waiting 5s Redis ping #4 failed. Error: invalid username-password pair or user is disabled.. Waiting 5s Failed to connect to redis using environment variable PAPERLESS_REDIS. ** Press ANY KEY to close this window ** redis 15:45:40.04 INFO ==> redis 15:45:40.04 INFO ==> Welcome to the Bitnami redis container redis 15:45:40.04 INFO ==> Subscribe to project updates by watching https://github.com/bitnami/containers redis 15:45:40.05 INFO ==> Did you know there are enterprise versions of the Bitnami catalog? For enhanced secure software supply chain features, unlimited pulls from Docker, LTS support, or application customization, see Bitnami Premium or Tanzu Application Catalog. See https://www.arrow.com/globalecs/na/vendors/bitnami/ for more information. redis 15:45:40.05 INFO ==> 1:C 24 Feb 2025 15:45:40.069 # WARNING Memory overcommit must be enabled! Without it, a background save or replication may fail under low memory condition. Being disabled, it can also cause failures without low memory condition, see https://github.com/jemalloc/jemalloc/issues/1328. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect. 1:C 24 Feb 2025 15:45:40.069 * oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo 1:C 24 Feb 2025 15:45:40.069 * Redis version=7.4.2, bits=64, commit=00000000, modified=1, pid=1, just started 1:C 24 Feb 2025 15:45:40.069 * Configuration loaded 1:M 24 Feb 2025 15:45:40.069 * monotonic clock: POSIX clock_gettime 1:M 24 Feb 2025 15:45:40.070 * Running mode=standalone, port=6379. 1:M 24 Feb 2025 15:45:40.070 * Server initialized 1:M 24 Feb 2025 15:45:40.070 * Ready to accept connections tcp Edited February 24, 20251 yr by nice83 translation
March 7, 20251 yr A few days ago, I set up Paperless in Unraid as a Docker container, assigned various automatic storage paths, and imported about 200 documents. I handle all processing via the browser. When I need files, I want to copy them via the mounted share using (Mac) Finder to my Desktop. I do not make any changes on the SMB share by hand! However, this doesn’t work for all files. About 10% of them are visible but cannot be opened wit this error "File xyz.pdf file not found." All files were uploaded via the web interface and can be read and edited from there without any issues, i can download them via the Unraid GUI also. The Media/Consume/Export folders are located on an internal SSD here: /mnt/user/paperless/. I access the web interface as an admin, and the SMB share is mounted with read/write permissions. In the Screenshot attached, File #1 Can be opened without problems. File #2+3 Can only be opened in the browser. tried running docker safe new permissions also. Quote root@d98e64333c06:/usr/src/paperless# ls -lh drwxrwxrwx 1 paperless users 6 Feb 2 10:17 consume drwxrwxrwx 1 paperless users 157 Feb 2 11:05 data drwxrwxrwx 1 paperless users 6 Jan 28 21:22 export -rw-r--r-- 1 paperless 1000 1.4K Jan 31 16:58 gunicorn.conf.py drwxrwxrwx 1 paperless users 41 Feb 2 10:17 media drwxr-xr-x 1 paperless 1000 219 Jan 31 16:58 src drwxr-xr-x 1 paperless 1000 261 Jan 31 17:01 static I assume it’s a permission issue, but I don’t understand why it only affects certain files. How can I fix this? server-diagnostics-20250307-0710.zip Edited March 7, 20251 yr by lys
March 14, 20251 yr On 9/19/2023 at 12:09 AM, arsvendg said: I have been trying to trigger a PAPERLESS_PRE_CONSUME_SCRIPT that I got from this site: https://piep.tech/posts/automatic-password-removal-in-paperless-ngx/. I have tried to add a scripts folder to my array share, and added the password txt file and the .py script. The script looks like this: #!/usr/bin/env python import pikepdf import os def unlock_pdf(file_path): password = None print("reading passwords") with open("/usr/src/paperless/scripts/passwords.txt", "r") as f: passwords = f.readlines() for p in passwords: password = p.strip() try: with pikepdf.open(file_path, password=password, allow_overwriting_input=True) as pdf: print("password is working:" + password) pdf.save(file_path) break except pikepdf.PasswordError: print("password isn't working:" + password) continue if password is None: print("Empty password file") file_path = os.environ.get('DOCUMENT_WORKING_PATH') unlock_pdf(file_path) I have set a path to give the container access to the scripts folder: And I have set the PAPERLESS_PRE_CONSUME_SCRIPT as a variable to run the script, I just have removed it now since it doesn't work... I am getting a permission denied error in the logs: [2023-09-18 23:47:43,698] [ERROR] [paperless.consumer] Error while executing pre-consume script: [Errno 13] Permission denied: '/usr/src/paperless/scripts/removepassword.py' At one point, I got these messages from the logs. [2023-09-18 23:02:34,261] [WARNING] [paperless.consumer] Script stderr: [2023-09-18 23:02:34,263] [WARNING] [paperless.consumer] /usr/bin/env: ‘python\r’: No such file or directory [2023-09-18 23:02:34,266] [WARNING] [paperless.consumer] /usr/bin/env: use -[v]S to pass options in shebang lines [2023-09-18 23:02:34,273] [ERROR] [paperless.consumer] Error while executing pre-consume script: Command '['/usr/src/paperless/scripts/removepassword.py', '/tmp/paperless/tmpl40jims_/loennslipp.pdf']' returned non-zero exit status 127. Does anyone have an idea to what I might be doing wrong? Is there something wrong with the script? I run into the same issue today but was lucky enought to find a quick solution for this. The problem is the line ending character of the script file itself. The fix was easy as descriped in this ubuntu forum post: https://askubuntu.com/questions/896860/usr-bin-env-python3-r-no-such-file-or-directory The problem are your line ending characters. Your file was created or edited on a Windows system and uses Windows/DOS-style line endings (CR+LF), whereas Linux systems like Ubuntu require Unix-style line endings (LF). There is a simple tool that can convert the two different styles for you called dos2unix. Install it by running sudo apt install dos2unix After that, you can convert files in either direction using one of the commands dos2unix /PATH/TO/YOUR/WINDOWS_FILE unix2dos /PATH/TO/YOUR/LINUX_FILE Example: $ cat test.py #!/usr/bin/env python3 print("ok") $ ./test.py /usr/bin/env: ‘python3\r’: No such file or directory $ dos2unix test.py dos2unix: converting file test.py to Unix format ... $ ./test.py ok Hope that helps someone else. Edited March 14, 20251 yr by ph0b0s101 wrong quote
March 17, 20251 yr On 10/30/2024 at 3:33 AM, stevenxl said: Hey ya'll. This is more of a general docker question, but the problem I am having is on paperless-ngx, so here I am. Anyway, I had a working paperless-ngx docker container running. I then when to "edit" the template, and I put in some extra parameters. This caused the updates to fail when I clicked "apply". Now the container is not running, and it is not in the "stopped" state. It's just gone. I know that the data is stored elsewhere, but how do I instantiate the container again without having to re-input all the parameters I had before (since I've now forgotten them). You should be able to "install from previous state" or something along those lines when you click the install button in the apps store
July 25, 2025Jul 25 Has anyone tried to use Pocket-ID with this app? In trying to follow their guide for Paperless-NGX, this container fails when adding the two variables as instructed.https://pocket-id.org/docs/client-examples/paperless-ngxPAPERLESS_APPS=allauth.socialaccount.providers.openid_connectPAPERLESS_SOCIALACCOUNT_PROVIDERS='{"openid_connect":{"SCOPE":["openid","profile","email"],"OAUTH_PKCE_ENABLED":true,"APPS":[{"provider_id":"pocket-id","name":"Pocket-ID","client_id":"Place the Client ID","secret":"Place the Client Secret","settings":{"server_url":"https://pocketid.example.com"}}]}}'
July 25, 2025Jul 25 Hello everyone,i tried to install paperless-ngx but im unable to create the superuser, the console is closing instantly with the docker shutting down.I cant enter "python manage.py createsuperuser". I guess thats the problem.Did someone know or has ideas how i could fix that?i already found a post in this topic, but letting paperless create the needed folders itself didnt helped me.Logs of Paperless.txtLogs of Redis.txti already turned SMB for appdata onmapping and setting overview:settings of paperless:settings of redis: Edited July 25, 2025Jul 25 by Happy15th wrong pictures
July 31, 2025Jul 31 I got paperless up and running and then, after processing 2,000 + documents, the documents were still in the consume folder. So...... I deleted them. This happened a few days ago. For an unrelated reason, I had to restart the container and every time I start the container, it completely crashes my server. The logs say File "/usr/src/paperless/src/documents/consumer.py", line 148, in _fail raise ConsumerError(f"{self.filename}: {log_message or message}") from exceptiondocuments.consumer.ConsumerError: T93271.pdf: Cannot consume /usr/src/paperless/consume/"radacted": File not found.[2025-07-31 08:27:26,539] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[7924107e-32c7-4baf-95ae-76757047cafe] received[2025-07-31 08:27:26,546] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[4a0e1579-57f3-40f2-8542-014482815659] received[2025-07-31 08:27:26,552] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[a59a85a7-4aea-49f1-b152-222694fca0b2] received[2025-07-31 08:27:26,558] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[a9ff1658-1414-4403-93e4-a9f238d39278] received[2025-07-31 08:27:26,564] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[13cdf592-2e15-44b5-a2d6-c6d6268e2f77] received[2025-07-31 08:27:26,571] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[cc8df2bf-556c-4d5d-824f-b94bbedbc869] received[2025-07-31 08:27:26,575] [ERROR] [paperless.consumer] Cannot consume /usr/src/paperless/consume/"radacted": File not found.[2025-07-31 08:27:26,577] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[6c9453de-8d0f-4409-bb05-ec1e1fda1dfb] received[2025-07-31 08:27:26,573] [ERROR] [paperless.consumer] Cannot consume /usr/src/paperless/consume/"radacted": File not found.[2025-07-31 08:27:26,573] [ERROR] [paperless.consumer] Cannot consume /usr/src/paperless/consume/"radacted": File not found.[2025-07-31 08:27:26,574] [ERROR] [paperless.consumer] Cannot consume /usr/src/paperless/consume/"radacted": File not found.[2025-07-31 08:27:26,576] [ERROR] [paperless.consumer] Cannot consume /usr/src/paperless/consume/"radacted": File not found.[2025-07-31 08:27:26,577] [ERROR] [paperless.consumer] Cannot consume /usr/src/paperless/consume/"radacted": File not found.[2025-07-31 08:27:26,579] [ERROR] [paperless.consumer] Cannot consume /usr/src/paperless/consume/"radacted": File not found.[2025-07-31 08:27:26,584] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[e787a14d-4df0-4905-8a7c-2c502a1e167d] received[2025-07-31 08:27:26,579] [ERROR] [paperless.consumer] Cannot consume /usr/src/paperless/consume/"radacted": File not found.[INFO] Shutting down granianIs there an easier way to resolve this issue? I managed to get my server back up and running by disabling paperless-ngx container.
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.