elbadepadualima

Ich habe gerade noch etwas gesucht und ich bin nicht der einzige mit dem Problem. Ich teste gerade das Mappen des /tmp bereichs auf einen Bereich außerhalb des Containers. Bis jetzt funktioniert dies recht gut.

Kann ich nicht bestätigen, auch wenn es das log sagt. Die Auslastung vom Arbeitsspeicher liegt im Schnitt so bei 20%. Damit muss ich mich beschäftigen, aber spürbare Probleme habe ich mit nginx nicht. Wie geschrieben, das Docker Image wird voll geschrieben, die Auslastung des Arbeitsspeichers liegt weiterhin bei den bereits genannten 20%. Dies werde ich versuche, da ein ähnliches Problem aber auch bei Thunderbird auftritt habe vermute ich eine andere Ursache. Nein, nur powertop...das sind Überbleibsel von Nerdpack. Das habe ich heute gleich behoben.

Zunächst habe ich die Docker-Container updated und später auch Unraid. Das Problen bestand aber auch schon vor dem Unraid-Update, Ich kann es leider nicht sagen, der Docker startet und nach 2-3Minuten geht die Speicherauslastung des Dockers rapide nach oben, 400-600MB pro Minute. Ebenfalls geht die Prozessorauslastung nach oben, zunächst 25% und nach 3-5Minuten nahezu auf 100%. ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/django/db/backends/sqlite3/base.py", line 328, in execute return super().execute(query, params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ sqlite3.IntegrityError: NOT NULL constraint failed: documents_paperlesstask.status The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/src/paperless/src/documents/signals/handlers.py", line 855, in task_postrun_handler task_instance.save() File "/usr/local/lib/python3.11/site-packages/django/db/models/base.py", line 814, in save self.save_base( File "/usr/local/lib/python3.11/site-packages/django/db/models/base.py", line 877, in save_base updated = self._save_table( ^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/django/db/models/base.py", line 990, in _save_table updated = self._do_update( ^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/django/db/models/base.py", line 1054, in _do_update return filtered._update(values) > 0 ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/django/db/models/query.py", line 1231, in _update return query.get_compiler(self.db).execute_sql(CURSOR) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/django/db/models/sql/compiler.py", line 1984, in execute_sql cursor = super().execute_sql(result_type) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/django/db/models/sql/compiler.py", line 1562, in execute_sql cursor.execute(sql, params) File "/usr/local/lib/python3.11/site-packages/django/db/backends/utils.py", line 67, in execute return self._execute_with_wrappers( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers return executor(sql, params, many, context) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/django/db/backends/utils.py", line 84, in _execute with self.db.wrap_database_errors: File "/usr/local/lib/python3.11/site-packages/django/db/utils.py", line 91, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/usr/local/lib/python3.11/site-packages/django/db/backends/utils.py", line 89, in _execute return self.cursor.execute(sql, params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/django/db/backends/sqlite3/base.py", line 328, in execute return super().execute(query, params) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ django.db.utils.IntegrityError: NOT NULL constraint failed: documents_paperlesstask.status [2024-07-02 22:09:25,761: ERROR/MainProcess] Process 'ForkPoolWorker-4' pid:304 exited with 'signal 15 (SIGTERM)' [2024-07-02 22:09:25,927] [ERROR] [celery.worker.request] Task handler raised error: WorkerLostError('Worker exited prematurely: signal 15 (SIGTERM) Job: 3.') Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/billiard/pool.py", line 1264, in mark_as_worker_lost raise WorkerLostError( billiard.einfo.ExceptionWithTraceback: """ Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/celery/worker/worker.py", line 202, in start self.blueprint.start(self) File "/usr/local/lib/python3.11/site-packages/celery/bootsteps.py", line 116, in start step.start(parent) File "/usr/local/lib/python3.11/site-packages/celery/bootsteps.py", line 365, in start return self.obj.start() ^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/celery/worker/consumer/consumer.py", line 340, in start blueprint.start(self) File "/usr/local/lib/python3.11/site-packages/celery/bootsteps.py", line 116, in start step.start(parent) File "/usr/local/lib/python3.11/site-packages/celery/worker/consumer/consumer.py", line 746, in start c.loop(*c.loop_args()) File "/usr/local/lib/python3.11/site-packages/celery/worker/loops.py", line 86, in asynloop state.maybe_shutdown() File "/usr/local/lib/python3.11/site-packages/celery/worker/state.py", line 93, in maybe_shutdown raise WorkerShutdown(should_stop) celery.exceptions.WorkerShutdown: 0 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/billiard/pool.py", line 1264, in mark_as_worker_lost raise WorkerLostError( billiard.exceptions.WorkerLostError: Worker exited prematurely: signal 15 (SIGTERM) Job: 3. """ [2024-07-02 22:09:25,939] [WARNING] [celery.redirected] Restoring 4 unacknowledged message(s) [2024-07-02 22:09:26 +0200] [96] [INFO] Handling signal: term [2024-07-02 22:09:26 +0200] [96] [INFO] Shutting down: Master 2024-07-02 22:09:25,307 INFO waiting for gunicorn, celery to die 2024-07-02 22:09:26,311 INFO stopped: celery (exit status 0) 2024-07-02 22:09:28,284 INFO stopped: gunicorn (exit status 0) Paperless-ngx docker container starting... Creating directory scratch directory /tmp/paperless Adjusting permissions of paperless files. This may take a while. Waiting for Redis... Connected to Redis broker. Apply database migrations... Operations to perform: Apply all migrations: account, admin, auditlog, auth, authtoken, contenttypes, django_celery_results, documents, guardian, paperless, paperless_mail, sessions, socialaccount Running migrations: No migrations to apply. Running Django checks System check identified no issues (0 silenced). Executing /usr/local/bin/paperless_cmd.sh 2024-07-02 22:11:06,333 INFO Set uid to user 0 succeeded 2024-07-02 22:11:06,533 INFO supervisord started with pid 1 2024-07-02 22:11:07,540 INFO spawned: 'gunicorn' with pid 82 2024-07-02 22:11:07,555 INFO spawned: 'celery' with pid 83 2024-07-02 22:11:07,563 INFO spawned: 'celery-beat' with pid 84 2024-07-02 22:11:07,573 INFO spawned: 'consumer' with pid 85 2024-07-02 22:11:07,594 INFO spawned: 'celery-flower' with pid 86 Checking if we should start flower... 2024-07-02 22:11:07,649 INFO success: celery-flower entered RUNNING state, process has stayed up for > than 0 seconds (startsecs) Not starting flower 2024-07-02 22:11:07,649 INFO exited: celery-flower (exit status 0; expected) 2024-07-02 22:11:08,650 INFO success: gunicorn entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-07-02 22:11:08,656 INFO success: celery entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-07-02 22:11:08,659 INFO success: celery-beat entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2024-07-02 22:11:08,659 INFO success: consumer entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) celery beat v5.4.0 (opalescent) is starting. [2024-07-02 22:11:12,455] [WARNING] [paperless.management.consumer] Not consuming file /usr/src/paperless/consume/.smbdeleteAAAd0a34.4: Unknown file extension. [2024-07-02 22:11:12,457] [INFO] [paperless.management.consumer] Adding /usr/src/paperless/consume/ALU-WX-instruction_wx_2_de 0007.pdf to the task queue. [2024-07-02 22:11:12,777] [INFO] [paperless.management.consumer] Adding /usr/src/paperless/consume/2024-03-26 scan__010879.pdf to the task queue. [2024-07-02 22:11:12,806] [INFO] [paperless.management.consumer] Adding /usr/src/paperless/consume/KeContact_KCP20_30_ih_de.pdf to the task queue. __ - ... __ - _ LocalTime -> 2024-07-02 22:11:12 Configuration -> . broker -> redis://192.168.1.58:6379// . loader -> celery.loaders.app.AppLoader . scheduler -> celery.beat.PersistentScheduler . db -> /usr/src/paperless/data/celerybeat-schedule.db . logfile -> [stderr]@%INFO . maxinterval -> 5.00 minutes (300s) [2024-07-02 22:11:12,893] [INFO] [celery.beat] beat: Starting... [2024-07-02 22:11:13,021] [INFO] [paperless.management.consumer] Adding /usr/src/paperless/consume/d165f3b5-54c4-4029-bfdb-974ccd734c38.pdf to the task queue. [2024-07-02 22:11:13,056] [INFO] [paperless.management.consumer] Using inotify to watch directory for changes: /usr/src/paperless/consume [2024-07-02 22:11:13,069] [INFO] [celery.beat] Scheduler: Sending due task Check all e-mail accounts (paperless_mail.tasks.process_mail_accounts) [2024-07-02 22:11:13 +0200] [82] [INFO] Starting gunicorn 22.0.0 [2024-07-02 22:11:13 +0200] [82] [INFO] Listening at: http://[::]:8000 (82) [2024-07-02 22:11:13 +0200] [82] [INFO] Using worker: paperless.workers.ConfigurableWorker [2024-07-02 22:11:13 +0200] [82] [INFO] Server is ready. Spawning workers -------------- celery@0bc36505ce97 v5.4.0 (opalescent) --- ***** ----- -- ******* ---- Linux-6.1.79-Unraid-x86_64-with-glibc2.36 2024-07-02 22:11:15 - *** --- * --- - ** ---------- [config] - ** ---------- .> app: paperless:0x149194d12b10 - ** ---------- .> transport: redis://192.168.1.58:6379// - ** ---------- .> results: - *** --- * --- .> concurrency: 1 (prefork) -- ******* ---- .> task events: ON --- ***** ----- -------------- [queues] .> celery exchange=celery(direct) key=celery [tasks] . documents.bulk_edit.delete . documents.tasks.bulk_update_documents . documents.tasks.consume_file . documents.tasks.empty_trash . documents.tasks.index_optimize . documents.tasks.sanity_check . documents.tasks.train_classifier . documents.tasks.update_document_archive_file . paperless_mail.mail.apply_mail_action . paperless_mail.mail.error_callback . paperless_mail.tasks.process_mail_accounts [2024-07-02 22:11:15,714] [INFO] [celery.worker.consumer.connection] Connected to redis://192.168.1.58:6379// [2024-07-02 22:11:15,857] [INFO] [celery.apps.worker] celery@0bc36505ce97 ready. [2024-07-02 22:11:15,861] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[05e968a0-7956-4294-b2ae-c80085e0647d] received [2024-07-02 22:11:15,866] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[3f93e29f-51cd-4e9f-bf3f-0108866c28f9] received [2024-07-02 22:11:15,870] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[28bd1885-d7f6-42e9-8b23-876f9749bd2d] received [2024-07-02 22:11:15,875] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[fa499c22-06d0-452a-bd69-c1febaa5e48a] received [2024-07-02 22:11:15,878] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[e809e3c3-d4b7-4896-a35b-53b51e51f4aa] received [2024-07-02 22:11:42,453] [INFO] [paperless.tasks] BarcodePlugin completed with no message [2024-07-02 22:11:42,508] [INFO] [paperless.tasks] WorkflowTriggerPlugin completed with: [2024-07-02 22:11:42,902] [ERROR] [paperless.consumer] Not consuming 2024-03-26 scan__010879.pdf: It is a duplicate of scan__010879 (#1621) [2024-07-02 22:11:42,902] [ERROR] [paperless.tasks] ConsumeTaskPlugin failed: 2024-03-26 scan__010879.pdf: Not consuming 2024-03-26 scan__010879.pdf: It is a duplicate of scan__010879 (#1621) Traceback (most recent call last): File "/usr/src/paperless/src/documents/tasks.py", line 151, in consume_file msg = plugin.run() ^^^^^^^^^^^^ File "/usr/src/paperless/src/documents/consumer.py", line 502, in run self.pre_check_duplicate() File "/usr/src/paperless/src/documents/consumer.py", line 326, in pre_check_duplicate self._fail( File "/usr/src/paperless/src/documents/consumer.py", line 302, in _fail raise ConsumerError(f"{self.filename}: {log_message or message}") from exception documents.consumer.ConsumerError: 2024-03-26 scan__010879.pdf: Not consuming 2024-03-26 scan__010879.pdf: It is a duplicate of scan__010879 (#1621) [2024-07-02 22:11:42,944] [ERROR] [celery.app.trace] Task documents.tasks.consume_file[05e968a0-7956-4294-b2ae-c80085e0647d] raised unexpected: ConsumerError('2024-03-26 scan__010879.pdf: Not consuming 2024-03-26 scan__010879.pdf: It is a duplicate of scan__010879 (#1621)') Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/celery/app/trace.py", line 453, in trace_task R = retval = fun(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/celery/app/trace.py", line 736, in __protected_call__ return self.run(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/asgiref/sync.py", line 327, in main_wrap raise exc_info[1] File "/usr/src/paperless/src/documents/tasks.py", line 151, in consume_file msg = plugin.run() ^^^^^^^^^^^^ File "/usr/src/paperless/src/documents/consumer.py", line 502, in run self.pre_check_duplicate() File "/usr/src/paperless/src/documents/consumer.py", line 326, in pre_check_duplicate self._fail( File "/usr/src/paperless/src/documents/consumer.py", line 302, in _fail raise ConsumerError(f"{self.filename}: {log_message or message}") from exception documents.consumer.ConsumerError: 2024-03-26 scan__010879.pdf: Not consuming 2024-03-26 scan__010879.pdf: It is a duplicate of scan__010879 (#1621) [2024-07-02 22:11:43,220] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[15ef7e4b-148f-4cbb-bae5-f7b6cb1dad7e] received [2024-07-02 22:13:13,314] [INFO] [paperless.tasks] BarcodePlugin completed with no message [2024-07-02 22:13:13,488] [INFO] [paperless.tasks] WorkflowTriggerPlugin completed with: [2024-07-02 22:13:14,146] [ERROR] [paperless.consumer] Not consuming ALU-WX-instruction_wx_2_de 0007.pdf: It is a duplicate of ALU-WX-instruction_wx_2_de (#1594) [2024-07-02 22:13:14,148] [ERROR] [paperless.tasks] ConsumeTaskPlugin failed: ALU-WX-instruction_wx_2_de 0007.pdf: Not consuming ALU-WX-instruction_wx_2_de 0007.pdf: It is a duplicate of ALU-WX-instruction_wx_2_de (#1594) Traceback (most recent call last): File "/usr/src/paperless/src/documents/tasks.py", line 151, in consume_file msg = plugin.run() ^^^^^^^^^^^^ File "/usr/src/paperless/src/documents/consumer.py", line 502, in run self.pre_check_duplicate() File "/usr/src/paperless/src/documents/consumer.py", line 326, in pre_check_duplicate self._fail( File "/usr/src/paperless/src/documents/consumer.py", line 302, in _fail raise ConsumerError(f"{self.filename}: {log_message or message}") from exception documents.consumer.ConsumerError: ALU-WX-instruction_wx_2_de 0007.pdf: Not consuming ALU-WX-instruction_wx_2_de 0007.pdf: It is a duplicate of ALU-WX-instruction_wx_2_de (#1594) [2024-07-02 22:13:14,195] [ERROR] [celery.app.trace] Task documents.tasks.consume_file[3f93e29f-51cd-4e9f-bf3f-0108866c28f9] raised unexpected: ConsumerError('ALU-WX-instruction_wx_2_de 0007.pdf: Not consuming ALU-WX-instruction_wx_2_de 0007.pdf: It is a duplicate of ALU-WX-instruction_wx_2_de (#1594)') Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/celery/app/trace.py", line 453, in trace_task R = retval = fun(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/celery/app/trace.py", line 736, in __protected_call__ return self.run(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/asgiref/sync.py", line 327, in main_wrap raise exc_info[1] File "/usr/src/paperless/src/documents/tasks.py", line 151, in consume_file msg = plugin.run() ^^^^^^^^^^^^ File "/usr/src/paperless/src/documents/consumer.py", line 502, in run self.pre_check_duplicate() File "/usr/src/paperless/src/documents/consumer.py", line 326, in pre_check_duplicate self._fail( File "/usr/src/paperless/src/documents/consumer.py", line 302, in _fail raise ConsumerError(f"{self.filename}: {log_message or message}") from exception docker run -d --name='paperless-ngx' --net='bridge' -e TZ="Europe/Berlin" -e HOST_OS="Unraid" -e HOST_HOSTNAME="heimdall2" -e HOST_CONTAINERNAME="paperless-ngx" -e 'PAPERLESS_REDIS'='redis://192.168.1.58:6379' -e 'PAPERLESS_OCR_LANGUAGE'='deu+eng' -e 'PAPERLESS_OCR_LANGUAGES'='' -e 'PAPERLESS_FILENAME_FORMAT'='{created}_{document_type}_{title}_{correspondent}_{tag_list}' -e 'PAPERLESS_TIME_ZONE'='Europe/Berlin' -e 'PAPERLESS_CONSUMER_ENABLE_BARCODES'='true' -e 'PAPERLESS_CONSUMER_ASN_BARCODE_PREFIX'='ASN' -e 'PAPERLESS_CONSUMER_ENABLE_ASN_BARCODE'='true' -e 'PAPERLESS_CONSUMER_BARCODE_UPSCALE'='2.0' -e 'PAPERLESS_FILENAME_FORMAT_REMOVE_NONE'='true' -e 'PAPERLESS_CONSUMER_BARCODE_DPI'='600' -e 'PAPERLESS_IGNORE_DATES'='' -e 'PAPERLESS_CONSUMER_POLLING'='0' -e 'PAPERLESS_SECRET_KEY'='e11fl1oa-*ytql8p)(06fbj4ukrlo+n7k&q5+$1md7i+mge=ee' -e 'USERMAP_UID'='99' -e 'USERMAP_GID'='100' -l net.unraid.docker.managed=dockerman -l net.unraid.docker.webui='http://[IP]:[PORT:8000]' -l net.unraid.docker.icon='https://raw.githubusercontent.com/selfhosters/unRAID-CA-templates/master/templates/img/paperless.png' -p '8000:8000/tcp' -v '/mnt/user/appdata/paperless-ngx/data':'/usr/src/paperless/data':'rw' -v '/mnt/user/paperless/ablage/':'/usr/src/paperless/media':'rw' -v '/mnt/user/paperless/scan/':'/usr/src/paperless/consume':'rw' 'ghcr.io/paperless-ngx/paperless-ngx' 156066cceef689c72045fabaa4f2fc4f7cc399d206b3bab37b66539c44e40cf3 Der Befehl wurde erfolgreich ausgeführt! heimdall2-diagnostics-20240702-2220.zip

Hallo Zusammen, ich habe seit 2 Jahren einen Paperless Docker in Unraid laufen, bisher ohne Probleme. Seit ich auf die aktuelle Version geupdatet habe (ich habe Paperless immer aktuell gehalten), flutet der Container mein docker.img. Am Mapping habe ich nichts verändert und ebenfalls nichts in den Einstellungen von Paperless. Ein Rollback auf Version 2.9.0 hat leider auch keinen Erfolg gebracht. Ich habe den Container nun gestoppt, da das Beschreiben des Image die Auslastung des gesamten Servers auf 100%. Hat jemand eine Vermutung wo die Ursache liegen könnte? Ich wäre Euch sehr dankbar. Ich ergänze noch um Thunderbird, der Docker verhält sich genauso. Auslastung geht hoch und das docker.img wird vollgeschrieben. Mir ist eben noch eingefallen, dass ich vor 2 Tagen auch Appdata Backup installiert habe. Könnte dies auch der Auslöser sein?