Tuetenk0pp

Members
 View Profile  See their activity

  • Posts

    37

  • Joined

  • Last visited

 Content Type 

Posts posted by Tuetenk0pp

    [Support] Paperless-ngx Docker

    in Docker Containers

    Posted · Edited by Tuetenk0pp

    1 hour ago, Mika said:

     

    Hey, did you find a solution for Paperless in combination with Authentik?

    @Mika@MobileDude I have a working setup:

      

    PAPERLESS_APPS=allauth.socialaccount.providers.openid_connect
PAPERLESS_SOCIALACCOUNT_PROVIDERS='{"openid_connect": {"APPS": [{"provider_id": "authentik", "name": "Authentik", "client_id": "YOUR_CLIENT_ID", "secret": "YOUR_CLIENT_SECRET", "settings":{ "server_url": "https://auth.domain.tld/application/o/paperless/.well-known/openid-configuration"}}], "OAUTH_PKCE_ENABLED": "True"}}'


    Be sure to name the Authentik Outpost "paperless". In addition, you can set the following variables, once the basics work:

      

    # hide the default login form
PAPERLESS_DISABLE_REGULAR_LOGIN=true

# sign up new users from authentik automatically
PAPERLESS_SOCIAL_AUTO_SIGNUP=true

# redirect to authentik after logout
PAPERLESS_LOGOUT_REDIRECT_URL=https://auth.domain.tld/application/o/paperless/end-session/logout

# trust authentik to provide valid email addresses
PAPERLESS_ACCOUNT_EMAIL_VERIFICATION=none

     

    I hope this helps :)

    VM/libvirt service fails to start

    in VM Engine (KVM)

    Posted

    14 hours ago, gilladur said:

    Hi Tuetenk0pp,

     

    where you actually able to fix the issue. I'm running currently into the same issues with my Win 10 VM.
    My Home assistant VM is not affected.

     

     

    Actually not, BUT: Since the measured Powerdraw from the wall was lower with the VM on than off, I leave it running all the time. And I never had the issue again. Obviously, this does not work if you use the same HW in different VMs and you need to switch them on and off. 

    • Like 1

    [Support] Paperless-ngx Docker

    in Docker Containers

    Posted

    Quote

    [2023-09-18 23:47:43,698] [ERROR] [paperless.consumer] Error while executing pre-consume script: [Errno 13] Permission denied: '/usr/src/paperless/scripts/removepassword.py'

    Have you checked the permissions on this file? Use `ls -l /mnt/user/share_paperless_ngx/scripts/`for that. It should look like this: -rw-rw-rw-

     

    Quote

    [2023-09-18 23:02:34,263] [WARNING] [paperless.consumer] /usr/bin/env: ‘python\r’: No such file or directory

    I have had these kinds of errors in the past and was able to fix it with LF line endings.

     

    pikepdf comes installed in the paperless image so no need to worry about that.

    [Support] Paperless-ngx Docker

    in Docker Containers

    Posted

    7 hours ago, arsvendg said:

    I can see the script calls for a "import pikepdf". WIll Unraid just do that, or do I have to install something somehow so the script actually have something to import...?

    it depends: if the package is already installed in the paperless container, import is the only thing you need. If its not installed, python would give an error like this: 

    Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ModuleNotFoundError: No module named 'pikepdf'

     

    [Support] Paperless-ngx Docker

    in Docker Containers

    Posted

    40 minutes ago, Rops said:

    Here's the one from Paperless

     

     

    image.thumb.png.174d89eab6831f46374cfd51eded2d2a.png

    image.thumb.png.3e0d9627165b707e96de570a7d8c57cd.png

    image.thumb.png.91c3d13a5c11f869b53f37e93f337948.png

     

     

    Now the one from Redis

     

    image.thumb.png.be5f30868eaa420fc8e48eb04a72a537.png

     

    Yes, I created the folders via sharing (SMB) like in the video. I then created the three folders in this folder by hand.

    Should I then just create the folder in Shares and let Paperless create the three subfolders?

     

     

     

     

    Timezone should be 'Europe/Berlin'

     

    Quote

    Should I then just create the folder in Shares and let Paperless create the three subfolders?

    You could try that

    • Thanks 1

    [Support] Paperless-ngx Docker

    in Docker Containers

    Posted

    4 hours ago, Rops said:

    Hello everyone,
    I have a problem with my Paperless NGX!

    I installed it following the instructions in a YouTube video, but then I can't access the surfaces.

    https://www.youtube.com/watch?v=iuxsNJ3Ru7Y&t=157s&pp=ygUacGFwZXJsZXNzIG5neCBpbnN0YWxsaWVyZW4%3D

    When I want to start the console to enter the superuser, the window only opens briefly (half a second) and then immediately closes again. Even if I want to open Paperless via the WebUI, I get the message - the website is not accessible and [Port] has refused the connection. -

    Redis has of course been installed beforehand.

    What am I doing wrong?

    Does somebody has any idea?

    Can we have a look at the logs? Both paperless and redis.

     

    Also, did you create the paperless folders over smb like shown in the video? This could have messed up the file permissions. Better to let unraid create those folders on container creation.

    [Support] Paperless-ngx Docker

    in Docker Containers

    Posted

    On 9/14/2023 at 4:23 PM, pallalino said:

    Exec format error: '/usr/src/paperless/scripts/info.py'

    Maybe something to do with the file format (line endings) or perhaps missing shebang?

     

     

    I'm curious, what do you want to achieve with a pre-consumption script? I was always aware of that functionality but found no use for it.

    VM/libvirt service fails to start

    in VM Engine (KVM)

    Posted

    I have a problem with my VM setup. Every now and then, my previously working VM fails to start. When I try to solve the issue with a restart of libvirt via the VM Manager, libvirt fails to start. Once I fully reboot the server, everything works fine until a few days later, the problem reoccurs. How can I solve that issue? I attached two diagnostics: one before I tried to restart libvirt and the other one just after it in case some log gets overwritten.

     

    I noticed these issues in the libvirt log:

      

    virNetSocketReadWire:1791 : End of file while reading data: Input/output error

    this appears every 10 minutes

      

    qemuDomainGetBlockInfo:11099 : invalid argument: invalid path Endeavouros_Cassini_Nova-03-2023_R2.iso not assigned to domain

    this appears every now and then and is related to a VM that I never started. I will remove the VM and see if that changes anything

      

    warning : qemuDomainObjBeginJobInternal:858 : Cannot start job (query, none, none) in API remoteDispatchDomainGetBlockInfo for domain Windows 11; current job is (modify, none, none) owned by (15916 remoteDispatchDomainAttachDevice, 0 <null>, 0 <null> (flags=0x0)) for (1777s, 0s, 0s)
error : qemuDomainObjBeginJobInternal:893 : Timed out during operation: cannot acquire state change lock (held by monitor=remoteDispatchDomainAttachDevice)

    this is probably the most relevant section because it is related to the VM I am trying to start.

      

    error : qemuMonitorIORead:423 : Unable to read from monitor: Connection reset by peer

    and this is the first line in the libvirt log after I tried to restart the libvirt service. The VMs Tab reads 'Libvirt Service failed to start.'

    I will now restart the server and hope for somebody to help me :)

    unraid-server-diagnostics-20230829-0859.zip unraid-server-diagnostics-20230829-0920.zip

    [Support] Paperless-ngx Docker

    in Docker Containers

    Posted

    8 minutes ago, K1LLA_KING_KING said:

    Is Redis not the database?

    I have MariaDB already installed, not sure its working properly tho, as it fails to work with Nextcloud, I could try Postgres, how does one set this up to work with paperless?



     

    Redis is only in ram

    [Support] Paperless-ngx Docker

    in Docker Containers

    Posted

    Hello, I have a very serious problem with my paperless-ngx install. In short: when paperless consumes a (fairly large) document, the consumtion fails but instead, the docker image starts to fill up rapidly to a point, where containers fail and I had to delete the entire image to get everything back up and running. Here is the paperless log message:

      

    [2023-05-02 20:48:38,906] [INFO] [paperless.management.consumer] Received SIGINT, stopping inotify

[2023-05-02 20:48:38,911] [DEBUG] [paperless.management.consumer] Consumer exiting.

[2023-05-02 20:48:39,483] [ERROR] [paperless.handlers] Updating PaperlessTask failed

Traceback (most recent call last):

  File "/usr/local/lib/python3.9/site-packages/celery/app/trace.py", line 451, in trace_task

    R = retval = fun(*args, **kwargs)

  File "/usr/local/lib/python3.9/site-packages/celery/app/trace.py", line 734, in __protected_call__

    return self.run(*args, **kwargs)

  File "/usr/src/paperless/src/documents/tasks.py", line 99, in consume_file

    doc_barcode_info = barcodes.scan_file_for_barcodes(

  File "/usr/src/paperless/src/documents/barcodes.py", line 181, in scan_file_for_barcodes

    barcodes = _pdf2image_barcode_scan(pdf_filepath)

  File "/usr/src/paperless/src/documents/barcodes.py", line 158, in _pdf2image_barcode_scan

    pages_from_path = convert_from_path(

  File "/usr/local/lib/python3.9/site-packages/pdf2image/pdf2image.py", line 250, in convert_from_path

    data, err = proc.communicate(timeout=timeout)

  File "/usr/local/lib/python3.9/subprocess.py", line 1134, in communicate

    stdout, stderr = self._communicate(input, endtime, timeout)

  File "/usr/local/lib/python3.9/subprocess.py", line 1979, in _communicate

    ready = selector.select(timeout)

  File "/usr/local/lib/python3.9/selectors.py", line 416, in select

    fd_event_list = self._selector.poll(timeout)

  File "/usr/local/lib/python3.9/site-packages/billiard/common.py", line 119, in _shutdown_cleanup

    sys.exit(-(256 - signum))

  File "/usr/local/lib/python3.9/site-packages/billiard/pool.py", line 283, in exit

    return _exit(status)

SystemExit: -241

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

  File "/usr/local/lib/python3.9/site-packages/django/db/backends/utils.py", line 89, in _execute

    return self.cursor.execute(sql, params)

  File "/usr/local/lib/python3.9/site-packages/django/db/backends/sqlite3/base.py", line 357, in execute

    return Database.Cursor.execute(self, query, params)

sqlite3.IntegrityError: NOT NULL constraint failed: documents_paperlesstask.status

The above exception was the direct cause of the following exception:

Traceback (most recent call last):

  File "/usr/src/paperless/src/documents/signals/handlers.py", line 594, in task_postrun_handler

    task_instance.save()

  File "/usr/local/lib/python3.9/site-packages/django/db/models/base.py", line 812, in save

    self.save_base(

  File "/usr/local/lib/python3.9/site-packages/django/db/models/base.py", line 863, in save_base

    updated = self._save_table(

  File "/usr/local/lib/python3.9/site-packages/django/db/models/base.py", line 976, in _save_table

    updated = self._do_update(

  File "/usr/local/lib/python3.9/site-packages/django/db/models/base.py", line 1040, in _do_update

    return filtered._update(values) > 0

  File "/usr/local/lib/python3.9/site-packages/django/db/models/query.py", line 1216, in _update

    return query.get_compiler(self.db).execute_sql(CURSOR)

  File "/usr/local/lib/python3.9/site-packages/django/db/models/sql/compiler.py", line 1822, in execute_sql

    cursor = super().execute_sql(result_type)

  File "/usr/local/lib/python3.9/site-packages/django/db/models/sql/compiler.py", line 1398, in execute_sql

    cursor.execute(sql, params)

  File "/usr/local/lib/python3.9/site-packages/django/db/backends/utils.py", line 67, in execute

    return self._execute_with_wrappers(

  File "/usr/local/lib/python3.9/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers

    return executor(sql, params, many, context)

  File "/usr/local/lib/python3.9/site-packages/django/db/backends/utils.py", line 89, in _execute

    return self.cursor.execute(sql, params)

  File "/usr/local/lib/python3.9/site-packages/django/db/utils.py", line 91, in __exit__

    raise dj_exc_value.with_traceback(traceback) from exc_value

  File "/usr/local/lib/python3.9/site-packages/django/db/backends/utils.py", line 89, in _execute

    return self.cursor.execute(sql, params)

  File "/usr/local/lib/python3.9/site-packages/django/db/backends/sqlite3/base.py", line 357, in execute

    return Database.Cursor.execute(self, query, params)

django.db.utils.IntegrityError: NOT NULL constraint failed: documents_paperlesstask.status

[2023-05-02 20:50:03,379] [INFO] [paperless.management.consumer] Using inotify to watch directory for changes: /usr/src/paperless/consume

     

    frequent game and browser window crashes in Win 11 VM

    in VM Engine (KVM)

    Posted

    Here is my VM XML:

      

    <?xml version='1.0' encoding='UTF-8'?>
<domain type='kvm'>
  <name>Windows 11</name>
  <uuid>60d77ad0-5f40-73a0-c9d6-XXXXXXXX</uuid>
  <metadata>
    <vmtemplate xmlns="unraid" name="Windows 11" icon="windows11.png" os="windowstpm"/>
  </metadata>
  <memory unit='KiB'>16777216</memory>
  <currentMemory unit='KiB'>16777216</currentMemory>
  <memoryBacking>
    <nosharepages/>
  </memoryBacking>
  <vcpu placement='static'>8</vcpu>
  <cputune>
    <vcpupin vcpu='0' cpuset='2'/>
    <vcpupin vcpu='1' cpuset='8'/>
    <vcpupin vcpu='2' cpuset='3'/>
    <vcpupin vcpu='3' cpuset='9'/>
    <vcpupin vcpu='4' cpuset='4'/>
    <vcpupin vcpu='5' cpuset='10'/>
    <vcpupin vcpu='6' cpuset='5'/>
    <vcpupin vcpu='7' cpuset='11'/>
  </cputune>
  <os>
    <type arch='x86_64' machine='pc-i440fx-7.1'>hvm</type>
    <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi-tpm.fd</loader>
    <nvram>/etc/libvirt/qemu/nvram/60d77ad0-5f40-73a0-c9d6-XXXXXXXXX_VARS-pure-efi-tpm.fd</nvram>
  </os>
  <features>
    <acpi/>
    <apic/>
    <hyperv mode='custom'>
      <relaxed state='on'/>
      <vapic state='on'/>
      <spinlocks state='on' retries='8191'/>
      <vendor_id state='on' value='none'/>
    </hyperv>
  </features>
  <cpu mode='host-passthrough' check='none' migratable='on'>
    <topology sockets='1' dies='1' cores='4' threads='2'/>
    <cache mode='passthrough'/>
    <feature policy='require' name='topoext'/>
  </cpu>
  <clock offset='localtime'>
    <timer name='hypervclock' present='yes'/>
    <timer name='hpet' present='no'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <devices>
    <emulator>/usr/local/sbin/qemu</emulator>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <source file='/mnt/user/isos/virtio-win-0.1.225-2.iso'/>
      <target dev='hdb' bus='sata'/>
      <readonly/>
      <address type='drive' controller='0' bus='0' target='0' unit='1'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw' cache='writeback'/>
      <source dev='/dev/disk/by-id/ata-CT1000MX500SSD1_XXXXXXXXX'/>
      <target dev='hdc' bus='sata' rotation_rate='1'/>
      <boot order='1'/>
      <address type='drive' controller='0' bus='0' target='0' unit='2'/>
    </disk>
    <controller type='pci' index='0' model='pci-root'/>
    <controller type='sata' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
    </controller>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci2'>
      <master startport='2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci3'>
      <master startport='4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/>
    </controller>
    <interface type='bridge'>
      <mac address='52:54:00:6a:e6:45'/>
      <source bridge='br0'/>
      <model type='virtio-net'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
    </interface>
    <serial type='pty'>
      <target type='isa-serial' port='0'>
        <model name='isa-serial'/>
      </target>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
    </console>
    <channel type='unix'>
      <target type='virtio' name='org.qemu.guest_agent.0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='tablet' bus='usb'>
      <address type='usb' bus='0' port='4'/>
    </input>
    <input type='mouse' bus='ps2'/>
    <input type='keyboard' bus='ps2'/>
    <tpm model='tpm-tis'>
      <backend type='emulator' version='2.0' persistent_state='yes'/>
    </tpm>
    <audio id='1' type='none'/>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0' multifunction='on'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x01' slot='0x00' function='0x1'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x1'/>
    </hostdev>
    <hostdev mode='subsystem' type='usb' managed='no'>
      <source>
        <vendor id='0x046d'/>
        <product id='0x08e5'/>
      </source>
      <address type='usb' bus='0' port='1'/>
    </hostdev>
    <hostdev mode='subsystem' type='usb' managed='no'>
      <source>
        <vendor id='0x046d'/>
        <product id='0xc345'/>
      </source>
      <address type='usb' bus='0' port='2'/>
    </hostdev>
    <hostdev mode='subsystem' type='usb' managed='no'>
      <source>
        <vendor id='0x046d'/>
        <product id='0xc52b'/>
      </source>
      <address type='usb' bus='0' port='3'/>
    </hostdev>
    <memballoon model='none'/>
  </devices>
</domain>

     

    It is generated by Unraid VM Manager. The only parameters I changed are rotation_rate (makes C drive show up as SSD) and multifunction=on etc (best practice for handling PCIe devices)

    frequent game and browser window crashes in Win 11 VM

    in VM Engine (KVM)

    Posted

    Maybe I used the wrong keywords but I was not able to find a similar thread in this forum.

     

    Recently, I set up a Windows 11 VM as my daily driver Desktop and I am quite happy with it. Unfortunately, I noticed that some applications suddenly crash. It happens to applications that run for longer than a few minutes.

     

    • Docker Desktop with WSL
    • Firefox Tabs or whole Browser
    • Handbrake
    • Games, e.g. Satisfactory, Civ 6, Railway Empire

     

    I know running WSL inside a VM is probably not the smartest thing in the world and I don't need to. I can also use a Handbrake Docker container without issue. But I really need to use my webbrowser and run some games, otherwise the purpose of the VM is kind of defeated.

     

    Windows Event Monitor does not help unfortunately. Since I have installed Windows on a bare metal ssd I was able to boot directly from that and test the install - no crashes there. So the issue is definetly related to KVM.

    Unraid hangs after array startup

    in General Support

    Posted

    1 hour ago, JorgeB said:

    Recently there have been a couple of issues reported with space cache v1, I would expect if that was the problem here it also wouldn't mount manually, but it won't hurt to try, run:

      

    btrfs check --clear-space-cache v1 /dev/sdX1

     

    Replace X with correct letter, then try mounting with UD again.

     

     

    So this seems to have solved the issue. The array is running now for over an hour without issue. Thank you both @JorgeB and @dlandon. Can I buy you a coffee somewhere?

    • Like 1

    Unraid hangs after array startup

    in General Support

    Posted

    46 minutes ago, dlandon said:

    Did you install UD and not mount the drive as a test?

    So thats interesting. I did install UD and disabled automount for USB drives. Manually mounting the drive after array startup (GUI button in main tab) did result in the same error as before: 1 CPU thread at 100% and no way to stop unraid except hard crash.