Jump to content

DZMM

Members
 View Profile  See their activity

  • Posts

    2,801

  • Joined

  • Last visited

  • Days Won

    9

 Content Type 

Posts posted by DZMM

    [Support] Linuxserver.io - SWAG - Secure Web Application Gateway (Nginx/PHP/Certbot/Fail2ban)

    in Docker Containers

    Posted

    1 hour ago, Melawen said:

    Here's mine, with obvious bits edited for privacy :)

      

    
<?php
$CONFIG = array (
  'memcache.local' => '\\OC\\Memcache\\APCu',
  'datadirectory' => '/data',
  'instanceid' => 'myinstanceid',
  'passwordsalt' => 'mypasswordsalt,
  'secret' => 'mysecret ... shhhh',
  'trusted_domains' =>
  array (
    0 => '10.10.0.25',
    1 => 'mydomain.com',
  ),
  'dbtype' => 'sqlite3',
  'version' => '21.0.2.1',
  'overwrite.cli.url' => 'https://mydomain.com',
  'overwritehost' => 'mydomain.com',
  'overwriteprotocol' => 'https',
  'installed' => true,
  'maintenance' => false,
  'theme' => '',
  'loglevel' => 2,
);

     

    Thanks.  I think my problem isn't my config file.  It's weird - everything is fine locally, but remotely I get the login page, but it won't login.

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted

    26 minutes ago, bobo89 said:

    My issue is that on server reboot some of my docker containers seem to boot faster than the rclone mount comes up. For example emby keeps giving me can't find media stream errors and from within the docker console no files show up. Rebooting the docker containers picks up the mount properly.

    Anyone else have this problem ? Any way to delay docker startup on array start ?

    Sent from my SM-N960W using Tapatalk
     

    There's an option in the script to enter dockers to start after a successful mount

    • Like 1

    SOLVED - W10 Not Working After Hardware Change

    in VM Engine (KVM)

    Posted · Edited by DZMM

    I removed a network card and now my main W10 VM won't start throwing up this error:

      

    Device 0000:0e:00.3 not found: could not access /sys/bus/pci/devices/0000:0e:00.3/config: No such file or directory

     

    I know the device references/addresses can change slightly after a HW change, but I can't for the life of me work out how to change.  Help please!  I want to passthrough the 1660, use the onboard audio as Soundcard1, the 1660 SC as Soundcard 2, and the TU116 USB controllers (x2).

     

    Thanks in advance for any help.

    Here's my old xml:

      

    <?xml version='1.0' encoding='UTF-8'?>
<domain type='kvm'>
  <name>Buzz</name>
  <uuid>54263aab-81a4-ed75-aa59-e7701d3f14fd</uuid>
  <description>3 Cores</description>
  <metadata>
    <vmtemplate xmlns="http://unraid.net/xmlns" name="Windows 10" icon="windows.png" os="windows10"/>
  </metadata>
  <memory unit='KiB'>16777216</memory>
  <currentMemory unit='KiB'>16777216</currentMemory>
  <memoryBacking>
    <nosharepages/>
  </memoryBacking>
  <vcpu placement='static'>6</vcpu>
  <cputune>
    <vcpupin vcpu='0' cpuset='10'/>
    <vcpupin vcpu='1' cpuset='26'/>
    <vcpupin vcpu='2' cpuset='11'/>
    <vcpupin vcpu='3' cpuset='27'/>
    <vcpupin vcpu='4' cpuset='12'/>
    <vcpupin vcpu='5' cpuset='28'/>
    <emulatorpin cpuset='18-19'/>
  </cputune>
  <numatune>
    <memory mode='strict' nodeset='1'/>
  </numatune>
  <resource>
    <partition>/machine</partition>
  </resource>
  <os>
    <type arch='x86_64' machine='pc-i440fx-4.2'>hvm</type>
    <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader>
    <nvram>/etc/libvirt/qemu/nvram/54263aab-81a4-ed75-aa59-e7701d3f14fd_VARS-pure-efi.fd</nvram>
  </os>
  <features>
    <acpi/>
    <apic/>
    <hyperv>
      <relaxed state='on'/>
      <vapic state='on'/>
      <spinlocks state='on' retries='8191'/>
      <vendor_id state='on' value='none'/>
    </hyperv>
  </features>
  <cpu mode='host-passthrough' check='none' migratable='on'>
    <topology sockets='1' dies='1' cores='6' threads='1'/>
    <feature policy='require' name='topoext'/>
  </cpu>
  <clock offset='localtime'>
    <timer name='hypervclock' present='yes'/>
    <timer name='hpet' present='no'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <devices>
    <emulator>/usr/local/sbin/qemu</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='writeback' discard='unmap'/>
      <source file='/mnt/user/domains/Buzz/vdisk1.img'/>
      <backingStore/>
      <target dev='hdc' bus='scsi'/>
      <boot order='1'/>
      <address type='drive' controller='0' bus='0' target='0' unit='2'/>
    </disk>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='writeback' discard='unmap'/>
      <source file='/mnt/user/domains/Buzz/vdisk2.img'/>
      <backingStore/>
      <target dev='hdd' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='0' unit='3'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <source file='/mnt/user/iso/Windows.iso'/>
      <backingStore/>
      <target dev='hda' bus='ide'/>
      <readonly/>
      <boot order='2'/>
      <address type='drive' controller='0' bus='0' target='0' unit='0'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <source file='/mnt/user/iso/virtio-win-0.1.189-1.iso'/>
      <backingStore/>
      <target dev='hdb' bus='ide'/>
      <readonly/>
      <address type='drive' controller='0' bus='0' target='0' unit='1'/>
    </disk>
    <controller type='scsi' index='0' model='virtio-scsi'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
    </controller>
    <controller type='ide' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
    </controller>
    <controller type='pci' index='0' model='pci-root'/>
    <controller type='usb' index='0' model='qemu-xhci' ports='15'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
    </controller>
    <interface type='bridge'>
      <mac address='e8:2e:d9:1e:b4:9d'/>
      <source bridge='br0'/>
      <model type='virtio-net'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
    </interface>
    <serial type='pty'>
      <target type='isa-serial' port='0'>
        <model name='isa-serial'/>
      </target>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
    </console>
    <channel type='unix'>
      <target type='virtio' name='org.qemu.guest_agent.0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='mouse' bus='ps2'/>
    <input type='keyboard' bus='ps2'/>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x44' slot='0x00' function='0x0'/>
      </source>
      <rom file='/mnt/user/domains/gpu/gtx1660.dump'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0' multifunction='on'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x0d' slot='0x00' function='0x3'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x44' slot='0x00' function='0x1'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x1'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x44' slot='0x00' function='0x2'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x2'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x44' slot='0x00' function='0x3'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x3'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x0e' slot='0x00' function='0x3'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x09' function='0x0'/>
    </hostdev>
    <memballoon model='none'/>
  </devices>
  <seclabel type='dynamic' model='dac' relabel='yes'/>
</domain>

     

     

    highlander-diagnostics-20210606-1241.zip

    Weird GUI behaviour

    in General Support

    Posted

    27 minutes ago, snoopy5707 said:

    I had the same problem after installing "VM Backup". I see you installed it too. Remove it and restart..

    Thanks - just seen it's been marked incompatible with the RC builds.  Hope that works

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted

    1 hour ago, livingonline8 said:

    the main reason I have to mount to non-empty folder is because I am combining two folders of my media, one on google drive and the other on my unraid....they are both not empty and I have to mount to my non empty media folder 

    the rclone mount should always be to an empty directory - mergerfs/unionfs merges the local and cloud folder.  The simple solution is to make sure the rclone mount location is empty.

     

    Also, I recommend you switch to the mergerfs scripts which are much better and will make debugging much easier.

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted

    10 hours ago, lilbumblebear said:

    Thank you for the scripts and how-to guide!  I have gotten through all of the steps and it looks like things are working well for Plex.  I had a couple of questions to clarify how some things work (I apologize if these have already been answered, I might have missed it while I was reading the thread):

     

    1.  I would like to be able to use some files from my Google Drive in my VMs.  I am unable to "see" the mount_mergerfs directory in my network.  When I checked, it looks like the share was created as root:root instead of nobody:users.  Is this correct?  If so, how do I sync files to/from Google Drive within my VM? 
    2. I have 2 remotes like the instructions described (unencrypted and encrypted).  My encrypted remote is a sub-directory inside of my Google Drive root directory.  So, if I move a file into mount_mergerfs/remotename/encrypteddirectory, will it automatically be encrypted during upload to Google?  If not, what did I miss to set this up correctly?

    1. you should be able to see your files just like other unRAID shares.  Check your unRAID share settings

    2. Correct - rclone encrypts the file.  If you want to check for peace of mind, create a new folder on your server and monitor gdrive to see the encrypted folder/file being created

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted

    2 hours ago, veritas2884 said:

    Quick question. Could mergerfs be used to combine a 4k movies folder and 1080p movies folder for Plex, but keep the two folders separate for my 2 instances of Radarr to address?

     

    Example: I use @DZMM's script to mount my 4k movies folder and 1080p movies folder, I have a Radarr 1080p docker that maps to the 1080p Folder and Radarr 4k docker that maps to the 4k movies folder. I then add another line to DZMM's script that also creates a mergerfs folder that combines those two locations for Plex to address. Since plex now has the ability to choose a 1080p file over a 4k file if the client can't natively stream 4k, this would eliminate the need to have 2 separate libraries of movies. I believe the 2 Radarr instances would keep the movie folder's naming convention the same inside each of their parent folders, so only the movie files themselves would be different since I have radarr add the quality to the filename. 

     

    If anyone could give me a sanity check on if this would work and also the mergerfs syntax, that would be huge. 

    I think what you are proposing to do isn't the best way to solve your problem as Radarr won't like it and will end up deleting files e.g. Radarr_4K will delete and upgade the 1080p file. 

     

    This is what I do - short version as in a rush - but you should be able to follow the logic:

     

    1. Radarr 1080p (R1080) docker looking at HD folder
    2. Radarr 4k docker (R4K) looking at 4K folder
    3. Radarr sync script so R1080P movies with profile UHD get synced to R4K
    4. R1080P UHD set to not upgrade beyond 1080p remux
    5. Files get added to seperate folders
    6. Both those folders added to my Movies library in Plex that manages which version to play

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted

    3 hours ago, axeman said:

    Same here. I even tried adjusting the sleep time to 120 seconds. Didn't seem to help. 

    With the introduction of the cache, rclone does a bit of extra checking before the mount is fully live and accessible.  Just keep repeating the script and it gets there.  It takes me a while to complete my mount (about 5-10 mins) with 7 tdrvies each with a 300GB cache.  I've found that bigger caches take even longer.

     

    One option I'm considering adding is to choose whether or not to flush the cache on unmount.

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted

    On 1/21/2021 at 6:16 PM, tamito said:

    I have an issue when running rclone_mount script. It can't create gdrive_media_vfs inside mount_rclone folder. I check mount_rclone from krusade. It has ghost gdrive_media_vfs existed. What should I do?

      

    
Script location: /tmp/user.scripts/tmpScripts/rclone_mount/script
Note that closing this window will abort the execution of this script
21.01.2021 10:12:03 INFO: Creating local folders.
mkdir: cannot stat '/mnt/user/mount_rclone/gdrive_media_vfs': Transport endpoint is not connected
21.01.2021 10:12:03 INFO: Creating MergerFS folders.
21.01.2021 10:12:03 INFO: *** Starting mount of remote gdrive_media_vfs
21.01.2021 10:12:03 INFO: Checking if this script is already running.
21.01.2021 10:12:03 INFO: Script not running - proceeding.
21.01.2021 10:12:03 INFO: *** Checking if online
21.01.2021 10:12:04 PASSED: *** Internet online
21.01.2021 10:12:04 INFO: Mount not running. Will now mount gdrive_media_vfs remote.
21.01.2021 10:12:04 INFO: Recreating mountcheck file for gdrive_media_vfs remote.
2021/01/21 10:12:04 DEBUG : rclone: Version "v1.53.4" starting with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone/.rclone.conf" "copy" "mountcheck" "gdrive_media_vfs:" "-vv" "--no-traverse"]
2021/01/21 10:12:04 DEBUG : Creating backend with remote "mountcheck"
2021/01/21 10:12:04 DEBUG : Using config file from "/boot/config/plugins/rclone/.rclone.conf"
2021/01/21 10:12:04 DEBUG : fs cache: adding new entry for parent of "mountcheck", "/"
2021/01/21 10:12:04 DEBUG : Creating backend with remote "gdrive_media_vfs:"
2021/01/21 10:12:04 DEBUG : Creating backend with remote "gdrive:crypt"
2021/01/21 10:12:05 DEBUG : mountcheck: Modification times differ by -5m13.245271688s: 2021-01-21 10:12:04.210271688 -0800 PST, 2021-01-21 18:06:50.965 +0000 UTC
2021/01/21 10:12:06 INFO : mountcheck: Copied (replaced existing)
2021/01/21 10:12:06 INFO :
Transferred: 32 / 32 Bytes, 100%, 23 Bytes/s, ETA 0s
Transferred: 1 / 1, 100%
Elapsed time: 2.4s

2021/01/21 10:12:06 DEBUG : 4 go routines active
21.01.2021 10:12:06 INFO: *** Creating mount for remote gdrive_media_vfs
21.01.2021 10:12:06 INFO: sleeping for 5 seconds
2021/01/21 10:12:06 NOTICE: Serving remote control on http://127.0.0.1:5572/
2021/01/21 10:12:07 Fatal error: Can not open: /mnt/user/mount_rclone/gdrive_media_vfs: open /mnt/user/mount_rclone/gdrive_media_vfs: transport endpoint is not connected
21.01.2021 10:12:11 INFO: continuing...
21.01.2021 10:12:11 CRITICAL: gdrive_media_vfs mount failed - please check for problems. Stopping dockers
plex

     

    Post your script and rclone config without passwords

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted

    3 hours ago, bnevets27 said:

    I'm trying to use this script to mount multiple shared drives. From everything I've read here I should just be able to run multiple version of this script. But when I do I get the following error: 

    
Failed to start remote control: start server failed: listen tcp 127.0.0.1:5572: bind: address already in use

     

    I have rebooted. I'm only mounting the mergerfs in one of the versions of the script. Whichever script I run first will work but I can't get a second to work due to the above error. 

    Any clues?

    You can only use the --rc command once.  I think you've got it in each mount instance

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted

    1 hour ago, Ericsson said:

    Deluge will be linked to /mnt/user/data/torrents

    Sabnzbd will be linked to /mnt/user/data/usenet

    Completed files will be moved to /mnt/user/data/media

    Radarr/Sonarr/Lidarr will take the files and move them to /mnt/user/data/gdrive/mount_mergerfs

    This is the problem - you need all your dockers using the same mappings, otherwise hardlinks won't work as they will be seen as different volumes.

     

    I.e in your docker settings in unraid just create /user -->/mnt/user , then in the docker applications link to where on unraid you want to use e.g. /user/data/torrents for files you want storing in /mnt/user/data/torrents on unraid.

     

    Read the thread (search for hardlinks) if it's not clear as I must have gone over this at least a dozen times.

    Guide: How To Use Rclone To Mount Cloud Drives And Play Files

    in Plugins and Apps

    Posted

    5 hours ago, AlexGreenUK said:

    --poll-interval 15s \

     

    Change this in the script manually

     

    17 minutes ago, AlexGreenUK said:

    If I upload to /mount_rclone will they poll to the cloud straight away even though they are not physically there and then upload? Or will they disappear from /mount_rclone when the upload happens.

     

    /mount_rclone is a live view of gdrive.  If you try to add a file it will be transferred in real-time to gdrive.  It's not advised as if the transfer fails the file can be lost, whereas rclone move will retry the upload.  Also, I believe that with the new cache functionality, the file gets cached and then uploaded in the background - which means you lose all control of the upload speed or when the upload occurs. 

     

    I can't think of a scenario where I would advise adding files directly to /mount_rclone - just use the upload script and set the cron to a high frequency

×
×
  • Create New...