Leaderboard

Popular Content

Showing content with the highest reputation on 06/22/20 in all areas

  1. 6 points
  2. Multiple mounts, one upload and one tidy-up script. @watchmeexplode5 did some testing and performance gets worse as you get closer to the 400k mark, so you'll need to do something like below soon: 1. My folder structure looks something like this: mount_mergerfs/tdrive_vfs/movies mount_mergerfs/tdrive_vfs/music mount_mergerfs/tdrive_vfs/uhd mount_mergerfs/tdrive_vfs/tv_adults mount_mergerfs/tdrive_vfs/tv_kids 2. I created separate tdrives / rclone mounts for some of the bigger folders e.g. mount_rclone/tdrive_vfs/movies mount_rclone/tdrive_vfs/music mount_rclone/tdrive_vfs/uhd mount_rclone/tdrive_vfs/adults_tv for each of those I created a mount script instance where I do NOT create a mergerfs mount 3. I mount each in turn and for the final main mount add the extra tdrive rclone mounts as extra mergerfs folders: ############################################################### ###################### mount tdrive ######################### ############################################################### # REQUIRED SETTINGS RcloneRemoteName="tdrive_vfs" RcloneMountShare="/mnt/user/mount_rclone" LocalFilesShare="/mnt/user/local" MergerfsMountShare="/mnt/user/mount_mergerfs" # OPTIONAL SETTINGS # Add extra paths to mergerfs mount in addition to LocalFilesShare LocalFilesShare2="/mnt/user/mount_rclone/music" LocalFilesShare3="/mnt/user/mount_rclone/uhd" LocalFilesShare4="/mnt/user/mount_rclone/adults_tv" 4. Run the single upload script - everything initially gets moved from /mnt/user/local/tdrive_vfs to the tdrive_vfs teamdrive 5. Overnight I run another script to move files from the folders that are in tdrive_vfs: to the correct teamdrive. You have to work out the encrypted folder names for this to work. Because rclone is moving the files, the mergerfs mount gets updated i.e. it looks to plex etc like they haven't moved #!/bin/bash rclone move tdrive:crypt/music_tdrive_encrypted_folder_name gdrive:crypt/music_tdrive_encrypted_folder_name \ --user-agent="transfer" \ -vv \ --buffer-size 512M \ --drive-chunk-size 512M \ --tpslimit 8 \ --checkers 8 \ --transfers 4 \ --order-by modtime,ascending \ --exclude *fuse_hidden* \ --exclude *_HIDDEN \ --exclude .recycle** \ --exclude .Recycle.Bin/** \ --exclude *.backup~* \ --exclude *.partial~* \ --drive-stop-on-upload-limit \ --delete-empty-src-dirs rclone move tdrive:crypt/tv_tdrive_encrypted_folder_name tdrive_t_adults:crypt/tv_tdrive_encrypted_folder_name \ --user-agent="transfer" \ -vv \ --buffer-size 512M \ --drive-chunk-size 512M \ --tpslimit 8 \ --checkers 8 \ --transfers 4 \ --order-by modtime,ascending \ --exclude *fuse_hidden* \ --exclude *_HIDDEN \ --exclude .recycle** \ --exclude .Recycle.Bin/** \ --exclude *.backup~* \ --exclude *.partial~* \ --drive-stop-on-upload-limit \ --delete-empty-src-dirs rclone move tdrive:crypt/uhd_tdrive_encrypted_folder_name tdrive_uhd:crypt/uhd_tdrive_encrypted_folder_name \ --user-agent="transfer" \ -vv \ --buffer-size 512M \ --drive-chunk-size 512M \ --tpslimit 8 \ --checkers 8 \ --transfers 4 \ --order-by modtime,ascending \ --exclude *fuse_hidden* \ --exclude *_HIDDEN \ --exclude .recycle** \ --exclude .Recycle.Bin/** \ --exclude *.backup~* \ --exclude *.partial~* \ --drive-stop-on-upload-limit \ --delete-empty-src-dirs exit
    2 points
  3. One use case I will be using it for off the bat would be having a separate cache for docker and appdata formatted as XFS to prevent the 10x - 100x inflated writes that happen with a BTRFS cache. It is also a way of adding more then 30 drives if someone needed that. A second cache pool could be used as a more "classic" NAS with raid and apparently possible ZFS support in the future, really pushing into freeNAS territory there. Or simply setup cache pools based on usage and speed needs. For example a scratch drive that doesn't need reduntacy with a raid 0 setup on less trustworthy drives. another high speed cache with NVME drives for working projects. Then a high stability pool for normal writes to the array caching using raid1 and very good drives that has very low chance of failure. Just the first things that came to mind, If they make it, people will find uses for it that is for sure. For example this makes a tiered storage system fairly easy to implement in the future, this is a use case I would use for sure. Tired storage will move recently / frequently used data to faster storage pools and less used or old data to slower tiers automatically.
    2 points
  4. Summary: Support Thread for ich777 Application Dockers (DirSyncPro, Rapid Photo Downloader,... all available Docker's in the second post) DockerHub: https://hub.docker.com/u/ich777/ Please read the discription of each docker and the variables (some dockers need special variables to run). If you like my work, please consider making a donation
    1 point
  5. Intent: This guide will take you through the process of passing through the integrated audio of the Intel chipset. This methods is tested with a B150 chipset, but it should work with any recent chipset from Intel. I have found this process in the forum, however, my intent is to try to write an easier post to read. Prerequisites: Working VM Unraid 6.3.x / 6.4.x / 6.5.x / 6.6.x Intel CPU and Bios that supports VT-d Intel Motherboard Guide: 1. Enable Intel VT-D inside your motherboard bios. 2. Open the Web GUI and go to Settings -> VM Manager and click on Advanced View. 3. Enable the PCIe ACS Override setting, try downstream first. (This step might not be required, i've tried with the override disabled and it looks like it working just fine) 4. Go to Tools -> System Devices and look for an audio device. In my case : [8086:a170] 00:1f.3 Audio device: Intel Corporation Sunrise Point-H HD Audio (rev 31) Copy everything between [ ] , this is your device ID and you will need that for the next step. 5. Go to Main tab and under Boot Device, click on Flash. 6. Go to your Syslinux configuration and replace the append line under "label unRAID OS" with this one and then click "Apply". append pcie_acs_override=downstream vfio-pci.ids=PUT_YOUR_DEVICE_ID_HERE modprobe.blacklist=i2c_i801,i2c_smbus initrd=/bzroot Your syslinux configuration should look like this, except maybe your device ID: default /syslinux/menu.c32 menu title Lime Technology, Inc. prompt 0 timeout 50 label unRAID OS menu default kernel /bzimage append pcie_acs_override=downstream vfio-pci.ids=8086:a170 modprobe.blacklist=i2c_i801,i2c_smbus initrd=/bzroot label unRAID OS GUI Mode kernel /bzimage append pcie_acs_override=downstream initrd=/bzroot,/bzroot-gui label unRAID OS Safe Mode (no plugins, no GUI) kernel /bzimage append pcie_acs_override=downstream initrd=/bzroot unraidsafemode label unRAID OS GUI Safe Mode (no plugins) kernel /bzimage append pcie_acs_override=downstream initrd=/bzroot,/bzroot-gui unraidsafemode label Memtest86+ kernel /memtest 6. Reboot your server. 7. Now you should have the choice to add your Intel audio in the Sound Card selection when you're editing your VM. NOTICE: It may require to unplug your server from the AC to make this work, also sometimes from my experience the sound card may just stop working and the only way I have found to make it work again is to shutdown the server and unplug it from the AC.
    1 point
  6. A discounted 2nd or 3rd license was offered a few years ago in the major transition from unRAID v5 to v6 and I bought a couple of extra licenses. Since then, that has not been offered, but I would not hesitate to buy a couple of extra licenses at full price if a need arose. For my purposes, at the current price levels unRAID remains a bargain even in comparison to free offerings (yes, a discount would still be nice, but, hopefully not an absolute necessity. 😀)
    1 point
  7. You will be able to start the windows vm automatically Should be no problem shutting down array daily, provided that you do it correctly , not just pulling the plug! windos performance will be largely on par with a bare metal system for most tasks, assuming you are passing through a Gpu, and sufficient cpu cores and RAM. Conventional wisdom says you’ll have a 5-10% performance drop, but you’ll only really notice it in benchmarks or serious gaming. You do need to reserve some system resources to allow unRAID run. for usb, for best results, pass through a whole usb controller / adapter. This is especially relevant when working with usb audio devices which won’t perform at all well if passed through directly to a vm. Much better to pass through the usb controller and attache the usb device to that. good luck,
    1 point
  8. https://forums.unraid.net/bug-reports/prereleases/unraid-os-version-690-beta22-available-r955/?do=findComment&comment=9350
    1 point
  9. You're welcome, like mentioned not all SSDs (in fact most of them) are able to sustain 500MB/s writes, 800MB/s means you now have an NVMe device, which is generally considerably faster, though like all devices some models are faster than others.
    1 point
  10. Look at the Main page on the GUI and make sure that all of the drives are mounted. If they are all there, you can start the array. It will begin by running a parity check. If any are missing, get a diagnostics file Tools >>> Diagnostics Post the file in a new post.
    1 point
  11. Thanks for write up, and if you don't mind going to mark this as solved.
    1 point
  12. What do you get from the command line with this? ifconfig
    1 point
  13. I agree, I didn't want to hack stuff apart too much to try and fix this so that any official fix would work properly. At this point the remount option is your best bet, it can be done with the array running, it does not change anything about the base unraid workings and it reverts to stock after a reboot. So no risk to give it a try. You will just need to run it again after every reboot. If you only have a single cache drive, then reformatting as XFS is the only true fix, dropped my writes from 7gb/hour to less then 200mb/hour. For those of us with a cache pool, there is no fix, we have to get creative, like me adding an SSD to the array formatted as XFS, this only works since I don't have a parity drive at the moment.
    1 point
  14. My bad. Tou have to switch to another language before you can remove
    1 point
  15. You've never installed it as a language pack then. (Inatalling via CA always pulls the latest zip file (auto generated after PRs are merged) regardless of what the dates version is
    1 point
  16. Sorry Rückzug, bin einfach nur blind 🤓 Sprache ist bei Werkzeuge doch da
    1 point
  17. Less clicks to just go back to CA and click the x within the language section
    1 point
  18. i found this: https://www.reddit.com/r/VFIO/comments/eba5mh/workaround_patch_for_passing_through_usb_and/ And i have no idea of how to implement this with your docker But if you need a tester i'm your man Thanks
    1 point
  19. found this:- https://github.com/Novik/ruTorrent/issues/2041 looks to be a caching issue, try clearing your browsers cache.
    1 point
  20. Sollte nun gefixt sein, bitte Sprache deinstallieren und neu installieren dann sollte es richtig sein
    1 point
  21. Your GPU will not work, as it is not supported by macOS! Unfortunately there is no way to make use of your card so under macOS. Get a supported GFX like mentioned here... Also older NVIDIA GPUs will work, GTX 1070, 1080, etc. with webdriver. All GTX780 will work OOB without the need of any NVIDIA webdrivers.
    1 point
  22. Just a follow-up and close out this issue, turns out the PCIe USB card I was using is, for some reason, not compatible with Unraid and so would not work regardless of what I tried. I found THIS post by @CHBMB and, thanks to his research and testing of the various PCIe USB cards, I ended up ordering the Inateck KT5001. I just installed it, went through the process to use it as a passthrough device, and the VM booted up just fine with success in read/write/delete/etc from a USB stick and another USB drive.
    1 point
  23. Hi, if you still have that problem, adding -crossplay to "Extra Game Parameters" solved it for me. I also left the steam credentials blank.
    1 point
  24. Been mostly "off the grid" for three days enjoying some national park hikes and wilderness recreation. I restarted the container with a 4GB limit just before I left. I returned to find RAM usage at 1.144GB after a little more than three days. Before setting the limit, I had seen usage as high as 1.3GB after two days. Even with the limit, RAM utilization climbs every day but the rate of increase seems to have slowed.
    1 point
  25. You can use rsync if it's XFS or rsync/snapshots if it's btrfs.
    1 point
  26. I was able to get the controller working again by. 1. renaming the app data folder unifi-controllerd 2. Removing the unifi docker 3. reinstalling the unfi docker 4. restoring a backup from unifi-controllerd The only problem is that when I tried to install the LTS Tag, I could not restore my backup because it was a newer version. I was forced to install the latest tag. I'm looking now to see if I can change tags Chas
    1 point
  27. Really hoping that the 5.8 kernel makes it into a release not too far down the line. As I understand it, the combination of the GPU reset patches which were submitted for 5.8 alongside the team working on amdgpu driver support should hopefully fix the Navi reset issue without a custom kernel being required.
    1 point
  28. There's filesystem corruption on cache, best bet is to backup, re-format and restore cache data.
    1 point
  29. Same for me, using x570 auros master and it is a pity i cant use the onboard sound as passthrough and im really not comfortable with running a custom kernel. i was hoping for unraid 6.9 to be the version that could unleash the power of my new ryzen system, without the need for custom kernels
    1 point
  30. I appreciate you looking into it so quickly (really wow), it looks like that first reddit post I linked was updated just today to reflect those upstream changes to 5.8. I personally work around it currently by passing through a usb headset to the VM for sound because I didn't feel comfortable running a custom kernel even though it looks like many have with success. It isn't ideal but it works. I am sure there are a lot of people who would find these patches useful with the popularity of the new Ryzen processors and X570 motherboards. Thank you for your time.
    1 point
  31. I might have an older quadro card that I could ship to you. Send me a PM.
    1 point
  32. After unsuccessfully changing the branch from 'latest' to 'dev' and running chmod -R 777 /mnt/user/appdata/pihole/ I found a solution: In my docker config I changed /mnt/cache/appdata/pihole/pihole/ to /mnt/user/appdata/pihole/pihole/ and /mnt/cache/appdata/pihole/dnsmasq.d/ to /mnt/user/appdata/pihole/dnsmasq.d/ All the error message seem to have gone away.
    1 point
  33. That suggests you're being limited by the device speed, not all SSDs (in fact most of them) are able to sustain nowhere near 500MB/s writes, by default Unraid uses 20% free RAM for write cache, that explains the first 8/10 seconds at max speed, then you are limited by the device actual write speed, and you can do an easy test to confirm, set the RAM cache to 40% and see if now you get approximately double the time at max speed: sysctl vm.dirty_ratio=40 Type sysctl vm.dirty_ratio=20 or reboot to go back to defaults.
    1 point
  34. Dockers Available so far: DirSyncPro: very strong synchronization tool that's highly customizable and schedulable (Docker comes with WebGUI, SMB, FTP & WebDAV support and with encryption by CryFS - backup your files securely to any SMB, FTP & WebDAV offsite server) Rapid Photo Downloader: a tool to improve the workflow of your photo and video import. Customize the import by setting filters and rules to rename, sort, backup and more all within the Docker including a WebGUI. DNS over HTTPS - DoH-Server: You easily can hide your DNS querys from your ISP on your mobile devices with this docker on Firefox or Chrome and even on Android with the Intra App (by default it is set to use the Cloudflare and Google DNS servers). As a special bonus you can hide all Ad's on your Android Device on the go without the need of a VPN (for Android Devices only the Intra app is needed https://getintra.org/)! Very usefull if you have kids and they should not visit certain sites or if you simply don't like Ad's on your Android Device. Also works for iOS (search for 'DNS Cloak' on the AppStore and create a custom server)! DNS over HTTPS - DoH-Client: Easily hide your DNS querys from your ISP on your home network and in combination with PiHole you can block also Ad's and also protect your mobile devices and encrypt even your mobile devices DNS querys with the DoH-Server. jDownloader2: A free and very powerful download manager with WebGUI. Jenkins: A software tool that's used to automate the non-human part of the software development process. Zabbix-Server: A enterprise-class open source distributed monitoring solution. Zabbix-Webinterface: Zabbix web interface is a part of Zabbix software. It is used to manage resources under monitoring and view monitoring statistics. Online Check Your Server: - A really simple ping container with Pushover notification if the pinged host is not reachable. TeamSpeak3 Server: A free (for 32 slots) VoIP client with file transfare capabilitys. STUN-TURN Server: A simple STUN and TURN Server mainly created for Nextcloud Talk. Remmina: Remmina is a remote desktop client for POSIX-based computer operating systems. It supports the Remote Desktop Protocol, VNC, NX, XDMCP, SPICE and SSH protocols. XLink-Kai-Evolution: lets you connect with other console users around the world, and play online games for free. XLink Kai: Evo VII tricks your console into thinking that the other users it is connecting to over the Internet, are actually part of a Local Area Network. This is the basis of system-link gaming, where friends would gather around in the same house and play over 2 or more consoles. With XLink Kai: Evo VII, you now have the option to test your skills out with anybody in the world. As for the technical aspects of tunnelling network packets, we won't bore you with that... MagicMirror²: Make your own Smart Mirror - this container is the Server version of MagicMirror² and is also capable of installing most modules automatically. MEGASync: MEGAsync is an intuitive application that enables you to effortlessly synchronize folders on several computers. PhotoPrism: is a server-based application for browsing, organizing and sharing your personal photo collection. InspIRCd: is a modular Internet Relay Chat (IRC) server. TheLounge: is the self-hosted web IRC client. Anope: is a set of IRC Services designed for flexibility and ease of use. Electrum: A Bitcoin wallet focused on speed and simplicity, with low resource usage. Enpass: is a cross-platform password management app to securely store passwords and other credentials in a virtual vault locked with a master password. FlutterCoin-Wallet: FlutterCoin is a community driven triple hybrid coin and the very first to offer a highly secure network through: Proof of Work (Mining), Proof of Stake (Investing), and it's own highly innovative Proof of Transaction (Using). Firefox: is a free web browser backed by Mozilla, a non-profit dedicated to internet health and privacy. SABnzbd: is a program to download binary files from Usenet servers. Radarr: Radarr A fork of Sonarr to work with movies à la Couchpotato. Sonarr: Sonarr is a PVR for Usenet and BitTorrent users. Lidarr: Lidarr is a music collection manager for Usenet and BitTorrent users. luckyBackup: is a very user-friendly GUI backup program that uses rsync as a backend. Thunderbird: is a free email application. Chrome: is a web browser developed by Google. NZBGet: is an Usenet-client written in C++ and designed with performance in mind to achieve maximum download speed by using very little system resources. Ferdi-Client: is based on Franz - a software already used by thousands of people - with the difference that Ferdi gives you many additional features and doesn't restrict its usage! NZBHydra2: is a meta search for newznab indexers and torznab trackers. OpenVPN-Client: is a container that was designed to be started first to provide a VPN Tunnel connection to other containers. Debian Bullseye: Fully working Debian Bullseye container with a noVNC WebGUI and all basic tools installed. Krusader: is an advanced orthodox file manager for KDE and other desktops in the Unix world. Restreamer: allows smart free video streaming in real time. Owncast: is a self-hosted live video and web chat server for use with existing popular broadcasting software. Checkmk-RAW: is the official container of checkmk. Checkmk is a leading tool for Infrastructure & Application Monitoring. Simple configuration, scalable, flexible. Open Source and Enterprise. Checkmk-Agent: monitors local services and reports any issues to the Checkmk server. Ungoogled-Chrome: is a lightweight approach to removing Google web service dependency from the Chromium project web browser.
    1 point
  35. Also, any users that created what should be a redundant pool from v6.7.0 should convert metadata to raid1 now, since even after this bug is fixed any existing pools will remain as they were, use: btrfs balance start -mconvert=raid1 /mnt/cache To check if it's using correct profile type: btrfs fi usage -T /mnt/cache Example of a v6.7 created pool, note that while data is raid1, metadata and system are single profile, i.e. some part of the metadata is on each device, and will be incomplete if one of them fails, all chunks types need to be raid1 for the pool to be redundant : Data Metadata System Id Path RAID1 single single Unallocated -- --------- --------- --------- -------- ----------- 2 /dev/sdg1 166.00GiB 1.00GiB - 764.51GiB 1 /dev/sdi1 166.00GiB 1.01GiB 4.00MiB 764.50GiB -- --------- --------- --------- -------- ----------- Total 166.00GiB 2.01GiB 4.00MiB 1.49TiB Used 148.08GiB 555.02MiB 48.00KiB
    1 point
  36. Have you had any trouble using the USB 3.0 ports with your Unraid USB stick? I thought about getting one but the lack of USB 2.0 kind of scared me off.
    1 point
  37. Ok, have added sudo to the container. So update your container. So this should work to enable you to run occ.. docker exec -it nextcloud bash sudo -u abc php /config/www/nextcloud/occ Just remember as stated on the first post, we're not supporting migrations from Owncloud, so you're on your own...
    1 point