Jump to content

Leaderboard


Popular Content

Showing content with the highest reputation since 08/29/20 in Posts

  1. 8 points
    OK guys, multi remote endpoint support is now in for this image please pull down the new image (this change will be rolled out to all my vpn images shortly). What this means is that the image will now loop through the entire list, for example, pia port forward enabled endpoints, all you need to do is edit your ovpn config file and add the remote endpoints at the top and sort into the order you want them to be tried, an example pia ovpn file is below (mine):- remote ca-toronto.privateinternetaccess.com 1198 udp remote ca-montreal.privateinternetaccess.com 1198 udp remote ca-vancouver.privateinternetaccess.com 1198 udp remote de-berlin.privateinternetaccess.com 1198 udp remote de-frankfurt.privateinternetaccess.com 1198 udp remote france.privateinternetaccess.com 1198 udp remote czech.privateinternetaccess.com 1198 udp remote spain.privateinternetaccess.com 1198 udp remote ro.privateinternetaccess.com 1198 udp client dev tun resolv-retry infinite nobind persist-key # -----faster GCM----- cipher aes-128-gcm auth sha256 ncp-disable # -----faster GCM----- tls-client remote-cert-tls server auth-user-pass credentials.conf comp-lzo verb 1 crl-verify crl.rsa.2048.pem ca ca.rsa.2048.crt disable-occ I did look at multi ovpn file support, but this is easier to do and as openvpn supports multi remote lines, it felt like the most logical approach. note:- Due to ns lookup for all remote lines, and potential failure and subsequent try of the next remote line, time to initialisation of the app may take longer. p.s. I dont want to talk about how difficult this was to shoe horn in, i need to lie down in a dark room now and not think about bash for a while :-), any issues let me know!.
  2. 7 points
    OK guys, multi remote endpoint support is now in for this image please pull down the new image (this change will be rolled out to all my vpn images shortly). What this means is that the image will now loop through the entire list, for example, pia port forward enabled endpoints, all you need to do is edit your ovpn config file and add the remote endpoints at the top and sort into the order you want them to be tried, an example pia ovpn file is below (mine):- remote ca-toronto.privateinternetaccess.com 1198 udp remote ca-montreal.privateinternetaccess.com 1198 udp remote ca-vancouver.privateinternetaccess.com 1198 udp remote de-berlin.privateinternetaccess.com 1198 udp remote de-frankfurt.privateinternetaccess.com 1198 udp remote france.privateinternetaccess.com 1198 udp remote czech.privateinternetaccess.com 1198 udp remote spain.privateinternetaccess.com 1198 udp remote ro.privateinternetaccess.com 1198 udp client dev tun resolv-retry infinite nobind persist-key # -----faster GCM----- cipher aes-128-gcm auth sha256 ncp-disable # -----faster GCM----- tls-client remote-cert-tls server auth-user-pass credentials.conf comp-lzo verb 1 crl-verify crl.rsa.2048.pem ca ca.rsa.2048.crt disable-occ I did look at multi ovpn file support, but this is easier to do and as openvpn supports multi remote lines, it felt like the most logical approach. note:- Due to ns lookup for all remote lines, and potential failure and subsequent try of the next remote line, time to initialisation of the app may take longer. p.s. I dont want to talk about how difficult this was to shoe horn in, i need to lie down in a dark room now and not think about bash for a while :-), any issues let me know!.
  3. 6 points
    Ultimate UNRAID Dashboard (UUD) Current Release: Version 1.3 | Version 1.4 In Active Development! Overview: This is my attempt to develop the Ultimate Grafana/Telegraf/InfluxDB dashboard. This entire endeavor started when one of our fellow users @hermy65 posed a simple, but complex question in the below forum topic. I decided to give it a shot, as I am an IT professional, specifically in enterprise data warehouse/SQL server. If you are a Grafana developer, or have had experience building dashboards/panels for UNRAID, please let me know. I would love to collaborate. Version 1.3 Screenshots - Serial Numbers Redacted (Click the Images as They are Very High Resolution): Disclaimer: This is based on my 30 Drive UNRAID Array. So this shows an example of a fully maxed out UNRAID setup with max drives, dual CPUs, Dual NICs, etc. You will/may need to adjust panels & queries to accommodate your individual UNRAID architecture. This is a heavily modified and customized version of GilbN's original off of his tutorial website, with new and original code. As such, he is a co-developer on this version. I have spent many hours custom coding new functionality and features based on that original template. Much has been learned and I am excited to see how far this can go in the future. GilbN has been gracious enough to help support my modded version here as he wrote the back-end. Thanks again! Developers: Primary Developer: @falconexe (USA) UUD Founder | Active Development | Panels | Database Queries | Look & Feel | GUI | Refinement | Support Co-Developer: @GilbN (Europe) Original Template | Back-end | Dynamics | REGEX | Support | Tutorials Contributors: @hermy65 @atribe @Roxedus @SpencerJ @testdasi @ChatNoir @MammothJerk @FreeMan @danktankk Dependencies (Last Updated On 2020-09-24): Docker - InfluxDB Docker - Telegraf Docker Network Type: HOST (Otherwise You May Not Get All Server Metrics) 👉 Create Telegraf Configuration File 👈 (DO THIS FIRST!) Create and Place a File into Directory "mnt/user/appdata/YOUR_TELEGRAF_FOLDER" Enable and Install Telegraf Plugins Telegraf Plugin - [[inputs.net]] Enable in telegraf.config Telegraf Plugin - [[inputs.docker]] Enable in telegraf.config Telegraf Pugin - [[inputs.diskio]] Enable in telegraf.config To Use Static Drive Serial Numbers in Grafana (For DiskIO Queries) Do the Following: Edit telegraf.conf > [[inputs.diskio]] > Add device_tags = ["ID_SERIAL"] > Use ID_SERIAL Flag in Grafana Now Upon Booting, You Don't Have to Worry About SD* Mounts Changing (So Your Graphs Don't Get Messed Up!) You Can Also Set Overrides on the Query Fields to Map the Serial Number to a Common Disk Name Like "DISK01" etc. Telegraf Plugin - [[inputs.smart]] Enable in telegraf.config Also Enable "attributes = true" Bash Into Telegraf Docker and Run "apk add smartmontools" Telegraf Plugin - [[inputs.ipmi_sensor]] Enable in telegraf.config Bash Into Telegraf Docker and Run "apk add ipmitool" Telegraf Pugin - [[inputs.apcupsd]] Enable in telegraf.config Docker Config Add New Path (NOTE: This path has now been merged into Atribe's Telegraf Docker Image. (Thanks @GilbN & @atribe) Post Arguments "/bin/sh -c 'apk update && apk upgrade && apk add ipmitool && apk add smartmontools && telegraf'" Docker - Grafana CA Plugin: IPMI Tools Dashboard Variables (Update These For Your Server): Compatible With: Grafana Unraid Stack @testdasi Docker: https://hub.docker.com/r/testdasi/grafana-unraid-stack Let me know if you have any questions or are having any issues getting this up and running if you are interested. I am happy to help. I haven't been this geeked out about my UNRAID server in a very long time. This is the cherry on top for my UNRAID experience going back to 2014 when I built my first server. Thanks everyone! VERSION 1.3 (Latest) Ultimate UNRAID Dashboard - Version 1.3 - 2020-09-21 (falconexe).json VERSION 1.2 (Deprecated) Ultimate UNRAID Dashboard - Version 1.2 - falconexe.json
  4. 6 points
    sadly you probably just got lucky, that is unless pia are finally sorting their sh*t out, in any case the multi remote line code should help, as mentioned above i am working on next-gen now and its going well, i MIGHT have something for people to test by the end of today. p.s. LOTS more endpoints support port forwarding on next-gen! - like dozens!
  5. 6 points
    Well this is what I sent them. Maybe the possibility of losing customers is a higher priority to them. "I am using the legacy OVPN connections with port forwarding in a docker on my unRAID server. The community seems to be having major issues with connections to endpoints that support port forwarding. It seems like these issues have started happening in the past recent few weeks. I would like to know if there is a plan to support OVPN connections on your next generation servers? There is a section of your customer base that are using these connections that I fear you will loose if you do not address this concern."
  6. 5 points
    ok progress with PIA!, they now at least accept there is an issue, email just received:-
  7. 4 points
    Added prebuilt images for Unriad v6.9.0beta29 to the bottom of the first post. Prebuilt images include: nVidia nVidia & DVB nVidia & ZFS ZFS iSCSI
  8. 4 points
    VERSION 1.3 IS FINALLY HERE! After many many hours, little sleep, and just short of a metric crap-ton of edits/revisions/code changes/code merges, I have finally finished development on UUD version 1.3. This is a HUGE update and should make everyone's lives much easier trying to adapt this to their own UNRAID server. The dashboard is now extremely dynamic. I have removed hard coding throughout and implemented REGEX where possible. If it can't work for EVERYONE's server, I rewrote the code so it could. I wanted to give a HUGE shout-out to @GilbN for his continued help, support, and coding on this dashboard. He has been extremely helpful, especially with the dynamics (REGEX and Global Dashboard Variables). Without further ado... Core Changes: This Release is Related to Bug Fixes, Code Cleanup, Adding More Dynamic Ability For a Vast Range of Users/Configurations, and Continued Fine Tuning Added/Modified Dashboard Variables (See Below) to Support Wide Range of Users/Architecture/Use Cases Implemented REGEX Throughout Dashboard When and Where Possible Re-Wrote All Code Using Serial Numbers Where Possible (DiskIO, S.M.A.R.T. Device Temperatures, etc.) You Can Now Set Value Mappings on These Serials Numbers to Forever Label Drives by Drive Number! See Panel Descriptions For Usage Requires Additional Setup: There is a Way to Make Drive Order/Mapping Permanent by Using the Serial Number of the Drive Add the Following Path to the Telegraf Docker Then Edit telegraf.conf > [[inputs.diskio]] > Add device_tags = ["ID_SERIAL"] > Use ID_SERIAL Flag in Grafana This Means That Upon Booting, You Don't Have to Worry About SD* Mounts Changing You Could Override the Serial Number With "DISK01" etc. So the Serials Would Never Show Unless You Want Them To Fan Speed Gauges: Added Regex to Extract Fans From IPMI Sensors List Updated Drive Temperatures (Celsius) Panel to Display All Drive Temps Including Flash (Boot) Updated Docker CPU to Use New Variable Name "cputhreads" Instead of "cpucores" (Deprecated) Changed All Array Share Queries to Use Path = "/mnt/user0" Instead of Device = "sfhs" (Provides More Accurate/Consistent Results) Changed/Ensured All Panel Reference Query IDs to Be In Order by Appearance/Alphabetical (Query 1 = A, Query 2 = B, etc.) Changed All References and Code Involving Dual Assets to 1/2 As Opposed to 0/1 Not Treating as an Array - Example: CPU 00/CPU 01 Becomes CPU 01/CPU 02 Updated Code In Drive S.M.A.R.T. Health Summary Panel to Use Current Standards/Nomenclature Bug Fixes: UPS - Cost This Year Resolved Calculation Error Where Proper Daily Growth Was Not Enumerating Grammatical Errors Throughout Dashboard New Panels/Graphs Array Storage Utilized % Displays Percentage of Array Usage Cache Storage Utilized Displays Usage in GB of Cache Drive(s) Cache Storage Utilized % Displays Percentage of Cache Drive(s) Usage Network Interfaces (TX) Uses REGEX | Includes All Networks Interfaces (NICs, Bridges, Docker, & Virtual) Network Interfaces (RX) Uses REGEX | Includes All Networks Interfaces (NICs, Bridges, Docker, & Virtual) UI Changes: Moved Uptime Clock Panel Above "Overwatch" Section Changed Uptime Clock Panel to Transparent Style Moved Array/Disk Stat Panels to Very Top of Dashboard Renamed Panels Fan Speeds > Fan Speed Gauges Disk Storage > Array Disk Storage Drive S.M.A.R.T. Health > Drive S.M.A.R.T. Health Overview Drive Temperatures > Drive Temperatures (Celsius) CPU 00 > CPU 01 CPU 01 > CPU 02 UPS Load vs Time Left > UPS Load Vs. Time Left This Year's Cost > Cost This Year Dashboard Variables: Modified CPU Cores Variable Name to Match Label: cpucores > cputhreads Modified UPS Variables to Have "UPS" Prefix in Name kwhprice > upskwhprice maxwatt > upsmaxwatt Added Flash (Boot) Drive Variable Uses Serial Numbers. This way it will NEVER CHANGE. Set it once and forget it! (Requires New Dependency - See Above) Usage: Select Single Flash (Boot Drive) Added Parity Drive(s) Variable Uses Serial Numbers. This way they will NEVER CHANGE. Set it once and forget it! (Requires New Dependency - See Above) Usage: Select 1 or More Parity Drives Added Cache Drive(s) Variable Uses Serial Numbers. This way they will NEVER CHANGE. Set it once and forget it! (Requires New Dependency - See Above) Usage: Select 1 or More Cache Drives Added Array Drive(s) Variable Uses Serial Numbers. This way they will NEVER CHANGE. Set it once and forget it! (Requires New Dependency - See Above) Usage: Select 1 or More Array Drives (Not Flash, Not Parity, & Not Cache) Added Descriptions To Following Panels: Fan Speed Gauges Note: Uses REGEX to Parse Fan Names From IPMI Sensor List! Array Growth (Week) Note: Query Options > Min Interval - Must Match on Week/Month/Year (Set to 2h [2 Hours] by Default For Performance Reasons Array Growth (Month) Note: Query Options > Min Interval - Must Match on Week/Month/Year (Set to 2h [2 Hours] by Default For Performance Reasons) Array Growth (Annual) Note: Query Options > Min Interval - Must Match on Week/Month/Year (Set to 2h [2 Hours] by Default For Performance Reasons) Docker CPU Note: Uses Variable Flash I/O (Read & Write) Note: Uses Variable Cache I/O (Read & Write) Note: Uses Variable Array I/O (Read) Note: Uses Variables | Use Overrides > Display Name to Dynamically Name Serial Number (Field Name) to Drive Number Array I/O (Write) Note: Uses Variables | Use Overrides > Display Name to Dynamically Name Serial Number (Field Name) to Drive Number Drive S.M.A.R.T. Health Overview Note: Uses REGEX Drive Temperatures (Celsius) User Overrides > Display Name to Dynamically Name Serial Number (Field Name) to Drive Number Network Interfaces (RX) Note: Uses REGEX | Includes All Networks Interfaces (NICs, Bridges, Docker, & Virtual) Network Interfaces (TX) Note: Uses REGEX | Includes All Networks Interfaces (NICs, Bridges, Docker, & Virtual) CPU 01 Note: Uses REGEX To Find Cores in CPU 01. Change REGEX According to Your Number of Cores! Example: CPU 01 Has 8 Cores (16 With HyperThreading) - The REGEX For Cores 0-15 is "/cpu(1[6-9]|2[0-9]|3[01])|cpu-total/" CPU 02 Note: Uses REGEX To Find Cores in CPU 02. Change REGEX According to Your Number of Cores! Example: CPU 02 Has 8 Cores (16 With HyperThreading) - The REGEX For Cores 16-31 is "/cpu(1[6-9]|2[0-9]|3[01])/" CPU 01 Core Load Note: Uses REGEX To Find Cores in CPU 01. Change REGEX According to Your Number of Cores! Example: CPU 01 Has 8 Cores (16 With HyperThreading) - The REGEX For Cores 0-15 is "/cpu(1[6-9]|2[0-9]|3[01])|cpu-total/" CPU 02 Core Load Note: Uses REGEX To Find Cores in CPU 02. Change REGEX According to Your Number of Cores! Example: CPU 02 Has 8 Cores (16 With HyperThreading) - The REGEX For Cores 16-31 is "/cpu(1[6-9]|2[0-9]|3[01])/" IPMI Fan Speeds Note: Uses REGEX to Parse Fan Names From IPMI Sensor List! UPS Load % Note: Uses Variables Current Load kWh Note: Uses Variables Average UPS Load Note: Uses Variables Current UPS Load Note: Uses Variables UPS Load Vs. Time Left Note: Uses Variables Estimated Yearly Cost Note: Uses Variables | Adjust Field Unit For Your Set UPS Currency Variable As Required! Actual Cost This Year Note: Uses Variables | Adjust Field Unit For Your Set UPS Currency Variable As Required! Average Daily Cost Note: Uses Variables | Adjust Field Unit For Your Set UPS Currency Variable As Required! See Post Number 1 For the New JSON File! Alright, I'm finally heading to bed. Let me know if you run into any issues. Thanks guys. I hope you ENJOY! 😁
  9. 4 points
    We have indeed made a lot of progress in this thread. I now have a temporary stopgap solution running on my system that seems to work very well (SAS drives spin down in sync with Unraid's schedule, no sporadic / unexpected spin-ups). Since quite a few people expressed interest in this, I thought I'd share this stopgap. So I packaged it into a single run-and-forget script. We can use it until Limetech puts the permanent solution into standard Unraid code. To use, simply place the attached script somewhere on your flash drive (e.g. /boot/extra) and run it like so: bash /boot/extra/unraid-sas-spindown-pack It should be effective immediately. Assuming it works well for you, you can add a line in your "go" script to run it upon system boot. Essentially, it does the following: 1. Install a script that spins down a SAS drive. The script is triggered by the Unraid syslog message reporting this drive's (intended) spin down, and actually spins it down. 2. Install an rsyslog filter that mobilizes the script in #1. 3. Install a wrapper for "smartctl", which works around smartctl's deficiency of not supporting the "-n standby" flag for non-ATA devices. When this flag is detected and the target device is SAS, smartctl is bypassed. As always, no warranty, use at your own risk. It works for me. With that said, please report any issue. Thanks and credit points go to this great community, with special mention to @SimonF and @Cilusse. EDIT: Just uploaded an updated version. Please use this one instead; previous one had a small but nasty bug that sneaked in during final packing. Apologies. unraid-sas-spindown-pack
  10. 4 points
    Hey guys, just wanted to say a huge thanks for putting @GilbN and I in the top 3 yesterday on the entire forum. Never thought that would happen. We really appreciate it! (wipes away small tears...) 😅
  11. 3 points
    I'm using Unraid for a while now and collected some experience to boost the SMB transfer speeds: 1.) Choose the right CPU The most important part is to understand that SMB is single-threaded. This means SMB uses only one CPU core to transfer a file. This is valid for the server and the client. Usually this is not a problem as SMB does not fully utilize a CPU core (except of real low powered CPUs). But Unraid adds, because of the ability to split shares across multiple disks, an additional process called SHFS and its load raises proportional to the transfer speed, which could overload your CPU core. So the most important part, is to choose the right CPU. At the moment I'm using an i3-8100 which has 4 cores and 2257 single thread passmark points: And since I have this single thread power I'm able to use the full bandwith of my 10G network adapter which was not possible with my previous Intel Atom C3758 (857 points). I even was not able to reach 1G speeds while a parallel Windows Backup was running (see next section to bypass this limitation). Now I'm able to transfer thousands of small files and parallely transfer a huge file with 250 MB/s. With this experience I suggest a CPU that has around 1400 single thread passmark points to fully utilize a 1G ethernet port. As an example: The smallest CPU I would suggest for Unraid is an Intel Pentium Silver J5040. P.S. Passmark has a list sorted by single thread performance for desktop CPUs and server CPUs. 2.) Bypass single-thread limitation The single-thread limitation of SMB and SHFS can be bypassed through opening multiple connections to your server. This means connecting to "different" servers. The easiest way to accomplish that, is to use the ip-address of your server as a "second" server while using the same user login: \\tower\sharename -> best option for user access through file explorer as it is automatically displayed \\10.0.0.2\sharename -> best option for backup softwares, you could map it as a network drive If you need more connections, you can add multiple entries to your windows hosts file (Win+R and execute "notepad c:\windows\system32\drivers\etc\hosts"): 10.0.0.2 tower2 10.0.0.2 tower3 Results If you now download a file from your Unraid server through \\10.0.0.2 while a backup is running on \\tower, it will reach the maximum speed while a download from \\tower is massively throttled: 3.) Bypass Unraid's SHFS process If you enable access directly to the cache disk and upload a file to //tower/cache, this will bypass the SHFS process. Beware: Do not move/copy files between the cache disk and shares as this could cause data loss! The eligible user account will be able to see all cached files, even those from other users. Temporary Solution or "For Admins only" As Admin or for a short test you could enable "disk shares" under Settings -> Global Share Settings: By that all users can access all array and cache disks as SMB shares. As you don't want that, your first step is to click on each Disk in the WebGUI > Shares and forbid user access, except for the cache disk, which gets read/write access only for your "admin" account. Beware: Do not create folders in the root of the cache disk as this will create new SMB Shares Safer Permanent Solution Use this explanation. Results In this thread you can see the huge difference between copying to a cached share or copying directly to the cache disk. 4.) Enable SMB Multichannel + RSS SMB Multichannel is a feature of SMB3 that allows splitting file transfers across multiple NICs (Multichannel) and multiple CPU Cores (RSS) since Windows 8. This will raise your throughput depending on your amount of NICs, NIC bandwidth, CPU and used settings: This feature is experimental SMB Multichannel is considered experimental since its release with Samba 4.4. The main bug for this state is resolved in Samba 4.13. The Samba developers plan to resolve all bugs with 4.14. Unraid 6.8.3 contains Samba 4.11. This means you use Multichannel on your own risk! Multichannel for Multiple NICs Lets say your mainboard has four 1G NICs and your Client has a 2.5G NIC. Without Multichannel the transfer speed is limited to 1G (117,5 MByte/s). But if you enable Multichannel it will split the file transfer across the four 1G NICs boosting your transfer speed to 2.5G (294 MByte/s): Additionally it uses multiple CPU Cores which is useful to avoid overloading smaller CPUs. To enable Multichannel you need to open the Unraid Webterminal and enter the following (the file is usually empty, so do not wonder): nano /boot/config/smb-extra.conf And add the following to it: server multi channel support = yes Press "Enter+X" and confirm with "Y" and "Enter" to save the file. Then restart the Samba service with this command: samba restart Eventually you need to reboot your Windows Client, but finally its enabled and should work. Multichannel + RSS for Single and Multiple NICs But what happens if you're server has only one NIC. Now Multichannel is not able to split something, but it has a sub-feature called RSS which is able to split file transfers across multiple CPU cores with a single NIC: Of course this feature works with multiple NICs: And this is important, because it creates multiple single-threaded SMB processes and SHFS processes which are now load balanced across all CPU cores, instead of overloading only a single core. So if your server has slow SMB file transfers while your overall CPU load in the Unraid WebGUI Dashboard is not really high, enabling RSS will boost your SMB file transfer to the maximum! But it requires RSS capability on both sides. You need to check your servers NIC by opening the Unraid Webterminal and entering this command (could be obsolete with Samba 4.13 as they built-in an RSS autodetection): egrep 'CPU|eth*' /proc/interrupts It must return multiple lines (each for one CPU core) like this: egrep 'CPU|eth0' /proc/interrupts CPU0 CPU1 CPU2 CPU3 129: 29144060 0 0 0 IR-PCI-MSI 524288-edge eth0 131: 0 25511547 0 0 IR-PCI-MSI 524289-edge eth0 132: 0 0 40776464 0 IR-PCI-MSI 524290-edge eth0 134: 0 0 0 17121614 IR-PCI-MSI 524291-edge eth0 Now you can check your Windows 8 / Windows 10 client by opening Powershell as Admin and enter this command: Get-SmbClientNetworkInterface It must return "True" for "RSS Capable": Interface Index RSS Capable RDMA Capable Speed IpAddresses Friendly Name --------------- ----------- ------------ ----- ----------- ------------- 11 True False 10 Gbps {10.0.0.10} Ethernet 3 Now, after you are sure that RSS is supported on your server, you can enable Multichannel + RSS by opening the Unraid Webterminal and enter the following (the file is usually empty, so do not wonder): nano /boot/config/smb-extra.conf Add the following and change 10.10.10.10 to your Unraid servers IP and speed to "10000000000" for 10G adapter or to "1000000000" for a 1G adapter: server multi channel support = yes interfaces = "10.10.10.10;capability=RSS,speed=10000000000" If you are using multiple NICs the syntax looks like this (add RSS capability only for supporting NICs!): interfaces = "10.10.10.10;capability=RSS,speed=10000000000" "10.10.10.11;capability=RSS,speed=10000000000" Press "Enter+X" and confirm with "Y" and "Enter" to save the file. Now restart the SMB service: samba restart Does it work? After rebooting your Windows Client (seems to be a must), download a file from your server (so connection is established) and now you can check if Multichannel + RSS works by opening Windows Powershell as Admin and enter this command: Get-SmbMultichannelConnection -IncludeNotSelected It must return a line similar to this (a returned line = Multichannel works) and if you want to benefit from RSS then "Client RSS Cabable" must be "True": Server Name Selected Client IP Server IP Client Interface Index Server Interface Index Client RSS Capable Client RDMA Capable ----------- -------- --------- --------- ---------------------- ---------------------- ------------------ ------------------- tower True 10.10.10.100 10.10.10.10 11 13 True False If you are interested in test results, look here. 5.) smb.conf Settings Tuning At the moment I'm doing intense tests with different SMB config settings found on different websites: https://wiki.samba.org/index.php/Performance_Tuning https://wiki.samba.org/index.php/Linux_Performance https://wiki.samba.org/index.php/Server-Side_Copy https://www.samba.org/~ab/output/htmldocs/Samba3-HOWTO/speed.html https://www.samba.org/samba/docs/current/man-html/smb.conf.5.html https://lists.samba.org/archive/samba-technical/attachments/20140519/642160aa/attachment.pdf https://www.samba.org/samba/docs/Samba-HOWTO-Collection.pdf https://www.samba.org/samba/docs/current/man-html/ (search for "vfs") https://lists.samba.org/archive/samba/2016-September/202697.html https://codeinsecurity.wordpress.com/2020/05/18/setting-up-smb-multi-channel-between-freenas-or-any-bsd-linux-and-windows-for-20gbps-transfers/ https://www.snia.org/sites/default/files/SDC/2019/presentations/SMB/Metzmacher_Stefan_Samba_Async_VFS_Future.pdf https://www.heise.de/newsticker/meldung/Samba-4-12-beschleunigt-Verschluesselung-und-Datentransfer-4677717.html I will post my results after all tests have been finished. By now I would say it does not really influence the performance as recent Samba versions are already optimized, but we will see. 6.) Choose a proper SSD for your cache You could use Unraid without an SSD, but if you want fast SMB transfers an SSD is absolutely required. Else you are limted to slow parity writes and/or through your slow HDD. But many SSDs on the market are not "compatible" for using it as an Unraid SSD Cache. DRAM Many cheap models do not have a DRAM Cache. This small buffer is used to collect very small files or random writes before they are finally written to the SSD and/or is used to have a high speed area for the file mapping-table. In Short, you need DRAM Cache in your SSD. No exception. SLC Cache While DRAM is only absent in cheap SSDs, SLC Cache can miss in different price ranges. Some cheap models use a small SLC cache to "fake" their technical data. Some mid-range models use a big SLC Cache to raise durability and speed if installed in a client pc. And some high-end models do not have an SLC Cache, as their flash cells are fast enough without it. Finally you are not interested in SLC Cache. You are only interested in continuous write speeds (see "Verify Continuous Writing Speed") Determine the Required Writing Speed But before you are able to select the right SSD model you need to determine your minimum required transfer speed. This should be simple. How many ethernet ports do you want to use or do you plan to install a faster network adapter? Lets say you have two 1G ports and plan to install a 5G card. With SMB Multichannel its possible to use them in sum and as you plan to install a 10G card in your client you could use 7G in total. Now we can calculate: 7G * 117.5 MByte/s (real throughput per 1G ethernet) = 822 MByte/s and by that we have two options: buy one M.2 NVMe (assuming your motherboard has such a slot) with a minimum writing speed of 800 MByte/s buy two or more SATA SSDs and use them in a RAID0, each with a minimum writing speed of 400 MByte/s Verify Continuous Writing Speed of the SSD As an existing "SLC Cache" hides the real transfer speed you need to invest some time to check if your desired SSD model has an SLC cache and how much the SSD throttles after its full. A solution could be to search for "review slc cache" in combination with the model name. Using the image search could be helpful as well (maybe you see a graph with a falling line). If you do not find anything, use Youtube. Many people out there test their new ssd by simply copying a huge amount of files on it. Note: CrystalDiskMark, AS SSD, etc Benchmarks are useless as they only test a really small amount of data (which fits into the fast cache). Durability You could look for the "TBW" value of the SSD, but finally you won't be able to kill the SSD inside the warranty as long your very first filling of your unraid server is done without the SSD Cache. As an example a 1TB Samsung 970 EVO has a TBW of 600 and if your server has a total size of 100TB you would waste 100TBW on your first fill for nothing. If you plan to use Plex, think about using the RAM as your transcoding storage which would save a huge amount of writes to your SSD. Conclusion: Optimize your writings instead of buying an expensive SSD. NAS SSD Do not buy "special" NAS SSDs. They do not offer any benefits compared to the high-end consumer models, but cost more. 7.) More RAM Linux is clever and uses all your free RAM as a Cache. This means if you download a file twice, the second download comes directly from your RAM. And as the RAM is even faster than the fastest SSDs, this can boost your SMB transfer speeds as well. I recommend installing two identical (or more depening on the amount of slots) RAM modules to benefit from "Dual Channel" speeds. I will test the "write cache size" Samba setting. Maybe its usefull for Uploads, too. If, you will find this information under #5 of this Guide.
  12. 3 points
    Don't do that unless you have bonded the UPS ground to earth through some other means. Any current imbalance between the equipment powered by the UPS and other equipment still grounded will travel through whatever connections are still there, probably your network at the very least. Turn off the circuit at the breaker, or temporarily plug the UPS into a switched outlet or power strip, but don't just yank the plug out of the wall.
  13. 3 points
    Would it be possible to implement SR-IOV into Unraid? I specifically want it for SMB Direct, but there are other applications for it like using a single gpu for multiple vms.
  14. 3 points
    Hello, I would like to thank the unraid team that created the product For me it is simply awesome I'm a one year Unraid user and I want to share, a little, my thoughts about the server. I had some prior experience with linux(debian/ubuntu based mostly) but I always wanted something like Unraid that has both the liberty for creating scripts/custom stuff from linux console and to have predefined stuff in an interface to get repetitive things done fast (here I'm thinking dockers and community applications). Intentionally I left out the virtualisation because for me this was a selling point I was in a period where I tried to do that on my own with Fedora and stuff and it was a big hassle ... when I tried unraid and it did that out of the box ... I never looked back Bottom line now I have dockers and vm-s for everything I wanted and now with the added pools my life is even better. PS. Many many thanks to the Unraid team.
  15. 3 points
    https://github.com/atribe/unRAID-docker/pull/7 Merged. Template should be updated in around 1 hour.
  16. 3 points
    You had doubts that data collecting junkies love data? 🤣
  17. 3 points
    Are you really too lazy to read a few of the latest posts in a thread before posting the exact same issue that's been discussed for the past week?
  18. 3 points
    @binhex Does the container only use a single .ovpn file from the appdata directory for configuration? Can I put all of the PIA port-forwarding capable server .ovpn files in there so that it can try them until it gets a working API? Just this week I had to change from Montreal to Vancouver to Spain. I didn't know if you have it scripted to try the next ovpn in a sequence.
  19. 3 points
    As you all are probably aware PIA has issues with regards to port forwarding on their legacy network, i have raised a support ticket and i have just gone through the pain of checking each endpoint and thought i would share my email as it details the results, things are slightly better than i thought but still not great!:- i will let you know what the response is from the PIA tech support, i am not holding my breath!.
  20. 3 points
    @binhex Would it be possible to have the script run through a list of .ovpn files after failing to port forward with one? Use case would be, CA-Montreal is having port-forward API issues right now, and as it is the first in the list alphabetically (I assume), the script only chooses it to retry with. Could it instead take a list of all .ovpn files in the config/openvpn directory and try them each in succession until a successful API call is made? As always, thanks for your work!
  21. 3 points
    Been running it for a few months now and love it, it's been super stable (disabled C states and set power supply idle control to typical in BIOS). Both Intel NIC's work out the box and register as 10Gb and the IOMMU groupings are nice as well. Details of my system are in my signature. I am on the latest 6.9.0Beta25 using a recompiled Kernel to add Nvidia Drivers from @ich777 's nice docker tool - Here For BIOS and BMC: BMC Version - 1.30.00 - Download BIOS Version - L1.37 (BETA BIOS I requested from Support) - Download For the BETA BIOS, it's been rock solid. The difference with this one is not only (current release bios doesn't even have bifurcation) does it allow you to set bifurcation, but it does so on a per PCIe slot basis. BETA BIOS prior had PCIe slots setup in groups. So if you wanted to set one slot to x4x4x4x4, then you got two slots as x4x4x4x4, I didn't like that. I am posting it in my onedrive for you since I find it a requirement.
  22. 3 points
    Hallo, schau mal unter Settings > Network Settings. Dort solltest du beide Karten finden und auch das Gateway eingeben können. DNS Server (bis zu 3 Stück) habe ich nur bei eth0. Weiter unten unter "Interface Rules" kannst du die Zuweisungen der Netzwerkkarten (anhand der MAC Adresse) zu den eth0 / eth1 Port erledigen. Wenn dein Router (DSK/Kabel) DNS macht (und wenn auch nur Forwarding), solltest du diesen als Gateway eintragen - das könnte schon ausreichen. Ansonten Zuweisung unter "Interface Rules" mal ändern. Logisch....achte darauf, dass beide Netzwerkports per Kabel am Router/Switch (im selben VLAN, falls vorhanden) hängen.....
  23. 3 points
    UNRAID Fanless & Silent Case: Streacom DB4 Fanless Chassis Power: Streacom ST-NANO120 Pico Mobo: Supermicro X11SCL-IF CPU: Intel Xeon E-2134 4 Cores | 8 Threads @ 3,4 GHz RAM: 2x Kingston 32GB DDR4 ECC NET: 1x 10GB Asus XG-100C PCIe, 1x Gigabit IPMI USB-Drive: 16GB Verbatim Store'n'Go USB 3.0 NVME-SSD (VMs & Cache): Samsung 970 Pro 512GB HDDs: 3x Seagate ST12000VN0007 12TB VMs: Windows 10 2004 Windows Server 2019 & Exchange 2019 Proxmox Mailgateway DOCKERs: letsencrypt piHole mariaDB Nextcloud bitwarden photoprism airsonic jellyfin dokuwiki calibre quake 3 server unifi controller jitsi (in planing ...) Build this little beauty in the beginning of last year and i am still loving it. The chassis is a bit expensive but the best case i have ever had my hands on: well designed and thought out: simply fantastic! A huge shoutout to "spaceinvader one" and everybody in this community introducing me to docker (which i completely neglected since its implementation in UnRaid) what makes this build more versatile than i could have ever dreamed of.
  24. 2 points
    @testdasi You may want to consider this. I’m tentatively planning on adding Varken/Plex panels/stat tracking to the Ultimate UNRAID Dashboard (UUD) in version 1.5. Not a guarantee until I get into it, but if I can integrate some/all of it, that would be cool.
  25. 2 points
    I have very little computer experience. Just basic things I use them for such as email, internet, Word, some software we use for our store like accounting and such. Yet, found myself in need of a server but it was unrealistic right now for us to be able to buy anything and pay someone to set it all up. I decided to try to put something together myself. At first I was just going to get a off the shelf NAS, but with research, I decided I could build something much more useful for the same money. I started reading and decided on Unraid. Here on the forum you guys helped me with some hardware questions....I've never built a computer before. It took me some time to get all the parts, but I got them all in during August and got it all put together. Then during the 30 day Unraid trial which just ended yesterday....I was able to setup Unraid, configure everything, have Sonarr, Radarr, Lidarr, all running along with Plex. I have a Win10VM setup with hardware passed through, I have the Wireguard VPN setup and running, Nextcloud syncing to my phone with Reverse Proxy all setup and configured on my own custom domain. Its amazing that someone with no computer knowledge can get this far! Before starting this journey I didnt even know what Unraid was or what a parity was. I owe it to all of you who have helped me here on the forum as well as SpaceInvader for his amazing videos. I want to thank all of you and let you know that I greatly appreciate all of the help and support. You guys are great Its a rock solid server and I'm grateful to have it, we needed it badly. Thank You! Stephen
  26. 2 points
    I finally got all the UPS stats showing properly. The hold up was something stupid, as is often the case. I installed the Grafana-Unraid-Stack (GUS) from @testdasi while using UUD as the dashboard. For some reason, I could not get the UPS stats to show no matter what I did. Edited telegraf.conf to add [[inputs.acpupsd]], deleted telegraf.conf and forced an update on GUS which supposedly downloaded a new telegraf.conf with apcupsd enabled, etc. Nothing. Then I realized the mistake. Two years ago, I installed Grafana, Influxdb and Telegraf docker containers to play around with setting up an unRAID dashboard. It was taking too much time and I had other priorities so I deleted the docker containers; however, the folders were still in appdata with their contents including telegraf.conf. I had been editing and deleting the wrong file!!! The telegraf.conf file that matters is in appdata/Grafana-Unraid-Stack/telegraf. I deleted the old stand-alone folders and their contents and enabled [[inputs.apcupsd]] editing the telegraf.conf in the correct folder and voila!, UPS stats in UUD. After adding the cost per kwh and the max wattage of the UPS in UUD, everything is now working as it should be with customizations for my hardware. Thanks to @falconexe and @testdasi (and @GilbN) for making this all so simple. I remember what a pain it was two years ago which is why I eventually moved on to other things. Now I have a really good looking dashboard based on an extremely easy to install and use docker container stack without all the manual messing around in myriad config files.
  27. 2 points
    I *was* a plank. having read the run command output, I realise that the names of the folders I assigned in the container were what the GUI was expecting to have in the fields, not the *actual* paths - DOH: This is the GUI now with correctly identified paths and no more missing folders
  28. 2 points
    So this one is a little more off topic of an Unraid build, rather it was a custom rack build for transferring my Unraid tower into a 4U chassis. I had shopped around for an actual server rack but didn't really find much that suited my desires. I had lots of inspiration from other Lack Rack builds around the internet, and this was my creation. I guess I didn't keep any of the in-progress pictures, but there really wasn't much to see. This was my first attempt and am actually quite pleased with it. The costs in the end probably came close to actually buying some type of rack, but it was fun to make just the same. I didn't keep an exact supplies list.. so this will sound kind of rough.. I started with 5 IKEA Lack end tables for $15 each. https://www.ikea.com/us/en/p/lack-side-table-high-gloss-white-60193736/ I had to first get an inside length of the legs, so I unplugged the bottom of a leg -- it was about a half inch of particle board to drill out and the rest of the leg is hollow. Measured the inside length of the leg and then got........ Some 1.75" x 1.75" x 36" wood dowels from Home Depot, that fit perfectly (with some light sanding for smoothness) into the legs of the Lack racks for reinforcement. I believe it was that each dowel got me 2 legs plus some extra left over lengths (the top level was the remaining length of the dowel, so it's a shorter level). So I probably got 6 dowels at $10 each. https://www.homedepot.com/p/Kelleher-1-3-4-in-x-1-3-4-in-x-36-in-Wood-Square-Dowel-IM8322U-6/308668091 Each one had to be cut to size (thanks Home Depot saw guy), put into place, and then had some amount of final sanding to make it flush with the ends of the legs.. for whatever reason they weren't all perfect. Then I started the assembly. I thought for support, and alignment, that it would be good to use a dowel in each leg to connect it to the table top. That required some precise placement of the drill bit in the legs and the table top so the holes would line up with the dowel in them. So each leg has a dowel with some glue in them, and some glue on the table where the leg sits. Just to keep everything together a little bit more. Dowel drill kit $10. Then I used those lovely black corner braces on each leg to attach it to the table top for more support. They do work to some extent but the table top is mostly hollow where I screwed them in so most of them aren't really grabbing into any structure.. some of them seemed to hit something, and some didn't. So a few sets of brackets for $3 or so each. For front to rear weight distribution and support where I thought it would be good to have, I used aluminum angle channels as a shelf. These are screwed into the wood dowels in the legs so nice and strong. $11 each, got a few of them and cut to size, and filed down the sharp edges of the cuts. https://www.homedepot.com/p/Everbilt-1-1-4-in-x-48-in-Aluminum-Angle-with-1-16-in-Thick-800037/204373304 For the 2 pull out shelves near the top I used wood corner moulding. These would never hold much weight so didn't feel I needed to use anything stronger there. $12 each, got a few. https://www.homedepot.com/p/1-in-x-1-in-x-8-ft-Wood-Primed-Outside-Corner-Moulding-W9568PFJ/203579452 The entire thing is on a set of casters. They were a set from IKEA, $10 or so. I forget how I attached the wheels... remember that the table top (which was used as the first base platform) is mostly hollow. I think the corners had some material in them. So I forget if I just screwed into them, or if I followed the advice of a youtuber and used plastic wall anchors in the table top, and attached the wheels that way. Actually, I think I might have done that....... The actual pull out shelves are some pieces that were perfectly sized to use from my old computer station I had customized a few years ago. Worked out perfectly. Added some handles to them to pull out the shelves. Beautiful! After I did that and put some stuff on the shelf and pulled it out.. I said doh! I have to hold the shelf up so it doesn't just fall down! I added another strip of the wood channel to keep the shelf in place when I pull it out. It's its own support bracket. The XBOX and PS4 game shelf ---- might not work for the PS5 and/or new Xbox... LOL! Those things are huge! But the black shelf is something I already had, and I customized it with some metal corner brackets to keep the PS4 in place., the shelf is also secured to the shelf with some hose clamps. Front and back corners have corner brackets on them so the PS4 sits there and won't fall out. The Xbox has little L brackets around it to keep it in place. So does the cable modem on the side. The HDMI matrix is secured to the shelf as well. I think that pretty much sums up the rack. It was a fun little project. In the end I might of been up to around $250 or so in supplies.. but totally worth it. Rack bottom to top: SilverStone RM400 4U Chassis -- Unraid CyberPower OR1500LCDRM1U UPS Netgear 24 port switch 24 port patch panel SilverStone RM41-506 4U Chassis - Main PC Pull out printer shelf -- it was meticulously measured and hoped to hell that it would fit. It's actually upside down so that the printer sits inside the shelf and has another inch or so of clearance. I really boxed myself in on this one as I can only ever get a printer that is exactly the size that I have now... but it's a sacrifice I'm willing to make. 3U cabinet drawer Blackbird 4K Pro 4X4 HDMI Matrix XBOX, PS4 CyberPower PDU15M2F12R Metered PDU. I actually had 2 of these but one was defective and returned it, then decided for now I didn't need a second one. So there you have it. A very custom, compulsively designed, IKEA Lack Rack.. for Unraid.
  29. 2 points
    it looks like ive worked it out i have a i7-5820K cpu with 28 lanes on a asus x99 deluxe with 6 pci-e slots i had the two hba cards in the wrong slots making them pcie 2.0 i shoud of used 1,3,5 but i was using 1,4,6 now my parity estimated speed is 148mb and 23 hours to complete
  30. 2 points
  31. 2 points
    I’ve been running @doron’s script for a few days and it has been perfect so far! Absolutely no unwanted spin ups, and my SAS drives are always sent to standby when needed. Thank you so much to everyone who contributed to this thread, especially @SimonF and @doron (and thanks for crediting me in your script even if I really just suggested something and haven’t written a single line of code 😆). Now let’s push this to the devs and get it included in Unraid! Stay safe and keep up the positive vibes 😉
  32. 2 points
    Thanks. It's done. Thank you so much, im gratefull!
  33. 2 points
    @testdasi please do Love this
  34. 2 points
    Hi, I got this working. This is what I've done. 1. Edit container settings and change configuration path to look like this (you point to the directory, not to the file, that was my problem) 2. With windows or whatever edit a file named turnserver.conf with this content (It is a simple config, you only have to change the secret and the domain name) listening-port=3478 fingerprint use-auth-secret static-auth-secret=yourdesiredsecret realm=your.domain.com total-quota=100 bps-capacity=0 stale-nonce no-multicast-peers 3. With krusader copy the turnserver.conf you just created to /mnt/user/appdata/coturn/ 4. Forward the ports in the router as OP says 5. Restart the container 6. In nextcloud add the servername:port and secret and TCP only Now click to test and must be successful. BTW @xthursdayx thanks for you work
  35. 2 points
    Pfsense in an in a 1u supermicro rack server with an 8-core Xeon, 32GB ram and an SSD. Just a little bit overkill. Will probably install proxmox or something similar at one point to be able to test other firewalls.
  36. 2 points
    I was using rm with the 'find' command to purge aged files in the recycle bin. I've changed it now because it seems that 'rm -rf' removes too much and removes files that haven't been aged. I switched to using the -delete switch with 'find' which doesn't exhibit the same behavour. He was just explaining how the use of 'rm -rf; with 'find' was potentially causing some problems. I was able to duplicate the issue he was explaining.
  37. 2 points
    Thanks @konaboy. I got it working. Early on in my build I checked the box to make the iGPU available to VMs on the IOMMU Groups page. I never created any VMs so I forgot about it. 🤪 Cleared this and GPU is passing through to the docker containers now.
  38. 2 points
    So do you ever need to access a vdisk but dont want to , or cant start the vm. Well we can using qemu-nbd. This video shows how to use that and mount a vdisk. Also see how to fix ntfs disks when not 'clean' and so set to read only. Happen when vm not shutdown correctly. Also in the video there are some scripts which will mount and unmount the vdisks very easily. hope some of you out there find it useful
  39. 2 points
    I just wanted to say I have now replaced the PCIe card with one that has the JMB585 Chipset which was recommended and the errors have gone away and all seems to be fine. So thanks Again JorgeB
  40. 2 points
    maybe the message is finally getting through that they have a problem, its only taken them two weeks! 🙄
  41. 2 points
    I was also told by their chat support that port forwarding would be fully supported on next gen 😕 Edit:
  42. 2 points
    I had a similar issue. Windows 10 VM boot-looping with blue screen. Ryzen 3950x. Solved it by adding the following to the end of the VM xml as suggested elswhere on this forum: <qemu:commandline> <qemu:arg value='-cpu'/> <qemu:arg value='host,topoext=on,invtsc=on,hv-time,hv-relaxed,hv-vapic,hv-spinlocks=0x1fff,hv-vpindex,hv-synic,hv-stimer,hv-reset,hv-frequencies,host-cache-info=on,l3-cache=off,-amd-stibp'/> </qemu:commandline>
  43. 2 points
    I have verified the port, cable works. I tried reseting my equipment and it didn't work. I will definitely try 6.9 beta today. I really really appreciate all the help. I will post the results of using the beta version today. EDIT- UPDATE: Switching to 6.9 beta made all the difference. After dealing with a few more issues I reset CMOS, tweaked a few more things in the BIOS, created a new USB boot device with 6.9, and disabling Network Stack, everything worked. I am able to boot to GUI mode if I want to work from the machine and it showed up on my network with all drives showing up properly. I am excited!!! I am certain I will run into other problems along the way, but the main issues of getting started, are at least resolved.
  44. 2 points
    I just updated my hardware a month ago from an Intel E6600 with 2 Gb ram (DDR2 baby!). 😎 Ran fine for a decade with unraid, but I just used it as a NAS. Cache_dirs was literally the only program I ran (well, and pre_clear). Now I'm with the cool kids like you with 32 Gig.
  45. 2 points
    Can't speak to the X570 taichi, but I just recently upgraded to a used X370 taichi and it's been great. stable, overclocked the memory just fine, 10 sata ports (none of which get deactivated when using either of the M2 slots). Only thing I can't attest to is passthrough, as I'm not running any VM's yet, but i've read others saying it wasn't an issue. I couldn't justify the new price tag for an X570 version when I came across the $85 used x370. Pcie 4.0 and 2 less SATA ports for $200 extra.
  46. 2 points
    @lzrdking71 @theGrok i have identified the issue, not exactly sure how it was related to my previous change but it has caused a race condition, i have now corrected this and the image is building, please pull it down in around 1 hour from now.
  47. 2 points
  48. 2 points
    No need to script anything. And you only need to do this once. on your mac, scp ~/.ssh/id_rsa.pub tower.local:/boot/config/ssh/root.pubkeys then ssh in Unraid sed -i~ -e 's#^AuthorizedKeysFile.*#AuthorizedKeysFile /etc/ssh/%u.pubkeys#' /etc/ssh/sshd_config cp /etc/ssh/sshd_config /boot/config/ssh/ /etc/rc.d/rc.sshd restart What this does is copy your public key into the USB, then it makes a config change to sshd to make it look for the authorized key file in /etc/ssh/root.pubkeys (the %u is expanded to the user trying to login). When the sshd server is started up, all the files from the /boot/config/ssh location is copied to /etc/ssh and permissions are set to 600 (RW by user only). So no need to add putty (unless you really want to use putty) and no need to keep the root password in plaintext inside your scripts.
  49. 2 points
  50. 2 points
    How do I increase the size of my docker.img file? Go to settings - Docker Settings. Set Enable Docker to be "No" Apply. Switch to Advanced View (Top Right) Change the size of the image. Set Enable Docker to be "yes" Apply Done.