Maik75

For posterity and because it did take hours to find the problem... For some reason unraid per default sets low read-ahead values (512) for md devices, at least for my setup (External 3.1 USB drive enclosure, 3 disks). This affects systems that are used to read large files over SMB shares with some overhead in the setup (External USB drives, iSCSI drives, weird setups like that). Main Issue: Copying files from shared folder directly from disk (not cached!) resulted in read speeds of 5-15 mb/s on a 1GB network. Drove me crazy. Symptoms: - SMB copy from disk share: ~100+ MB/s (great! So no network issue) - SMB copy from user share: ~5–20 MB/s wildly fluctuating(huh!?) - local dd from /mnt/user: normal speed (250 MB/s per disk -> no USB or disk issue) - hdparm -t /dev/sdX: normal for all drives - SMART: clean, disks are fine - filesystem check: clean. xfs is fine on all drives - Direct I/O setting: no impact - SMB "sendfile" off: no improvement - /mnt/user0 shared as a test: only slightly faster - no CPU bottleneck, only short flickers of 100% (waiting for I/O?) Key diagnostic: Slow user-share SMB transfer showed iostat like: - high disk util ~95–100% - low throughput ~15 MB/s - small average read request size ~50 KB Fast disk-share SMB transfer showed: - high disk util - throughput ~100 MB/s - average read request size ~220 KB Check what blockdev --getra /dev/md<device> says first. If it´s already high (higher than 512...) then this is not your issue. Fix: blockdev --setra 8192 /dev/md<first device> blockdev --setra 8192 /dev/md<second device> (or more if you have more disks) This set the read-ahead size to 4 MB and instantly fixed all performance woes after issuing those commands. If you want to persist this easiest way is the use the plugin user scripts and set it as "execute on array startup". Pre-made script: #!/bin/bash # 8192 sectors = 4 MiB read-ahead RA=8192 logger "Setting Unraid md partition read-ahead to ${RA} sectors" for dev in /dev/md[0-9]*p[0-9]*; do if [ -b "$dev" ]; then /sbin/blockdev --setra "$RA" "$dev" logger "Set read-ahead on $dev to $RA" fi doneIf you have a 10GB network and only large files, your might even increase this to a higher value. Test first. This also potentially tanks small file and concurrent performance. If you have 20 users hammering on small files, this may not be a great idea. Hope someone some day finds this.

Hi all, recently got a new USB NVMe enclose with dual NVMe. Unraid does not recognize any smart information on default auto scan, message is "Unknown USB bridge [0x152d" CLI smartctl does also not work on auto, however setting -d sntjmicron yields good results, with plausible data. lsusb shows: |__ Port 3: Dev 4, If 0, Class=Hub, Driver=hub/2p, 10000M ID 2109:0822 VIA Labs, Inc. |__ Port 1: Dev 8, If 0, Class=Mass Storage, Driver=usb-storage, 10000M ID 152d:0586 JMicron Technology Corp. / JMicron USA Technology Corp. root@Vault:~# smartctl --all -d sntjmicron /dev/sdf smartctl 7.4 2023-08-01 r5530 [x86_64-linux-6.1.82-Unraid] (local build) Copyright (C) 2002-23, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Model Number: CT2000P3PSSD8 Serial Number: 2351E88AA1BB Firmware Version: P9CR40D PCI Vendor/Subsystem ID: 0xc0a9 IEEE OUI Identifier: 0x00a075 Controller ID: 1 NVMe Version: 1.4 Number of Namespaces: 1 Namespace 1 Size/Capacity: 2,000,398,934,016 [2.00 TB] Namespace 1 Formatted LBA Size: 512 Namespace 1 IEEE EUI-64: 6479a7 88400000a9 Local Time is: Fri Apr 5 14:58:00 2024 CEST Firmware Updates (0x12): 1 Slot, no Reset required Optional Admin Commands (0x0017): Security Format Frmw_DL Self_Test Optional NVM Commands (0x005e): Wr_Unc DS_Mngmt Wr_Zero Sav/Sel_Feat Timestmp Log Page Attributes (0x06): Cmd_Eff_Lg Ext_Get_Lg Maximum Data Transfer Size: 64 Pages Warning Comp. Temp. Threshold: 85 Celsius Critical Comp. Temp. Threshold: 95 Celsius Supported Power States St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat 0 + 6.00W 0.0000W - 0 0 0 0 0 0 1 + 3.00W 0.0000W - 1 1 1 1 0 0 2 + 1.50W 0.0000W - 2 2 2 2 0 0 3 - 0.0250W 0.0000W - 3 3 3 3 5000 1900 4 - 0.0030W - - 4 4 4 4 13000 100000 Supported LBA Sizes (NSID 0x1) Id Fmt Data Metadt Rel_Perf 0 + 512 0 1 1 - 4096 0 0 === START OF SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED SMART/Health Information (NVMe Log 0x02) Critical Warning: 0x00 Temperature: 37 Celsius Available Spare: 100% Available Spare Threshold: 5% Percentage Used: 0% Data Units Read: 105,617 [54.0 GB] Data Units Written: 95,446 [48.8 GB] Host Read Commands: 829,685 Host Write Commands: 393,769 Controller Busy Time: 0 Power Cycles: 7 Power On Hours: 1 Unsafe Shutdowns: 0 Media and Data Integrity Errors: 0 Error Information Log Entries: 0 Warning Comp. Temperature Time: 0 Critical Comp. Temperature Time: 0 Temperature Sensor 1: 37 Celsius Temperature Sensor 2: 40 Celsius Temperature Sensor 8: 37 Celsius Error Information (NVMe Log 0x01, 16 of 16 entries) No Errors Logged Self-test Log (NVMe Log 0x06) Self-test status: No self-test in progress No Self-tests Logged Which looks fine to me and usable SMART info. How can I make unraid read and use this? I tried adding the two drives to /boot/config/smart-one.cfg with smType="-d sntjmicron", this sometimes yields temperatures in the UI, but no smart attributes. It also seems to hang unraid for a few seconds here and there with 100% CPU load on a core. Has someone managed to get this working? I probably need some magical parameters for smart-one.cfg to make unraid able to parse the smart data correctly, but I have no idea what to try. Probably needs some info how to send the smart request and parse it additionally to the device type. Any help is appreciated! Maik.