tr0910

I have taken another 4tb drive that has been previously connected to this server when it was XFS formatted and converted it to an empty XFS-Encrypted disk on another server. I am getting the same problem with my server not recognizing that it has been previously formatted XFS-Encrypted and wanting to format it again. This is now 2 drives with this same issue. To troubleshoot, I did a new config on the intended destination server and formatted them xfs-encrypted there as a way to prove beyond a shadow of a doubt what might be wrong. I then restored the server to its previous configuration and these 2 4tb drives were attached via UD. This time they worked without issue. In conclusion, sometimes you can format xfs-encrypted on another machine and then mount on the intended server via UD, and sometimes you cannot. The 2 drives that I was able to do this with were both 2tb. The 2 that wouldn't work were 4tb drives. The other thing that might have been a factor was that there were formatted via a USB3 external device. I did also try and plug the USB3 device into the intended destination server and see if we could mount them that way. Surprisingly one of the drives showed up as crypto formatted on the USB3 connection, but it still would not mount.

When I had 300m of cat 5 on one network I had issues too. Lightning would fry it every time. You're going to have to do some cable testing. Are any runs excessively long? Simplify and test is all I can suggest. Sent from my Nexus 6 using Tapatalk

Actually the hardware failures are me hot-plugging the drive in and out hoping for it to be properly recognized. Since that never worked, I rebooted cleanly, and still the xfs-encrypted disk ST4000DM000-1F2168_S30030A6 is not showing up as mountable. Notice that the SAMSUNG_HD203WI_S1UYJ1YZ601695 is also xfs-encrypted and has no problems mounting via UD. Something is weird with the 4tb Seagate. I hoped a reboot would clean up the problems, but it still is stuck with only a format option showing. What should I try next? (see diagnostics attached for both server conditions, before and after reboot) drchina1-diagnostics-20180506-1442.zip drchina1-diagnostics-20180506-2047.zip

I have had many single sector issues and since I have a hot spare, I yank the offending drive and rebuild to the spare. I them start a pre clear on the offending drive, and most of the time the offending sector returns good. False alarm?? Sent from my Nexus 6 using Tapatalk

Don't think it's connection as I can format via UD then use without problem. However if I reformat as xfs encrypted and reconnect it won't mount. Sent from my Nexus 6 using Tapatalk

Strange behavior for a 4tb disk converted to xfs-encrypted on a different machine and then plugged in and attempted to mount with UD. No option to rename the device is given and format is the only option available. It should present a mount option. This drive was previously formatted xfs and attached via UD so there is some history that may be confusing things. However after I have forgotten the historical record of it, still no luck mounting it. I have done this exact same process with other drives and had no issue mounting xfs-encrypted. What might be wrong with this one? Relevant logs below? May 5 11:14:08 drChina1 kernel: ata7: hard resetting link May 5 11:14:09 drChina1 kernel: ata7: SATA link down (SStatus 0 SControl 300) May 5 11:14:09 drChina1 kernel: ata7: limiting SATA link speed to 1.5 Gbps May 5 11:14:14 drChina1 kernel: ata7: hard resetting link May 5 11:14:14 drChina1 kernel: ata7: SATA link down (SStatus 0 SControl 310) May 5 11:14:14 drChina1 kernel: ata7.00: disabled May 5 11:14:14 drChina1 kernel: ata7: EH complete May 5 11:14:14 drChina1 kernel: ata7.00: detaching (SCSI 7:0:0:0) May 5 11:14:14 drChina1 kernel: sd 7:0:0:0: [sdh] Synchronizing SCSI cache May 5 11:14:14 drChina1 kernel: sd 7:0:0:0: [sdh] Synchronize Cache(10) failed: Result: hostbyte=0x04 driverbyte=0x00 May 5 11:14:14 drChina1 kernel: sd 7:0:0:0: [sdh] Stopping disk May 5 11:14:14 drChina1 kernel: sd 7:0:0:0: [sdh] Start/Stop Unit failed: Result: hostbyte=0x04 driverbyte=0x00 May 5 11:14:14 drChina1 rc.diskinfo[9417]: SIGHUP received, forcing refresh of disks info. May 5 11:14:14 drChina1 rc.diskinfo[9417]: SIGHUP received, forcing refresh of disks info. May 5 11:18:48 drChina1 kernel: ata7: exception Emask 0x10 SAct 0x0 SErr 0x4040000 action 0xe frozen May 5 11:18:48 drChina1 kernel: ata7: irq_stat 0x00000040, connection status changed May 5 11:18:48 drChina1 kernel: ata7: SError: { CommWake DevExch } May 5 11:18:48 drChina1 kernel: ata7: hard resetting link May 5 11:18:58 drChina1 kernel: ata7: softreset failed (1st FIS failed) May 5 11:18:58 drChina1 kernel: ata7: hard resetting link May 5 11:19:01 drChina1 kernel: ata7: SATA link up 3.0 Gbps (SStatus 123 SControl 300) May 5 11:19:01 drChina1 kernel: ata7.00: ATA-8: ST4000DM000-1F2168, S30030A6, CC52, max UDMA/133 May 5 11:19:01 drChina1 kernel: ata7.00: 7814037168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA May 5 11:19:01 drChina1 kernel: ata7.00: configured for UDMA/133 May 5 11:19:01 drChina1 kernel: ata7: EH complete May 5 11:19:01 drChina1 kernel: scsi 7:0:0:0: Direct-Access ATA ST4000DM000-1F21 CC52 PQ: 0 ANSI: 5 May 5 11:19:01 drChina1 kernel: sd 7:0:0:0: Attached scsi generic sg7 type 0 May 5 11:19:01 drChina1 kernel: sd 7:0:0:0: [sdh] 7814037168 512-byte logical blocks: (4.00 TB/3.64 TiB) May 5 11:19:01 drChina1 kernel: sd 7:0:0:0: [sdh] 4096-byte physical blocks May 5 11:19:01 drChina1 kernel: sd 7:0:0:0: [sdh] Write Protect is off May 5 11:19:01 drChina1 kernel: sd 7:0:0:0: [sdh] Mode Sense: 00 3a 00 00 May 5 11:19:01 drChina1 kernel: sd 7:0:0:0: [sdh] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA May 5 11:19:01 drChina1 kernel: sd 7:0:0:0: [sdh] Attached SCSI disk May 5 11:19:01 drChina1 rc.diskinfo[9417]: SIGHUP received, forcing refresh of disks info. May 5 11:19:01 drChina1 rc.diskinfo[9417]: PHP Warning: Use of undefined constant ID_MODEL - assumed 'ID_MODEL' (this will throw an Error in a future version of PHP) in /etc/rc.d/rc.diskinfo on line 470 May 5 11:19:01 drChina1 rc.diskinfo[9417]: PHP Warning: Use of undefined constant SERIAL_SHORT - assumed 'SERIAL_SHORT' (this will throw an Error in a future version of PHP) in /etc/rc.d/rc.diskinfo on line 470 Here the result of a successful xfs-encrypted mount May 5 11:37:36 drChina1 unassigned.devices: Adding disk '/dev/mapper/SS_1695'... May 5 11:37:39 drChina1 unassigned.devices: Mount drive command: /sbin/mount '/dev/mapper/SS_1695' '/mnt/disks/SS_1695' May 5 11:37:39 drChina1 kernel: XFS (dm-3): Mounting V5 Filesystem May 5 11:37:39 drChina1 kernel: XFS (dm-3): Ending clean mount May 5 11:37:39 drChina1 unassigned.devices: Successfully mounted '/dev/mapper/SS_1695' on '/mnt/disks/SS_1695'. May 5 11:37:39 drChina1 unassigned.devices: Defining share 'SS_1695' with file '/etc/samba/unassigned-shares/SS_1695.conf' May 5 11:37:39 drChina1 unassigned.devices: Adding share 'SS_1695' to '/boot/config/smb-extra.conf' May 5 11:37:39 drChina1 unassigned.devices: Reloading Samba configuration... May 5 11:37:39 drChina1 unassigned.devices: Directory '/mnt/disks/SS_1695' shared successfully. May 5 11:37:39 drChina1 unassigned.devices: Device '/dev/mapper/SS_1695' script file not found. 'ADD' script not executed.

The second cpu will bump your power consumption. My dual e5 2670 rig never drops below 100w, but with only one CPU in it, 60w idle is possible. Your CPU should be some better but I can't say how much Sent from my Nexus 6 using Tapatalk

I have started using unassigned devices for mounting xfs-encrypted drives. I am needing to take backups of the Luks Header, as this is recommended for disaster recovery. If the drive is array mounted I would: cryptsetup luksHeaderBackup /dev/md1 --header-backup-file /boot/LuksHeaderBackup/SS_2T_1695 But with unassiged devices I get the following: May 2 08:55:39 drChina1 unassigned.devices: Adding disk '/dev/mapper/SS_1695'... May 2 08:55:41 drChina1 unassigned.devices: Mount drive command: /sbin/mount '/dev/mapper/SS_1695' '/mnt/disks/SS_1695' May 2 08:55:41 drChina1 kernel: XFS (dm-2): Mounting V5 Filesystem May 2 08:55:41 drChina1 kernel: XFS (dm-2): Ending clean mount May 2 08:55:42 drChina1 unassigned.devices: Successfully mounted '/dev/mapper/SS_1695' on '/mnt/disks/SS_1695'. and referencing as /dev/mapper/SS_1695 just errors out with "Device /dev/mapper/SS_1695 is not a valid LUKS device." Is this not the correct way to reference this drive?

Is there a command line way to format a drive as encrypted xfs? This will then be hooked up via Unassigned Devices. Prefer not to have to add to the array just to format it XFS-encrypted.

@dlandon has updated the Unassigned Devices plugin to allow us to mount encrypted drives. However support for formatting the drives as encrypted is not yet working in UD. Is there a commandline way to do this? I will have encrypted drives outside the array.

UD does not support formatting to the encrypted file systems that unRaid now supports. I would be interested in XFS encrypted formatting specifically. Thanks for making UD support mounting encrypted devices. Is there any way to format a drive as encrypted in UD?

Yes, I run Peter's awesome OpenVPN plugin which is a true VPN and tunnels all traffic. But OpenVPN and Outline are 2 totally different tools for totally different uses. Outline is a proxy for safe encrypted access to standard sites (gmail, Wikipedia, Twitter) that are blocked in some countries. It is great to have a secure OpenVPN tunnel back to my lan in America when I travel to other parts of the world. However, OpenVPN is fingerprinted by the GFW of China and attempts to use it to tunnel under the GFW to access outbound blocked services such as Google, Facebook, Youtube etc are instantly blocked. OpenVPN allows me to access my lan in America from behind the GFW of China, but that is all it is good for. Outline on the other hand is a Shadowsocks proxy and totally cracks open the GFW. It continues working to my amazement after about a month of steady and heavy use from behind the GFW. The GFW is a nasty beast that quickly blocks most VPN's. I have tested with numerous clients running iOS, Windows, Android, Mac etc. (Outline was tested and is running presently on a Docker Droplet created on Digital Ocean as recommended as the easiest installation.)

Google's Jigsaw has created an open source Shadowsocks proxy that works via a Docker. It is meant to be set up on a Digital Ocean Docker Droplet, to allow you to have your own secure and private connection to the internet when you travel to places where the internet is monitored and blocked. Since it is docker based, we should be able to run it on our unRaid servers. What do you think? Possible? https://getoutline.org/en/home https://github.com/Jigsaw-Code/outline-server https://github.com/Jigsaw-Code It is branded as a way for small journalists to keep their stuff private when reporting on repressive regimes. I run the awesome Open-VPN plugin by @peter_sm. Only issue is openvpn is partially blocked for use from China. This Google one is designed for places like China. Could we spin it up on our unRaid boxes? Outline is a Docker that works directly with Digital Ocean API's to create a one click install. Awesome, but we have unRaid servers that can do docker very easily and I like to control both ends of my VPNs. What would it take to run the Outline docker on unRaid? https://quay.io/repository/outline/shadowbox?tab=tags https://techcrunch.com/2018/03/22/alphabets-outline-lets-you-build-your-own-vpn/

I can confirm the same data even the same manufacturing date and specified device lifetime and accumulated start stop cycles from my Samsung 204UI 2TB drive. In fact all my drives report the same information. Wonder where it is picking this up from?? This is an ARC1260 16 port version on bios 1.49 I also have another 24 port version ARC 1280 but it isn't installed at the moment.... unRaid 6.5 rc5 on this server still.

If you have one drive that is mostly static with no new content being created on it, and accessed very little, this is the drive I would make external. The second parity needs to have fast reliable access, and the external may not have that, depending how you hook it up. However, I think you are being overly paranoid. The external drive is very likely to cause you more problems than it will solve. Time for an upgraded chassis if you are serious about needing dual parity. And get one with hot-swap drive capability. I can't count the number of times that I have bumped a cable and caused the array to burp a drive offline during routine maintenance. Since I went to 24 bay SuperMicro 846 hot swap chassis, that has never happened once. I do question whether I need the 24 bay capacity anymore now that 8tb drives are so available. They were acquired when I was using 3tb drives and creating onsite media at a prodigious rate. I only have dual parity on one of my 24 bay servers. And that is because I sometimes am away from that location for months on end. Otherwise I have never needed it. If I still had duct taped servers held together with a snarl of my own bad wiring, I would have much more use for dual parity.

This issue seems to persist on 6.5 too. Once I trigger a false alarm with the plugin by deleting a file in the monitored shares, the server shuts SMB down and resetting the plugin does not reset the SMB access. It is totally gone and only a stop of the array and a restart of the array restores access. I seem to recall the SMB shares would go to read only before on 6.3 They didn't completely go off-line. I am only using bait shares and not using bait files.

My China IP address changes every 48 hours like clockwork

It's quite common in China for updates and installs to hang for no reason. Then suddenly a week later, it will work fine. When you are behind the GFW, this is normal. Expect to be frustrated. I used to use Peter's plugin from China accessing my unRaid server in America. In 2014 that was good enough to access Facebook Google etc from China. But that is no longer the case. New tools are required now.

The managing app automatically downloads a Docker image and creates a server on DigitalOcean based on this Docker image. Software on the server will be automatically updated every hour. Anybody have any idea how to install on unRaid?? @Squid, @peter_sm, @linuxserver.io, @sparklyballs, @CHBMB https://quay.io/repository/outline/shadowbox?tab=tags https://techcrunch.com/2018/03/22/alphabets-outline-lets-you-build-your-own-vpn/

Recently Google released a tool that allows us to create our own VPN's. It is branded as a way for small journalists to keep their stuff private when reporting on repressive regimes. I run the awesome Open-VPN plugin by @peter_sm. Only issue is it is partially blocked for use from China. This Google one is designed for places like China. Could we spin it up on our unRaid boxes? Outline is a Docker that works directly with Digital Ocean API's to create a one click install. Awesome, but we have unRaid servers that can do docker very easily and I like to control both ends of my VPNs. What would it take to run Outline as a docker on unRaid? https://getoutline.org/en/home China blocks access to normal web sites like google, gmail, Facebook, Twitter, YouTube, Twitter etc. Several years ago, China started blocking us from using Open-VPN to access these necessary sites when inside China. There are many commercial VPN's that you can use and get access, but you need to trust them with all you data.

I suppose you could work that way. But best practice would be to have actual different encyption for different drives. Suppose that one encrypted drive is shared with clients.

At this point, unRaid crypto is a bit inflexible as it requires all drive to have the same crypto key/passphrase. And you must have an array drive already encrypted before UD will allow you to attach an encrypted drive. Others have noted that UD will likely need to be more flexible and support different keyphrases as you are unlikely to want all your unassigned drives encrypted with the same key. See here:

Might be my connection to docker hub. This server is in China behind the GFW. They might be blocking something new today....

With my dual 2670 rig with Intel 2600cp mb and 96GB ECC ram, the first boot of a 2 core 32GB Win10 Pro VNC is 8 seconds to TianoCore and further 78 seconds to login screen. This is with only 2 cores (6/22). Changing to 4 cores (6/22, and 15,31) drops the boot time to the login screen to 10 seconds after the same 8 seconds to TianoCore. Then bumping to 24 cores of 32 total allocated to this Win10VM drops boot time to 8 seconds to the login screen with the same 8 seconds to TianoCore . All testing done over VNC. Initial Memory: 32768 Max Memory: 32768 Machine: i440fx-2.10 BIOS:OVMF More memory and more cores are not slowing my VM boot speed at all. (Nothing is passed through to this Win10 VM. unRaid 6.50)

Anybody having trouble pulling the docker down. I downloaded the xml file and uploaded to flash as my-Diskspeed.xml After pulling the fs layer I get.... Error: error pulling image configuration: Get https://dseasb33srnrn.cloudfront.net/registry-v2/docker/registry/v2/blobs/sha256/99/99f826b4904595eb9a74607c19a094bc081a5bce3207e8534dca548ccc98ec96/data?Expires=1522846668&Signature=ZkYgL1dLS1ZDM49hidy5hLFEDzDQ9Jzl~6rm8xelIOF-fBSHg4EnOeoRrPyvgwgbYyG26vCPTsBSvqjMB3AVBMcRwAzGcJXkMdqnFEvmxQzxLG~5Ri9-o1QDMX8iIlyfu-rZSarW8posR-LDANxYPfRh~_&Key-Pair-Id=APKAJECH5M7VWI: net/http: TLS handshake timeout