Jump to content
Dave-Kay

Problems setting up encrypted Disks - Encryption in Unraid is broken

52 posts in this topic Last Reply

Recommended Posts

Posted (edited)

Hello,
I am using unraid for a bunch of years now and i am still delighted how good it works for me. So i suggested to a friend to use unraid, too.
He bought hardware an began setting it up an ended up in a ton of problems, till i decided to take his hardware to my home and to start testing it.
 

At first everything was good. i set up the system and began testing, disk, docker, vm all good. But then i added an ecrypted disk.

immediately after everything was set up and i began to copy files on the encrypted disk, the system stopped responding. the copyprocess stopped, my explorer on the windowsmachine stopped working and i was unable to stop the array.

I tried xfs encrypted, as well as btrfs encrypted. At the moment the system is clearing a disk again for the next try. i tried to find clues, about what i possibly could have done wrong, but i didn't find anything which would have been an explanation for the behaviour.

what am i missing? what do i have to search for? Version is 6.7.2. As i said, the sytem ran just fine, till i tried to use encrypted disks. 

thanks in advance for your help

Edited by Dave-Kay

Share this post


Link to post
Posted (edited)

So i tried again, and ist seems to be failing again.
hardware is 

ASRock C3758D4I-4L
32GB Memory

2x WD-Red 4TB

1 x WDC_WD20EZRX
At the moment it seems to be endles syncing drives to stop array. 2 out of 8 cpus are at 100%
I'm stuck with this.

 

tower-syslog-20190723-1549.zip

Edited by Dave-Kay

Share this post


Link to post

So i had to hard reset the server because he wouldn't neither finish the sync, nor tell me what is going on in any way.

after next boot this appeared out of nowhere. (see image)
 

Screenshot 2019-07-23 20.34.02.png

Share this post


Link to post
Posted (edited)

So it seems, there is nothing really written to the encrypted drive.
As i said, i had to hard reset the server, as he told me, he was syncing the filesystem. after next boot i accessed the share and it was empty.

i have never seen anything like that before. 
(of course there is no cache drive.)

Edited by Dave-Kay

Share this post


Link to post

found something interesting though... both modules show like this in dynamix System Information
 

Memory Device

Total Width:8 bits      <<<<<<!!!

Data Width:8 bits      <<<<<<!!!

Size:16384 MB

Form Factor:DIMM

Set:None

Locator:DIMM1

Bank Locator:BANK 0

Type:DDR4

Type Detail:Synchronous Unbuffered (Unregistered)

Speed:2400 MT/s

Manufacturer:Samsung

Serial Number:38F1142D

Asset Tag:BANK 0 DIMM1 AssetTag

Part Number:M378A2K43BB1-CRC

Rank:2

Configured Memory Speed:2400 MT/s

Minimum Voltage:1.2 V

Maximum Voltage:1.2 V

Configured Voltage:1.2 V

Share this post


Link to post

You might want to troubleshoot each variable one by one. Start with - does your array work WITHOUT encryption?

Share this post


Link to post
Posted (edited)

Thank you for your reply!
 

10 minutes ago, testdasi said:

You might want to troubleshoot each variable one by one. Start with - does your array work WITHOUT encryption?

Yes! After the friend failed to get it working and i suspected the encryption the first approach was of course to just test the system on this Hardware, without any encryption. I installed it and put plugins in it, VMs and Docker-instances. Everthing worked just fine, for 2 days. After that i wanted to add encryption and immediatels the sytem had gone nuts as described.

 

Edited by Dave-Kay

Share this post


Link to post

That's what I suspected.

 

Encryption needs quite a bit of oomph on the CPU and I think yours is an Atom which may not be powerful enough.

I have seen a lot of posts about hanging / slow performance with encryption and the consistent theme throughout is low-power CPU.

Share this post


Link to post

Oh, i didn't find anything here in the forum.
But i didn't even consider performance-Problems in any way.
So there shoulkd be Problems with any linux and luks on the machine, too?

 

Share this post


Link to post

as i am new to luks... does this help in any way?
------------------------------------------------------------------------------------
root@Tower:~# cryptsetup benchmark
# Tests are approximate using memory only (no storage IO).
PBKDF2-sha1       489074 iterations per second for 256-bit key
PBKDF2-sha256     604715 iterations per second for 256-bit key
PBKDF2-sha512     406424 iterations per second for 256-bit key
PBKDF2-ripemd160  392431 iterations per second for 256-bit key
PBKDF2-whirlpool  233639 iterations per second for 256-bit key
#     Algorithm | Key |  Encryption |  Decryption
        aes-cbc   128b   312.0 MiB/s   294.1 MiB/s
    serpent-cbc   128b    41.2 MiB/s   101.5 MiB/s
    twofish-cbc   128b    88.9 MiB/s   105.1 MiB/s
        aes-cbc   256b   237.3 MiB/s   245.4 MiB/s
    serpent-cbc   256b    44.0 MiB/s   101.5 MiB/s
    twofish-cbc   256b    92.0 MiB/s   105.0 MiB/s
        aes-xts   256b   293.8 MiB/s   283.8 MiB/s
    serpent-xts   256b    91.1 MiB/s    97.0 MiB/s
    twofish-xts   256b    97.4 MiB/s   100.1 MiB/s
        aes-xts   512b   237.6 MiB/s   238.4 MiB/s
    serpent-xts   512b    96.7 MiB/s    97.0 MiB/s
    twofish-xts   512b    99.8 MiB/s    99.9 MiB/s

Share this post


Link to post
Posted (edited)

thanky you, for your reply, will test that tomorrow.
first i have to check parity again....

Edited by Dave-Kay

Share this post


Link to post

i tried to understand the 8bit datawidth and read a bit,m but i still don't get it, why has this DDR4 Memorychip 8bit and my DDR3 has 64Bit?
------------------------------------------------------------------
Mine:
---------------------------------

Total Width:64 bits

Data Width:64 bits

Size:8192 MB

Form Factor:DIMM

Set:None

Locator:DIMM0

Bank Locator:BANK 0

Type:DDR3

Type Detail:Synchronous Unbuffered (Unregistered)

Speed:1600 MT/s

Manufacturer:Micron

Serial Number:18201217

Asset Tag:1BANK 0 DIMM0 AssetTag

Part Number:18KSF1G72AZ-1G6P1

Rank:2

Configured Memory Speed:1600 MT/s
----------------------------------------------------------------
The one in the Server with Problems:
----------------------------------------------------------------

Total Width:8 bits      <<<<<<!!!

Data Width:8 bits      <<<<<<!!!

Size:16384 MB

Form Factor:DIMM

Set:None

Locator:DIMM1

Bank Locator:BANK 0

Type:DDR4

Type Detail:Synchronous Unbuffered (Unregistered)

Speed:2400 MT/s

Manufacturer:Samsung

Serial Number:38F1142D

Asset Tag:BANK 0 DIMM1 AssetTag

Part Number:M378A2K43BB1-CRC

Rank:2

Configured Memory Speed:2400 MT/s

Minimum Voltage:1.2 V

Maximum Voltage:1.2 V

Configured Voltage:1.2 V

Share this post


Link to post
Posted (edited)

It's just the same, if i try to copy the files in MC.
That's highly disappointing.

Edited by Dave-Kay

Share this post


Link to post

Sounds like some specific issue with that hardware and encrypton, but I never used encryption so not very familiar with it.

Share this post


Link to post
9 minutes ago, johnnie.black said:

Sounds like some specific issue with that hardware and encrypton, but I never used encryption so not very familiar with it.

Yeah, thats what i think. but i really don't know which Hardware... however, next step, changing RAM.

 

Share this post


Link to post
4 minutes ago, Dave-Kay said:

however, next step, changing RAM.

Doubt it, I would guess board/CPU related, possibly also a kernel compatibility issue, have you tried an earlier Unraid release?

Share this post


Link to post
Posted (edited)
1 hour ago, johnnie.black said:

Doubt it, I would guess board/CPU related, possibly also a kernel compatibility issue, have you tried an earlier Unraid release?

You're right. That didn't help.

I had 6.7.3.rc1 installed for testing, which didn't change anything. Now i downgraded to 6.6.7 and i am waiting for parity ceck once again...

Edited by Dave-Kay

Share this post


Link to post
On 7/22/2019 at 2:03 PM, Dave-Kay said:

the sytem ran just fine, till i tried to use encrypted disks. 

 

On 7/24/2019 at 11:43 AM, testdasi said:

 

Encryption needs quite a bit of oomph on the CPU and I think yours is an Atom which may not be powerful enough.

I have seen a lot of posts about hanging / slow performance with encryption and the consistent theme throughout is low-power CPU.

 

5 hours ago, Dave-Kay said:

ok, i give up, it is broken

 

I get why encryption can be desirable, but is it necessary for this specific server? If so, then a CPU upgrade is in order.

Share this post


Link to post

We include a lowly Atom D510 @ 1.66GHz for all testing and writing to encrypted volumes works just fine - perhaps a bit slower but certainly no hangs or time-outs.

Share this post


Link to post

I'm wondering if it has something to do with cross-drive shares. You have Drive 2 excluded in several of the shares. Which drive are you encrypting?

 

I'm assuming that you're copying to the encrypted drive. Have you tried copying to an unencrypted drive?

 

Have a telnet session open to "Tower" with "tail -f /var/log/syslog" running before you start to copy.

Share this post


Link to post

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.