bing281
-
Posts
48 -
Joined
-
Last visited
Content Type
Profiles
Forums
Downloads
Store
Gallery
Bug Reports
Documentation
Landing
Posts posted by bing281
-
-
actually it looks like disks 1,2,3 are all showing this issue. Are those 3 disks connected differently than the others. Looking at the LSPCI log it looks like they are connected to the system via USB?
-
Your problem is with this disk
=== START OF INFORMATION SECTION ===
Vendor: HITACHI
Product: HUS723030ALS640
Revision: A440
Compliance: SPC-4
User Capacity: 3,000,592,982,016 bytes [3.00 TB]
Logical block size: 512 bytes
Rotation Rate: 7200 rpm
Form Factor: 3.5 inches
Logical Unit id: 0x5000cca03ec60450
Serial number: YVKHWZ3K
Device type: disk
Transport protocol: SAS (SPL-4)
Local Time is: Fri Oct 28 17:01:36 2022 BST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
Temperature Warning: Enabled
Read Cache is: Enabled
Writeback Cache is: Enabledand the problem is here
Protocol Specific port log page for SAS SSP
relative target port id = 1
generation code = 3
number of phys = 1
phy identifier = 0
attached device type: SAS or SATA device
attached reason: unknown
reason: unknown
negotiated logical link rate: phy enabled; 6 Gbps
attached initiator port: ssp=1 stp=1 smp=1
attached target port: ssp=0 stp=0 smp=0
SAS address = 0x5000cca03ec60451
attached SAS address = 0x51402ec0002d2a34
attached phy identifier = 4
Invalid DWORD count = 1327
Running disparity error count = 1300
Loss of DWORD synchronization count = 35
Phy reset problem count = 0
relative target port id = 2
generation code = 3
number of phys = 1
phy identifier = 1
attached device type: no device attached
attached reason: unknown
reason: power on
negotiated logical link rate: phy enabled; unknown
attached initiator port: ssp=0 stp=0 smp=0
attached target port: ssp=0 stp=0 smp=0
SAS address = 0x5000cca03ec60452
attached SAS address = 0x0
attached phy identifier = 0
Invalid DWORD count = 0
Running disparity error count = 0
Loss of DWORD synchronization count = 0
Phy reset problem count = 0This device doesn't give you back smart attributes because of the error above which looks like it is losing connection to the SAS card.
-
you can get errors on a disk that is considered out of parity if another disk is losing sectors basically you need to look at the SMART attributes on all the drives you have in the array including the parity drive and see if one of them is getting more REALLOCATED SECTORS. A lost sector on any drive during parity rebuild will fail the rebuild
-
Was thinking this would be an issue that not just I have with tracking and replacing hard drives and would love to hear from others if they think this is a good idea that they would use or if they have a alternative workflow they already use to get and track all this information.
I currently use / have disklocation, scrutiny docker. I like scrutiny a lot and I like how backblaze has a few algorithms to use SMART attributes to be able to calculate if a drive will fail. scruitiny docker has this built in also.
Basically with the backblaze / scrutiny algoriths this could turn into a single column that is called DRIVE HEALTH and they start at 100% and as things happen via SMART depending on weight those numbers go down telling the user which drives are most at risk.
The data and way to do it is already out there just not implemented in UNRAID
-
I believe this should be a sub forum folder under General Support for AD / SMB / NFS / Apple Timemachine
I would also have this be the place that any new future SSO or login / credential support is located.
-
1
-
-
22 hours ago, SpencerJ said:
Do you have any suggestions on where such a sub-forum should live?
I used to use Active Directory on my UNRAID system around 2010-2015 it was the main reason I originally purchased my PRO key. There used to be a sub forum location for AD on UNRAID 4.5 and suggest that this sub forum that used to exist be reopened and renamed and used as the location.
-
1
-
-
I updated the original post with notes about not currently recommended to purchase until my testing and peer reviewed testing is complete.
-
1
-
-
7 hours ago, JorgeB said:
It's not Unraid, it's a general issue, though it Unraid in can b worse since all the devices are accessed simultaneously (if they are in the array).
Each SATA port 600MB/s is split into 5 ports, so 600/5=125MB/s max per port if all used at the same time in the same multiplier, also the JMB585 is PCIe x2 (it's only x4 physically) max usable bandwidth is around 1750MB/s, so if all drives are accessed at the same time that's around 73MB/s max per device.
yeah i think you are right on this one for the 73MB/s that card says it requires 4x lanes but who knows if it really does.
I think i am going to install it and run it on one of my test UNRAID servers and see how it does. I am interested to see how it operates on a 24 hard drive system and the speed it will really give. Because if it did give 160MB/s per drive and was stable it is an excellent inexpensive UNRAID solution. Since I have one I might as well find out for others. However I went on the eBay yesterday and purchased a 24i HBA card which was surprisingly inexpensive at only $200 without any cables at all.
Therefore my current comment is that no one should run out and buy this for UNRAID until i put it in my system and see how it runs and report back.
Appreciate your help and comments thank you.
-
1
-
-
my 5th UNRAID server ran at 250 watts for 24 hard drives and dual opteron processors with 24 cores i think.
my 6th UNRAID server runs at 250-350 watts specs below.
EST006 - CURRENT - MAIN -
- CASE: Norco-4224
- MB: Supermicro X10SLL-F
- CPU: Intel® Xeon® CPU E3-1246 v3 @ 3.50GHz
- RAM: 32 GiB DDR3 Single-bit ECC (max. installable capacity 32 GiB)
- GPU: NVIDIA P2000
-
ARRAY:
- 2022-10: 136 TB
-
CONNECTION:
- 1gbps symmetric fiber
I do not spin down hard drives ever on either
EST005 had 3x 120mm fans and big passive heat sinks on processors with 2x 80mm on the rear
EST006 has 6x 120mm magnetic lev fans and a corsair water cooler on the processor with 2x 80mm fans on the rear
Both have additional copper on other components to keep heat down, hard drives on EST006 sit around 35c not used and 40c used and the processor sits around 55-65c
Both are relatively silent and under 50 db all the time.
My suggestion to you is that the processors take the most and that E3-1246v3 is like under 40 watts power pull. You want to focus on ultra low power processors with more cores and offload harder work to a NVIDIA P2000 or better.
-
1
-
7 hours ago, peterg23 said:
For users tempted to use USB connected drives within the array, on the Unraid forum JonathanM has said:
USB is notorious for random disconnects, which kicks the drive out of
the array. Also, the USB-SATA interface may introduce differences in
absolute size, or other abnormalities like non-unique serial number
returns or several other issues. Smart reports, and the ability to track
drive health may be limited. Cooling can be a challenge.
Some drives work better than others as USB, but on the whole it's a
recipe for disaster when you depend on all drives to work perfectly 100%
of the time.https://forums.unraid.net/topic/75930-why-not-to-use-usb-external-drives-in-an-array/
Yes thank you for clarifying that. I put in my large original text I do not use this for any drives in my array. I also would not do that or recommend anyone does that.
-
1
-
-
Shoot i see the issue now i think hmm
Basically it goes JMB585 which is PCIE to 5xSATA ports (6Gbps)
then it goes on each of the 5xSATA to a JMB575 which is a SATA port multiplier from 1xSATA to 5xSATA (6Gbps) total of 25 SATA however it is only using 24 of them and neglecting 1.
So you are saying that UNRAID doesn't like the JMB575 multiplier in this case. What is the reason that UNRAID doesn't like port multipliers is it a speed thing or is it another inherent reason?
Let me do some math real quick here.
PCIE x4 = 3.938 GB/s or 31.504 Gbps
PCIE x4 31.504 Gbps / 5xSATA = 6.308 Gbps to each multiplier over the sata link
6.308 Gbps / 5xSATA port multiplier = 1.26016 Gbps to each of the final 24 SATA ports
1.26016 Gbps on each of the 24 ports is approximately equal to 157.5 MB/s max speed on each port.
On my spinners I see them at parity check when on the beginning / inside of the plates run around 160 MB/s max speed for parity checking
Now continuing my thinking out loud here there is clearly some loss in there during all of this however theoretically it can basically push all 24 of my spinners at max speed which they can only do for about the first 0-25% of the parity check. Therefore I am guessing that while I would see some decrease in max sustainable speed I don't think it would bring them down below 140 MB/s or around 10% and i think it could maintain that speed easily. Therefore for a 10% loss in max sustainable speed I can stop purchasing $1000 cards. However this only holds true if there is not some other unknown to me issue for why UNRAID can't use port multipliers.
Thoughts?
I currently am running my older -8i IT cards on my drives and i think they bring down the max sustainable speed to around 120 MB/s
-
i agree those are not recommended and i don't even use them after my HBA's but i also was reading lately that these specific port multipliers are supported and they also are fast enough to max out all the ports at once on spinning hardware but not on SSD's.
Can you correct me here if I am wrong because that was my understanding on these specific chips from this forum and from storage review
Here is the basic setup from this card
Goes JMB585 -> 5x JMB575 -> 25/24 SATA ports
on the thread you referenced they call out JMB585 chip cards as recommended. Difference here it does't have the secondary breakdown with the JMB575 however to my knowledge this should only be a speed issue for SSD's.
Perhaps I am uneducated or missing something and I look forward to understanding better. Thanks for the help.
-
1
-
-
I recently purchased the following USB3.0 external enclosure for 8 bay hard drives and can confirm that it is well worth the price
I have 8 drives in it and can confirm the following:
-
Accessing a single hard drive it can max the speed of the hard drive and maintain the max speed
- on my drive this was ~220 MB/s
- The tool less trays are quality
-
it is quiet
- Quieter than my server is at least
- i have it it sitting horizontally and it works great
- comes with everything you need
- can now have 8 drives attached using unassigned drives to transfer data / format / preclear before putting into main array
- single USB3.0 connection to computer / server
- single external power brick to wall power
Only con i can think of is that you can't control the fan speeds but for the external switch, however i don't use it for drives in an active array so this is not a problem for me. I use this instead of a Hard Drive Dock for extra drives.
Hope this helps others.
-
Accessing a single hard drive it can max the speed of the hard drive and maintain the max speed
-
NOTE: i own this card but have not currently tested it in my fully populated 24 drive array system to see how it performs for speed to each drive and under UNRAID on XFS using RECONSTRUCTIVE WRITE aka all drive same time live. I appreciate the discussion i had below and will report back on this card as soon as I get it tested.
IMPORTANT: CURRENTLY UNTESTED on UNRAID do not purchase thinking it will work until I do my testing unless you want to take that risk. See replies to this post below.
I recently had my LSI 9305-24i fail and I purchased the following card and cables to replace it. I believe this is fully supported and I also believe it is a really inexpensive option over LSI HBA's for 24 port internal
3x Amazon.com: ChenYang CY SFF-8654 8i 74Pin PCI-E Ultraport Slimline SAS Slim 4.0 to Dual SFF-8087 Mini SAS Cable PCI-Express @ ~$36 each
note may need different cables depending on what you are connecting to
note the card for ~$150 comes with 3x SFF-8654 (big connector on board) to 8x sata port cables included in price.
Total ~$250 for 24 port internal JBOD SATA with cables
I will report back after i actually install this however I thought it would be interesting to others
-
Feature Request : Main : Array Table : Add ability to display SMART Column(s) to display attributes
Description:
On the main page I would like the ability to be able to see a column or column(s) for the main 5 or 6 SMART Attributes in order to see the current count of said attributes over all hard drives at once.
Allow these columns to be enabled / disabled
Examples Current Column Names:
DEVICE, IDENTIFICATION, TEMP, READS, WRITES, ERRORS, FS, SIZE, USED, FREE, VIEW
Example with additional columns enabled:
DEVICE, IDENTIFICATION, TEMP, <SMART COLUMNS>, READS, WRITES, ERRORS, FS, SIZE, USED, FREE, VIEW
Justification:
When you have 24+ HD's and they are all aging and you need to be able to keep track of these things it would be nice to be able to see them on a single page instead of having to look at 24 HD's individually and then remember which one is which.
Additional Thought:
Allow each device to have a notes text box 128 characters or so under the device itself and to display the notes in a column like the SMART attributes if wanted.
Additional Thought Justification:
Can then mark drives with information like replace this one next or something or keep an eye on me or remove data from me soon.
Screenshots:
Array Table
Disk 14 Attributes
Disk 15 Attributes
Badly Done Mockup
-
Description:
Cloning SMB Shares Settings on Disk Share 1 to ALL will only clone the settings to Disks 1-24
How to reproduce:
Clone Disk Share Settings on Disk Share 1 to ALL
Expected results:
All Disks will have the same settings
Actual results:
Disks 1-24 have the cloned settings
Disks 25+ do not
Other information:
None
-
Can you please change the aacraid driver to because the one you have only supports the HBA cards please see post linked below:
https://lime-technology.com/forum/index.php?topic=51359.msg492558#msg492558
Thanks
-
Yes I had it also.
To solve it currently I made a user on UnRaid with username and password.
I cleared the remembered credentials on windows 10
I went back to the UnRaid share on the windows 10 device and put in the new username and password made earlier and clicked remember username and password
then it works and I should never see it again.
Not probably the solution you are looking for however it works
-
Will this be able to be put into the Release Candidate.
thanks
-
UnRaid 6.2.0-RC4 (Current):
Adaptec aacraid driver is version 1.2.1-50663custom
50663:
http://storage.microsemi.com/en-us/speed/raid/aac/linux/aacraid-linux-src-1_2_1-50663_tgz.php
Driver 50663 is only for the HBA cards according to the link above.
Compatible Products
PMC Adaptec HBA 1000-8e
PMC Adaptec HBA 1000-8i
PMC Adaptec HBA 1000-8i8e
PMC Adaptec HBA 1000-16e
PMC Adaptec HBA 1000-16i
50667:
http://storage.microsemi.com/en-us/speed/raid/aac/linux/aacraid-linux-src-1_2_1-50667_tgz.php
Driver is for the rest of the cards not the HBA cards:
Compatible Products
Adaptec RAID 7805
Adaptec RAID 7805Q
Adaptec RAID 71605
Adaptec RAID 71605E
Adaptec RAID 71605Q
Adaptec RAID 71685
Adaptec RAID 72405
Adaptec RAID 78165
Adaptec RAID 8405
Adaptec RAID 8805
Adaptec RAID 8885
Adaptec RAID 8885Q
Adaptec RAID 81605Z
Adaptec RAID 81605ZQ
I own 2x 71605e cards to run my UnRaid server and they are set to run in HBA mode however they only work when they are alone in the system. If I put in both cards the second card locks up and will not mount the drives while the first card will mount the drives just fine.
I believe this problem is likely due to the driver issue I have shown above where there is actually 2 different aacraid drivers for Linux based on the cards you use
I am wondering if the 50667 driver will work correctly for the HBA cards and I assume it will, however the 50663 driver does not work correctly for the other cards.
Can we please replace the 50663 driver with the 50667 driver?
Thanks
-
Can't wait for this to be fixed. I have a few drives pending installation took me a bit to figure out what was going on.
I also believe that preclear both normal and beta are broken in RC2.
-
This post is to describe an error I found that took me a bit to figure out. I want to explain what my system was initially as described below:
PCIEx8 verision 3 ---> 9211-8i ---> 4i direct ------------------------------> backplane breakout (4 drives including parity)
|--> 4i --> RES2SV240 SAS Expander --> backplane breakout (20 drives)
Motherboard SATA -----------------------------------------------------------> 2 SSD drives for cache
I wanted to move the system to:
PCIEx8 version 3 ---> Adaptec 71605E ---> 4i direct ---------------------> backplane breakout (4 drives including parity)
|--> 4i direct ---------------------> backplane breakout (4 drives)
|--> 4i direct ---------------------> backplane breakout (4 drives)
PCIEx8 version 3 ---> Adaptec 71605E ---> 4i direct ---------------------> backplane breakout (4 drives)
|--> 4i direct ---------------------> backplane breakout (4 drives)
|--> 4i direct ---------------------> backplane breakout (4 drives)
Motherboard SATA -----------------------------------------------------------> 2 SSD drives for cache
However it took me some time to figure this out but no matter what I did the second Adaptec 71605E controller would lock up after unraid was loaded even if I switched the control cards places. I believe there is a driver issue that does not allow 2 Adaptec Controller Cards. I saw on the Adaptec page it was fixed in a newer version of the driver.
Anyway so I had to change the setup to:
PCIEx8 version 3 ---> Adaptec 71605E ---> 4i direct ---------------------> backplane breakout (4 drives including parity)
|--> 4i direct ---------------------> backplane breakout (4 drives)
|--> 4i direct ---------------------> backplane breakout (4 drives)
|--> 4i direct ---------------------> backplane breakout (4 drives)
PCIEx8 verision 3 ---> 9211-8i ------------> 4i direct ---------------------> backplane breakout (4 drives)
|-----------> 4i ----------------------------> backplane breakout (4 drives)
Motherboard SATA -----------------------------------------------------------> 2 SSD drives for cache
-
I have thank you for checking with me. This is actually my 3rd UnRaid Server and I did as much research as I could before pulling the trigger on the change.
Anyway I wanted to say everything went well for the set of directions except I did find a driver error which was unfortunate and had me thinking that I had bad hard drives where in fact I don't believe I did. Luckily all of this mess is sorted out now, I will explain the driver error in my next post in order to keep it clean.
I wanted to report back in this post that the instructions I gave in the first post are correct and it was actually quite easy.
Thanks
-
I ended up going with losing 2 TB of data after i figured out what was on the failed disk.
I did a new config and kept both the failed disk and the disabled disk off the new config.
Then I redid the parity on the other drives.
Now I am copying the data back from the disabled disk and failed disk using unassigned devices to mount them by themselves and then move their data back to the user share.
I believe this was the best way to do this.
I am going to replace both disks one of them will become my second parity and the other will get a shinny new 4tb hard drive installed.
Thanks for taking the time to write a post to help me
How many TB's is your Unraid Server?
in Unraid Polls
Posted
136 TB currently but soon to be 200 TB + with my 16 TB hard drives replacing my 6=7 year old 4 TB's