brandon

I love that I've never lost data from drive loss in my unRaid system (and I've been a user since early 2000s with IDE drives). Thanks for that! I'd love to see the ability to have multiple cache pools and multiple arrays added.

https://access.redhat.com/security/cve/CVE-2015-0240 http://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2015-0240

Has anyone installed multiple AOC SAS2LP-MV8 cards in their unRAID machines? I have one, but looking at getting another one for my system to add ports and to replace some older SATA1/2 controllers. I read of other cards/controllers having an issue when two or more cards are installed, but is there a problem with the AOC SAS2LP-MV8?

By top level folders, you mean user shares (if they're being used)? Just want to make sure I did it right (and not wrong as per my problem above). ex. I have 13 drives, and I used "getfattr -d /mnt/disk#/Movies" (where # was 1-12), and they all reported "user.org.netatalk.supports-eas.J0IAGj: Input/output error" and a few "Removing leading '/' from absolute path names" Then I ran "/boot/rmattrs /mnt/disk#/Movies" for each of the drives (since they all reported errors), and not testing again with getfattr -d nothing shows up. Is this the right practice?

Not sure if it's related, but this fix didn't clear up my mover issue: http://lime-technology.com/forum/index.php?topic=23100.10 I did however have a bunch of "user.org.netatalk.supports-eas" messages show up for some shares, and now they don't thanks to this tool.

Not at home now to check, but I'm using a Gigabyte Z68 based motherboard with the SAS2LP and it's working fine. I also have two additional BIOS' come up too (for another SATA card and an Intel NIC). Also, check the firmware on the card you receive. A new firmware came out last month: ftp://ftp.supermicro.com/driver/SAS/Marvell/MV8/SAS2/Firmware/

I'm using a SAS2LP flashed to the current firmware. I'm not having any performance problems, except when the unRAID gui with SimpleFeatures is currently loaded in a browser. If I close the browser window, performance goes back up (80MB/s parity checks, but limited in speed due to two older drives).

I think actually copying the files rather than renaming them may fix the xattrs. This may also do nothing... I'm assuming I use rsync to copy from a share to another? ('TV Shows' to 'TV Shows 2') Then I can delete the 'TV Shows' share, and rename 'TV Shows 2' back to 'TV Shows'? What would the rsync command be? (sorry I'm not familiar with linux)

Would a good next move to try be to make new shares ('TV Shows 2' vs 'TV Shows') and move everything to the new shares? Would I be able to create a new share and just rename the folder within each disk share to the name of the new share?

Thanks, but it didn't work. I'm finding it (xattr error) happens for some shares only: Downloads, TV Shows and Movies. But a new share I created works fine with mover.

It took a while, but I ran it all on my drives (except parity). The output for all the drives were 0 transactions replayed and No corruptions found (I'm assuming that's the main part that's important). Here's the output from my cache drive (all other drives were the same other than the filesystem stats): Do you want to run this program?[N/Yes] (note need to type Yes if you do):Yes ########### reiserfsck --check started at Fri Apr 5 14:42:12 2013 ########### Replaying journal: Done. Reiserfs journal '/dev/sdh1' in blocks [18..8211]: 0 transactions replayed Checking internal tree.. finished Comparing bitmaps..finished Checking Semantic tree: finished No corruptions found There are on the filesystem: Leaves 3809 Internal nodes 26 Directories 62 Other files 173 Data block pointers 3810444 (186274 of them are zero) Safe links 0 ########### reiserfsck finished at Fri Apr 5 14:42:13 2013 ########### root@fileserver:~#

Maybe you can post the steps to the group on one of the other threads so anyone else who wants to do this won't have to PM you. This would be great. Also having the same problem.

Ok so to update this thread, I am now running RC12a and am still having the same problems (I just stopped trying to fix cache/mover functions). I tried adding a new share, and it the mover works fine for that share. I get these errors still for other files going to other pre-existing shares: rsync: get_xattr_names: llistxattr("[b][i]<share name>[/i][/b]",1024) failed: Input/output error (5) I've also run the new permissions script and that didn't help. Any ideas on how to get mover working without crashing?

So far 12a works fine for me (was at rc10 earlier). I am getting the same problems with a SF (1.0.11) window open. My speeds drop from around 65MB/s to 20MB/s within the span of 15 seconds. Then when I close the SF window, the parity check goes back up to 65MB/s in about 30 seconds. My speeds are slow because I'm using two older 500GB Hitachi drives on a PCIe1x Sil3132 (getting a new controller to replace). Once I get past 500GB in the parity check, my speeds climb. I'll check SF again when I'm past 750GB (my third slowest drive).

Yea that's my setup now: Motherboard 2x SATA3: parity and SSD cache (to be installed) Motherboard 4x SATA2: all populated with a variety of 2TB drives Rosewill 4x SATA2: all populated with a variety of 1TB drives Syba 4x SATA3: three populated: 2x 750GB, 1x 500GB Monoprice SIL3132's: each card with 1x 500GB each It's the 500GB drives that are in the sub 100MB/s range... especially the Hitachi drive which only gets 70-80MB/s reads. The next step of capacity expansion will be to swap out the 500GB drives with 2-3TB drives in the future (but I'll do it when I need more space). It's shitty in that if I knew that this was what I would get, I would have gotten the SATA3 SuperMicro PCIe 2.0 8x card for a bit more. Then I wouldn't use the Monoprice cards either.

Damnit, so some bad news (good for you guys). The Z77 motherboard with unRaid 5 rc8a loads up the Syba card fine at PCIe 2.0 with 2 lanes. I guess my Gigabyte Z68 board can't run 2 lanes on any slots. I tried running a brand new install with no cards other than the Syba (and in the three compatible slots), and it's still only able to connect with 1 lane.

I just tested it and elkay14's script isn't required. But it still uses the same driver and the lspci -vv output is still as follows: http://lime-technology.com/forum/index.php?topic=23483.msg207970#msg207970

Since a very important counter-example was the successful Syba-x2 behavior on the Z77/Windows combo, the Z77/unRAID tests should include one with the Syba in the same Z77 slot as was used for the Windows win. (In case that was not the x16 unshared which is in your stated plan.) I commend, and appreciate, your perseverance. I'll get to testing this week. And yes you're right. I tested in the motherboard's PCIe 3.0 8x slot (16x physical, shared with primary PCIe 16x slot), so I'll use that one again.

OK. I did not see you mention the x4, so just tried to cover all bases. You did even better ... Those tests should tell the story. One other thing, I didn't see mention of which Linux version you're running (u4.7==L2.6.32;... u5.0rc8==L3.4.11), but I would also try those barebones tests with the opposite end of the above "spectrum", in addition. For instance, my SiI3726 port multipliers (connected to a Mrv 88se9125) stopped working when I went from Linux 2.6.37 to 3.2.29. (I don't use unRAID myself). Good luck. It was all with 5rc8a. I'll add testing with 4.7 to the list as well. To do list tonight (or tomorrow): Z77: test base 5rc8a install with ahci add-on (with Syba in unshared 16x slot) Z68: test base 4.7 install with ahci add-on (with Syba in unshared 16x slot)

Well, that's somewhat encouraging. But, it is not conclusively proven to be a Linux problem. Since both the OS and the motherboard are different in that experiment, it lacks rigor. But, rather than loading Windows on your Z68 guy, you could just boot the Z77 w/ your unRAID flash (in combo with the mod'd enable_ahci script [and a neutered unRAID config (??)]), and then try putting the pedal to the metal [and checking lspci]. Because of all the PCIe bandwidth sharing and dropbacks on your Z68 mobo, in combo with a newly-introduced card using a "mongrel" PCIe lane-grab (x2 is rarely seen), the above observation (re: concern about a two-variable experiment) is (possibly) more than anally academic. Speaking of your Z68 mobo, I know that you tested the Syba in the X16 & X8, but just for grins, did you try it in the X4? (Note that if you do, you need to remove the 3132 that is in the PCIeX1_2 slot because of this note from Gigabyte: You mean, so it isn't just a half-fast card ? [couldn't resist] If the above tests don't improve the scene, I don't know. I tried searching around, but there appears to be nothing applicable regarding the 9230 on any *nix. This Syba card is the first instance of the chip being used in a Marvell-Id'd card (ie, 1b4b:9230) [as opposed to, eg, a Highpoint-Id'd one). What is surprising is that I find nothing *nix-related regarding the several mobo's that incorporate the 9230 onboard. Amusingly, the only hit was in a syslog attached to a forum posting here (July '12) but it, expectedly, didn't ID. Yea, I tried out the Syba card in the 4x slot as well. I removed all non-essential cards from the Z68 system (Intel PCIe NIC, 2x Monoprice cards). The only card that was in the system was the Rosewill PCIe 4x card. I tried the following combinations: Rosewill in 4x slot, Syba in 16x and 8x slots (no other cards) Rosewill in 16x slot, Syba in 4x slot (no other cards) 2x Monoprice cards installed in the 1x slots, Syba in the 16x and 8x slots (no other cards) I did this because I thought that it might be because the Rosewill card is PCIe 1.0 and the Syba was PCIe 2.0, and that mixing them in the shared slots might complicate things... but this didn't work either. I'll try putting the Syba card back in the Z77 rig with a new flash drive with the only the ahci mod (and everything else default/stock). I'm also going to try it in another system (AMD 780G based).

With two or three regular hard drives hooked up to the Syba controller, performance should be pretty good. I'm limited by the performance of my old/slow 500GB drives (esp the Hitachi one), but the rest of the drives are okay. The motherboard built-in and Rosewill card's ports are all populated, with both of the Monoprice SIL3132 cards hosting one drive each, and the Syba with two ports populated.

It must be a linux problem, as I tried installing the card in a Windows system with a Z77 chipset and it maxes out around 800MB/s with four drives running. Any ideas on how to get this controller running with a 2x link width?

It says that ASPM is disabled for the card, so it's not a power saving feature that's limiting speed. I will have to try the card in another computer.

Here are results of the cards/controllers I have. It doesn't seem like the Syba card is connecting via PCIe 2.0 2x, but only at PCIe 2.0 1x. I tried both the 16x and 8x PCIe slots on the motherboard. The 16x slot is supposed to revert to 8x when the 8x slot is populated. In either case, the Rosewill card works fine at 4x in both slots, but the Syba card stays at 1x. SYBA SD-PEX40054: PCIe 2.0 2x, 4x SATA3 root@fileserver:/boot# dskt.sh X p r q s sdp V4-CT256V4SSD2 = 228.45 MB/sec sdr OCZ-VERTEX4 = 321.38 MB/sec sdq OWC Mercury Electra 6G SSD = 351.40 MB/sec sds DP-CT050M4SSC2 = 350.75 MB/sec root@fileserver:/boot# dskt.sh p r q s sdp = 102.96 MB/sec sdq = 103.81 MB/sec sdr = 107.00 MB/sec sds = 103.20 MB/sec Rosewill RC-218: PCIe 1.0 4x, 4x SATA2 root@fileserver:/boot# dskt.sh X d e f g sdd OWC Mercury Electra 6G SSD = 253.99 MB/sec sde DP-CT050M4SSC2 = 257.49 MB/sec sdf V4-CT256V4SSD2 = 237.43 MB/sec sdg OCZ-VERTEX4 = 241.62 MB/sec root@fileserver:/boot# dskt.sh d e f g sdg = 198.02 MB/sec sdd = 199.27 MB/sec sdf = 199.10 MB/sec sde = 200.19 MB/sec Monoprice SIL3132: PCIe 1.0 1x, 2x SATA2 root@fileserver:/boot# dskt.sh X d e sdd V4-CT256V4SSD2 = 127.37 MB/sec sde OCZ-VERTEX4 = 125.41 MB/sec root@fileserver:/boot# dskt.sh d e sdd = 73.17 MB/sec sde = 76.50 MB/sec Z68 Chipset Built-In SATA3 root@fileserver:/boot# dskt.sh X j k sdj DP-CT050M4SSC2 = 484.18 MB/sec sdk OWC Mercury Electra 6G SSD = 474.71 MB/sec root@fileserver:/boot# dskt.sh j k sdj = 458.53 MB/sec sdk = 457.01 MB/sec Z68 Chipset Built-In SATA2 root@fileserver:/boot# dskt.sh X l m n o sdl DP-CT050M4SSC2 = 258.96 MB/sec sdm V4-CT256V4SSD2 = 237.32 MB/sec sdn OWC Mercury Electra 6G SSD = 255.41 MB/sec sdo OCZ-VERTEX4 = 249.20 MB/sec root@fileserver:/boot# dskt.sh l m n o sdl = 246.62 MB/sec sdo = 149.28 MB/sec sdm = 233.65 MB/sec sdn = 245.82 MB/sec

Reading a lot of the reviews of other SYBA cards makes me think that many users are idiots. Lots of things I saw were lack of TRIM in RAID configuration, can't boot with drives on the add-in card, slower than the on-board MB ports (when some of the cards are freaking PCIe 1.0 1x and have 4 four drives hooked up). I wouldn't be surprised if there is a bad review that shows up for this card that says, "It has 6 ports but I can only use 4 at the same time?" or "I can only read/write at 100MB/s... not 6gb/s like it says"