WeeboTech
-
Posts
9,472 -
Joined
-
Last visited
Content Type
Profiles
Forums
Downloads
Store
Gallery
Bug Reports
Documentation
Landing
Posts posted by WeeboTech
-
-
Yeah works fine with passthrough, all my drives spin down properly (except the .vmdk cache drive, but then if that ZFS array spun down, I'd have a lot of other issues haha)
What are you using for the ZFS Array? I'm contemplating an experiment.
-
Yeah a .vmdk is probed for status fairly regularly, so I think you will see the same occur for a RDM drive and it not being spun down unfortunately. I think there was a discussion about this a while back.. buggers me if I can find it though!
I bet it works for pass through.
Although I wonder how it would work with an Areca controller.
They have a bios setting to spin down the drive during idle time.
I know unRAID could not spin down my RAID0/RAID1 array, but the controller would do it for me.
-
I wouldn't be surprised if you can't get SMART either, as with RDM, you are essentially putting an extra layer between the VM and your drives.
With pvscsi, and the lsisas controller you can get smartctl information. Although it wont spin down.
I'm going to try a test where I set the spindown time into the drive with hdparm -S241 /dev/sd? on bare metal unRAID.
Then boot into vmware and see if does actually spin down.
Since I cannot tell directly, I can try to see if there is a delay when I access the drive.
From what I saw, ESX probes the drives every now and then, so the drives may never spin down.
-
I followed the instructions in here http://lime-technology.com/forum/index.php?topic=7914.0 to map disks directly to the UnRAID VM. It seems to be working. However, the SMART status is not coming through and I'm getting blinking green balls so it doesn't even seem them as spun up.
What is the preferred method of mapping disks to UnRAID on ESXi 5.1?
Thanks.
I've used a command like this.
vmkfstools -z /vmfs/devices/disk/vml.xxxx diskname.vmdk -a lsilogic
I ended up changing it to pvscsi, in my tests it was faster, but only if you had the hardware to support it.
Blinking green balls and no spin down. Yes, that's my case too.
Actually they are probably spinning, but the status cannot be determined. Therefore they cannot be spun down correctly either.
You should be able to get smart status though.
-
What controller did you choose? I think I remember fiddling around to pick a controller type.
-
Has anyone upgraded their N54L with the modified Bios for the improved SATA options?
-
Have any of you tried installing ESXI on N40L and what the performance like? is it too much hassle?
I played with ESXi on N36L shortly but because (1) you can not passthrough a hardware controller to a VM and (2) CPU is incredibly weak for any practical application, it makes little sense to run ESXi on a microserver other than for testing and experimenting.
How it can make sense to run ESXi on a microserver when you say CPU is incredibly weak for any practical application?
I am considering selling N40L so I can build my own mini server (same server case size) with much powerful CPU and better motherboard that support passthrough.
Tempted to do the same, but the cost of new server will be higher than the N40L I assume?
I have the N54L with 16GB of ram. ESX runs OK on it.
In comparison, at work we have a dual processor 2.5 ghz opteron we've been running RHEL 4 with vmware server 1.0 for years. It gets about 5184 Bogo mips. We hit this hard with about 3-9 RHEL linux VM's at a time.
The N54L is 2.2ghz dual core and gets about 4400 bogo mips.
Since I do not hit the server so hard as we do at work, Plus with the use of ESX rather then RHEL/VMware Server, ESX is pretty do-able with light loads and/or use of an SSD for the datastore.
-
Cross post from another thread. I'm only adding it because some of the performance tests and recommended devices.
FWIW, I got my two N54L's running today with ESX and unRAID.
I found I had to use the -z switch to make the RDM files/links to the .vmdk.
Once I did that it worked with lsi sas then switched over the pvscsi without issue.
I did find some interesting tidbits with the N54L and speed.
I have a Startech PEXESAT322I PCI-Express x1 Low Profile Ready SATA III (6.0Gb/s) 2 Int/2 Ext SATA Controller Card
http://www.newegg.com/Product/Product.aspx?Item=N82E16816129101
This card supports SATA III.
I had the sandisk external raid unit set up with 2 3TB Seagate 7200 RPM drives.
Native unRAID did a read test clocked at 230 MB/s
under ESX unRAID did 170MB/s with the LSI SAS controller and 230 MB/s with the PVSCSI controller.
Just something to think about.
I did a whole assortment of speed tests with the N54L. I found the Startech controller to be good for single drives, but a SIL3132 to be good for multiple drives on a PMP device.
I'm also using the Addonics ADSA3GPX1-2E PCI Express eSATA and SATA II 2 Port eSATA II RAID Controller
http://www.newegg.com/Product/Product.aspx?Item=N82E16816318005
I found this to handle the PMP smoother. It seems the silicon image drivers multiplex drive access smoother then the Startech ASMEDIA ASM1061.
While the startech handles single drive speed the fastest, the PMP speed of multiple drives at the same time was abysmal.
SIL3132 DD read tests of 4GB on all drives brought it down to about 33MB/s for all drives at the same time. Actually that's not too shabby. Single drive speed was about 120MB/s never really higher no matter what model of drive I used.
ASMEDIA ASM1061 DD read tests of 4GB on all drives brought it down to about 10-20MB/s on various tests for all drives at the same time. Single drive speed maxed at 170MB/s for the newer seagate 1TB platter drives (3TB and 2TB). with a Samsung PM 840 PRO I was getting 350-420MB/s read tests.
The interesting point about the SIL3132 is that for a single drive, you get max speed, for 2 drives, you get half speed, for the drives you get 1/3rd, then down to 1/4th. Seems appropriate. With the ASMEDIA ASM1061, I saw big blocks of data being serviced for one drive.. then move on to the next drive, then onto the next, and so on.
I've yet to do an analysis of how it affects parity generation or checking.
I still see myself using the ASMEDIA ASM1061 for the top two drives which are going to be dedicated to ESX.
Samsung PM 840 PRO 256GB for ESX data store and a Seagate 2TB 7200 RPM for it's backup. I may change this if I find the Samsung to be so reliable that the spinner is unnecessary.
-
Are you using an external system to add more drives into it to make use of those other connections you'll get with the pci and pci-e and esata ports that are open?
I like these
SANS DIGITAL TR4UTBPN 4Bay USB 3.0 / eSATA Hardware RAID 5 Tower RAID Enclosure (no eSATA card bundled)
http://www.newegg.com/Product/Product.aspx?Item=N82E16816111149
I'm sure there could be better ones. In my case I like having and internal power supply. (no blocks, just standard PC style power cord).
The option of plugging a drive in without trays.
The ability to use Port multplier with JBOD or hardware raid, concat,1,0,5,or 10.
I have one in RAID10 mode and another in jbod mode.
Although I not tested PMP capability in JBOD mode under unRAID, the drives did show up individually in JBOD mode under ESX 5.1 (but let me double check and verfiy that again). In my Micro server I had two controllers. 1 startech, and one SIL3132.
I did test the PMP capability using the eSATA port on the back of the server and ESX nor unRAID saw all drives in JBOD mode. It could require a load of the modified bios. An original unmodified machine did not have PMP capability of the eSATA port (yet). In any case you could take smaller drives, RAID10 or RAID5 them and use that as a vmfs DATASTOR for esx.
-
I can confirm this ram works in the N54L.
Crucial 16GB (2 x 8GB) 240-Pin DDR3 SDRAM DDR3 1333 (PC3 10600) Desktop Memory Model CT2KIT102464BA1339
http://www.newegg.com/Product/Product.aspx?Item=N82E16820148466
There were posts about it, i bought it, it worked. I have two machines with it.
As far as, will be be useful? Well you have to determine how busy the machine is.
With the right kernel tunings, the large ram and buffer cache come into play and you can move small files to the machine at very high speed. Granted you have to retune the kernel a bit, but I was getting high transfer speeds on small writes for a burst. Good when moving lots of MP3 files or torrents.
You also can consider how cheap ram is these days vs what could come around the corner next year.
4GB is enough for an unRAID server, anything more is cache enhancement.
I'm running ESX 5 on my machine. If you plan to run ESXI, go for the most you can afford.
When I'm not running ESX and just unRAID, my unRAID usage is very fast.
FWIW, I use these in the top bay.
ICY DOCK MB971SP-B DuoSwap 5.25" Hot-Swap Drive Caddy for 2.5" and 3.5" SATA HD/SSD
http://www.newegg.com/Product/Product.aspx?Item=N82E16817994143
SYBA SY-MRA55006 5.25" Dual Bay Mobile Rack for both 2.5" and 3.25" SATA HDD, Plus 2 USB 3.0 Port
http://www.newegg.com/Product/Product.aspx?Item=N82E16817998184
The ICY DOCK is well made, but I do not like how the drive is exposed a bit when you put a drive in.
The SYBA has a door that closes. It's not as sturdy, but looks nicer then the edge of a drive showing.
So you can fit a 3.5" drive and a 2.5" SSD in the top bay.
You will need a Molex to SATA power cable.
You will need an SATA cable from motherboard to top bay and an eSATA to SATA cable to route from the back.
Frankly, I decided to go with another controller instead.
StarTech PEXESAT322I PCI-Express x1 Low Profile Ready SATA III (6.0Gb/s) 2 Int/2 Ext SATA Controller Card
http://www.newegg.com/Product/Product.aspx?Item=N82E16816129101
I plan to use two controllers and put each drive and each eSATA unit on it's own card. But for now I have one drive on the motherboard and the other drive on this controller.
On one of the other machines I'm using a SYBA-SIL3124 PCIe controller which gives me 2 internal and 2 external ports. newegg doesn't have it anymore. I had to score it off eBay.
Power-over-eSATA II + Internal SATA II 4-port PCI-e Controller Card with Low Profile Bracket
http://www.sybausa.com/productInfo.php?iid=844¤tPage=0
-
I'm using this with the double twin in my N40L. It is a tight fit in mine but I got it to work.I remember reading in one of the threads related to the microserver that someone was using a mesh blanking plate.
Can anyone provide a link to a product that will work with the nexus double twin?
Thanks it! Thanks!
-
WOW that is excellent news.
Two months older news now, than when I tried telling you ...
For those interested, I just purchased a N54L.
...
I'm using an addonics SIL3132 card for external eSATA access to a Sans Digital PM Unit.
Have you tried plugging the SansDigital into the MicroServer's eSATA port? [surprise!!
]I'll have to test if unRAID can support the PMP capability.
Probably will, but performance (parity check, etc.) might be yucky.
At the very least a SIL3132 or SIL3134 with eSATA should do nicely.
Even there, you will be limited to about 120 MB/s total bandwidth with the PM enclosure. The SiI3132 has a bogus transfer rate limit of ~120 MB/s (even though it is PCIe x1 v1, and should be able to get 180-200 MB/s).
I forgot.. I've been so buried in life after Sandy recovery.
-
I think someone on http://hardforum.com tried maxing out the drives further and there's a limit -- something like 12 drives.
It's somewhere in this thread: http://hardforum.com/showthread.php?t=1555868
I've had 9 drives attached to mine.
How do you have them attached?
I was thinking of using the SANS DIGITAL external eSATA/USB units to attach more drives along with SIL3132 controllers that do PMP.
I have an Adaptec 1430SA in mine and the extra drives (apart from the 6x 3.5") are:
2x 2.5" (internal)
1x 3.5" (external eSATA with its own PSU)
With all these drives attached (6x 3.5" + 2x 2.5"), the Microserver PSU is maxed out.
Note that you can apparently use a port multiplier on the eSATA port: http://homeservershow.com/forums/index.php?/topic/4727-successfully-enabled-port-multiplier-on-esata/
WOW that is excellent news. I'll have to test if unRAID can support the PMP capability.
At the very least a SIL3132 or SIL3134 with eSATA should do nicely.
I would end up with about 13 drives. 5 internal, 4 port SANS Digital box.
I doubt I'll do it, but I'm looking at options since I lost my 20 drive beast and I'm not sure I want to build such a big server anymore.
Good reading there at that link, plus the hard forum link. Thanks for posting.
-
I think someone on http://hardforum.com tried maxing out the drives further and there's a limit -- something like 12 drives.
It's somewhere in this thread: http://hardforum.com/showthread.php?t=1555868
I've had 9 drives attached to mine.
How do you have them attached?
I was thinking of using the SANS DIGITAL external eSATA/USB units to attach more drives along with SIL3132 controllers that do PMP.
-
I remember reading in one of the threads related to the microserver that someone was using a mesh blanking plate.
Can anyone provide a link to a product that will work with the nexus double twin?
I'm going back and forth with the idea of 2 3.5 drives in the top bay or 1 3.5 & 1 2.5.
I'm using these two products for now.
SYBA SY-MRA55006 5.25" Dual Bay Mobile Rack for both 2.5" and 3.25" SATA HDD, Plus 2 USB 3.0 Port
http://www.newegg.com/Product/Product.aspx?Item=N82E16817998184
ICY DOCK MB971SP-B DuoSwap 5.25" Hot-Swap Drive Caddy for 2.5" and 3.5" SATA HD/SSD
http://www.newegg.com/Product/Product.aspx?Item=N82E16817994143
-
I would love a better bios, just bought an N54L recently.
-
on my N54L with RC8a and without the tweeked kernel
model name : AMD Turion(tm) II Neo N54L Dual-Core Processor real 0m44.619s user 0m44.300s sys 0m0.110s root@unRAID:/tmp# grep "cpu MHz" /proc/cpuinfo cpu MHz : 2200.000 cpu MHz : 800.000 root@unRAID:/tmp# grep "cpu MHz" /proc/cpuinfo cpu MHz : 800.000 cpu MHz : 800.000 root@unRAID:/tmp# grep "cpu MHz" /proc/cpuinfo cpu MHz : 800.000 cpu MHz : 2200.000
When I get a chance I'll install the tweaked kernel and retest.
-
elkay-
I have one of these: http://www.ascendtech.us/lsi-ser523-rev-b2-raid-sata-controller_i_cntlsilogser523.aspx which seems to have 3 SiL3112 controllers to handle the 6 drives. Ford Prefect directed me to this thread, but none of your notes in OP seem to be applicable to this particular board.
Is it my lack of understanding, or is this another chipset you might be able to add to your script?
Docs here: http://www.lsi.com/downloads/Public/Obsolete/Obsolete%20Common%20Files/sata150_ug.pdf
Thanks!
FreeMan
EDIT: Never mind, Ford got back to me and indicated he'd misread my question. He felt that my controller would be supported out of the box under v5rc10. Unfortunately, I don't have the patience or know-how to get it so. It's OK, I've got other controller options.
I would suggest going with the tried and tested supermicro 8 port controller. I had 2 of them in a machine that supported PCI-X and they performed very well. I had high read/write and parity check/generate rates.
-
For further discussion
sysctl vm.highmem_is_dirtyable=1 seems to have a positive effect w write speed
http://lime-technology.com/forum/index.php?topic=25431.msg221288
-
I wanted to do this soon... Do you think I should get Hardware Controller Card?
I did, it didn't cost all that much to add 2 more eSATA ports.
I purchased another card from syba that has 4 ports, 2 internal, 2 external.
This way the top 2 drives have full speed without installing a hacked bios.
I'm not sure if it's esxi compatible yet, but I'll work on it in the future.
It's a SIL3124, in addition to the SIL3132 card.
I may try to score an ARC-1200 for the internal drives since I know it's compatible and I have to extract data from an Areca array anyway.
-
Nice!
Why do you need a big ram? Is it because you installed ESXI ?
I have not 'yet' but plan to. Sometimes I max out the machine just so I don't have to do it later on.
There are many times in the past I did not max things out and it became hard to find parts.
With the newer CPU and extra ram I plan to have ESXi a slackware dev environment and an XP instance for utorrent. (either that or put it on my laptop).
FWIW I'm getting excellent read speeds with the newer Seagate 3TB 7200 RPM drives. They have consistantly outperformed my expectations by leaps and bounds. At least for the preclearing step.
I'll be posting benchmarks as I test the two drive setups for parity speeds and write speeds.
This should be an interesting comparison. What are the speed differences from 5400 rpm parity to 7200 rpm parity.
Any suggested benchmarking I should do?
I was planning to put 4 drives in the array.
Testing with a 5400 RPM parity drive, then a 7200 RPM parity drive.
-
Nice setup.
A little off topic. what is the max resolution on that portable monitor?
I have been looking for something like that for a while.
I have a rack mounted mac mini server that gets used offsite quite often. most of time it needs no monitor. but every now and then we need to put a monitor on it. We found out that none of the normal portable USB monitors work as the primary/only display on OSx. the HDMI of this one should work for us.
1366x768. It's made for VGA, HDMI and MHL, Battery or USB Power. Audio input too.
-
For those interested, I just purchased a N54L.
I'm able to see 16GB of ram with the following chips.
Crucial 16GB (2 x 8GB) 240-Pin DDR3 SDRAM DDR3 1333 (PC3 10600) Desktop Memory Model CT2KIT102464BA1339
http://www.newegg.com/Product/Product.aspx?Item=N82E16820148466
I get 4392.57 bogomips
I also installed this unit up top so I could swap drives in an out fast.
SYBA SY-MRA55006 5.25" Dual Bay Mobile Rack for both 2.5" and 3.25" SATA HDD, Plus 2 USB 3.0 Port
http://www.newegg.com/Product/Product.aspx?Item=N82E16817998184
I'm using an addonics SIL3132 card for external eSATA access to a Sans Digital PM Unit.
I plan to swap it out with a SYBA SD-PEX40031 so I can use the internal SATA ports for the upper two bays.
http://www.newegg.com/Product/Product.aspx?Item=N82E16816124038&Tpk=SD-PEX40031
We'll see how it goes.
In the mean time I am preclearing 4 drives simultaneously. They seem to be running at max speed.
Two of the drives are 3TB 7200 RPM Seagates - ST3000DM001
I was getting 170MB/s on the first 1TB of the drive, now I'm at 155MB/s.
For the Hitachi 3TB 5400 RPM drives HDS5C3030ALA630, I started at 130MB/s and I'm at 115MB/s after the first 1TB.
Nifty lil machine.
The monitor I have is the GeChic 2501. It has all sorts of cool features.
GeChic On-Lap 2501M 15.6” LCD Monitor with built-in battery. It supports HDMI, MHL and VGA output.
http://www.newegg.com/Product/Product.aspx?Item=9SIA0V10H35673
Since my new apartment is much smaller then the old one, I have to get creative about how many monitors and how long they will be connected. This puppy is battery and/or usb powered with a VGA adapter MHL and HDMI adapter.
I'm using a DELL Bluetooth keyboard until everything is stable and I no longer need to access the console.
-
Just got the N54L in the other day. Thanks for the tips on the 6 drive upgrade. Will have to check it out.
I decided to go with all 3TB drives. 7200RPM parity, 7200RPM disk 1, 5400 RPM Disk 2,3.
Will be interesting to see the speed variances when comparing models.
]
ESXi 5.x - pre-built VMDK for unRAID
in Virtualizing Unraid
Posted
Why?