bluepr0

Members
  • Posts

    214
  • Joined

  • Last visited

Posts posted by bluepr0

  1. It's done! I've bought all the components... now wait for arrival :)

     

    Hardware

    - Motherboard: Supermicro X10SRL-F

    - CPU: Intel Xeon E5 2698 V4 20 cores

    - RAM: 2x16GB DDR4-2400 ECC REG

    - PSU: Seasonic Platinium 660 (single rail)

    - Heatsink: Noctua NH-U12DC i4

    - Disks: 2x4TB WD RED NAS, 1x3TB WD, 1x2TB WD, 1x500GB WD

    - Disk cache: 1x250GB SSD Samsung Evo 850

    - Quad LAN IBM PRO/1000 PT Quad Port Gigabit Server Adapter PCI-E

     

    Software I will be running

    - unRAID 6.1.9

    - Dockers: Plex, Home Assistant, MQTT, iVideon, Influxdb, Grafana, jDownloader, Torrent, duckdns, cadviser

    - Plugins: IPMI tools, preclear, unbalance

    - VMs: pfSense 2.3, Win 10, Win 8.1, El Capitan (I will try to use it for work)

     

  2. Have any of you be able to check if VT-d is enabled on the Xeon ES?

    You can check this yourself with the S-spec number (5 digits) that is usually in the eBay listing. Go to cpu-world.com and search for the CPU and you will have a list of the different S-spec numbers. Clicking them will show you if it has vt-d or not.

     

    umm it seems there isn't that number in the offer :(http://www.ebay.es/itm/351725990417?_trksid=p2055119.m1438.l2649&ssPageName=STRK%3AMEBIDX%3AIT

  3. I've pulled the trigger... AGAIN :P

     

    Hardware

    - Motherboard: Supermicro X10SRL-F

    - CPU: Intel Xeon E5 2698 V4 20 cores

    - RAM: 2x16GB DDR4-2400 ECC REG

    - PSU: Seasonic Platinium 660 (single rail)

    - Heatsink: Noctua NH-U12DC i4

    - Disks: 2x4TB WD RED NAS, 1x3TB WD, 1x2TB WD, 1x500GB WD

    - Disk cache: 1x250GB SSD Samsung Evo 850

     

    Software I will be running

    - unRAID 6.1.9

    - Dockers: Plex, Home Assistant, MQTT, iVideon, Influxdb, Grafana, jDownloader, Torrent, duckdns, cadviser

    - Plugins: IPMI tools, preclear, unbalance

    - VMs: pfSense 2.3, Win 10, Win 8.1

  4. Well, after researching the entire evening I think I could go with this, but PLEASE let me know what do you think:

     

    • MB: Supermicro X10SRL-F
    • CPU: Xeon E5-2684 V4 120w TDP, a bit more than my previous option E3-1230 but I guess they should idle more or less the same (?). This is a ES one, so it's cheap... I'm just waiting for seller to reply about VT-x and VT-d support

     

    With this MB I don't get M2 PCie 3.0 4x BUT I get a lot of PCIe slots so works for me as well.

  5. Yeah absolutely, it can't be accurate if your disk is SATA3 capable of around 500mb/ on bare-metal and you are getting more than 1000mb/s on the test!

     

    My wish was to get near bare-metal performance on the disk side (I know I can get it from GPU) so I could take seriously this VM-for-work idea I had in mind, rather than building an entire hackintosh!

  6. argh! I wish we could get almost bare-metal performance. That would be absolutely amazing!. I've been reading through the forum and I think I found someone who claims to get it... but I'm a bit lost as the benchmarks in VMs are not offering realistic results

  7. Oookay, I have got some bad and good news!

     

    Bad is that order was taking so long to arrive (because the super micro mb) that I cancelled it

     

    Good news is that I have been searching through eBay and I found ES of the recently released E5 v4 processor extremely cheap. I have asked to see if this ES still supports vt-d and vt-x but I might get one of those

     

    I have also found an Asus (I think it's workstation grade) that supports IPMI and includes usually the features/capabilities of a gaming MB (Asus X99-WS/IPMI - supposedly with a BIOS update it should get Xeon E5 v4 support)

     

    What do you guys think about it?

  8. Yeah i love my unraid setup. My mac vm is the fastest mac i have. My 2013 macbook pro gets a geekbench score of around 11000 whilst my vm gets 26800, so thats very close to the macpro 2013 with xeon 2697 v2 but at a fraction of the cost!!

    That's AWESOME! and how's the SSD speed? I'm interested on using PCIe NVME SSDs and was wondering how's the performance?

     

    Thanks!

  9. As an additional, i modified by xml so the nvme image user the following

    <driver name='qemu' type='raw' cache='none' io='threads'/>

     

    it did make things faster. I have attached a crystal disk mark run on my nvme within 2 vm's booted and running.

    The read speeds aren't as high as possible but are pretty quick.

     

    I also added this to the bottom of my go file

    mkdir /mnt/nvme0
    mount /dev/nvme0n1p1 /mnt/nvme0

     

    I have my VM's set to autostart and the go file mounts the nvme on boot for me

     

    Regards,

    Jamie

    I will definitely try this when I get home  :D

    I just picked up an Intel 750 400gb to play with.

     

    I posted something about tweaks I tried to improove perfomance in THIS thread.

     

    In short: I use "cache=unsafe" and "x-data-plane=on".

     

    <domain type='kvm' xmlns:qemu='http://libvirt.org/schemas/domain/qemu/1.0'>
    ...
    ...
    <devices>
        <disk type='file' device='disk'>
          <driver name='qemu' type='raw' cache='unsafe' io='threads'/>
          <source file='/mnt/nvme/Rechner/Rechner_vDisk1.img'/>
          <backingStore/>
          <target dev='hda' bus='virtio'/>
          <boot order='1'/>
          <alias name='virtio-disk0'/>
          <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
        </disk>
      ...
      ...
      </devices>
      <qemu:commandline>
        <qemu:arg value='-set'/>
        <qemu:arg value='device.virtio-disk0.scsi=off'/>
        <qemu:arg value='-set'/>
        <qemu:arg value='device.virtio-disk0.config-wce=off'/>
        <qemu:arg value='-set'/>
        <qemu:arg value='device.virtio-disk0.x-data-plane=on'/>
      </qemu:commandline>
    </domain>

     

    pardon my ignorance.... but from the benchmark image you posted what's the write and read speed I should consider? higher ones seems too high for the supported speed of the device itself (I think it was around 2.5 and 1.2) but lower ones are too slow... I'm confused!

     

    Adding your image for reference:

    NzilOFXK+

  10. Hello guys,

     

    I was thinking about buying a lighting fast SSD for my hopefully-soon-to-arrive Supermicro MB. Specs says it has a M2 PCIe 3.0 x2. I'v been searching through Google and I couldn't find exactly what's the speed for a PCIe 3.0 with 2 lanes, but I found this article where they mention that a PCIe 3.0 x4 has a max speed of 3.9 GB/s. Am I right to think that then a PCIe 3.0 x2 has a max speed of 1.95 GB/s?

     

    I was looking at the Samsung 950 Pro M2 which says it has a speed of 1.5 GB/s write and 2.5 GB/s read speed. Considering the speed of my M2 slot am I right to think that then I could get a full write speed of 1.5 GB/s and 1.9 GB/s read speed from this SSD?.

     

    Or maybe I should take a look to a cheaper SSD that has less read speed?

  11. Not sure how to answer your question more broadly, but happy to provide some data. I ran CrystalDiskMark within a Windows 10 VM running on my E3 Xeon TS140. The hard drive is a Samsung SSD 850 EVO 120GB.

    -----------------------------------------------------------------------
    CrystalDiskMark 5.1.2 x64 (C) 2007-2016 hiyohiyo
                               Crystal Dew World : http://crystalmark.info/
    -----------------------------------------------------------------------
    * MB/s = 1,000,000 bytes/s [sATA/600 = 600,000,000 bytes/s]
    * KB = 1000 bytes, KiB = 1024 bytes
    
       Sequential Read (Q= 32,T= 1) :  5653.807 MB/s
      Sequential Write (Q= 32,T= 1) :   144.931 MB/s
      Random Read 4KiB (Q= 32,T= 1) :   599.689 MB/s [146408.4 IOPS]
    Random Write 4KiB (Q= 32,T= 1) :   247.703 MB/s [ 60474.4 IOPS]
             Sequential Read (T= 1) :  3098.443 MB/s
            Sequential Write (T= 1) :   149.109 MB/s
       Random Read 4KiB (Q= 1,T= 1) :    70.047 MB/s [ 17101.3 IOPS]
      Random Write 4KiB (Q= 1,T= 1) :    65.852 MB/s [ 16077.1 IOPS]
    
      Test : 1024 MiB [F: 0.1% (0.1/79.9 GiB)] (x5)  [interval=5 sec]
      Date : 2016/05/07 19:58:31
        OS : Windows 10 Professional [10.0 Build 10586] (x64)
    

     

    Thanks a lot! so the speed is 144MB/s for write and 149MB/s for read? That's actually less than half of it's bare-metal performance :(

  12. Hello guys,

     

    I'm about to become a new unRAID-er very soon (just waiting for components to arrive). I have been searching A LOT through the forum regarding SSD performance on Virtual Machines. General feeling seems that "it's fine" but:

     

    - I would love to know real overhead. Let's say I have a SSD capable on bare-metal of doing 520mb/s read and 520mb/s write. What would be the speed in the VM? I tried to benchmark my current VMs on VMWare OSX using CrystalDiskMark but I'm getting unrealistic results. Is there a way to benchmark a VM?

     

    - Is the passthrough the best option to get bare-metal performance? If yes, as for what I've been reading it seems I cannot pass only one SATA port but the entire "set" of ports, Am I right?

     

    Thanks a lot!

  13. thanks John_M! I had no idea BTRFS was that smart setting up the disks.

     

    I'm clear that if I have 250gb+250gb+500gb, that will be effectively a 2x250 RAID0 + 500GB for redundancy. However, the RAID0 will outperform the 500gb disk alone... would this affect the performance of the RAID0*?

     

    Also, how is supposed to work when I have 3x250 drives? Would I get the performance of a RAID0?

     

    *sorry for saying "RAID0", I'm not entirely sure if the BTRFS system creates a RAID0 or something else that is called differently.

  14. Hello guys!

     

    I'm new to unRAID (actually, I haven't received yet the components to put together my new rig).

     

    In any case, I'm a Mac user, I do graphic design and I currently use an iMac i7 from late 2013. It's funny because what got me into the Mac world was actually building my first hackintosh back in 2008 when the InsanelyMac forums were the reference (I heard now its tonyx86).

     

    What got my attention from unRAID is the ability to get into one PC your NAS/Dockers/etc but also a perfectly-capable VM with all this passthrough technology. However we all know that keep running a hackintosh could be risky when new updates and stuff goes out, so I think making a virtual machine of OS X is a much better option for reliability as you can just back it up and have that copy safe in case something goes wrong after an update.

     

    So, my question is... can you create with unRAID an El Capitan VM that is as performing and stable as a normal Mac as you can actually do with Windows VM? (of course buying adequate hardware). I'm not thinking on doing this now, but it could be an option when the time to upgrade my iMac comes

     

    Thank you!

  15. Hello!

     

    I'm planning on moving my pfSense box (currently a Mac mini) to a VM with unRaid (parts should arrive this week). How is working for your guys?

     

    Thanks!

     

    perfect. uptime is currently 7 weeks.

     

    Glad to hear that! are you using the virtio drivers or just doing passthrough of the NICs?

     

    Also, if you need to restart the unRAID server or do some maintenance, is there problems to get the pfsense VM running back again?