SavellM Posted April 11, 2021 Share Posted April 11, 2021 Hi all, I created a windows VM to do some Chia storage plotting. I added a manual vDisk as: /dev/disk/by-id/ata-INTEL_SSDSC2KB019T8_PHYF016402MC1P9DGN With SATA as the Bus. But when reading/writing to the disk its going at around 100MB/s. But SATA should allow around 500MB/s. The same drive on a dedicated PC gets full 500MB/s. Is there any way I can pass it through to the VM where I can read and write at almost full speed? Windows is showing it as QEMU Harddisk if that helps anyone. Or does it need specific drivers? Quote Link to comment
Vr2Io Posted April 11, 2021 Share Posted April 11, 2021 (edited) If your SATA controller ( in standalone IOMMU group ) and only connect that SSD, then you can passthrough it to VM. Otherwise no way. You need different storage controller to host Unraid's disk or passthrough disk. Edited April 11, 2021 by Vr2Io Quote Link to comment
SavellM Posted April 11, 2021 Author Share Posted April 11, 2021 But why is passthrough so much slower? Quote Link to comment
Vr2Io Posted April 11, 2021 Share Posted April 11, 2021 (edited) You are not in VFIO passthrough. I can't confirm vdisk performance, but it should over 100MB/s, this also depends on different conditions/factor. Edited April 11, 2021 by Vr2Io Quote Link to comment
SavellM Posted April 11, 2021 Author Share Posted April 11, 2021 Sorry I meant emulation not passthrough. Is there any other way to get faster perf? I cant split IOMMU group as its part of my backplane Quote Link to comment
Vr2Io Posted April 11, 2021 Share Posted April 11, 2021 (edited) 46 minutes ago, SavellM said: Is there any other way to get faster perf? No idea, I will do some test for compare. 46 minutes ago, SavellM said: I cant split IOMMU group as its part of my backplane SSD can place anywere, it use little space. Some PCIe SATA controller card also cheap. Edited April 11, 2021 by Vr2Io Quote Link to comment
SavellM Posted April 11, 2021 Author Share Posted April 11, 2021 Thank you for testing... Yup I'm aware of PCIe SATA, but its in a Supermicro 24 bay case with backplane. Dont really have space to fit another one inside or anything. But maybe a PCIe M.2 but dont really want to spend more money on it. Quote Link to comment
Vr2Io Posted April 11, 2021 Share Posted April 11, 2021 (edited) 10 minutes ago, SavellM said: Dont really have space to fit another one inside or anything. I freely place it under PSU, give it power and connect to onboard in a 3U case. No hotplug / swap. Edited April 11, 2021 by Vr2Io Quote Link to comment
SavellM Posted April 11, 2021 Author Share Posted April 11, 2021 I just ordered one of these: https://www.sonnettech.com/product/fusion-dual-ssd-raid/overview.html This should hopefully allow me to make it its own IOMMU group and I can either have 2 extra SSD's separate or maybe RAID 0 them and it seems to support full speed like 1GB/s. So that might be the way to go... Quote Link to comment
Vr2Io Posted April 11, 2021 Share Posted April 11, 2021 (edited) Seems not a cheap RAID card, hardware RAID usually not recommend, if it is AHCI type then Unraid may be work with it, if not, you need driver support. But even work, it just like a black box, no SMART monitor possible on the disks. If you have M2 slot, why don't simple go to NVMe ? Or why don't buy some cheap Asmedia 2 port SATA controller card, lowest price could be 10usd. Pls note, IOMMU standalone or not almost not relate the card itself, it relate on CPU and Motherboard always. Edited April 11, 2021 by Vr2Io Quote Link to comment
SavellM Posted April 11, 2021 Author Share Posted April 11, 2021 Ah thats a good point about the cpu/mobo. Is there any way to know before it arrives? I liked this one as no cables or anything, just strap it on. I found a few cheaper but they all seemed to cap out at 400MB/s even with 2 drives. Why not go NVMe, because I already have 2x2tb SSD's and need space and some speed. 2x2TB NVMe is going to be pretty expensive. But I am looking at some now with a m.2 PCI-e card too, so maybe I'll end up doing both in the future. Quote Link to comment
Vr2Io Posted April 11, 2021 Share Posted April 11, 2021 (edited) For speed and capacity need, I will use spinning disk in 4 disk RAID0 (BTRFS RAID), it have 400MB/s+, I even try 10 disks RAID0, it have 1.5GB/s performance. I use it as backup data purpose. The real problem was vDisk performance to VM drop too much. You need storage under VM ? Can't simple provide by Unraid ? Edited April 11, 2021 by Vr2Io Quote Link to comment
Vr2Io Posted April 11, 2021 Share Posted April 11, 2021 20 minutes ago, SavellM said: Ah thats a good point about the cpu/mobo. Is there any way to know before it arrives? You can plug some PCIe card to the slot, then check does it nativly in its own IOMMU group. Or try ACS override patch. Quote Link to comment
SavellM Posted April 11, 2021 Author Share Posted April 11, 2021 13 minutes ago, Vr2Io said: For speed and capacity need, I will use spinning disk in 4 disk RAID0 (BTRFS RAID), it have 400MB/s+, I even try 10 disks RAID0, it have 1.5GB/s performance. I use it as backup data purpose. The real problem was vDisk performance to VM drop too much. You need storage under VM ? Can't simple provide by Unraid ? I'm trying to plot Chia (crypto currency) It needs fast SSD/NVMe storage, and quite a bit to plot a lot in parallel. Currently passing through SSD via emulation is taking me like 24hours to do 1 plot, but same drive on my dedicated PC is taking like 7 hours to do a plot. So I'm trying to cut the plotting time down via my server as I can do a lot more in parallel. After it does the plotting, it then moves that file to my unRAID storage array. Quote Link to comment
Vr2Io Posted April 11, 2021 Share Posted April 11, 2021 2 minutes ago, SavellM said: plot Chia (crypto currency) Understand, seems need high performance random I/O storage and under VM. Quote Link to comment
SavellM Posted April 11, 2021 Author Share Posted April 11, 2021 Just now, Vr2Io said: Understand, seems need high performance random I/O storage and under VM. Yup bit of a pickle I have quite a few threads and a lot of ram on my server. But passing through SSD perf just doesnt seem to be there. Really hope that PCIe card will be in its own IOMMU group then it should be good. I think I should be ok, looking through my current IOMMU's seems like just about everything is in its own group.... I think Quote Link to comment
Vr2Io Posted April 12, 2021 Share Posted April 12, 2021 FYR, test on SATA vDisk got 130MB/s, performance not consistence with deep drop. Quote Link to comment
SavellM Posted April 12, 2021 Author Share Posted April 12, 2021 4 hours ago, Vr2Io said: FYR, test on SATA vDisk got 130MB/s, performance not consistence with deep drop. Yup thats what I'm seeing... Perf is not consistent at all... It might hit 130MB/s sometimes I've seen it scape 250MB/s very briefly and then drop. But latency to the drive is really bad. Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.