sota Posted November 25, 2020 Share Posted November 25, 2020 there's one problem with that: every time I hot swap a disk in, it restarts that module and spams the log again. Quote Link to comment
peppingc Posted November 25, 2020 Share Posted November 25, 2020 3 hours ago, sota said: there's one problem with that: every time I hot swap a disk in, it restarts that module and spams the log again. Won't be an issue for me as the drive bays on my Gen8 Microserver are non-hot swap. Can't recall exactly which model it is but it only has 4 bays and is running a Pentium G2020T CPU. Quote Link to comment
JerryRay59 Posted January 15, 2021 Share Posted January 15, 2021 I am attempting to passthrough a PNY Nvidia 1030G graphics card through my HP DL380p (G8) to a VM in Unraid. I feel like I have been trying for ever and read just about every thread out there. At this point I think I may have tinkered too much. so far this is what I have done. Please help. Error: internal error: qemu unexpectedly closed the monitor: 2021-01-15T17:59:22.466043Z qemu-system-x86_64: -device vfio-pci,host=0000:04:00.1,id=hostdev1,bus=pci.0,addr=0x6.0x1: vfio 0000:04:00.1: failed to setup container for group 33: Failed to set iommu for container: Operation not permitted Bios: SRV-IOV - enabled Embedded graphics primary, installed graphics secondary (this was causing my server to use the 1030 and losing all output) Unraid: OS: 6.9-rc1 syslinux config: Unraid OS: append vfio_iommu_type1.allow_unsafe_interrupts=1 pcie_acs_override=id:10de:1d01,10de:0fb8 initrd=/bzroot system devices: Bind audio and video to same iommu group PCIe ACS override - enabled (also seen above) Allow unsafe interrupts (also seen above) VM: VM XML add the multifunction='on' and set sound and gpu to be same slot (6) , different functions (0x01) VM XML I have tried changing my default slot of 5 to slot 6 tried with and without vbios <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x04' slot='0x00' function='0x0'/> </source> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0' multifunction='on'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x04' slot='0x00' function='0x1'/> </source> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x1'/> unraid.jerry-diagnostics-20210115-1228.zip Quote Link to comment
1812 Posted January 16, 2021 Author Share Posted January 16, 2021 8 hours ago, JerryRay59 said: I am attempting to passthrough a PNY Nvidia 1030G graphics card through my HP DL380p (G8) to a VM in Unraid. I feel like I have been trying for ever and read just about every thread out there. At this point I think I may have tinkered too much. so far this is what I have done. Please help. Error: internal error: qemu unexpectedly closed the monitor: 2021-01-15T17:59:22.466043Z qemu-system-x86_64: -device vfio-pci,host=0000:04:00.1,id=hostdev1,bus=pci.0,addr=0x6.0x1: vfio 0000:04:00.1: failed to setup container for group 33: Failed to set iommu for container: Operation not permitted Bios: SRV-IOV - enabled Embedded graphics primary, installed graphics secondary (this was causing my server to use the 1030 and losing all output) Unraid: OS: 6.9-rc1 syslinux config: Unraid OS: append vfio_iommu_type1.allow_unsafe_interrupts=1 pcie_acs_override=id:10de:1d01,10de:0fb8 initrd=/bzroot system devices: Bind audio and video to same iommu group PCIe ACS override - enabled (also seen above) Allow unsafe interrupts (also seen above) VM: VM XML add the multifunction='on' and set sound and gpu to be same slot (6) , different functions (0x01) VM XML I have tried changing my default slot of 5 to slot 6 tried with and without vbios <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x04' slot='0x00' function='0x0'/> </source> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0' multifunction='on'/> </hostdev> <hostdev mode='subsystem' type='pci' managed='yes'> <driver name='vfio'/> <source> <address domain='0x0000' bus='0x04' slot='0x00' function='0x1'/> </source> <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x1'/> unraid.jerry-diagnostics-20210115-1228.zip 143.66 kB · 1 download You did not follow the steps in the first post for "VM problems - pass-through" your logs show 0000:04:00.1: DMAR: Device is ineligible for IOMMU domain attach due to platform RMRR requirement. Contact your platform vendor. 0000:04:00.1: DMAR: Device is ineligible for IOMMU domain attach due to platform RMRR requirement. Contact your platform vendor. your fix is: Quote Link to comment
xqplc Posted January 16, 2021 Share Posted January 16, 2021 Hello I have a hp dl380 g6 and in trying to setup unpaid and I'm having some issues I've been trying to get unraid to detect my SATA SSD I've put in but it doesn't detect it at all I've made a raid 0 array on it's own but no luck Can you help me? Quote Link to comment
trurl Posted January 16, 2021 Share Posted January 16, 2021 5 minutes ago, xqplc said: made a raid 0 array Do not use any controller RAID mode for any of your disks Quote Link to comment
xqplc Posted January 16, 2021 Share Posted January 16, 2021 I'm using a p420i as my raid controller with my SATA SSD in raid 0. Quote Link to comment
Myleslewis Posted January 16, 2021 Share Posted January 16, 2021 1 hour ago, trurl said: Do not use any controller RAID mode for any of your disks I think it says in one of the first posts that due to the hp controllers not having a JBOD mode the only way around this without using an add on card (lsi/hp h210/220) you have to create individual raid 0 volumes which are then presented to unraid, which can make data recovery difficult but is there another way ? Thanks, Myles Quote Link to comment
1812 Posted January 17, 2021 Author Share Posted January 17, 2021 5 hours ago, Myleslewis said: I think it says in one of the first posts that due to the hp controllers not having a JBOD mode the only way around this without using an add on card (lsi/hp h210/220) you have to create individual raid 0 volumes which are then presented to unraid, which can make data recovery difficult but is there another way ? Thanks, Myles Correct. Currently there is no other way. But, there is something in development by other forum members to use/froce the controller in JBOD mode even though it's not available in the bios. If that becomes viable then I'll definitely share here. Quote Link to comment
xqplc Posted January 17, 2021 Share Posted January 17, 2021 When I put the disk in raid 0 unraid still doesnt reconise it. Quote Link to comment
Myleslewis Posted January 17, 2021 Share Posted January 17, 2021 I don’t know if it’s a problem with the ssd not having hp firmware on it perhaps ? Has anyone else had much luck using non HP drives in dl380 g6/g7 etc ? The fact that the controller is seeing the drive kind of makes me think it’s an issue with unraid, I’ve not got any other drives and no ssd’s I can try it with Thanks, Myles Quote Link to comment
1812 Posted January 17, 2021 Author Share Posted January 17, 2021 27 minutes ago, Myleslewis said: I don’t know if it’s a problem with the ssd not having hp firmware on it perhaps ? Has anyone else had much luck using non HP drives in dl380 g6/g7 etc ? I use a slew of Samsung evo ssd's in my ml350p gen 8 without issue. But his is using an HBA. After my initial issues with the onboard raid controller, I avoid it like the plague. But there are some others running disks in Raid 0 using the controller without issues. 43 minutes ago, xqplc said: When I put the disk in raid 0 unraid still doesnt reconise it. I don't have a fix for you aside from getting a HBA or waiting to see if the patch works out. Do you have other disks you can try to see if it's the disk itself or something else? Quote Link to comment
Myleslewis Posted January 17, 2021 Share Posted January 17, 2021 6 minutes ago, 1812 said: I use a slew of Samsung evo ssd's in my ml350p gen 8 without issue. But his is using an HBA. After my initial issues with the onboard raid controller, I avoid it like the plague. But there are some others running disks in Raid 0 using the controller without issues. I don't have a fix for you aside from getting a HBA or waiting to see if the patch works out. Do you have other disks you can try to see if it's the disk itself or something else? I currently use the onboard controller in my dl380 G7, but the plan is to move to a hba, I actually bought another g7 off social media with the aim of taking the drive cage out and expanding my drives to 16, so been waiting to do it all together. What HBA do you use ? Can you make a recommendation for the G7? Thanks, Myles Quote Link to comment
1812 Posted January 17, 2021 Author Share Posted January 17, 2021 1 hour ago, Myleslewis said: I currently use the onboard controller in my dl380 G7, but the plan is to move to a hba, I actually bought another g7 off social media with the aim of taking the drive cage out and expanding my drives to 16, so been waiting to do it all together. What HBA do you use ? Can you make a recommendation for the G7? Thanks, Myles I use an H220. I've actually used them in several HP servers from G6 to this one for years without issue and they are pretty cheap. I bought an h240 once but it didn't send drive temps through at the time,. So now it sits in a box until that's better supported or I figure out what needs to be configured. But there is no real need for a card like that which does 12gbps in most unRaid servers, mine included. Even on 10gbe networking, my transfers to an SSD cache pool are limited by network speed. Quote Link to comment
Myleslewis Posted January 17, 2021 Share Posted January 17, 2021 Will have a look for a couple h220, thanks Myles Quote Link to comment
xqplc Posted January 17, 2021 Share Posted January 17, 2021 So I've been doing some googling and apparently you need to disable "HBA mode" or something like that you have to boot into Linux and run some commands. I've never had any experience with Linux. Quote Link to comment
xqplc Posted January 17, 2021 Share Posted January 17, 2021 (edited) So I managed to get unraid to find the drive (by putting it in raid 0) but now it just loads as show here edit: It loaded but disapeared right after, i know the drive is working as i just ran an os on it. Edited January 17, 2021 by xqplc Quote Link to comment
estrim Posted January 18, 2021 Share Posted January 18, 2021 On 1/17/2021 at 2:16 AM, 1812 said: Correct. Currently there is no other way. But, there is something in development by other forum members to use/froce the controller in JBOD mode even though it's not available in the bios. If that becomes viable then I'll definitely share here. FWIW - This worked for me with the onboard on a DL380 G8 to get it in HBA mode. The drive temperatures would just disappear after a few days though - so moved to a H220 since Quote Link to comment
Myleslewis Posted January 18, 2021 Share Posted January 18, 2021 I’d also be interested in knowing SMART data on my drives if possible, still leaning towards a h220 but with the above work around did you get this data ? Thanks, Myles Quote Link to comment
estrim Posted January 18, 2021 Share Posted January 18, 2021 39 minutes ago, Myleslewis said: I’d also be interested in knowing SMART data on my drives if possible, still leaning towards a h220 but with the above work around did you get this data ? I seem to recall that SMART data was fine. Quote Link to comment
xqplc Posted January 18, 2021 Share Posted January 18, 2021 So after many hours of me trying to get unraid to detect my drive i've decided to buy a new raid card, which one should I get. ive been told that the H220 works fine with unraid. Quote Link to comment
Myleslewis Posted January 21, 2021 Share Posted January 21, 2021 (edited) Recently I had a 600gb HP SAS drive fail on me, so I have bought a few replacements (found 3 for £30 on ebay, supposedly in good working condition), I shut down the server, replaced the drives and booted it back up. The p410i detected the replaced drive so I didn't have to re-create the raid0 volume, and went on to boot into unraid. I stopped the array, selected the newly installed drive and then clicked start array... unraid crashed and the drive, which was previously fine and gave no smart warnings, then had it's fault light solid, suggesting it had failed and also when I rebooted the server I was given a SMART warning saying that imminent failure was detected...? Am I missing something with how I can replace the failed drive ? Thanks, Myles Edited January 21, 2021 by Myleslewis Quote Link to comment
1812 Posted January 21, 2021 Author Share Posted January 21, 2021 1 hour ago, Myleslewis said: Recently I had a 600gb HP SAS drive fail on me, so I have bought a few replacements (found 3 for £30 on ebay, supposedly in good working condition), I shut down the server, replaced the drives and booted it back up. The p410i detected the replaced drive so I didn't have to re-create the raid0 volume, and went on to boot into unraid. I stopped the array, selected the newly installed drive and then clicked start array... unraid crashed and the drive, which was previously fine and gave no smart warnings, then had it's fault light solid, suggesting it had failed and also when I rebooted the server I was given a SMART warning saying that imminent failure was detected...? Am I missing something with how I can replace the failed drive ? Thanks, Myles You could try another disk to see if you just got a bad one. I have no guidance because I don't use the raid controller with disks in raid 0 because weird things like this can happen. Quote Link to comment
Myleslewis Posted January 21, 2021 Share Posted January 21, 2021 Have tried another disk and this one seems to be okay. Drive is currently being rebuilt at 93~MB/sec, I did manage to get the previous drive to start rebuilding but it was writing at 300~KB/sec so it very well could of been a bad drive. I'm definitely going to look to buy a HBA at the end of the month. Thankfully I've currently only got 474gb total in the array so I can move that all to a portable hard drive I have to switch all the drives over to a HBA. Thanks, Myles Quote Link to comment
Myleslewis Posted February 19, 2021 Share Posted February 19, 2021 Hi all, Purchased and installed a h220, was wandering if the drive lights should be on For drives attached to the card? Not a problem at all if they aren’t, was just curious more than anything Thanks, Myles Quote Link to comment
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.