[Solved] unable to passthrough primary gpu (gtx 970) w/ rom bios on high sierra


Recommended Posts

so as the title suggests, after numerous attempts in the past few days, i am unable to run high sierra on my primary gpu (gtx 970) using both dumped bios and edited bios methods. my setup is running two vms, high sierra w/ primary gpu, and windows 10 with secondary gpu.

 

setup on unraid 6.7.2

amd ryzen 7 2700x

asus prime x470-pro (4207)

2x nvidia gtx 970

 

  • when starting vm w/ primary gpu bios, apple boot hangs around 25% and screen is split of unraid cmd on the upper half and black dots, yet vm still working with remote client without recognized graphics
  • vm runs normal with secondary gpu (gtx 970) passedthrough
  • was able to get primary gpu passed only once on windows alongside secondary gpu, and it was immediately after using dumbed bios from secondary gpu. not anymore
  • trying to passthrough primary gpu on both vms don't work
  • primary gpu works fine on unraid gui mode and bare metal

 

this is obviously a gpu bios issue, if i am correct. any idea how i could go about this?

cheers

Edited by iilied
Link to comment

You need more details than "don't work" e.g. log, xml etc.

 

Also which nvidia gtx 970 - brand, model?

Need to reiterate - one CANNOT cross-use vbios and assumes it will work because likely it won't.

In fact, even with the exact same brand and model, vbios from 1 specimen may not even work with another.

 

Lastly, you need to test your passthrough with Windows. Until you are 100% sure that your primary GPU passthrough works with Windows, there's zero point trying it with a Mac VM.

There are more people familiar with Windows than Mac so it's easier for people to help you.

Link to comment
3 hours ago, testdasi said:

You need more details than "don't work" e.g. log, xml etc.

apologies for lesser detailing… more below

 

high sierra xml (primary gpu):

<?xml version='1.0' encoding='UTF-8'?>
<domain type='kvm' xmlns:qemu='http://libvirt.org/schemas/domain/qemu/1.0'>
  <name>High Sierra</name>
  <uuid>c96e980e-2307-df89-7282-d11187d08a97</uuid>
  <metadata>
    <vmtemplate xmlns="unraid" name="High Sierra" icon="/mnt/user/domains/High Sierra/icon.png" os="linux"/>
  </metadata>
  <memory unit='KiB'>4194304</memory>
  <currentMemory unit='KiB'>4194304</currentMemory>
  <memoryBacking>
    <nosharepages/>
  </memoryBacking>
  <vcpu placement='static'>8</vcpu>
  <cputune>
    <vcpupin vcpu='0' cpuset='0'/>
    <vcpupin vcpu='1' cpuset='1'/>
    <vcpupin vcpu='2' cpuset='2'/>
    <vcpupin vcpu='3' cpuset='3'/>
    <vcpupin vcpu='4' cpuset='4'/>
    <vcpupin vcpu='5' cpuset='5'/>
    <vcpupin vcpu='6' cpuset='6'/>
    <vcpupin vcpu='7' cpuset='7'/>
  </cputune>
  <os>
    <type arch='x86_64' machine='pc-q35-3.1'>hvm</type>
    <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader>
    <nvram>/etc/libvirt/qemu/nvram/c96e980e-2307-df89-7282-d11187d08a97_VARS-pure-efi.fd</nvram>
  </os>
  <features>
    <acpi/>
    <apic/>
  </features>
  <cpu mode='host-passthrough' check='none'>
    <topology sockets='1' cores='8' threads='1'/>
  </cpu>
  <clock offset='utc'>
    <timer name='rtc' tickpolicy='catchup'/>
    <timer name='pit' tickpolicy='delay'/>
    <timer name='hpet' present='no'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <devices>
    <emulator>/usr/local/sbin/qemu</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='writeback'/>
      <source file='/mnt/user/domains/High Sierra/vdisk3.img'/>
      <target dev='hdc' bus='sata'/>
      <boot order='1'/>
      <address type='drive' controller='0' bus='0' target='0' unit='2'/>
    </disk>
    <controller type='pci' index='0' model='pcie-root'/>
    <controller type='pci' index='1' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='1' port='0x8'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0' multifunction='on'/>
    </controller>
    <controller type='pci' index='2' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='2' port='0x9'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
    </controller>
    <controller type='pci' index='3' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='3' port='0xa'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>
    </controller>
    <controller type='pci' index='4' model='pcie-root-port'>
      <model name='pcie-root-port'/>
      <target chassis='4' port='0x13'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x3'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <address type='pci' domain='0x0000' bus='0x02' slot='0x00' function='0x0'/>
    </controller>
    <controller type='sata' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x1f' function='0x2'/>
    </controller>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci2'>
      <master startport='2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci3'>
      <master startport='4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/>
    </controller>
    <interface type='bridge'>
      <mac address='52:54:00:66:1a:e8'/>
      <source bridge='br0'/>
      <model type='e1000-82545em'/>
      <address type='pci' domain='0x0000' bus='0x01' slot='0x00' function='0x0'/>
    </interface>
    <serial type='pty'>
      <target type='isa-serial' port='0'>
        <model name='isa-serial'/>
      </target>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
    </console>
    <channel type='unix'>
      <target type='virtio' name='org.qemu.guest_agent.0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='tablet' bus='usb'>
      <address type='usb' bus='0' port='1'/>
    </input>
    <input type='mouse' bus='ps2'/>
    <input type='keyboard' bus='ps2'/>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x08' slot='0x00' function='0x0'/>
      </source>
      <rom file='/mnt/user/isos/nvidiagtx970.rom'/>
      <address type='pci' domain='0x0000' bus='0x03' slot='0x00' function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x08' slot='0x00' function='0x1'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='usb' managed='no'>
      <source>
        <vendor id='0x22d4'/>
        <product id='0x130c'/>
      </source>
      <address type='usb' bus='0' port='2'/>
    </hostdev>
    <hostdev mode='subsystem' type='usb' managed='no'>
      <source>
        <vendor id='0x2516'/>
        <product id='0x0004'/>
      </source>
      <address type='usb' bus='0' port='3'/>
    </hostdev>
    <memballoon model='none'/>
  </devices>
  <qemu:commandline>
    <qemu:arg value='-usb'/>
    <qemu:arg value='-device'/>
    <qemu:arg value='usb-mouse,bus=usb-bus.0'/>
    <qemu:arg value='-device'/>
    <qemu:arg value='usb-kbd,bus=usb-bus.0'/>
    <qemu:arg value='-device'/>
    <qemu:arg value='isa-applesmc,osk=REDACTED'/>
    <qemu:arg value='-smbios'/>
    <qemu:arg value='type=2'/>
    <qemu:arg value='-cpu'/>
    <qemu:arg value='Penryn,vendor=GenuineIntel,kvm=on,+invtsc,+avx,+avx2,+aes,+xsave,+xsaveopt,vmware-cpuid-freq=on,'/>
  </qemu:commandline>
</domain>

 

windows 10 xml (secondary gpu) runs fine:

<?xml version='1.0' encoding='UTF-8'?>
<domain type='kvm'>
  <name>Windows 10</name>
  <uuid>f71a256e-dee1-0f7d-6a81-c0dc130ac0bc</uuid>
  <description>high performance game machine</description>
  <metadata>
    <vmtemplate xmlns="unraid" name="Windows 10" icon="windows.png" os="windows10"/>
  </metadata>
  <memory unit='KiB'>14680064</memory>
  <currentMemory unit='KiB'>14680064</currentMemory>
  <memoryBacking>
    <nosharepages/>
  </memoryBacking>
  <vcpu placement='static'>14</vcpu>
  <cputune>
    <vcpupin vcpu='0' cpuset='2'/>
    <vcpupin vcpu='1' cpuset='3'/>
    <vcpupin vcpu='2' cpuset='4'/>
    <vcpupin vcpu='3' cpuset='5'/>
    <vcpupin vcpu='4' cpuset='6'/>
    <vcpupin vcpu='5' cpuset='7'/>
    <vcpupin vcpu='6' cpuset='8'/>
    <vcpupin vcpu='7' cpuset='9'/>
    <vcpupin vcpu='8' cpuset='10'/>
    <vcpupin vcpu='9' cpuset='11'/>
    <vcpupin vcpu='10' cpuset='12'/>
    <vcpupin vcpu='11' cpuset='13'/>
    <vcpupin vcpu='12' cpuset='14'/>
    <vcpupin vcpu='13' cpuset='15'/>
  </cputune>
  <resource>
    <partition>/machine</partition>
  </resource>
  <os>
    <type arch='x86_64' machine='pc-i440fx-3.1'>hvm</type>
    <loader readonly='yes' type='pflash'>/usr/share/qemu/ovmf-x64/OVMF_CODE-pure-efi.fd</loader>
    <nvram>/etc/libvirt/qemu/nvram/f71a256e-dee1-0f7d-6a81-c0dc130ac0bc_VARS-pure-efi.fd</nvram>
  </os>
  <features>
    <acpi/>
    <apic/>
    <hyperv>
      <relaxed state='on'/>
      <vapic state='on'/>
      <spinlocks state='on' retries='8191'/>
      <vendor_id state='on' value='none'/>
    </hyperv>
  </features>
  <cpu mode='host-passthrough' check='none'>
    <topology sockets='1' cores='14' threads='1'/>
  </cpu>
  <clock offset='localtime'>
    <timer name='hypervclock' present='yes'/>
    <timer name='hpet' present='no'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>restart</on_crash>
  <devices>
    <emulator>/usr/local/sbin/qemu</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='raw' cache='writeback'/>
      <source file='/mnt/user/domains/Windows 10/vdisk1.img'/>
      <target dev='hdc' bus='virtio'/>
      <boot order='1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <source file='/mnt/user/isos/Win10_1903_V1_EnglishInternational_x64.iso'/>
      <target dev='hda' bus='ide'/>
      <readonly/>
      <boot order='2'/>
      <address type='drive' controller='0' bus='0' target='0' unit='0'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw'/>
      <source file='/mnt/user/isos/virtio-win-0.1.160-1.iso'/>
      <target dev='hdb' bus='ide'/>
      <readonly/>
      <address type='drive' controller='0' bus='0' target='0' unit='1'/>
    </disk>
    <controller type='pci' index='0' model='pci-root'/>
    <controller type='ide' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
    </controller>
    <controller type='virtio-serial' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
    </controller>
    <controller type='usb' index='0' model='ich9-ehci1'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x7'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci1'>
      <master startport='0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0' multifunction='on'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci2'>
      <master startport='2'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x1'/>
    </controller>
    <controller type='usb' index='0' model='ich9-uhci3'>
      <master startport='4'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x2'/>
    </controller>
    <interface type='bridge'>
      <mac address='52:54:00:7f:b5:65'/>
      <source bridge='br0'/>
      <model type='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
    </interface>
    <serial type='pty'>
      <target type='isa-serial' port='0'>
        <model name='isa-serial'/>
      </target>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
    </console>
    <channel type='unix'>
      <target type='virtio' name='org.qemu.guest_agent.0'/>
      <address type='virtio-serial' controller='0' bus='0' port='1'/>
    </channel>
    <input type='tablet' bus='usb'>
      <address type='usb' bus='0' port='1'/>
    </input>
    <input type='mouse' bus='ps2'/>
    <input type='keyboard' bus='ps2'/>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x09' slot='0x00' function='0x0'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x09' slot='0x00' function='0x1'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x0b' slot='0x00' function='0x3'/>
      </source>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>
    </hostdev>
    <hostdev mode='subsystem' type='usb' managed='no'>
      <source>
        <vendor id='0x22d4'/>
        <product id='0x130c'/>
      </source>
      <address type='usb' bus='0' port='2'/>
    </hostdev>
    <hostdev mode='subsystem' type='usb' managed='no'>
      <source>
        <vendor id='0x2516'/>
        <product id='0x0004'/>
      </source>
      <address type='usb' bus='0' port='3'/>
    </hostdev>
    <hostdev mode='subsystem' type='usb' managed='no'>
      <source>
        <vendor id='0x2516'/>
        <product id='0x0051'/>
      </source>
      <address type='usb' bus='0' port='4'/>
    </hostdev>
    <memballoon model='none'/>
  </devices>
  <seclabel type='dynamic' model='dac' relabel='yes'/>
</domain>

 

3 hours ago, testdasi said:

Also which nvidia gtx 970 - brand, model?

as stated in previous post, both are nvidia's own gtx 970 same one i am linking. 

 

3 hours ago, testdasi said:

Need to reiterate - one CANNOT cross-use vbios and assumes it will work because likely it won't.

In fact, even with the exact same brand and model, vbios from 1 specimen may not even work with another.

so you are suggesting to put now-primary gpu into secondary pci-e and dump vbios, then place it back on primary pci-e and try it, instead of dumbing vbios of the now-secondary gpu, which is the same specimen, and using it?

 

3 hours ago, testdasi said:

Lastly, you need to test your passthrough with Windows. Until you are 100% sure that your primary GPU passthrough works with Windows, there's zero point trying it with a Mac VM.

There are more people familiar with Windows than Mac so it's easier for people to help you.

as mentioned, i was unable to passthrough primray gpu even with windows. got it to work only once, in the first time after dumbing vbios from secondary and running it on windows vm, but overnight and on next day trying it on mac vm it stopped working even when put back to windows.

 

please let me know if you require more information.

and thanks for the help

Edited by trurl
redact osk
Link to comment
5 minutes ago, iilied said:

so you are suggesting to put now-primary gpu into secondary pci-e and dump vbios, then place it back on primary pci-e and try it, instead of dumbing vbios of the now-secondary gpu, which is the same specimen, and using it?

Yes indeed i.e. dump a vbios for each card.

I have had 2 GPU of the same brand and model not liking each other's vbios. Could be firmware, revision etc.

 

5 minutes ago, iilied said:

as mentioned, i was unable to passthrough primray gpu even with windows. got it to work only once, in the first time after dumbing vbios from secondary and running it on windows vm, but overnight and on next day trying it on mac vm it stopped working even when put back to windows. 

You didn't reboot overnight right? Sounds like reset issue, not uncommon with primary GPU passthrough.

 

Let's try to keep it simple first.

Can you use the secondary GPU for Mac and primary GPU for Windows?

Passing through primary GPU is always more difficult so it's preferable to use secondary for more complicated arrangements (e.g. switching between VM, Mac, etc.)

Link to comment
16 minutes ago, testdasi said:

Yes indeed i.e. dump a vbios for each card.

I have had 2 GPU of the same brand and model not liking each other's vbios. Could be firmware, revision etc.

okay, i will give this a try as last resort before opening up the setup

 

16 minutes ago, testdasi said:

You didn't reboot overnight right? Sounds like reset issue, not uncommon with primary GPU passthrough.

actually unraid was shutdown entirely

 

16 minutes ago, testdasi said:

Can you use the secondary GPU for Mac and primary GPU for Windows?

secondary gpu works fine both ways, on mac and windows, except not getting sound on mac which is an entirely different/unrelated topic. but the main reason for this build is the need for both vms to run simultaneously. primary gpu for a mac workstation, secondary gpu for gaming windows.

 

but getting the primary gpu to work seems to be troublesome on either vms. attached is the vm log when used on windows

Screen Shot 2019-08-15 at 2.53.26 PM.png

Edited by iilied
what to was (spelling)
Link to comment

Tools -> Diagnostics -> Download -> attach zip file here.

 

In the meantime are you booting Unraid in UEFI mode? If so switch to legacy mode and try again.

Booting in UEFI is known to holding on to the GPU too tightly.

 

Failing that, while still booting in legacy mode, stub your GPU (in syslinux boot options add this after append)

vfio-pci.ids=[your 970 ID in the form of xxxx:xxxx]

and reboot (in legacy mode!)

 

Try these simple solutions first.

 

 

Also, in case I wasn't clear: you should be booting your Mac VM using your secondary GPU and Windows VM using primary. Not sure why you seem to be insisting on booting Mac VM on primary GPU.

Edited by testdasi
  • Upvote 1
Link to comment

primary gpu passedthrough (windows)

Capture.PNG.68aa2240f289cc3fa450b96ce9a2f6eb.PNG

 

secondary gpu passedthrough (windows)

Capture_1.thumb.JPG.4b43c4c4aeb04cddfa0346b7866936ef.JPG

 

primary gpu passedthrough (mac)

hangs on load. this is taken from my phone 

Screen Shot 2019-08-15 at 3.19.21 PM.png

 

this is how it is on remote client

1951847578_ScreenShot2019-08-15at3_20_49PM.thumb.png.16e7cda2b5e9ec938d3f35006c49c602.png

 

log is the same as windows on primary gpu

592074077_ScreenShot2019-08-15at3_22_47PM.thumb.png.8d902e7f788b9e9b0a7883e501956bfe.png

secondary gpu passedthrough (mac)

781446796_ScreenShot2019-08-15at3_27_22PM.thumb.png.0814f805042d925b7f21683351a3b5ba.png

Edited by iilied
double images
Link to comment
15 minutes ago, testdasi said:

Tools -> Diagnostics -> Download -> attach zip file here.

here you go brother

 

15 minutes ago, testdasi said:

In the meantime are you booting Unraid in UEFI mode? If so switch to legacy mode and try again.

Booting in UEFI is known to holding on to the GPU too tightly.

yes, booting from uefi as we speak. will give this a try and post an update.

 

15 minutes ago, testdasi said:

Also, in case I wasn't clear: you should be booting your Mac VM using your secondary GPU and Windows VM using primary. Not sure why you seem to be insisting on booting Mac VM on primary GPU.

not insisting at all, whichever works i will go for it. kept running secondary for windows vm to avoid not being able to run vm as it is more important than mac as of now. so out of curiosity, is there a reason why i should be running windows vm using primary?

machine-diagnostics-20190815-1232.zip

Edited by iilied
spelling
Link to comment

In your primary gpu windows screenshot, there is an exclamation mark on the 970 device suggesting Windows error. What is the error?

 

No particular reason why you should boot Windows VM on primary. Rather it's better to boot Mac OS on secondary.

The primary slot is always more troublesome to deal with and Mac VM is also more troublesome to deal with (remember, Apple never intends for you to run Mac on a VM, even Hackintosh is a "your millage may vary" situation).

The more variables and roadblocks you can remove from an issue, the easier it is to troubleshoot.

Link to comment
20 minutes ago, testdasi said:

In the meantime are you booting Unraid in UEFI mode? If so switch to legacy mode and try again.

Booting in UEFI is known to holding on to the GPU too tightly.

i love you ❤️

this fixed it for me… currently running the primary gpu on mac through hdmi

 

240651774_ScreenShot2019-08-15at3_51_42PM.thumb.png.7af3665f62c93bc0c5031cae40eba7ef.png

 

log

477639409_ScreenShot2019-08-15at3_54_02PM.thumb.png.35fc1f3824a630576451cf7a9986b6ee.png

so any setback i should expect running unraid on legcay mode?

Link to comment
19 minutes ago, testdasi said:

In your primary gpu windows screenshot, there is an exclamation mark on the 970 device suggesting Windows error. What is the error?

switching back to uefi to check that message again, will update you in minutes

 

update:

here is what it says (code 43)

Capture.JPG.ce90c1b597d7f670fc3d9a522eb0e2a2.JPG

Edited by iilied
update
Link to comment
18 minutes ago, iilied said:

here is what it says (code 43)

Code 43 is Nvidia driver detecting that you are using it in a VM. Nvidia consumer card i.e. non-Quadro is not supposed to be run in a VM so if the driver detects a VM envi, it will refuse to load. This happens a lot with primary GPU pass-through.

 

Good to know that booting Unraid in legacy mode fixes your problem.

There is no setback or pitfall of booting Unraid in legacy mode that I know of.

I guess theoretically there might be some specific hardware that requires UEFI boot but that looks irrelevant to your case.

Edited by testdasi
  • Like 1
Link to comment
19 minutes ago, testdasi said:

Code 43 is Nvidia driver detecting that you are using it in a VM. Nvidia consumer card i.e. non-Quadro is not supposed to be run in a VM so if the driver detects a VM envi, it will refuse to load. This happens a lot with primary GPU pass-through.

 

Good to know that booting Unraid in legacy mode fixes your problem.

There is no setback or pitfall of booting Unraid in legacy mode that I know of.

I guess theoretically there might be some specific hardware that requires UEFI boot but that looks irrelevant to your case.

thanks a bunch my friend, been fighting with this for few days then had to give up and turn to veterans like yourself for help. not the first time you do so, really appreciative of your time. cheers and have a good one

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.