Virtualizing unRAID with Xen on Arch Linux, XBMC & Windows with VGA Passthrough

[ironicbadger]

It couldn't be that easy, could it? 

 

bigmama /home/VMs/unRAID # xl create unRAID.cfg
Parsing config from unRAID.cfg
libxl: error: libxl_exec.c:118:libxl_report_child_exitstatus: /etc/xen/scripts/vif-bridge online [1925] exited with error status 1
libxl: error: libxl_device.c:1021:device_hotplug_child_death_cb: script: Could not find bridge device xenbr0
libxl: error: libxl_create.c:1115:domcreate_attach_vtpms: unable to add nic devices
libxl: error: libxl_exec.c:118:libxl_report_child_exitstatus: /etc/xen/scripts/vif-bridge offline [1955] exited with error status 1
libxl: error: libxl_device.c:1021:device_hotplug_child_death_cb: script: Could not find bridge device xenbr0

 

You havn't set up a network bridge... To be fair, i havn't included that in my write up. Look here - https://wiki.archlinux.org/index.php/xen - for the section 'create a network bridge'.

 

 

 

[johnodon]

I just followed that. 

 

I now have a xenbr0:

 

bigmama ~ # brctl show

bridge name    bridge id              STP enabled    interfaces

xenbr0          8000.00259064a7d8      no              enp1s0f0

 

 

Question, once I started the bridge I was booted out of SSH and I now had to SSH back in with the IP of the bridge (192.168.1.235).  Is that expected?  I can no longer SSH in with the IP and enp1s0f0 (192.168.1.234)

 

bigmama ~ # ip link
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: enp1s0f0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc mq master xenbr0 state UP mode DEFAULT group default qlen 1000
    link/ether 00:25:90:64:a7:d8 brd ff:ff:ff:ff:ff:ff
3: enp1s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:25:90:64:a7:d9 brd ff:ff:ff:ff:ff:ff
4: xenbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default
    link/ether 00:25:90:64:a7:d8 brd ff:ff:ff:ff:ff:ff

 

bigmama ~ # ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: enp1s0f0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc mq master xenbr0 state UP group default qlen 1000
    link/ether 00:25:90:64:a7:d8 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::225:90ff:fe64:a7d8/64 scope link
       valid_lft forever preferred_lft forever
3: enp1s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 00:25:90:64:a7:d9 brd ff:ff:ff:ff:ff:ff
4: xenbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default
    link/ether 00:25:90:64:a7:d8 brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.235/24 brd 192.168.1.255 scope global xenbr0
       valid_lft forever preferred_lft forever
    inet6 fe80::225:90ff:fe64:a7d8/64 scope link
       valid_lft forever preferred_lft forever

[ironicbadger]

I just followed that. 

 

I now have a xenbr0:

 

bigmama ~ # brctl show

bridge name    bridge id              STP enabled    interfaces

xenbr0          8000.00259064a7d8      no              enp1s0f0

 

 

Question, once I started the bridge I was booted out of SSH and I now had to SSH back in with the IP of the bridge (192.168.1.235).  Is that expected?  I can no longer SSH in with the IP and enp1s0f0 (192.168.1.234)

 

Yup, looks good. Your VM should startup now no probs.

[johnodon]

What did you use the MAC addy in your unraid cfg?  That's not the MAC of xenbr0 is it?

 

vif = [ 'mac=00:16:3e:a1:b2:cc,bridge=xenbr0' ]

 

 

[ironicbadger]

What did you use the MAC addy in your unraid cfg?  That's not the MAC of xenbr0 is it?

 

vif = [ 'mac=00:16:3e:a1:b2:cc,bridge=xenbr0' ]

 

This is the mac address you're assigning the VMs virtual ethernet port and should therefore be a random collection of a1:b4:cd etc but the first few groups are unique to Xen. Google it, you'll find it.

[johnodon]

NM...found this:

 

The 00:16:3e MAC block is reserved for Xen domains, so the last three digits of the mac= must be randomly filled in (hex values 0-9 and a-f only).

[johnodon]

:D

 

Going multiuser...
Updating shared library links:  /sbin/ldconfig &
Starting sysklogd daemons:  /usr/sbin/syslogd -m0 /usr/sbin/klogd -c 3 -x
dhcpcd[709]: version 5.2.7 starting
dhcpcd[709]: forked to background, child pid 710
Starting RPC portmapper:  /sbin/rpc.portmap
Starting RPC NSM (Network Status Monitor):  /sbin/rpc.statd
Starting Internet super-server daemon:  /usr/sbin/inetd
Starting system message bus:  /usr/bin/dbus-uuidgen --ensure ; /usr/bin/dbus-daemon --system


Welcome to Linux 3.9.11p-unRAID (hvc0)

Tower login:

[guiper]

Congratulations on getting Unraid running. All working fine?

[ironicbadger]

:D

 

Going multiuser...
Updating shared library links:  /sbin/ldconfig &
Starting sysklogd daemons:  /usr/sbin/syslogd -m0 /usr/sbin/klogd -c 3 -x
dhcpcd[709]: version 5.2.7 starting
dhcpcd[709]: forked to background, child pid 710
Starting RPC portmapper:  /sbin/rpc.portmap
Starting RPC NSM (Network Status Monitor):  /sbin/rpc.statd
Starting Internet super-server daemon:  /usr/sbin/inetd
Starting system message bus:  /usr/bin/dbus-uuidgen --ensure ; /usr/bin/dbus-daemon --system


Welcome to Linux 3.9.11p-unRAID (hvc0)

Tower login:

 

Don't forget to hug your wife now it works!

[johnodon]

Haven't gone the next step yet (plugging in my unraid drives and usb key).  I have some other issues to work out yet with Arch/Xen.

 

1.  xenbr0 is not establishing a link after a reboot even though I did systemsctl enable xenbridge-dhcp.  I have to manually start it.

 

 

2.  When I created the bridge, it whacked my enps10f0 (does not establish a link).  I still no not know if this is expected but I see a failure in systemctl:

 

3.  As you can see in the above screenshot, I also have issues with libvirt.  I'll probably work with grumpy on this one unless someone else has any suggestions.

 

[johnodon]

OK...#1 and #2 solved.  grumpy had me disable enp1s0f0.  xenbr0 now comes back with an IP after reboot and there is no failure in systemctl.

 

on to #3.

[guiper]

Not using libvirt here, no ideas how to help.

 

Why are you using the libvirt for the client / web gui?

 

[johnodon]

Not using libvirt here, no ideas how to help.

 

Why are you using the libvirt for the client / web gui?

 

Trying to get virt manager going over x11 ssh.

[guiper]

Ok, got it. I'm doing everything using command line, and using the config files. Maybe I would try to get Xen working without libvirt first, and then get libvirt working on top of it once it's working.

 

 

[johnodon]

Had another issue...

 

Since disabling enp1s0f0, when I start the unraid VM, my SSH connection is dropping and I am seeing these messages in the console:

 

 

 

 

[ironicbadger]

Had another issue...

 

Since disabling enp1s0f0, when I start the unraid VM, my SSH connection is dropping and I am seeing these messages in the console:

 

 

post your netctl files... ie the enp1s0f0 and bridge-dhcp files

[grumpybutfun]

post your netctl files... ie the enp1s0f0 and bridge-dhcp files

 

We got it working. He just needed to remove his eth0 and refresh the xenbr0 with netctl.

[ironicbadger]

post your netctl files... ie the enp1s0f0 and bridge-dhcp files

 

We got it working. He just needed to remove his eth0 and refresh the xenbr0 with netctl.

 

god you're so grumpy! but my god, you're fun.

[johnodon]

grumpy was huge help as normal.    I had to run some errands and take a mental break.

 

unRAID is up and running.

 

Still no love with XBMCbuntu in a VM.  I just can't get the output to go to the Radeon card.  It's like it starts to and then just gets lost in space during the transition from VNC to the TV.  ESXi had no issue with this at all with nothing special other that passing through the video card.  I know this has be possible in Xen!

 

If I can just get this figured out I'll be golden.

[grumpybutfun]

grumpy was huge help as normal.    I had to run some errands and take a mental break.

 

unRAID is up and running.

 

Still no love with XBMCbuntu in a VM.  I just can't get the output to go to the Radeon card.  It's like it starts to and then just gets lost in space during the transition from VNC to the TV.  ESXi had no issue with this at all with nothing special other that passing through the video card.  I know this has be possible in Xen!

 

It isn't you or your machine... I can't get XBMCbuntu to work in Xen on Linux either.

 

I am testing it now in KVM. We might have to switch you to that.

 

Let me list out all the steps to switch to KVM:

 

1. Boot into the Linux Kernel from grub.

 

2. install QEMU.

 

Phew! You have your work cut out for you.

[johnodon]

I really need a dev server. 

 

I put ESXi back up so the boys could watch a movie.

 

At least I won't have to eject all of the unRAID drives anymore when I decide to play with Arch/Xen/KVM since we are past the install.  That was the biggest PITA.

[sparklyballs]

I received some absolutely sterling advice and help from grumpy at an unreasonable hour, which was absolutely appreciated. Whilst i had issues with amd's woeful driver support in linux regarding HD AUDIO passthrough, I am firmly of the belief that virtualisation is the way to go, luckily I have a small 250 GB slotted into a spare bay on my server that i can pull/push to give me a safe environment to muck about and explore possibilities without affecting my main system in any way.

 

Latest venture so far, I have followed the XMBC VDPAU installation instructions in ubuntu 13.10 minimal server install to get a kernel with some patches that allows AMD graphics card to passthrough HD AUDIO (AND IT WORKS !!!!!!) , i've got a xen hypervisor up and running. It's movie time for me now (using the main system again) , but tomorrow I plan on playing with getting unraid up and running on the hypervisor instance.

 

Once again, absolutely massive thanks to grumpy.

 

 

[grumpybutfun]

I received some absolutely sterling advice and help from grumpy at an unreasonable hour, which was absolutely appreciated. Whilst i had issues with amd's woeful driver support in linux regarding HD AUDIO passthrough, I am firmly of the belief that virtualisation is the way to go, luckily I have a small 250 GB slotted into a spare bay on my server that i can pull/push to give me a safe environment to muck about and explore possibilities without affecting my main system in any way.

 

Latest venture so far, I have followed the XMBC VDPAU installation instructions in ubuntu 13.10 minimal server install to get a kernel with some patches that allows AMD graphics card to passthrough HD AUDIO (AND IT WORKS !!!!!!) , i've got a xen hypervisor up and running. It's movie time for me now (using the main system again) , but tomorrow I plan on playing with getting unraid up and running on the hypervisor instance.

 

Glad you were successful. Are you using the Radeon Drivers (which I use) or does AMD have theirs out in beta yet?

[sparklyballs]

I received some absolutely sterling advice and help from grumpy at an unreasonable hour, which was absolutely appreciated. Whilst i had issues with amd's woeful driver support in linux regarding HD AUDIO passthrough, I am firmly of the belief that virtualisation is the way to go, luckily I have a small 250 GB slotted into a spare bay on my server that i can pull/push to give me a safe environment to muck about and explore possibilities without affecting my main system in any way.

 

Latest venture so far, I have followed the XMBC VDPAU installation instructions in ubuntu 13.10 minimal server install to get a kernel with some patches that allows AMD graphics card to passthrough HD AUDIO (AND IT WORKS !!!!!!) , i've got a xen hypervisor up and running. It's movie time for me now (using the main system again) , but tomorrow I plan on playing with getting unraid up and running on the hypervisor instance.

 

Glad you were successful. Are you using the Radeon Drivers (which I use) or does AMD have theirs out in beta yet?

 

I'm using the walkthrough that fritsch posted over on the XBMC forum in this thread, http://forum.xbmc.org/showthread.php?tid=174854

 

 

[johnodon]

I received some absolutely sterling advice and help from grumpy at an unreasonable hour, which was absolutely appreciated. Whilst i had issues with amd's woeful driver support in linux regarding HD AUDIO passthrough, I am firmly of the belief that virtualisation is the way to go, luckily I have a small 250 GB slotted into a spare bay on my server that i can pull/push to give me a safe environment to muck about and explore possibilities without affecting my main system in any way.

 

Latest venture so far, I have followed the XMBC VDPAU installation instructions in ubuntu 13.10 minimal server install to get a kernel with some patches that allows AMD graphics card to passthrough HD AUDIO (AND IT WORKS !!!!!!) , i've got a xen hypervisor up and running. It's movie time for me now (using the main system again) , but tomorrow I plan on playing with getting unraid up and running on the hypervisor instance.

 

Glad you were successful. Are you using the Radeon Drivers (which I use) or does AMD have theirs out in beta yet?

 

I'm using the walkthrough that fritsch posted over on the XBMC forum in this thread, http://forum.xbmc.org/showthread.php?tid=174854

 

How did you get the output to go to the radeon (TV) rather than the virtual display adapter (console).  I followed that thread to the letter and never got out to the TV.  XBMC always reports that "gallium" display adapter in the Settings Info.  Did you have to do anything other than what is outlined in that thread?

 

John