will try this tonight hopefully.

 

but  my question still remains where to I pass though the usb controller to?

or you just mean to do  the xen-pciback-hide (00:XX.X) setup

and see if it comes up in  this command  "sudo xl pci-list-assignable-devices" ?

 

will post the result...

 

PS>> I did not skipped any steps.

you told me last post  to install Ubuntu and Xen

and make sure that I have the network working (which I did)

the only thing was that I keep referring to an on line guide on how to install

Ubuntu 12.04 + Xen , and one of the steps in the guide was to remove KVM lib  before installing Xen. which I did. (it gives all the  instructions on install ubuntu server and all the  commands step by step . basically copy and paste).

 

but after I seen your post about libvirt and vit-manager and cheking out the websites for this apps, I saw a lot of references to KVM there and though I should ask if I should not have listen to the guide and not removed the KVM lib during install.

 

that is all.

will try this tonight hopefully.

 

but  my question still remains where to I pass though the usb controller to?

or you just mean to do  the xen-pciback-hide (00:XX.X) setup

and see if it comes up in  this command  "sudo xl pci-list-assignable-devices" ?

 

will post the result...

 

I also want you to do the "lspci -k" and verify the Kernel driver for that device is using pciback.

 

To answer your question, we aren't passingthrough any devices yet.

 

We are first checking to make sure the Linux Kernel and Xen can see / will be able to passthrough your devices.

 

Once we verify that, THEN we will proceed to step 2, step 3 and so on.

 

 

Got it..

 

 

lspci -k should bring you face to face with something like THIS

 

that's it ddeeds, I give up

nothing is working as expected

I am attching the file with all info as per your request. but

pciback drivers are not loading

ubuntu is loaded, xen is loaded

but pciback is not.

 

F$#$@# it.

I will use something else for file server.

just freaking setup nfs shares  directly.

or even RDM all disks into unRaid VM

 

would really like your help in geting the gui for managing this thing runing though.

 

thanks

lspciOut.txt

That's funny because most of the people I've asked all say debian/ubuntu is the way to go for xen.

Learn how to compile a Linux kernel and change the Xen options from modules to being installed in the Linux kernel itself all via a graphical tool. A million guides and 1,000+ times less complicated than what I had to go through above.

If we have to do that, well -- that brings me back full circle to an earlier thought -- we might as well look into making a dom0 kernel for unRAID.  I mean, if you don't run any extra addons in unRAID, there's not much happening in unRAID anyway, it could at least serve as dom0.  Do that, and Bob's your uncle!  Then all the extra crap one needs goes into virtual machines on top of that setup.

 

 

Tashak, I was actually just thinking about that very thing. I dont even think it is that difficult, providing xen works well on slackware. All you really need to do is full slackware install for unraid, and slap the xen on it. Dom0 have full hardware support so no need for any pass through crap.

Only issue is to make the  unraid read license properly I believe.  But maybe Tom can adjust his license module to support this kind of lnstall after all.

 

What do you think ddeeds?

 

 

Sent from my SGH-T889 using Tapatalk 4

 

 

Allso, a very strange behavior I come upon, when I run command to check if my hardware supports virtualisation, I have run it 10 times over all. First several times I did it I got indication that at least CPU supports it. But after reboot, now get nothing.

 

Sent from my SGH-T889 using Tapatalk 4

 

 

I am sure cpu have the supporr. I checked on amd site.

 

Sent from my SGH-T889 using Tapatalk 4

 

 

... All you really need to do is full slackware install for unraid ...

You totally misunderstood me.  I meant for unRAID to be just the way it is now.

Why on Earth would you want "full slackware install"?

 

Why would you not want an easier time by using a Debian based distro to run your stuff instead of Slackware which isnt exactly popular.

 

Sure you'd probably get it working but in months not hours. I'm going to write up Debian tonight with .deb files posted. Trust me when I say this is the easiest option as I'm compiling the kernel and xen for and providing all instructions to get a functional box.

 

Sent from my GT-I9505 using Tapatalk 2

 

 

Ironic, dude :-)  I take the most simple way any time of day.

It's just I think that my hardware probably will not support the pass through and at this moment unraid is the top issue to make it work. As most other stuff does not require this functionality.  All ither things can happily run on vm hardware. Thus making unraid a dom0 make sense.

But I will try anything at this point

 

Sent from my SGH-T889 using Tapatalk 4

 

 

i've done all of the following in virtualbox, but lspci -k seems to come up short .. i do boot xen 4.3 and linux 3.10.5

 

base install is ubuntu 12.04

 

# references
# http://www.howopensource.com/2011/08/how-to-compile-and-install-linux-kernel-3-0-in-ubuntu-11-04-10-10-and-10-04/
# http://www.tivipe.com/index.php?option=com_content&view=article&id=88:linux-ubuntu-kernel-compilation&catid=46:linux&Itemid=53
# http://mapopa.blogspot.com/2009/01/compiling-2.html
# http://www.gossamer-threads.com/lists/xen/users/290117

# ssh into the box
ssh <your machine name or ip>

# install dev environmente
sudo apt-get install build-essential libncurses5-dev

# upgrade and update system
sudo apt-get update && sudo apt-get upgrade

# get the linux kernel you want to install
mkdir ~/source
cd ~/source
wget https://www.kernel.org/pub/linux/kernel/v3.0/linux-3.10.5.tar.bz2

# unzip 
tar xjf linux-3.10.5.tar.bz2
cd linux-3.10.5

# copy config
cp /boot/config-$(uname -r) ./.config

# setup options
sudo make menuconfig
menu Processor type and features  ---> <enter>
submenu Linux guest support  ---> <Y>

menu Device Drivers  ---> <enter>
submenu Xen driver support  ---> <Y>

menu Device Drivers  ---> <enter>
submenu Block devices  ---> <enter>
option Xen block-device backend driver <y>

# compile kernel
# make all -j <2 * number_of_cores>
sudo make all -j 8

# install the kernel
# create deb package
sudo make deb-pkg

# make space
sudo make clean

# install package
sudo dpkg -i ../linux-image-3.10.5_3.10.5-2_amd64.deb

# compile xen from source
# get source
wget http://bits.xensource.com/oss-xen/release/4.3.0/xen-4.3.0.tar.gz

# install dependencies
sudo apt-get install bridge-utils iproute uuid uuid-dev libglib2.0-dev libyajl-dev bcc gcc-multilib iasl libpci-dev mercurial git flex bison libaio-dev python-dev gettext libpixman-1-0 libpixman-1-dev markdown texinfo

# configure & compile
./configure && make -j8 world &&

# install 
sudo make -j8 install

# not sure we need to run this
# sudo mv /etc/grub.d/20_linux_xen /etc/grub.d/09_linux_xen
# sudo update-grub 

# rebuild dynamic
sudo /sbin/ldconfig

# reboot
sudo shutdown -r now

# cleanup
sudo rm xen.gz xen-4.gz xen-4.3.gz xen-syms-4.3.0

 

and this is lspci -k

 

kayak@xenu:~$ sudo lspci -k
[sudo] password for kayak:
00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] (rev 02)
00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II]
00:01.1 IDE interface: Intel Corporation 82371AB/EB/MB PIIX4 IDE (rev 01)
Kernel driver in use: ata_piix
00:02.0 VGA compatible controller: InnoTek Systemberatung GmbH VirtualBox Graphics Adapter
00:03.0 Ethernet controller: Intel Corporation 82540EM Gigabit Ethernet Controller (rev 02)
Subsystem: Intel Corporation PRO/1000 MT Desktop Adapter
Kernel driver in use: e1000
Kernel modules: e1000
00:04.0 System peripheral: InnoTek Systemberatung GmbH VirtualBox Guest Service
00:05.0 Multimedia audio controller: Intel Corporation 82801AA AC'97 Audio Controller (rev 01)
Subsystem: Intel Corporation Device 0000
Kernel driver in use: snd_intel8x0
Kernel modules: snd-intel8x0
00:06.0 USB controller: Apple Inc. KeyLargo/Intrepid USB
Kernel driver in use: ohci_hcd
00:07.0 Bridge: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 08)
Kernel modules: i2c-piix4
00:0d.0 SATA controller: Intel Corporation 82801HM/HEM (ICH8M/ICH8M-E) SATA Controller [AHCI mode] (rev 02)
Kernel driver in use: ahci
kayak@xenu:~$

 

 

Learn how to compile a Linux kernel and change the Xen options from modules to being installed in the Linux kernel itself all via a graphical tool. A million guides and 1,000+ times less complicated than what I had to go through above.

If we have to do that, well -- that brings me back full circle to an earlier thought -- we might as well look into making a dom0 kernel for unRAID.  I mean, if you don't run any extra addons in unRAID, there's not much happening in unRAID anyway, it could at least serve as dom0.  Do that, and Bob's your uncle!  Then all the extra crap one needs goes into virtual machines on top of that setup.

Option A

Installing unRAID 5.0 on a full Slackware Distro

Guys, can we stop saying that we need a "full Slackware Distro" for that?  What's a "full Slackware Distro" anyway? Slackware with solitaire and tetris?  For our purposes unRAID is a full Slackware Distro.  We can add to it only what's needed, on top of what's already in it.

 

For this to work, we need five things:

1) compile Xen;

2) compile a dom0 kernel;

3) use a bootloader that can deal with Xen;

4) compile a piece of software that works inside dom0 and manages the virtual machines;

5) setup a client computer to talk to the server.

 

One & Two are trivial.

Three can be grub on the USB stick, or whatever.

Four is the part that I'm not quite clear about.  Is that libvirt?  More things?

Five is your everyday laptop, with a normal web-browser. (Or is it with some special client-side software?)

 

 

Tashak, when we say full slackware distro, we mens install unraid to boot from  harddrive and for that it ussually involves installing full distro and compile unraid on it.

 

Sent from my SGH-T889 using Tapatalk 4

 

 

Tashak, when we say full slackware distro, we mens install unraid to boot from  harddrive and for that it ussually involves installing full distro and compile unraid on it.

Why would you want to boot unRAID from a harddrive, instead from a USB stick, just the way it is now?  And even if you do want to do that for some reason, why would that require the install of a "full distro", whatever that means?  Fact is, you can boot the bzimage/bzroot from anywhare, (even from a network-PXE boot), as long as there is some disk labeled "UNRAID", so unRAID can mount it on top of its /boot/ folder.  (For example, on my development box I boot bzimage/bzroot from Grub, and unRAID doesn't mind.)

 

 

For this to work, we need five things:

1) compile Xen;

2) compile a dom0 kernel;

3) use a bootloader that can deal with Xen;

4) compile a piece of software that works inside dom0 and manages the virtual machines;

5) setup a client computer to talk to the server.

 

One & Two are trivial.

Three can be grub on the USB stick, or whatever.

Four is the part that I'm not quite clear about.  Is that libvirt?  More things?

Five is your everyday laptop, with a normal web-browser. (Or is it with some special client-side software?)

 

1 - Compile Xen - I do not believe you have too. You could always run whatever version your Linux Distro provides. ...

ddeeds, I thik you got distracted and you started talking about something different.  The post you quoted was about rinning unRAID as dom0.

 

 

I'm going to write up Debian tonight with .deb files posted.

 

I'm looking forward to your guide!

I'm going to write up Debian tonight with .deb files posted.

 

I'm looking forward to your guide!

 

Well, ladies and gentlemen. Here is PART ONE of my guide which covers getting Ubuntu installed and a custom kernel compiled.

 

http://blog.ktz.me/?p=48

 

Let me know if it helps you and I'm working on part two right now which includes PCI passthrough instructions and unRAID virtualisation instructions.

Well i am game to try it tonight

 

Sent from my SGH-T889 using Tapatalk 4

 

 

PART TWO: http://blog.ktz.me/?p=80

 

Compiling Xen 4.3 and setting up PCI passthrough (this bit is incomplete for now - it's late but I thought I'd get the info out there for you guys).

I'm going to write up Debian tonight with .deb files posted.

 

I'm looking forward to your guide!

 

Well, ladies and gentlemen. Here is PART ONE of my guide which covers getting Ubuntu installed and a custom kernel compiled.

 

http://blog.ktz.me/?p=48

 

Let me know if it helps you and I'm working on part two right now which includes PCI passthrough instructions and unRAID virtualisation instructions.

 

 

following your guide to the letter

 

make not working

gives me tis error although the ls command show the config file I downloaded.

what am I doing wrong?

 

 

vlad@ubuntuxen:~/src/linux/linux-3.10.5$ make -j12 deb-pkg

scripts/kconfig/conf --silentoldconfig Kconfig

***

*** Configuration file ".config" not found!

***

*** Please run some configurator (e.g. "make oldconfig" or

*** "make menuconfig" or "make xconfig").

***

make[2]: *** [silentoldconfig] Error 1

make[1]: *** [silentoldconfig] Error 2

make: *** No rule to make target `include/config/auto.conf', needed by `include/config/kernel.release'.  Stop.

vlad@ubuntuxen:~/src/linux/linux-3.10.5$

vlad@ubuntuxen:~/src/linux/linux-3.10.5$

vlad@ubuntuxen:~/src/linux/linux-3.10.5$ ls

arch                          COPYING        drivers  init    kernel      mm              samples  tools

block                          CREDITS        firmware  ipc      lib          net            scripts  usr

config_xen_ubuntuserver1304    crypto        fs        Kbuild  MAINTAINERS  README          security  virt

config_xen_ubuntuserver1304.1  Documentation  include  Kconfig  Makefile    REPORTING-BUGS  sound

vlad@ubuntuxen:~/src/linux/linux-3.10.5$

 

got it,

the file was not there

wget download the file but would not rename it to ".config"

 

as I assume  the command should do

"wget https://dl.dropboxusercontent.com/u/6775695/config_xen_ubuntuserver1304  ~/src/linux/linux-3.10.5/.config"

 

 

finish compiling, installed it.

 

uname -a

returns : Linux ubuntuxen 3.10.5 #1 SMP PREEMPT Sat Aug 10 21:33:52 EDT 2013 x86_64 x86_64 x86_64 GNU/Linux

 

 

finish Xen compile and install

when SSH into the box and run xl info  this is what I get (the command is at the end )

Welcome to Ubuntu 13.04 (GNU/Linux 3.10.5 x86_64)

 

* Documentation:  https://help.ubuntu.com/

 

  System information as of Sat Aug 10 22:55:42 EDT 2013

 

  System load:  1.16              Processes:          210

  Usage of /:  52.9% of 36.42GB  Users logged in:    0

  Memory usage: 0%                IP address for eth0: 192.168.1.10

  Swap usage:  0%

 

  Graph this data and manage this system at https://landscape.canonical.com/

 

Last login: Sat Aug 10 22:12:25 2013 from 192.168.1.3

 

 

vlad@ubuntuxen:~$ xl info

xl: error while loading shared libraries: libxlutil.so.4.3: cannot open shared object file: No such file or directory

vlad@ubuntuxen:~$ xl info

xl: error while loading shared libraries: libxlutil.so.4.3: cannot open shared object file: No such file or directory

 

CONGRATS!!!! I promise, you are almost there.

 

See if running the following helps:

 

sudo update-rc.d xencommons defaults 20 19
sudo update-rc.d xendomains defaults 21 22
sudo update-rc.d xen-watchdog defaults 23 22

 

Rebuild your dynamic linker cache by running:

 

sudo /sbin/ldconfig && sudo reboot

 

When you boot, is the Grub Menu selecting Ubuntu GNU/Linux, with Xen hypervisor by default? If not, manually select it.

 

When you have it working... Jump over to this thread:

 

Virtualizing unRAID in Xen on Ubuntu Server 13.04 (64-Bit) and follow the instructions on getting the unRAID VM up and running.

 

 

Success !!!

I just needed to run "  sudo xl info "

thanks ddeeds.

 

 

host                  : ubuntuxen

release                : 3.10.5

version                : #1 SMP PREEMPT Sat Aug 10 21:33:52 EDT 2013

machine                : x86_64

nr_cpus                : 12

max_cpu_id            : 11

nr_nodes              : 2

cores_per_socket      : 6

threads_per_core      : 1

cpu_mhz                : 2412

hw_caps                : 178bf3ff:efd3fbff:00000000:00001300:00802001:00000000:000037ff:00000000

virt_caps              :

total_memory          : 57343

free_memory            : 128

sharing_freed_memory  : 0

sharing_used_memory    : 0

outstanding_claims    : 0

free_cpus              : 0

xen_major              : 4

xen_minor              : 3

xen_extra              : .0

xen_caps              : xen-3.0-x86_64 xen-3.0-x86_32p

xen_scheduler          : credit

xen_pagesize          : 4096

platform_params        : virt_start=0xffff800000000000

xen_changeset          : Tue Jul 9 11:46:56 2013 +0100 git:f8cc9c2

xen_commandline        : placeholder

cc_compiler            : gcc (Ubuntu/Linaro 4.7.3-1ubuntu1) 4.7.3

cc_compile_by          : vlad

cc_compile_domain      :

cc_compile_date        : Sat Aug 10 22:45:14 EDT 2013

xend_config_format    : 4

vlad@ubuntuxen:~$

 

 

vlad@ubuntuxen:~$ xl info

xl: error while loading shared libraries: libxlutil.so.4.3: cannot open shared object file: No such file or directory

 

CONGRATS!!!! I promise, you are almost there.

 

See if running the following helps:

 

sudo update-rc.d xencommons defaults 20 19
sudo update-rc.d xendomains defaults 21 22
sudo update-rc.d xen-watchdog defaults 23 22

 

Rebuild your dynamic linker cache by running:

 

sudo /sbin/ldconfig && sudo reboot

 

When you boot, is the Grub Menu selecting Ubuntu GNU/Linux, with Xen hypervisor by default? If not, manually select it.

 

When you have it working... Jump over to this thread:

 

Virtualizing unRAID in Xen on Ubuntu Server 13.04 (64-Bit) and follow the instructions on getting the unRAID VM up and running.

 

 

Success !!!

I just needed to run "  sudo xl info "

thanks ddeeds.

 

 

host                  : ubuntuxen

release                : 3.10.5

version                : #1 SMP PREEMPT Sat Aug 10 21:33:52 EDT 2013

machine                : x86_64

nr_cpus                : 12

max_cpu_id            : 11

nr_nodes              : 2

cores_per_socket      : 6

threads_per_core      : 1

cpu_mhz                : 2412

hw_caps                : 178bf3ff:efd3fbff:00000000:00001300:00802001:00000000:000037ff:00000000

virt_caps              :

total_memory          : 57343

free_memory            : 128

sharing_freed_memory  : 0

sharing_used_memory    : 0

outstanding_claims    : 0

free_cpus              : 0

xen_major              : 4

xen_minor              : 3

xen_extra              : .0

xen_caps              : xen-3.0-x86_64 xen-3.0-x86_32p

xen_scheduler          : credit

xen_pagesize          : 4096

platform_params        : virt_start=0xffff800000000000

xen_changeset          : Tue Jul 9 11:46:56 2013 +0100 git:f8cc9c2

xen_commandline        : placeholder

cc_compiler            : gcc (Ubuntu/Linaro 4.7.3-1ubuntu1) 4.7.3

cc_compile_by          : vlad

cc_compile_domain      :

cc_compile_date        : Sat Aug 10 22:45:14 EDT 2013

xend_config_format    : 4

vlad@ubuntuxen:~$

 

I'll update my guide and I'm glad it helped you with this new info.

 

Sent from my GT-I9505 using Tapatalk 2