aaronjb

I realise I'm bumping a topic that's been idle a while, but.. I'm trying to build a custom kernel & initrd etc for unRAID 4.5.6 - that's no problem, but I'm trying to get rtorrent/wtorrent working and I'm facing a problem getting hold of xmlrpc-c-1.11 per the wtorrent docs. BubbaQ, I see that's the version you have in bubbaRAID (which I'm currently running as I'm on 4.4.x) - where did you get it from? The latest on sourceforge is now 1.09 something :-/ [edit] Ignore me, I'm an idiot.. I can just check out the numbered release from svn, duh! <re-engages brain!>

No problem at all, and thanks for the extra information I'll build a new SVN version soon, as the more recent versions support DTS-passthrough as well as AC3, which makes for easier transcoding of anything where you want to preserve a DTS track - I'll update here when I've done it

Aha - thanks I've not used the Windows version - only the Mac GUI & CLI versions, so I wasn't aware of that (maybe that feature exists in the Mac GUI too - I'll have to go hunting)

The best resource is really the HandBrake website - http://handbrake.fr - the forums and the Wiki. Start with the Wiki, though, as they don't suffer fools gladly on the forums It's fairly easy to figure out what CLI options you need based on what GUI options you're picking - the main thing is to remember to look at what x264 options are being set in the GUI (the long text string) and use those at the CLI with the '-x' parameter, but the GUI can't generate a script unfortunately (would be nice if it could, actually). Aaron (who really should get around to writing that Wiki page

So I did a quick search for dnsmasq here and found nothing, which shocked and awed me.. well, ok, I found it a little surprising First, a little background in case you're unaware what dnsmasq is: It's a small-footprint DHCP server and DNS server for use on relatively small networks, and allows you to very quickly set up a machine to both serve out IP addresses to clients via DHCP, and provide DNS name lookups for those same machines as well as forwarding non-local lookups to your ISPs (or any!) DNS servers for resolution. As an example of where it can be useful: I used to use a DSL router that allowed me to configure DHCP clients (my laptop, Mac Mini, unRAID server) with hostnames and would let me do lookups for those same machines - so whatever IP my unRAID box got, it was always accessible via the name 'oracle', my Mini was always available at 'tank' and my MacBook always 'link' (can you guess where the names are from? ) I switched to a fancy-dancyer router which lacked that feature - annoyingly - so I decided to have a changearound and have my unRAID box with a static IP, and have it serve DHCP addresses to the clients on my LAN, and do name lookups as well. Now for the HowTo part - it's quite straightforward really: 1. You'll need to configure a static IP address for your unRAID box if you're currently using DHCP, so do this now via the web interface and save your settings. 2. Connect via telnet to your unRAID server on it's new IP address and download dnsmasq - I store my packages in '/boot/packages/', my instructions assume you do, too: cd /boot/packages wget http://www.mirrorservice.org/sites/ftp.slackware.com/pub/slackware/slackware-12.1/slackware/n/dnsmasq-2.41-i486-1.tgz 3. Make a 'dnsmasq' directory so we can make the configuration 'stick' across reboots mkdir /boot/packages/dnsmasq 4. Install dnsmasq: installpkg /boot/packages/dnsmasq-2.41-i486-1.tgz 5. Configure dnsmasq - you're going to need to work out what options suit you best, but here's an example of my /etc/dnsmasq.conf file: domain-needed bogus-priv local=/lan/ expand-hosts domain=lan dhcp-range=192.168.1.10,192.168.1.100,255.255.255.0,72h dhcp-option=option:router,192.168.1.254 dhcp-option=option:domain-search,lan dhcp-leasefile=/boot/packages/dnsmasq/dnsmasq.leases dhcp-authoritative local-ttl=60 I highly recommend you read through the default /etc/dnsmasq.conf file yourself and work out what options you want or need - every available option is included in the file with comments explaining what they all do. If you're in a pinch, the above will get you a reasonable config that assumes an IP range of '192.168.1.0' for your machines. One thing that is important to note is the following line: dhcp-leasefile=/boot/packages/dnsmasq/dnsmasq.leases That will make our dhcp leases survive across reboots - it's not mandatory, but it's nice to do. However, if not burning out the write cycles of your USB stick is important, don't do it.. it'll work fine trashing the DHCP leases on reboot, really 6. Copy the dnsmasq.conf somewhere it will survive a reboot: cp /etc/dnsmasq.conf /boot/packages/dnsmasq 7. You'll need to edit your /etc/hosts file so that you don't get an invalid lookup for your unRAID server name (there's a neater way of doing this, actually, but this is quick & dirty) - since the file is generated at boot you'll also need to overwrite it on each boot, so edit your hosts file so it looks like this: # Generated 127.0.0.1 localhost 192.168.1.1 oracle Replace 192.168.1.1 with your actual server IP address - what you've done is moved the server name ('oracle' in my case) from 127.0.0.1 to it's real IP address. Now back that file up: cp /etc/hosts /boot/packages/dnsmasq 8. Now add the following lines to your /boot/config/go file (or /boot/config/go2 for you BubbaRAID folks): ## load dnsmasq here installpkg /boot/packages/dnsmasq-2.41-i486-1.tgz cp /boot/packages/dnsmasq/dnsmasq.conf /etc cp /boot/packages/dnsmasq/hosts /etc /usr/sbin/dnsmasq 9. Now start dnsmasq - you only need to do this now because you've not rebooted yet: /usr/sbin/dnsmasq If you need to debug anything, watch /var/log/syslog: tail -f /var/log/syslog And you're good to go! Local LAN clients will get their IP via DHCP on the unRAID box, and will be able to perform name lookups for anything on the lan, and DNS lookups for remote hosts will be forwarded to whatever you have listed in /etc/resolv.conf (configured via the unRAID GUI - most likely your router or ISP DNS servers). If nobody reports any problems with the above, I'll add it to the Wiki

Interesting you mention that - I had the exact same thing. After some cable shuffling they went away.. but it's good to know it's probably a cradle issue rather than anything else (although replacing cables would be arguably cheaper than repalcing the cradle.. d'oh!)

Takes a couple of minutes to boot here, and that's with the bigger BubbaRaid image (+100Mb or so over the standard initrd image), my own custom kernel, and vmware starting up and autobooting a couple of VMs.. and that's on a cheap (slow!) PNY USB key..

I have an Icy Dock in my case - it's pretty quiet (very quiet, actually), but I have found it quite picky in terms of cables - I was getting a lot of UDMA errors until I reseated all the cables & drives a couple of times, and switched to more expensive SATA cables. Can't comment on the Supermicro.

First of all, thanks for putting together BubbaRaid - it simplified my task of getting rtorrent working, and as a bonus I got everything else Now since you were so kind as to include so much stuff, I thought I'd start looking at the other things included, and stumbled across the instructions for enabling CPU frequency scaling.. Unfortunately it seems my CPU (Intel Core 2 Quad) requires the 'acpi_cpufreq' module, which isn't included with BubbaRaid by default Any chance of including it in future releases? For now I'll build a custom kernel & initrd, so I think I'll be ok, but it would be nice to include this frequency scaler for more modern CPUs I think

HowTo compile & install HandBrake is now here: http://lime-technology.com/forum/index.php?topic=3714.0 For ripping BR discs I believe you'll need a Windows box, as there's no decryption software available for Linux to my knowledge.. but I'm vague on that area as I've only just bought a BR reader and a couple of BR discs

So I did all this because VMWare only allows you to access two cores in any VM, even on a quad core box - and since I specifically spent the extra on a quad core processor for my unRAID box with transcoding my DVDs in mind, I wanted to make use of them So without further ado: If you want to compile HandBrake yourself then follow the instructions below - you'll be checking out a development tree of HandBrake and compiling that on your unRAID development box, then installing a package you build yourself. If you'd rather just download the last one I built (which could be out of date and/or have bugs, just as any SVN build can) then skip to step 1a at the foot of this post. 1) Prepare your unRAID Development machine per here: http://lime-technology.com/forum/index.php?topic=2937.0 N.B. The version of slackware your development machine uses will change the minimum version of libstdc you need later in these instructions - pay attention there! 2) Install yasm & jam: wget http://repository.slacky.eu/slackware-12.1/development/yasm/0.7.2/yasm-0.7.2-i486-1sl.tgz wget http://repository.slacky.eu/slackware-12.1/development/jam/2.5/jam-2.5-i486-2gal.tgz installpkg yasm-0.7.2-i486-1sl.tgz installpkg jam-2.5-i486-2gal.tgz 2) Check out a copy of the HandBrake source. I like to keep everything in a 'dev' directory in my home, so for me it's: cd dev svn co svn://svn.handbrake.fr/HandBrake/trunk HandBrake After a couple of minutes the checkout should complete, and drop you back at the shell prompt, so pop into the checked-out directory and let's get started: A HandBrake/make/config.guess Checked out revision 2353. root@slacky:~/dev$ cd HandBrake **N.B.** As of right now, HandBrake refuses to build on Slackware because they require a later version of libtool than is installed by default due to a patch to pass '-i' to libtoolize when building xvidcore. A dirty hack to fix this is to remove the patch file - you should test a build first to see if it completes, since the SVN version is always in-flux, this could easily be fixed by the time you're reading this. If it doesn't build, come back to this step and start from here again. 3) If you need to, remove the xvidcore patch: cd contrib/xvidcore rm -f A00-libtool.patch cd ~/dev/HandBrake rm -rf build Otherwise, run configure and then we can build: cd ~/dev/HandBrake ./configure cd build make Now sit back and watch as the build process runs through, downloading the required libraries and compiling everything up. The build should stop with an error relating to gtk, but that's OK - we don't actually care about the GTK GUI anyway: ../gtk/src/values.h:69: error: expected ')' before '*' token make: *** [gtk/src/create_resources-native.o] Error 1 As long as the build directory now contains a binary called 'HandBrakeCLI', we're good to go. 4) If you want to save the HandBrake binary on your USB key then you can now simply copy it (via whatever method you prefer) to somewhere in /boot (I keep packages in /boot/packages, for example), otherwise if you'd rather store it in the RAMfs, you can make an installation package now: mkdir -p /handBrakeREALTIME/usr/local/bin cp HandBrakeCLI /handBrakeREALTIME/usr/local/bin cd /handBrakeREALTIME makepkg HandBrakeREALTIME.tgz Then copy the package to somewhere on your unRAID /boot - I use /boot/packages personally. 5) From this point on, all steps are performed on your unRAID server directly Edit /config/go to include a line which reads: installpkg /boot/packages/HandBrakeREALTIME.tgz (Naturally change the path if you store your packages elsewhere) 5) HandBrake also requires cxxlibs, and depending on the version of Slackware you built on will dictate the version of cxxlibs you need to install. If your development box is 12.0, you'll need cxxlibs 6.0.8 or newer, 12.1 or newer will require 6.0.9 or newer. Download them on your main unRAID box thusly if you don't already have them: wget http://www.mirrorservice.org/sites/ftp.slackware.com/pub/slackware/slackware-12.1/slackware/a/cxxlibs-6.0.9-i486-1.tgz And add a line to your 'go' script to load the pacakge: installpkg /boot/packages/cxxlibs-6.0.9-i486-1.tgz And now you're all done! Congratulations! If you just want to use the package I've pre-built then start here: 1a) Telnet to your unRAID box and run the following commands - note I keep all my packages in /boot/packages, so that's where I'm assuming you do, too: wget http://zion.mind-design.co.uk/unRAID/HandBrakeCLI-svn2354-i686-1ajb.tgz wget http://www.mirrorservice.org/sites/ftp.slackware.com/pub/slackware/slackware-12.1/slackware/a/cxxlibs-6.0.9-i486-1.tgz 2a) Add the following lines to your /boot/config/go script: installpkg /boot/packages/cxxlibs-6.0.9-i486-1.tgz installpkg /boot/packages/HandBrakeCLI-svn2354-i686-1ajb.tgz Note that my package installs to /usr/local/bin Enjoy! Any corrections or problems then post up and I'll adjust the instructions accordingly Aaron

Funnily enough I actually did this earlier - it's pretty simply if you have an unRAID development box (essentially a full slackware install to compile on), in fact by far the hardest part is getting HandBrake to compile cleanly as the current SVN version has trouble with the old version of libtool that's the default in Slackware. Once I figure out the patch required to make HandBrake compile nicely, I'm going to write this up properly and post it here

My wiring is nowhere near as neat as Rob's up top - but then I haven't finished tying everything down just yet as I'll need to swap the nice modular PSU back in once it comes back from DOA RMA, but here goes. I wanted a system that was built to take the full 15 drives long-term, even though right now I only need two plus a cache, and I wanted it to be quiet. But more than that, I wanted it to be powerful enough to run VMWare with a full Ubuntu distribution running in it to transcode my DVDs to H.264. What I've ended up with is something plenty powerful and even quieter than my current fileserver (An Athlon Barton 3000+ based system, quite old now). Case: Lian-Li PCA17A case. Tons of room inside, 9x5.25" drive bays to take the full compliment of hard disc docks, and a motherboard tray - first time I've bought a case expensive enough to be easy to build with and quality enough not to shred my hands in the process! I really wanted the black one, but this one was in stock for Saturday delivery.. Motherboard: Gigabyte GA-P31-ES3G. I did some reading around and similar boards were being used successfully. Only four onboard SATA ports but three PCI slots, three PCI-E x1 slots and one PCI-E x16 slot means I can still spread the ports around extra cards to minimize bandwidth contention - technically I could use six 2 port cards, if my maths is correct. Processor: Intel Core 2 Quad Q8200, Yorkfield die. Not the most powerful quad core out there, but very cheap at £130! CPU Cooling: ASUS V60 Quiet - huge heatsink, pretty quiet (not silent) and keeps the CPU almost at room temperature when idle! Power Supply: 850W NorthQ Black Magic Flex Modular PSU. I found a review of this PSU online - here, in fact - it's nice and quiet when un-loaded, and has three 12v rails - one for the CPU, and the other two join to make one giant 50A 12v rail. Read the review for more, it's pretty thorough RAM: 2x2GB matched pair of Corsair TwinX DDR2 5-5-5-15 1066Mhz RAM. This gave me some problems with my Gigabyte motherboard. The motherboard insisted on running the RAM at 1110MHz on any automatically detected settings, which the RAM did not appreciate. Backing it off to 1000MHz results in a stable system, at the expense of a tiny bit of speed.. Drive Docks: Icy Dock MB-455SPF, just like the prebuilt systems. Drives: So far just two Hitachi Deskstar 7K1000.B 1TB drives - cheap at £70 a pop. USB Key: I started off with a tiny 128Mb no-name drive that's branded by the people I work for (they were promo items) - no GUID meant it was useless for registering, but let me prove the system. I invested in a couple of sticks at PC World as my other 1Gb Maxell sticks refused to boot. One of them was a tiny 2Gb PNY stick - honestly it's miniscule, quick and boots nicely. Peekshures! The case arrived and was taken out of the box, ooh, shiny! It's so small! (Words every man is afraid of hearing) I thought the F5 one was small, but no.. Bit of a rats nest in here: Looks nice from the outside, though:

*sound of much forehead-slapping* I used the wrong pam package - I'd downloaded the one from the 12.1 repository (which doesn't appear to work) rather than the one from the 12.0 repo (which does work).. At least that's what it appears to have been - all logged in now on the unRAID dev box. I can't move everything over to the actual unRAID box just yet as I don't have a cache drive installed (need to move the ~700Gb of content off the other server to free up it's drives - that's going to take a while, since I never did get around to upgrading to gigabit ethernet!). Thanks for the help

I'm going round in circles trying to get this working on my development server at the moment, and I'm not having much success.. The root of my problems seems to be pam, and having followed the instructions above (the only thing that's different is that when vmware asked me if I wanted a username to access the system I said yes, and entered 'root' without quotes) I'm unable to login to the UI, with the following errors in the logs: [2009-04-19 21:16:39.485 'App' 3064286096 error] System PAM libraries are unusable: libprelude.so.2: cannot open shared object file: No such file or directory [2009-04-19 21:16:39.486 'ha-eventmgr' 3064286096 info] Event 4 : Failed login attempt for [email protected] After finding and installing libprelude, the error becomes: [2009-04-19 21:21:35.924 'App' 3063761808 error] System PAM libraries are unusable: libgnutls.so.13: cannot open shared object file: No such file or directory [2009-04-19 21:21:35.926 'ha-eventmgr' 3063761808 info] Event 5 : Failed login attempt for [email protected] libgnutls has a whole bunch of dependencies that aren't installed.. Is my development box (installed as per the dev box thread from a Slackware 12.1 DVD) missing libraries that you all have by default, or have I gone wrong somewhere in the vmware install?

Just getting going with unRAID here, and following this tutorial prompts me to suggest some alterations The paths for the 2.6.27.7 files need changing as 'slackware-current' now points to 2.6.29.1; wget http://mirrors.easynews.com/linux/slackware/slackware-12.2/slackware/k/kernel-source-2.6.27.7_smp-noarch-1.tgz wget http://mirrors.easynews.com/linux/slackware/slackware-12.2/slackware/d/kernel-headers-2.6.27.7_smp-x86-1.tgz wget http://mirrors.easynews.com/linux/slackware/slackware-12.2/slackware/a/kernel-modules-2.6.27.7-i486-1.tgz Also, for those of us setting up a development environment under VMWare, there is an excellent list of what kernel options are necessary here: http://en.gentoo-wiki.com/wiki/HOWTO_Install_Gentoo_on_VMware#Kernel_options It's for Gentoo, and a couple of kernel options have moved (but are still easily locatable based on the information there), but those options should work very well for any VMWare dev environment (mine, for example, is running under VMWare Fusion) Aside from that the instructions were spot on - so thanks very much for writing it all up!