kenshin

I'm running the Norco 4020 with 8 drives, and with a few modifications I have no heat issues at all (Seagate 1tb AS drives run at 28-32 celsius, WD1001FALS run at 32-35 celsius). Just tape off all the checkerboard perforations on the back of the case, and install some more powerful rear exhaust fans than the stock 35cfm'ers and you'll be fine.

Wow Joe L. I'm sorry I haven't been able to help you troubleshoot all of these issues, but it looks like you've been taking care of business! I don't know where you find the time and determination, but it's impressive . I'm glad so many people have found this script useful. The first version I posted has been running nonstop on my own Unraid server for over a year straight!

I'm glad it worked. That is definitely a cleaner way to fix the file for SMTP. Thanks for spending the time on it. I replaced the original version attached in my post with your new version, so that no one downloads old code if they miss your post -kenshin

All of the above. The majority of storage space is dedicated to video (I hate looking between drives for a movie or tv show that I know exists), but I care more about protecting the documents and pictures it holds. -kenshin

Email notification of drive failure/array issues is possible with this script http://lime-technology.com/forum/index.php?topic=911.msg6151#msg6151 (a modified version of Joe L.'s Yac script ). I also use it to provide full status updates on a weekly basis (full output of /proc/mdcmd). It does require the existence of an existing smtp server whether on your LAN or the internet (or even on your unRAID box if you care to set it up). -kenshin

Thank you I actually didn't think of it until I saw you using it to talk to Yac (I just realized I spelled Yac with a K in the script. ) -kenshin

Yep, bummer When I was using a Windows File Server with a couple TB of data mozy worked like a charm. I knew this would happen when I moved to a nas; I may just end up dumping mozy if it is too hard to work around.

I completely agree that the no network share thing is a bummer. I still haven't given up on registering a network share as a fixed disk (probably because I already paid for the service, and have no choice) Acronis is a fine option (as you already know) and probably a good idea even if you had offsite storage as it supports versioning. -Kenshin

Attached is a script I created for smtp notification of unRAID status. As you can see, I used Joe L.'s excellent script as a base. Joe L.'s original script and instructions can be found here: http://lime-technology.com/forum/index.php?topic=140.msg814#msg814. I created two versions of the script for myself. One with emsg="" and the other with emsg="unRaid is OK" with the first called smtp_check_unraid_hourly.sh and the other called smtp_check_unraid_weekly.sh. I copied the hourly script to cron.hourly and the other script to cron.weekly. That way I will get a quick notification if something fails, but I won't get a ton of spam in my inbox (only weekly status reports). This script supports multiple "to" addresses (i.e. one for email, and one for text messages to your phone, etc.). The script also includes the option to include the output of /proc/mdcmd, which as Joe L. pointed out contains information about your unRAID server (a lot of information; I keep this enabled for both versions of the script that I use). You will need to use the nc (netcat) binary located at http://packages.slackware.it/package.php?q=current/nc-1.10-i386-1 (also attached below) as the behavior exhibited by the one Tom uploaded and the commands it accepts are very different. I attempted to make the script very easy to read. A summary, as well as instructions are included as inline comments. -Kenshin EDIT: Obviously you need an smtp server for this to work! The current implementation uses anonymous access, but can be modified to authenticate. #!/bin/bash # # Title: smtp_check_status.sh # # Summary: # The purpose of this script is to check the status of the unRAID # array by searching the /proc/mdcmd file for known bad states. # This script was originally created by Joe. L for use with Yak # and has been modified by kenshin (twelston) on 08-17-2007 to add smtp # functionality, and increase the information transmitted by the script # (i.e. adding ip, date, and the output of the /proc/mdcmd file if # elected by the user) # # If you have any questions or problems while using this script please # post them to the unRaid forum: # # http://lime-technology.com/forum/ # # DISCLAIMER: # Your use of this script is at your sole risk. This script is provided # "as -is", without any warranty # # Further, the authors of this script shall not be liable for any damages # you may sustain by using this information, whether direct, indirect, # special, incidental or consequential, even if they have been advised of # the possibility of such damages. # Define the following six values to setup this script # The name of your SMTP server sSmtpServer="samplehost" # Your domain name sDomain="www.sample.com" # The "from" email address sMailFrom="[email protected]" # The "to" mail address (The addressess must be separated by a space, a # single address requires no spaces) sRcptTo="[email protected] [email protected]" # The email subject sSubject="unRaid Status Notification" # Choose whether to include the contents of /proc/mdcmd in your status # notifications (Setting this value to anything but "True" is the same # as setting it to "False") bIncludeMdcmd="True" #PATH=$PATH:/boot/ # initialize the error message to an empty string if no hourly OK message is desired # like this: # emsg="" emsg="unRaid is OK" # request that status be updated echo "status" >/proc/mdcmd # now check the status and report as needed grep "mdState=STARTED" /proc/mdcmd >/dev/null 2>&1 if [ $? != 0 ] then emsg="unRaid array not started" fi egrep "=DISK_INVALID|=DISK_DSBL" /proc/mdcmd >/dev/null 2>&1 if [ $? = 0 ] then emsg="The unRaid array needs attention. One or more disks are disabled or invalid." fi # if an error message was set, broadcast it to all the machines # in the notify list in turn if [ "$emsg" != "" ] then # look up the ip address given the machine name ip_addr=`net lookup $sSmtpServer 2>/dev/null` if [ $? = 0 ] then # Build the echo string sEcho="ehlo $sDomain\r\nmail from:$sMailFrom\r\n" # Add each recipient to the RCPT list for i in $sRcptTo do sEcho+="RCPT TO:"$i"\r\n" done # Message header sEcho+="data\r\nFrom:$sMailFrom\r\nTo:" # Add each recipient to the message header for i in $sRcptTo do sEcho+=$i";" done sEcho+="\r\n" # Message Subject sEcho+="Subject:$sSubject\r\n" # Message Body (You can change this to look how you want. Just # to include \r\n at the end of each line.) sEcho+="This message is a status update for unRAID $HOSTNAME\r\n" sEcho+="-----------------------------------------------------------------\r\n" sEcho+="Server Name: $HOSTNAME\r\n" sEcho+="Server IP: `net lookup $HOSTNAME 2>/dev/null`\r\n" sEcho+="Status: $emsg\r\n" sEcho+="Date: " sEcho+=`date 2>/dev/null` sEcho+="\r\n" # Add the contents of /proc/mdcmd if elected by the user if [ $bIncludeMdcmd="True" ] then sEcho+="\r\n" sEcho+="Output of /proc/mdcmd:\r\n" sEcho+="-----------------------------------------------------------------\r\n" # Add <CRLF> to each line file=/proc/mdcmd x=0 while [ $x -lt $(wc -l <$file) ] do let x=x+1 sEcho+=`head -n $x $file | tail -n 1`"\r\n" done sEcho+="\r\n" fi # End the message sEcho+=".\r\n" sEcho+="QUIT\r\n" # Send the message we just built echo -e $sEcho|nc -i 1 -q 1 $ip_addr 25 # Use the following line for debug #echo -e $sEcho|nc -w 1 -q 2 -i 1 -vv $ip_addr 25 fi fi

@Tom: If you think it is necessary, can you move these posts to a separate thread called "Backup Solutions", or something similar? I thought it was pretty amazing as well the first time I saw it. Now that I have had time to use the service for around 6 months I've realized there are some drawbacks to choosing one of the cheaper "unlimited" services. The funny thing is that I didn't even realize there were cons until I started researching online. Pros: Reliable offsite storage Unlimited data storage (misleading; it is unlimited but you can only choose one client, and the software does not recognize non fixed disks) Unlimited data transfer (depending on the service you choose) Encrypts your files Using a key of your choice that only you know Or using an automatically generated key [*]The application they provide for data transfers supports bandwidth throttling (so you don't make the wife angry ) Cons: There is no ftp\rsync support You must use their application to encrypt and upload your files (windows only on my service) The encrypt process is incredibly resource intensive on my 2.4ghz Celeron There is a slider option for my service that allows you to select fast encryption or slow encryption which is supposed to alleviate this, but even on slow encryption it is still imho a hog [*]It's not a true archive, but instead more of a mirror of your current files If you change a file, the change will be uploaded to the server on your next sync (no versioning) If you delete a file, it is kept for 30 days (which is nice), but a true archive would keep it forever (how do you know you will catch it in 30 days?) To answer your questions directly. I am using Mozy (PCMag Editor's Choice). I have been using it for about 6 months now. I haven't tracked the uptime of the service, however it has never gone down that I know of. I really am pretty happy overall. I really really wish that they supported rsync, but I realize that I have to pay more with a different company to do that (with a business model centered around me paying per/GB). I'd rather spend less and deal with a proprietary windows app Carbonite seems to be very similar to Mozy, though they have an interesting approach to their user interface (shell extensions). You can find more info about online backup services in general here: http://www.onlinebackupreviews.com/ and here: http://www.pcmag.com/category2/0,1874,4798,00.asp I've known that I would be offloading my file server duties from a Windows Server to a dedicated NAS box of some sort for awhile now (I ended up choosing unraid of course ), so I have been researching a method to assign a network share as a fixed disk in Windows. Otherwise I won't be able to back up any of the data on my Unraid box unless it is mirrored to a local drive on the Windows box first (what I am trying to get away from!). The closest thing I have found so far is AOE or iSCSI; not exactly what I need (sarcasm). There are some threads at the daemon tools forum about creating a virtual device and mapping it to the share which would be perfect, however it doesn't look like it is ever going to be on the dev list. If you want the service you choose to support unraid (i.e. rsync or ftp or at the very least a network share from windows) you might want to look at some of the more expensive services. If you want to backup your vista workstations (or are willing to get your hands dirty figuring out how to register a network share as a fixed disk for unraid support) then the $5/month services might work just fine. Either way I would be interested in what you find/decide. -kenshin

Sounds like we have a somewhat similar setup. Regarding backing up your unraid box; I use an off site web storage service to back up the data on my file server. There are many good options out there. I pay about $5.00/month for unlimited storage. It's not free, but I don't have to worry about the fire sprinklers destroying my local data. I know of at least two companies who offer unlimited storage for that price (carbonite and mozy). I'm sure if you google it you can find more. Off site storage really is essential (imho) whether you keep discs/tapes in a safe deposit box, or use web storage. The only problem is that the cheap ones (read: the ones I use) require that you install their background "upload and encrypt" software on a windows machine. As I have a dedicated appserver running windows this is not a problem for me, however if you need ftp support or something similar it might be worth looking into some of the more expensive services. Also, I agree with Joe L. I would only add that Ghost and Acronis have similar functionality (Rescue CD for Restoring an image from a network share, etc.). @TheMaster, I promise I will not hijack your thread any further -kenshin

The digg post I linked to above suggested an interesting method of backup up in use files (like those on your system disk). That was why I added it. The poster recommended using VSS to abstract the data before copying it. Maybe creating a base image with Acronis/Ghost for all your machines would be best. You could then use rsync/robocopy to monitor/update a separate backup location. Boy, that functionality you were talking about with windows home server sure is starting to sound nice! On a side note, why do you need to backup all the data on your vista workstations? I use my file server (now an unraid server ) for storing all of my critical files (documents, pictures, etc.). That way I only have one machine that requires incremental backups. I changed the My Documents and All Documents links in the Windows XP registry on each workstation to point to my file server's network share, so that the users on my network don't even need training, they just use windows as normal, but every time they create/modify a file it is protected in realtime. An added benefit is that the All Documents folder now lives up to it's name. All the users on the network access the same network folder when they click on that link. -kenshin

They were very small (a few thousand KB's) unless I had added a large file to the disk. Then they would be the size of the new addition (give or take a couple hundred/thousand KB's). I just deleted my backup set yesterday, so I can't check the exact number unfortunately! I'm surprised that Acronis was not the same. A lot of people seem to like it (especially since it can create password protected archives unlike ghost).

I use Norton Ghost when I need incremental backups of the entire system disk. It runs in the background and after creating a base image, incrementally backs up any changes you make (modify/delete, etc.). If you need to revert to an old version you can, and it will track the versions for as long as you specify when you set everything up. You can also restore the entire disk (what ghost is originally famous for Wink) I had it set up to create a new base image the 1st of every month, and incremental backups every 12 hours (tried every 2 hours, but it slowed down the machine it was running on too much). I liked the fact that if I changed a file on accident (or deleted it) I could revert to an old version (If I caught it before the month was over) Acronis True Image does the same thing, some people like it better. I haven't tried it yet. The downside to both of these utilities, is that it would be difficult to restore the system image of one machine to a second machine. As with all system images, unless the hardware is the same on both the source and target you need to prepare the source system (sysprep, etc.) for the move. -kenshin

I know that this doesn't answer your question, but there are alternatives to the built in windows vista backup utility. You might already be familiar with both of these (free) options: rsync is popular (works with windows/incremental sync) and is built into unraid http://www.enterprisenetworkingplanet.com/netos/article.php/10951_1573881_1 http://digg.com/software/Rsync_client_for_windows I tested unraids implementation of rsync. For it to work you need to a create a file called rsyncd.conf in a nonvolatile location (i.e. somewhere under flash) example confs can be found at http://samba.anu.edu.au/ftp/rsync/rsyncd.conf.html. I used the following conf file: [disk1] path = /mnt/disk1 comment = disk1 export [disk2] path = /mnt/disk2 comment = disk2 export You will then need to add the following line to your go script (assuming you created your conf file in \\tower\flash\config): rsync --daemon --config=/boot/config/rsyncd.conf [*]robocopy is included with windows vista (you already have it!) and can be run with a startup script to monitor/sync a folder with a network share http://en.wikipedia.org/wiki/Robocopy There is a nice gui for robocopy by microsoft technet at http://www.microsoft.com/technet/technetmag/issues/2006/11/UtilitySpotlight/ -kenshin

I was pretty sure that NTFS used to be in there as a "read-only" filesystem driver, but I just looked at my current 4.0 final server. It's not in there... Tom, is my memory failing me? Joe L. [pre] root@Tower:/proc# cat filesystems nodev sysfs nodev rootfs nodev bdev nodev proc nodev debugfs nodev sockfs nodev usbfs nodev pipefs nodev futexfs nodev tmpfs nodev inotifyfs nodev eventpollfs nodev devpts reiserfs ext2 nodev ramfs msdos vfat iso9660 nodev smbfs nodev mqueue [/pre] I ran into the same issue on unraid 4.1 however I discovered that the kernel module for ntfs support IS included. It is just not loaded by default. I loaded it temporarily using the following command: modprobe ntfs and the response to cat /proc/filesystems: root@tower:~# cat /proc/filesystems nodev sysfs nodev rootfs nodev bdev nodev proc nodev debugfs nodev sockfs nodev usbfs nodev pipefs nodev anon_inodefs nodev futexfs nodev tmpfs nodev inotifyfs nodev devpts reiserfs ext2 nodev ramfs msdos vfat iso9660 nodev smbfs nodev mqueue ntfs I hope this helps someone else trying to copy data from an ntfs disk. -kenshin