dstoe

Hi, I have not been here for a while....6 years 😁,....but I am now looking into building a big file server for larger video files. During the pandemic we have built a video studio in our company and I need a place to store our productions. As I still have an older unraid setup in the garage, I was thinking, maybe I could ressurect it with new HDDs and SSD cache. Here is the old setup: Supermicro MB775 I-3210 X7SBE 2x Supermicro Cont SATA2 AOC-SAT2-MV8 PCI-X Intel Core 2 Duo E5200 4gb ddr2 800 Corsair TX750W Norco 4020 Would it be worth using the old hardware or at least the case? As the data I produce in a shooting day is in the range between 50GB and 2TB, is unraid quick enough for me, if I want to overnight backup? Thanks in advance for your insights! Dominik

Thanks, I will try it now. There is a lot to do

thanks, seems reasonable to change the filesystem. I will reread this thread.

is it worth it to change the file system?

Hi, I recently revived a very old version (4.something) of my unraid to the new age (6.1.6). My server has numerous old hdds, with 500GB each and reisrfs. Now I have some 3TB drives, that I would like use instead. If I understood correctly, just exchanging one drive at a time would bring me reiserfs 3TB drives(after rebuild). If I expand my system with a new 3TB xfs drive, I need to copy the data. What happens with the user shares? e.g disk 1 is 500GB and has partial files of 4 user shares If I copy all that to a new 3TB drive, then stop the array, take out the old 500GB, restart the array. Would I need to rebuild parity for everything? Would the user shares be intact? Thanks a lot for your help! Dominik

YES! Very nice. Thanks for this one!

thanks, i will checkout the powerdown script. For now, I killed the remaining two mover processes, stopped the array and rebooted. All disks showed up fine. Then I shutdown and added 5 more disks.And now i can leave office, knowing the server does something useful overnight.

I tried to stop the array, while mover was pushing files from the cache drive. Unraid seems to have stopped the other drives which now all show up as unformatted. I searched a bit around the forum and found hints, that this is some sort of bug. The shutdown button does not show up, as the array could not be stopped properly. Important learning from the search : I make sure not to push the format button! Should i now wait for the mover to finish, before trying to stop the array again? Should i somehow try to kill the mover app? If so, how would I do that? I actually wanted to shutdown, in order add some more disks to the array. Here the last part of the syslog. I started the mover manually. Mar 26 15:19:07 Tower logger: mover started Mar 26 15:19:14 Tower logger: `./Projekte/Vademecum Minze Phantom RAW/Nicole.small.mov' -> `/mnt/user0/./Projekte/Vademecum Minze Phantom RAW/Nicole.small.mov' Mar 26 15:19:14 Tower logger: removed `./Projekte/Vademecum Minze Phantom RAW/Nicole.small.mov' Mar 26 15:36:11 Tower emhttp: shcmd (83): /usr/sbin/hdparm -y /dev/sde >/dev/null Mar 26 15:53:54 Tower shfs(1): duplicate object: /mnt/disk4/Projekte/Vademecum Minze Phantom RAW/f25.cine Mar 26 15:57:08 Tower shfs(1): duplicate object: /mnt/disk4/Projekte/Vademecum Minze Phantom RAW/f25.cine Mar 26 15:58:08 Tower last message repeated 2 times Mar 26 16:10:11 Tower emhttp: shcmd (84): /usr/sbin/hdparm -y /dev/sdd >/dev/null Mar 26 16:11:12 Tower emhttp: shcmd (85): /usr/sbin/hdparm -y /dev/sdb >/dev/null Mar 26 16:42:14 Tower emhttp: shcmd (86): /etc/rc.d/rc.samba stop >/dev/null Mar 26 16:42:14 Tower emhttp: shcmd (87): /etc/rc.d/rc.nfsd stop >/dev/null Mar 26 16:42:15 Tower emhttp: Spinning up all drives... Mar 26 16:42:15 Tower emhttp: shcmd (88): sync Mar 26 16:42:57 Tower emhttp: shcmd (89): umount /mnt/user Mar 26 16:42:57 Tower emhttp: shcmd (90): rmdir /mnt/user Mar 26 16:42:57 Tower emhttp: shcmd (91): umount /mnt/user0 Mar 26 16:42:57 Tower emhttp: shcmd: shcmd (91): exit status: 1 Mar 26 16:42:57 Tower emhttp: shcmd (92): rmdir /mnt/user0 Mar 26 16:42:57 Tower emhttp: shcmd: shcmd (92): exit status: 1 Mar 26 16:42:57 Tower emhttp: shcmd (93): umount /mnt/disk1 Mar 26 16:42:57 Tower emhttp: shcmd (93): umount /mnt/disk2 Mar 26 16:42:57 Tower emhttp: shcmd (93): umount /mnt/disk3 Mar 26 16:42:57 Tower emhttp: shcmd (93): umount /mnt/disk4 Mar 26 16:42:57 Tower emhttp: shcmd (93): umount /mnt/cache Mar 26 16:42:57 Tower emhttp: shcmd: shcmd (93): exit status: 1 Mar 26 16:42:57 Tower emhttp: shcmd (94): rmdir /mnt/disk4 Mar 26 16:42:57 Tower emhttp: shcmd: shcmd (94): exit status: 1 Mar 26 16:42:57 Tower emhttp: shcmd: shcmd (93): exit status: 1 Mar 26 16:42:57 Tower emhttp: shcmd (94): rmdir /mnt/cache Mar 26 16:42:57 Tower emhttp: shcmd: shcmd (94): exit status: 1 Mar 26 16:42:57 Tower emhttp: shcmd (94): rmdir /mnt/disk2 Mar 26 16:42:57 Tower emhttp: shcmd (94): rmdir /mnt/disk3 Mar 26 16:42:57 Tower emhttp: shcmd (94): rmdir /mnt/disk1 Mar 26 16:42:57 Tower kernel: mdcmd (1188): stop Mar 26 16:42:57 Tower kernel: md: 2 devices still in use. Mar 26 16:42:58 Tower emhttp: shcmd (93): cp /etc/exports- /etc/exports Mar 26 16:42:58 Tower emhttp: shcmd (94): mkdir -m 700 /mnt/user Mar 26 16:42:58 Tower emhttp: shcmd (95): /usr/local/sbin/shfs /mnt/user 1 2000000 Mar 26 16:42:58 Tower emhttp: shcmd (96): mkdir -m 700 /mnt/user0 Mar 26 16:42:58 Tower emhttp: shcmd: shcmd (96): exit status: 1 Mar 26 16:42:58 Tower emhttp: shcmd (97): /usr/local/sbin/shfs /mnt/user0 0 Mar 26 16:42:58 Tower emhttp: shcmd: shcmd (97): exit status: 1 Mar 26 16:42:59 Tower emhttp: shcmd (98): /etc/rc.d/rc.samba start >/dev/null Mar 26 16:42:59 Tower emhttp: shcmd (99): /etc/rc.d/rc.nfsd start >/dev/null Mar 26 16:43:23 Tower emhttp: shcmd (100): /etc/rc.d/rc.samba stop >/dev/null Mar 26 16:43:23 Tower emhttp: shcmd (101): /etc/rc.d/rc.nfsd stop >/dev/null Mar 26 16:43:24 Tower emhttp: Spinning up all drives... Mar 26 16:43:24 Tower emhttp: shcmd (102): sync Mar 26 16:43:41 Tower emhttp: shcmd (103): umount /mnt/user Mar 26 16:43:41 Tower emhttp: shcmd (104): rmdir /mnt/user Mar 26 16:43:41 Tower emhttp: shcmd (105): umount /mnt/user0 Mar 26 16:43:41 Tower emhttp: shcmd: shcmd (105): exit status: 1 Mar 26 16:43:41 Tower emhttp: shcmd (106): rmdir /mnt/user0 Mar 26 16:43:41 Tower emhttp: shcmd: shcmd (106): exit status: 1 Mar 26 16:43:41 Tower emhttp: shcmd (107): umount /mnt/disk4 Mar 26 16:43:41 Tower emhttp: shcmd (107): umount /mnt/cache Mar 26 16:43:41 Tower emhttp: shcmd: shcmd (107): exit status: 1 Mar 26 16:43:41 Tower emhttp: shcmd (108): rmdir /mnt/disk4 Mar 26 16:43:41 Tower emhttp: shcmd: shcmd (107): exit status: 1 Mar 26 16:43:41 Tower emhttp: shcmd (108): rmdir /mnt/cache Mar 26 16:43:41 Tower emhttp: shcmd: shcmd (108): exit status: 1 Mar 26 16:43:41 Tower emhttp: shcmd: shcmd (108): exit status: 1 Mar 26 16:43:41 Tower kernel: mdcmd (1191): stop Mar 26 16:43:41 Tower kernel: md: 2 devices still in use. Mar 26 16:43:42 Tower emhttp: shcmd (107): cp /etc/exports- /etc/exports Mar 26 16:43:42 Tower emhttp: shcmd (108): mkdir -m 700 /mnt/user Mar 26 16:43:42 Tower emhttp: shcmd (109): /usr/local/sbin/shfs /mnt/user 1 2000000 Mar 26 16:43:42 Tower emhttp: shcmd (110): mkdir -m 700 /mnt/user0 Mar 26 16:43:42 Tower emhttp: shcmd: shcmd (110): exit status: 1 Mar 26 16:43:42 Tower emhttp: shcmd (111): /usr/local/sbin/shfs /mnt/user0 0 Mar 26 16:43:42 Tower emhttp: shcmd: shcmd (111): exit status: 1 Mar 26 16:43:43 Tower emhttp: shcmd (112): /etc/rc.d/rc.samba start >/dev/null Mar 26 16:43:43 Tower emhttp: shcmd (113): /etc/rc.d/rc.nfsd start >/dev/null Mar 26 16:59:13 Tower emhttp: shcmd (114): /usr/sbin/hdparm -y /dev/sdb >/dev/null Mar 26 16:59:13 Tower emhttp: shcmd (115): /usr/sbin/hdparm -y /dev/sdd >/dev/null Mar 26 16:59:14 Tower emhttp: shcmd (116): /usr/sbin/hdparm -y /dev/sde >/dev/null regards Dominik

Ok, nevermind. I took a different approach and setup a separate XP system in the office. On that one I just run Total Commander, which so far works flawless. regards Dominik

Ok, thanks for the input. Unmenu starts without me doing anything. The Go Script line works nice (remember I am a linux newb). I also installed a cache disk. This will speedup things a bit. But there is still something I can not figure out. Lets say I mount a disk full of data, that I want to copy to the array. Now I want to select some, but not all of the data on the disk to copy that to the array. How can I batch copy several files with midnight commander? If I select all, only files, but no folders are marked. I would really like a tool like total commander on the Unraid machine. Any ideas? regards Dominik

To get unMenu to boot on startup you need to add a line to your go script that reads: /boot/unmenu/uu To speed up transfers to the system you could also disable the parity drive. That will allow you to transfer the files and then you can reassign the parity drive. Ok, but how do I disable the parity drive?

a little update. I finally received all the bits and pieces for my office system. Getting the mainboard locally was taking more time, than shipping the Norco 4020 from the US to germany. Anyway, I build the system consisting of this hardware: Supermicro MB775 I-3210 X7SBE 2x Supermicro Cont SATA2 AOC-SAT2-MV8 PCI-X Intel Core 2 Duo E5200 4gb ddr2 800 Corsair TX750W Norco 4020 Running Unraid 4.4.2 For the start I use a 1,5TB Seagate as parity drive and 3x 500G Samsungs. While filling up, I will add more disks, but I wanted to try out the system first and get used to it. So far the only software addition has been Unmenu. Although I have not figured out how to start it automatically on boot. Yesterday I copied some 400GB to the array and right now I do a parity check. Unmenu shows 70,000KB/s as speed after the first 15%. Some observations: Had to change the NTP server, as it would not show the correct time. The Norco is far too loud. I would have to swap the divider plate with a custom one and go for slow 120mm fans, if I wanted a similar system at home. Copying to the array is slow, I will think about a cache drive. Unmenu is very useful and should be a part of the original package. I want to thank everybody who has given me advice. Thanks! regards Dominik

Does anybody know of a mainboard with 3 PCI-E x4 slots? regards Dominik

Thanks, that did it. Sometimes it is so easy

I just received my Norco 4020 case and I can not get the lid of. Has anybody, who knows this case, got an idea? Thanks Dominik

For my office setup I already decided on the Norco. In fact, I am waiting for the shipment from the US. Although I will keep this case in mind, when it comes to my media server. As I only collect HD stuff, there unfortunately is not a one key solution. I need different software to playback my stuff. All my BD rips are easily played with either Arcsoft TMT or PowerDVD, but I also have older TV-Caps, which I use directshow players for.

"just better cooling" was their answer. I did not want to wait and have ordered in the US. Norcotek ships their Norco 4020 for 165$ to germany.

But the xcase is no longer available. I contacted them and asked about it. Meanwhile I have also two mails out asking norcotek directly and an ebay seller on shipping to germany. UPDATE: I received an answer from xcase: the 420 will return.We are making a few changes I expect to see it back in late March

Again, let me thank you all for your help. I have seen quite a few forums, but none so far has treated newbies with so much help. None of you has pushed me to the search function or RTFM. This gives me the comfort to try out unRaid, knowing that I will find help when I need it. This is really appreciated. Back on topic My mediaserver plans are really only the ultimate goal, I have time for that plan. And thinking about the size of my collection, I will really need big disks in the long run. There is no sense in grouping some 40 disks into one private system. In my office I also have multiple HDDs laying around with lots of video data, that so far are not properly backed up. This is something I urgently need to change. My thought was, to setup an unRaid system for my office, using up some of my smaller 500GB disks from home and therefore gain some more 1TB disks from office. That way i have a setup to get comfortable with unRaid and also test some hardware for the noise and heat levels. So, I will definitely buy the 2-pack license to start with. Now I thought the whole morning about what case and HDD cage configuration I should finally go for. A 12-bay case with 4x 5in3 backplanes costs a fortune. On the other hand, getting a Norco 4020 in Europe seems difficult, as they have no distributor over here. Still importing one from the states is a lot cheaper than 4x 5in3 backplanes alone. So I decided to go for the Norco4020 in the office. If I can get it reasonably quiet, I could then build a similar system for my home media server. By that time the 2TB disks have hopefully become available in europe. I think I really should start my home media server with at least 2x 2TB disks. Two questions I still have: We use Macs at the office. Are there any problems with Macs and unRaid? The disks in unRaid have some sort of linux file system. Is there a files size limit for these, as I have some individual files of about 55GB size? Again, thanks for your patience with me! I will keep you posted. Cheers Dominik

Hmm, this is really hard to judge for me. Building a system with up to 16 disks and keeping it quiet seems a lot easier, than trying to get everything in one system. I am at over 20TB now, but this is not the end, so I might not catch up at all. Sounds plausible to me, I will think about 2 seperate systems. I was also consiering the Antec twelve hundred, as it is very cheap compared to the Lian Li's. What set me down a bit is that it seems to be lit like a christmas tree. I would need it to be dark. Would I need to exchange all fans? Those 5in3s have 80mm fans. How would you rate their noise level? If you tape up the case, you are trying to force the incoming air through the 5in3 front, right? Is that enough cooling for the drives? Almost all my HDDs are Samsung F1s with 7200RPM. I always thought having a fan blowing actively on the disk is more efficient compared to a fan pulling air over a disk.

BTW, this is the drawer, I was talking about:

Thanks again for all the input! Ok, you asked for it. 26x 500GB 4x 750GB 8x 1000GB + lots of DVD-Rs from the time before I chose HDDs for storage. I have another 2x 1000 and one 1,5TB Seagate waiting to be filled, the latter finally has a new firmware. I still do not know if they are to trust. That sounds ok. I read this thread before http://lime-technology.com/forum/index.php?topic=2179.0. "Slocate" was suggested there, but I hardly understood how to use that. Case and build: I was thinking of a Norco 4020, after reading quite a bit about it, but size and noise led me to another idea. Currently I am more thinking about a big tower, that can be well ventilated using at least 120mm fans. The I thought, even if the current limit of unRaid is 16 drives, there are hints here, this might change, so my build needs a little overhead. I read a lot of suggestions on this forum and came up with a rough idea: Lian Li PC-A77B CASE 12x 5,25 bays plus a cage for 3 HDDs in the top back I could use 4 Lian Li EX-H34B to get well cooled and probably quiet 16 drives using the externals or I could use 4 5in3s to get 20 crowded and probably hot quick trays Supermicro MB775 I-3210 X7SBE This board sounded nice, as it has 2 PCI-X and 6 onboard Satas. Combined with 2x Supermicro Cont SATA2 AOC-SAT2-MV8 PCI-X I would reach 22ports. A small CPU like a E5200 PLUS 4 GB DDR2 RAM Budgetwise I am unsure. The basic hardware like above gets me to something like 1200€ excluding hdds. With 5in3s even more. I guess, before I start with this project, I should probably wait for the WD 2TB hdds to come out. Otherwise, I will definitely have to prioritize my collection and keep the drawer solution for the not so relevant films. While waiting fro the 2 TB units, I could build a test setup with smaller drives. As I need a small file server for my business as well, I could use that to start with. Guess, the 2-pack license comes in handy there. Dominik

Thanks ReneV! What recently-available components do you think of? Or is this generally speaking for modern CPUs that clock down efficiently when not in use and "green" hard drives? Concerning the feature of file-system content remainig cached in RAM, is this built into unRaid or externally? Because I read one thread mentioning a seperate program and this seemed not too easy. Cheers Dominik

Hi, I got here via the AVS forum and read quite a bit on this unraid forum. But I have to admit that I am a linux newb, so a lot of the tech talk remains a mystery to me. Still I have the feling, Unraid could be the solution to my needs. I hope some of you could give me a quick evaluation. I am looking for a media server for my home theater. Currently I have a Vista HTPC playing 90% Blu-Ray rips. That means either mounted isos or folders with rips. Playback software are mostly Arcsoft TotalMediaTheatre or Powerd DVD 8. But my collection also has HD TV Caps as .ts and some .mkvs. For those I use directshow players. My collection is on sata hdds and they sit in a drawer. I use a database (DVDProfiler) to find the movies, then pick the numbered disk and use a sata docking station (like this one http://www.newegg.com/Product/Product.aspx?Item=N82E16817153066. I currently estimate +20TB Now to my questions: If i setup an Unraid system and use the share level system to put all movies in a share named e.g. "Blu-rays", would I see a huge folder on my Vista machine with all movies in there as if it was one gigantic disk? If each Blu-ray folder is limited to just one physical disk (not spread over 2 disks), would all the other disks kept spundown if I stream just the one film? I read that one should not copy files through user shares, how do i easily transfer files from the Vista machine to the unraid system? I use Total Commander on the Vista HTPC, could that be easily used? I would only want to build a server, if I can build it to be quiet and energy efficient. Power is expensive over here, so i would need unused disks to stay spundown. Is unraid a solution for me? Would you think this whole thing is manageable without linux skills? I build PCs and setup regular systems without too much hassle. Thanks alot for your help! Dominik