mazma

Has anyone have any suggestions for: Super Micro server board / X10SL7-F-O? Xeon chip / Xeon E3-1241 v3? Ram Processor cooling SSD 500gb Power - my current PSU is a CORSAIR HX Series HX750 750W ATX12V 2.3 / Gold - guessing this is still fine.

Current Workflow goes: SD > MacBok Pro (its pretty close to the 95Mb/s). I have a Lexar Pro USB 3.0 reader and its super fast. Getting data off the cards isn't an issue. Final Edits and RAW's are then transferred from laptop to external drive. I recently setup CrashPlan (after MUCH messing about) to back up the external drive over wi-fi to unRaid. unRaid will then (soon enough) back up to Crash Plan central. The server isn't in an easy accessible location (long story) so its to much hassle to always go to it and dump final edits to it, hence why I have an external drive for when I need to restore and re-export something for a client. Backing the external drive up via Crashplan over wired ethernet (its a fire wire 800 drive) I get anywhere from 14 to 65 Mb/s. It seems to hang around the low 20's for a while and eventually it might make it up to 65 Mb's. The cache drive does indeed seem central to the issues I'm having. Right now I'm leaning towards upgrading to a super micro board with an Xeon + SSD cache, or cache pool. At some point the WD EARS drives on the add-on controller boards are going to need replacing and anything I replacing them with I won't see the performance from them. Also, I can't be spending all my time messing with this stuff, I need it done so I can go make $$!! Seems if I do it now I'll be set for some time. This current setup has done well and its been running since 2010 I think so can't complain.

Don't want to compress anything, want as much info as poss. In the D810 I mainly use a 64Gb SD card (95Mbs), in the D4 they are 16 or 32 Gb CD pro cards.

00b5 Up until now all my work images etc have all been kept on my laptop and external drives. I wanted to get smarter with my workflow so I decided to utilize unRaid more by having an archive of the data on unRaid which was then backed up to the cloud via CrashPlan. Outside of this unRaid was just used as a media streamer with Plex, Sickbeard etc etc. One of the reasons I'd stayed away from it as a file server was because it was to slow, i.e. slow browsing, copying data from the array. Up until this week I never used mover, but with my new plan in mind I had a bunch of stuff that needed archiving so I could free up external drives. Its only this week I've had mover running during the day as I need to the space on the cache drive to do the next batch, certainly not a normal usage scenario. Right now I'm copying a 350gb batch, its been copying to the cache drive for well over 8 hours and its got 100gb to go. Parity check was done last week. I think its somewhere around 55/75 Mbs. tdallen I agree - until yesterday I hadn't considered what the current power of my current cpu was, but luckily with people like yourself and garycase around I have a much better understanding Right now I'm doing a timelapse move and each clip is 5-10 seconds long, each clip will contain 150-300 images at 75Mb per image. All of those RAW's then have to be converted into TIFF's which are 50Mb each. Eats space real quick.

Thanks garycase for the insight and suggestions, truly helpful and has given me something to think about.

The browsing symptoms exist with or without mover, but not as bad obviously. I rarely use mover and have never changed the default schedule, it just so happens that I have over 1Tb of data to move into the array and I've been trying to get it on there quickly all week so I could free up the external drive that data currently resides on. Ugh. I'm pretty sure that the 3 HGST's in there are already on the MB's sata's as they replaced previous 2TB Ears that were on those controllers. The other thing that I'd like is to have a second box where I can quickly offload RAW images, photoshop files and large Pro Res videos from my laptop which would then replicate itself over to the main NAS over night. Sure, I could dump them straight onto the current unRaid box but its current location would make that a pain and it would take to long to restore some of those files back to my laptop when needed. I saw a BT Sync Docker which would do the replication, but I'm not sure unRaid is the right platform for this second box. I was literally just thinking of a 2 drive box that was mirrored but super quick. Right now I could achieve this with the Synology 1815+ and one of the their 2 drive nas's.

Thanks so much for all the replies. All my apps etc are stored on the cache, if I mount the count in an external drive I presume the contents are visible? I'm not using the MB's NIC, instead there is a PCI NIC card installed. Would it be possible to combine the two for link aggregation? For file browsing, all I was looking at was my movies folder, so just folders with 1 file inside each. When I left it Finder (Windows Explorer) had the beach ball of death on it. Went out for an hour or so and came back and it was fine again. Could browse just fine. At the time a single movie was streaming (which I stopped and it didn't make a difference) and mover was moving a large amount of small files into the array. When I came back none of those operations were running. To avoid the add-in controllers and just use the MB's sata ports I'd have to condense 18.2Tb's of data down to 4 disks (2 for parity and cache) which would be expensive and not leave me any options after I max out that storage.

Currently its a Intel Core 2 Duo Quad Q9650 3.00GHz. Right now its idling around 20% use whilst mover is running. Streaming a single movie over wifi to Xbox 1 utilization is 50-75%. Playing a second movie to an ATV over wired ethernet the average utilization doesn't change to much but it has higher peaks (85% or so). The average seems to be around the high 50%-60% mark. Memory usage is at 27%. With all the drives spun up browsing files in my movies folder it takes on 2-3 seconds to view the contents of each folder. Sitting here randomly selecting folders its now got to a point where 20+ secs have elapsed and its still thinking about showing that folders contents. Only a single movie is playing and utilization is low.

Thanks SO much for the reply garycase! The remaining drives are hooked up to these: 3x Adaptec RAID 1220SA 2255900-R SATAII PCI Express x1 http://www.newegg.com/Product/Product.aspx?Item=N82E16816103104 The network is Gigabit. Most drives are over 85% full - some around 98% etc. Spin up groups is enabled but I've never set any. The drives power down after 15 mins. I have a spare WD WD1001FALS 1TB lying around - use this for cache instead?

Currently my unRaid setup is: Gigabyte EP43-DS3L Socket 775 http://www.gigabyte.com/products/product-page.aspx?pid=2847#ov Core 2 Duo Quad (2.4 Ghz I think, not sure) 6Gb ram DDR2 3x HGST HDN724040ALE640 4Tb 7x WD WD20EARS-00MVWB0 2Tb 1x Seagate Barracuda ES 750Gb Cache No hot swap bays ReiserFS file system unRaid 6.1.0 It runs Plex, SabnzBD, Couch, Sickbed, streams music for Sonos and file storage. Overall the box has been solid for 5+ years but I do have some gripes. Its streams Plex and so forth just fine but starts getting laggy when file operations are ongoing at the same time as video streams are bringing played. Copying large amounts of data to the cache drive takes to long and browsing files via Finder (Mac) over AFP or SMB is lame. The motherboard used the slower SATA 3Gb/s connectors. So, would I notice a significant difference in performance, particularly read/write if I upgraded to one of the popular Supermicro server boards with a Xeon processor and an SSD for cache? Would changing to the new XFS file system make a difference to? unRaid has served me well but as a busy photographer I'm finding it harder and harder to have time to look after the box and browse the forums (which have been excellent). I can't help looking at Synologys website (love the idea of having 1 small NAS where I dump RAW images which then replicates to the larger NAS on its own) Thanks in advance.

No change - so confused.

No. It looks like the backup is staying on my local drive, not sure where. In the guide above it mentions ui.properties which is in /conf. On the mac, that file isn't there, but there is a ui_(yourusername).properties in the parent folder /Library/Application Support/Crash Plan. This file doesn't have the same info as mentioned in the guide - I've pasted the info from the docker ui.properties into the the one my mac but then the app hangs.

Here you go - As far as I can tell the docker size isn't changing and looking at the unRaid gui there are writes to the cache drive. There is a CP folder in the share which I can only see via terminal.

Thanks to forum user Leifgg I finally have CrashPlan working, well of sorts. My laptop is backing up to unRaid and the client says its backed up 6gb, but for the life of me I can't find the data on unRaid. I created a share called Archive and flagged it to use the cache drive. The crash plan client is processing and transferring files but they aren't on the cache drive nor in the user share. The security for the share is public and I can write to it. Is the data encrypted so I can't see it?

This worked: CORD http://cord.sf.net