rmp5s
-
Posts
348 -
Joined
-
Last visited
Content Type
Profiles
Forums
Downloads
Store
Gallery
Bug Reports
Documentation
Landing
Posts posted by rmp5s
-
-
On 12/6/2019 at 10:56 PM, trurl said:
Have you been doing all your testing with a parity check underway? And obviously your parity needs correcting.
Why did you have an unclean shutdown? You must not power down or reboot with the array started. Only shutdown or reboot from the webUI so Unraid can stop the array cleanly.
No, not all testing is with a parity check underway.
My parity needs correcting?
I haven't had an unclean shutdown. Not that I know of. The thing is in a datacenter...it should never be shutting down. Ever.
-
On 12/5/2019 at 10:36 AM, johnnie.black said:
That's far from normal, you should get 40/50MB/s with default writing mode and line speed with turbo write, post the diagnostics, might provide some clues.
Good to hear something isn't right. Because, if this WAS normal, I don't know if I'd be able to continue to use unRAID. It's SO slow.
Diagnostics attached. Thanks so much for the assistance. -
11 minutes ago, testdasi said:
That description of "brutally slow" means nothing. What is the actual transfer speed?
From my own experience, only Linus-level stuff can make video rendering reach disk limit.
Even 125MB/s (network-limited speed) is 1 gigabit / s <-- that is a ridiculous bit rate.
"Brutally slow" as in, if I'm seeing 4.5-5 megs, I'm stoked.
-TightVNCViewer.thumb.png.c3f2115d59f8b0618dc75b9b595ffa17.png)
This is transferring a file from an unRAID share to the desktop of a VM. Transferring from my laptop to a share is lucky to break a meg.
-
On 12/4/2019 at 1:03 AM, johnnie.black said:
Array drives are always limited by that single device speed for reads and the slowest device in the array for writes (using turbo write), you can add SSDs to the array but only reads will be fast, assuming parity is a hard drive, also array devices can't be trimmed for now, so write performance might degrade with use.
Ah, ok. Doesn't sound like slapping SSDs in would help much. That sucks.
Oh well. Thanks!
-
And, by "brutally slow", I mean EVERYTHING is drive-speed limited. The CPUs never even really do anything. Drive speed is by FAR the bottleneck no matter what I try to do on the thing. I noticed this when I was trying to render a video in my "Adobe render machine VM" and it was taking FOR. EV. ER. (Cue Sandlot clip.)
I'd really like to use my server to render videos as that's what I actually got the thing for. lol I don't use it for that though because my weak ass hyper-threaded dual core i7 powered laptop will crank out a video in LITERALLY a tenth of the time...
-
My array is...BRUTALLY...slow and I've been trying to think of a way to speed things up beyond adding a cache drive, which I already have.
I was thinking slapping a fast(ish) SATA SSD in with all my slow spinners wouldn't do anything but...I dunno...Will it?
I was watching this:
...and it made me wonder...maybe unRAID CAN utilize faster storage in the array to speed things along.
So...what's the official verdict? Toss a few Samsung SSDs in with the spinners or no?
-
5 hours ago, John_M said:
There are three components to running your rendering VM (the system files, the VM boot disk and the data files) and at the moment you are running them all from the array. If you set your SSD as a cache you can move all three of those components onto it. The system files are in the system share, the VM boot disk is in the domains share. Once you've done that you can choose where you locate the input/output files for your renders. For example, there might be enough space on the VM's vdisk C : drive, or you might want to add a D : drive to accommodate them. (I had to put a space before the colons otherwise a stupid smiley is substituted - 😄 😧 )
Got ya. I'll give it a shot this weekend. Thanks!
-
17 minutes ago, John_M said:
No wonder the performance is atrocious. Install your SSD in your server and when your start it up allocate it as the cache disk. Then you can change the system and domains shares to cache:prefer (that's the default, anyway) and run the mover (make sure the VM service is temporarily disabled first).
I have an NVMe SSD in the server that was intended to be the cache drive but I'm having trouble getting the BIOS to recognize it as it's installed via PCIe.
The extra SSD I have is SATA. Would I be able to assign it to the VM somehow?
-
Just now, John_M said:
What do you mean by that? Do you mean that the VM's vdisk is on the array? If not, where is it? Or do you mean that the source and destination files for the render are on the array?
Yes, the vdisk and the source files are on the array. I'd like to dedicate an SSD to the VM so the VM can run off of it and I could put the source files on there for rendering. I'm hoping that would make the thing render as fast as it should.
Maybe I could just install the SSD and put the source files on it...maybe that would help. How would I "attach" that disk to the VM? -
I have a W10 VM that I use (try to use, anyway...) to render videos in Adobe. It's just on the array and the disk speeds are SO...INCREDIBLY...SLOW...that it takes an unbelievably long time to render. I stopped a render yesterday after over 2 hours because it was BARELY making progress...my flaccid dual core laptop did the entire render in that same amount of time. At the rate the server was going, it would seriously have taken 10 hours?...maybe 12? I don't even know. It's INCREDIBLY slow and, when I look at resource manager, I notice the disk access is pegged. Disk speeds seem to be the culprit.
So...I have a spare Samsung 860 Evo laying around. This got me thinking, how could I install it and dedicate it to the VM? What I'm wondering is, is it possible to assign that disk ONLY to that VM? Maybe using "unassigned devices"? Also, would it be possible to move the VM onto the SSD after I install it or will I have to create a new VM? No big deal if I have to reroll a new VM.
Thank you!!
-
24 minutes ago, itimpi said:
The default location for vdisks is specified under Settings -> VM Manager, but you can specify any location for a vdisk when setting up a VM.
Cool cool. Thanks!
-
On 10/4/2019 at 9:28 AM, itimpi said:
If you are running the VM from a vdisk then it can share the use of the cache (assuming the vdisk is smaller than the size of the cache).
Yea, I am running vdisks on all the VMs. Do they just use the cache disk automatically or do I have to change some setting?
-
13 minutes ago, itimpi said:
It WILL stop Unraid placing NEW files on the cache that are being written to a User Share.
It will NOT stop you manually placing files there or an application (e.g. a docker container) that is bypassing the share system from placing files on the cache.
The Mover application only takes action on a share whose Use Cache setting is set to Yes (cache to array or Prefer (array to cache)
Ah. Got ya. Makes sense.
10 minutes ago, itimpi said:You do not normally want VM files to be on the main array as the limited write speed to the array can badly affect performance of a VM. If not using the cache for such files then an Unassigned Device is typically used instead.
I'm not doing anything super intensive on most of my VMs, but there is one VM that I could use the performance. Maybe clean the cache off and just assign it to that VM?
-
1 minute ago, jonathanm said:
Only if you write new files to the user share. Files can be written directly to the cache drive by several different methods. What type of files are sitting on the cache drive that you think should have been written to the array?
I don't know specifically what's on the cache drive and that doesn't really matter to me. The issue I'm having, and the reason I'm needing it to clear off, is it's filling up and making my VMs do strange things. So, I suppose files related to VMs are what I don't want on the cache drive.
-
17 minutes ago, itimpi said:
You need to have the Use Cache setting set to ‘yes’ for any share where you want mover to move files from cache to array. You should read the help for this setting built into the GUI to understand how the options for this setting affects where new files are placed and what action (if any) mover takes.
Very interesting. I would think telling shares to not use the cache drive would keep data off of the cache drive. I guess not. I'll read up.
I set the shares that had data on the cache drive to "yes" and the mover says it's running now. So, I'll give it some time and see what happens.
Thank you!
-
My 256GB cache drive only has 11GB of space free and keeps filling up. I hit the "Move Now" button and nothing happens. I also tried everything mentioned here and still nothing.
Anyone have any ideas as to how to get the files moved out of the cache and onto the array?
Logs attached.
-
On 9/28/2019 at 6:54 PM, wesman said:
WOW, thanks for this, I just spent the last two hours looking for this solution.
Awesome. Glad it was a help.
-
On 9/25/2019 at 11:15 AM, [email protected] said:
I'm having the same issue.... Did you ever get this resolved? If so, what was the issue?
Honestly, I don't remember. Sorry.
-
-
...accomplish these two goals? Can be a single tool...a Docker...a couple separate tools...whatever. Doesn't matter.
1 - Deduplicate files on an array. I have a TON of data on two separate servers and I need a way to compare the data between the two and trash duplicates leaving one dataset.
2 - Mirror the two datasets so the one server (the one in the datacenter) can act as an offsite backup for the other server (the one in my house). I know CrashPlan used to do this but no longer does. (lame)
End goal being to have one, deduped, mirrored data set between the two servers. Anyone know an efficient way to accomplish this?
-
55 minutes ago, jonathanm said:
I would avoid those tiny drives, for the reasons you are figuring out. They are so small, they don't shed heat very well. A little larger drive with a metal case is going to be much more reliable.
https://www.kingston.com/us/usb-flash-drives/datatraveler-se9-usb-flash-drive
The replacement(s) is actually made of metal. Now that it's in a datacenter, I'm not worried about it, anyway. I freeze my balls off in there. It will too.
-
2 minutes ago, CyBuzz said:
doing this solved it for me also. New USB drive (ultrafit) replaced the other ultrafit that was in there.
Should i plan on doing this periodically?
Yup. I replaced it and all is well yet again.
I even bought an extra thumb drive to leave on top of the server in the expectation that I'm going to have to do this again. lol
-
38 minutes ago, Squid said:
Practice, guesses, reading other users responses here who actually know what they're talking about (and no life
)
...exactly what I was afraid of. 😛
-
33 minutes ago, Squid said:
Your share M---a exists on the cache drive, but is set to not use the cache. Change it to Use Cache Yes temporarily to clean that up next time mover runs. You can hit "Compute" on the Shares tab next to that share and you'll see how much space it takes up.
It looks like the Mover is running now. Thanks!
So...where would one go to read about how to decypher unRAID logs? Would really like to learn how to so I don't have to keep coming here and bugging you guys every time something breaks. (And I'd like to be able to help here, as well.) It just looks like gibberish, though.
-TightVNCViewer.png.17540450dd02047d84808cbb3d113990.png)
)
How exactly are drives utilized in unRAID?
in Hardware
Posted
Hmm...well, wtf...
How is it rebooting but looking exactly as I left it when I log in? My unRAID server at home just got unplugged on accident and it was completely dead until I went back in and restarted it. Had to go back in and restart the array and all that.