January 4, 201313 yr Unraid runs on itself perfectly with the current config, with a somewhat limited combination of plugins this is also the case. In the course of time the horsepower of the systems we use is increasing and more and more valuable plugins are developped. Though I do not own a lot of them I notice Out Of Memory errors on a regular basis, I have come to a setup that will make sure that tasks will get killed that will simply get restarted and this is functioning quite well. However I do see it as a patchwork solution and am wondering how this will continue. The main thing I am wondering is if it could be expected that a 64bit version of Unraid could surface at some time, as far as I understand this would solve a lot of memory issues. Should thus a thing lie not in the future I will have to find another way to fix this, one of the options I am thinking of is moving to a virtualised environment where I will have more 32bit (or 64bit) instances running.. I do not know how difficult a 64 version of unraid would be, and would it really solve memory issues ?
January 6, 201313 yr Yes, a 64-bit kernel is the first "feature" after 5.0 "final". Already started the work.
January 6, 201313 yr Author That is great to hear, thanks for the update and good luck. Latest rc5 version still rocksolid ! Marc
January 8, 201313 yr Let me ask this, Does 64bit solve the issue of low memory buffers vs high memory buffers? Does it get rid of the need for bounce buffers dealing with DMA and/or other things? I mention this because, I had 8GB and still got out of memory errors. If I over configured the buffering in unRAID, and did a massive filesystem sweep or rsync, the kernel would run out of memory buffers in low memory.
January 8, 201313 yr Surely anything that needs to address more than ~4GB of ram would benefit? Virtual Machines for a kick off...
January 8, 201313 yr Surely anything that needs to address more than ~4GB of ram would benefit? Virtual Machines for a kick off... I would agree!
January 8, 201313 yr Let me ask this, Does 64bit solve the issue of low memory buffers vs high memory buffers? That is my understanding. Does it get rid of the need for bounce buffers dealing with DMA and/or other things? Pretty sure bounce buffers were eliminated in 2.6 kernel, maybe even one of the later 2.4 kernels.
January 8, 201313 yr Let me ask this, Does 64bit solve the issue of low memory buffers vs high memory buffers? That is my understanding. Does it get rid of the need for bounce buffers dealing with DMA and/or other things? Pretty sure bounce buffers were eliminated in 2.6 kernel, maybe even one of the later 2.4 kernels. Maybe the bounce buffers were eliminated, however I remember bumping up the denty cache and running out of 'low' kernel memory when I did a massive rsync... I doubt I should have run out of memory on an 8GB system. In any case, 64bit is a welcome upgrade!!!
January 8, 201313 yr I every once in a while run out of RAM on my system that has Crashplan running on it. With it starts to do is rescan of the system it can start to kill things and I end up loosing SAB, SickBeard, Transmission, etc.
January 9, 201313 yr Author Yup, those are the OOM issues I am referring to.. Remember though that only upgrading unraid to 64bit will not solve this. All plugins you use will need to have a 64bit upgrade to be able to run on the new system.. Base functionality wise 64 bit could also have some speed benefits with respect to unraid itself I suspect..
January 9, 201313 yr All plugins you use will need to have a 64bit upgrade to be able to run on the new system.. Why do you say this, what would have to change?
January 9, 201313 yr Maybe the bounce buffers were eliminated, however I remember bumping up the denty cache and running out of 'low' kernel memory when I did a massive rsync... I doubt I should have run out of memory on an 8GB system. In any case, 64bit is a welcome upgrade!!! Rsync's memory usage massively increases if you use the --delete-after or --delete-before options. I don't know if this was a factor for you, but I have switched to using --delete which for is not quite as safe as --delete-after but it means that rsync no longer has to maintain a complete list of all of the affected files and folders for the duration of the rsync session. Rsync's memory usage had dropped hugely as a consequence.
January 9, 201313 yr Maybe the bounce buffers were eliminated, however I remember bumping up the denty cache and running out of 'low' kernel memory when I did a massive rsync... I doubt I should have run out of memory on an 8GB system. In any case, 64bit is a welcome upgrade!!! Rsync's memory usage massively increases if you use the --delete-after or --delete-before options. I don't know if this was a factor for you, but I have switched to using --delete which for is not quite as safe as --delete-after but it means that rsync no longer has to maintain a complete list of all of the affected files and folders for the duration of the rsync session. Rsync's memory usage had dropped hugely as a consequence. I'm not using --delete or anything like that. Just an regular rsync backup. While I do realize that rsync can use allot of memory. If I have 8Gb of ram and 2GB of swap, it should handle it. But when the kernel gets an OOM error and starts killing processes, there's another situation at hand. Depending on how I set the unRAID, kernel and dentry buffers, this can get worse. My way around the situation was to set the rsync jobs to drop the kernel buffer cache, then let it grow as needed. then flush it again after the job. This resolved some issues. If I happen to run two large rsync jobs, one or the other would cause a kernel OOM error. In any case, 64bit should help resolve this.
January 9, 201313 yr Author All plugins you use will need to have a 64bit upgrade to be able to run on the new system.. Why do you say this, what would have to change? Well.. You are a lot more knowledgeable on this then I am so I guess I am wrong... I am actually making a comparison with the microsoft environment where it is not buy default that everything 32bit can run in a 64bit environment... Also to take -advantage- of the 64 bit stuff needs to be aware of this... Maybe thats different on linux ?
January 9, 201313 yr All plugins you use will need to have a 64bit upgrade to be able to run on the new system.. Why do you say this, what would have to change? Why do >>you<< say this? (IF I was an unRAID user, I'd be worried. )
January 9, 201313 yr All plugins you use will need to have a 64bit upgrade to be able to run on the new system.. Why do you say this, what would have to change? Why do >>you<< say this? (IF I was an unRAID user, I'd be worried. ) LOL, I was wondering if he knew something I didn't. With proper libraries in place 32-bit linux apps can run with a 64-bit kernel, e.g.: http://connie.slackware.com/~alien/multilib/
Archived
This topic is now archived and is closed to further replies.