March 23, 201016 yr Author i am remoting into a windows 7 pc and then accessing unraid via telnet and the web gui from that machine i am remoting into. I dont want to mess too much with my config so i will just wait till I get home and run the memtest on boot up.
March 24, 201016 yr Author so I didn't get a chance to do the memtest last night - hopefully I can do that tonight. but i do have a good idea of what is opening all the files. I am pretty sure it is windows backup. I have my windows backup set to run every morning at 4AM. and it appears as though the "too many Files open" errors in the syslog seem to start shortly after 4AM. I disabled windows backup for tonight and i'll see if i have the problem. but unraid won't allow windows backup to do a backup without getting the "Too may files open" error that will be a problem. but I will see what happens tonight and take it from there (and i will try to run the memtest tonight)
March 24, 201016 yr so I didn't get a chance to do the memtest last night - hopefully I can do that tonight. but i do have a good idea of what is opening all the files. I am pretty sure it is windows backup. I have my windows backup set to run every morning at 4AM. and it appears as though the "too many Files open" errors in the syslog seem to start shortly after 4AM. I disabled windows backup for tonight and i'll see if i have the problem. but unraid won't allow windows backup to do a backup without getting the "Too may files open" error that will be a problem. but I will see what happens tonight and take it from there (and i will try to run the memtest tonight) You can set the max number of open files (at one time) allowed on linux. You can see the current limit by typing: cat /proc/sys/fs/file-max You can set a different value by typing: sysctl -w fs.file-max=100000 Add a line like that to the end of your config/go script if it helps.
March 24, 201016 yr Author thanks for the info! it looks like its currently set to 92405. that seems like a kind of arbitrary number. is there any downside to bumping this setting up?
March 24, 201016 yr thanks for the info! it looks like its currently set to 92405. that seems like a kind of arbitrary number. is there any downside to bumping this setting up? Not really, other than it using a bit more memory. The bigger issue is that windows should be closing the files as it writes them. There is no way it should have 90,000+ files open at one time. It really sounds like a bug in the windows backup in that it is not closing the files once it finishes with them. (a beginner's programming error)
March 24, 201016 yr Author hmm - i wonder if anyone else has had that problem - if anyone else is using windows 7 backup to backup their system to an unraid server. if it continues to be a problem then perhaps I will have to switch back to acronis for my backups. I just liked the fact that windows backup was simple and free and integrated right into windows.
March 24, 201016 yr thanks for the info! it looks like its currently set to 92405. that seems like a kind of arbitrary number. is there any downside to bumping this setting up? That is kinda low. My main Gentoo Linux desktop for example is set to 205500. Try a larger number. My unraid is set to 101525. I wonder if linux sets it based on the amount of RAM or something. My desktop has 2gig and my unraid has 1.
March 24, 201016 yr hmm - i wonder if anyone else has had that problem - if anyone else is using windows 7 backup to backup their system to an unraid server. if it continues to be a problem then perhaps I will have to switch back to acronis for my backups. I just liked the fact that windows backup was simple and free and integrated right into windows. I'm testing it on my Win7 machine right now. I've never used the built in back up so it's a good test. Also, I found this bit of information about this problem. Reading down to the bottom it seems like they think it was fixed in some samba patch. Not sure which is the culprit actually but it seems to be that the file handles aren't getting closed fast enough and the pool of open file handles gets exhausted momentarily causing the message box to pop up. https://bugs.launchpad.net/ubuntu/+source/samba/+bug/462172
March 27, 201016 yr Author so I shut off my microsoft backup for one night and the storagetower made it through the night just fine without having to have the array restarted. So I figured i would just switch to Acronis for my nightly backups. I set up acronis and ran it manually and it ran fine. then last night when the scheduled job kicked off it failed. and when I looked into it - it appeared to be the same issue that I had with MS backup. too many files open. So it CANT be that BOTH microsoft backup and Acronis or poorly written and leave all those files open. this is so very frustrating - ever since upgrading to unraid 4.5 i cant run backups anymore. i never used to have problems with this. oh and btw i am finally getting around to running the memtest right now. it has been running for 45 minutes so far ant there are no errors. so what doI do now? how can i get these backups to run??
March 27, 201016 yr Author put this in flash config\smb-extra.conf max open files = 16500 no i haven't tried that yet... is that different from the other max files open setting that I adjusted? I'll give it a shot but it seems like there is a deeper issue for limetech to fix here so thatall these files arent left open...
March 27, 201016 yr Author ok so I am looking in my flash share in the conf folder and i don't see the smb-extra.conf file. for that matter i don't see any .conf files...
March 27, 201016 yr ok so I am looking in my flash share in the conf folder and i don't see the smb-extra.conf file. Create it. Keep in mind this: http://lime-technology.com/wiki/index.php?title=FAQ#Why_do_my_scripts_have_problems_with_end-of-lines.3F
March 27, 201016 yr bdee1, you may also try this on your win7: http://alan.lamielle.net/2009/09/03/windows-7-nonpaged-pool-srv-error-2017 Set HKLM\SYSTEM\CurrentControlSet\Control\Session Manager\Memory Management\LargeSystemCache to 1 Set HKLM\SYSTEM\CurrentControlSet\Services\LanmanServer\Parameters\Size to 3 Some people on our forum reported that the above tweak has fixed their win7 problems: http://lime-technology.com/forum/index.php?topic=5004.45
March 30, 201016 yr Author well i thought i had it under control when i disabled my backup for a few days but its baaaack. this morning i went to browse a share and it appeared empty and i looked in the syslogs and there a million "too many files open" errors and i had to stop and re-start the array. is there some way to figure out which machine is accessing all these files?
March 30, 201016 yr is there some way to figure out which machine is accessing all these files? is there some way that you tell us whether you tried the two fixes suggested above?
March 30, 201016 yr is there some way to figure out which machine is accessing all these files? Yes, turn off all but one of your machines over night (or for an extended period of time) and see what happens. If the activities disappears then you have found your machine.
March 30, 201016 yr i have tried every fix suggested so far. a) fix #2 was supposed to be tried on the win7 machine that's causing the problem. b) you are still looking to find which win7 machine is causing the problem. a+b) ... is there some way to figure out which machine is accessing all these files? smbstatus -v
March 30, 201016 yr Author i thought i knew which system was causing the problem but since none of the fixes worked i am wondering if it is a different system which is why i asked for advice on tracking down which system it was.
March 30, 201016 yr i am wondering if it is a different system which is why i asked for advice on tracking down which system it was. Telnet to your server and type: smbstatus -v That should show you which machine it is.
March 30, 201016 yr i have tried every fix suggested so far. So you isolated the unraid? That is, you turned off everything except the unraid and one machine like was suggested earlier?
March 31, 201016 yr bdee1, do you by any chance keep copies of earlier unRAID versions? Do you want to experiment and downgrade your unRAID server to version 4.5-beta7 or earlier? (as back as 4.4.2 maybe?) I'd be very interested in the result.
April 2, 201016 yr Author bdee1, you may also try this on your win7: http://alan.lamielle.net/2009/09/03/windows-7-nonpaged-pool-srv-error-2017 Set HKLM\SYSTEM\CurrentControlSet\Control\Session Manager\Memory Management\LargeSystemCache to 1 Set HKLM\SYSTEM\CurrentControlSet\Services\LanmanServer\Parameters\Size to 3 Some people on our forum reported that the above tweak has fixed their win7 problems: http://lime-technology.com/forum/index.php?topic=5004.45 when setting these values shoudl it be set to Hexidecimal or Decimal?
April 2, 201016 yr bdee1, you may also try this on your win7: http://alan.lamielle.net/2009/09/03/windows-7-nonpaged-pool-srv-error-2017 Set HKLM\SYSTEM\CurrentControlSet\Control\Session Manager\Memory Management\LargeSystemCache to 1 Set HKLM\SYSTEM\CurrentControlSet\Services\LanmanServer\Parameters\Size to 3 Some people on our forum reported that the above tweak has fixed their win7 problems: http://lime-technology.com/forum/index.php?topic=5004.45 when setting these values shoudl it be set to Hexidecimal or Decimal? Your choice... Hex 3 = Decimal 3 Hex 1 = Decimal 1
April 2, 201016 yr Author thanks - I wasn't sure because after applying these changes: a) the unraid problems continued b) my win7 system seems to have become unstable. Int completely hangs all the time and reboots at random. I had to roll back the registry changes. the win7 stability it seems better now. the smbstatus - v command was helpful too for finding which machine had files open - unfortunately it looks like its a combination of both of my machines. maybe i will try re-applyign the registry changes on both machines and see what happens. the most frustrating part I think is that I cant seem to figure out what keeps opening all these files every night.
Archived
This topic is now archived and is closed to further replies.