Pro-289

Members
  • Content Count

    42
  • Joined

  • Last visited

Posts posted by Pro-289

  1. Fast forward 6 years. Any progress? Lots of nerdy crap in here. But no way to hook into the low level file system to know what's going on? Of course at first the cache needs to know what's there and read everything. Then afterward hook into the filesystem to always know what happens afterwards.

     

    I've been struggling with the add-on for years of never working right for me. Having low-level kernel support would be such a benefit. I'm surprised throughout all the years of Linux that it doesn't have some sort of file caching option already. I'm bumping this thread for future development.

  2. On 2/16/2020 at 7:38 AM, jonathanm said:

    if you open a windows command prompt and navigate to the mapped letter and issue a dir does it spin up the drives?

    I just tried to access the drive letter from the command prompt. Six of the eight drives powered up right after. The directory paused a few times while the drives powered up. A few hours earlier I even had all drives powered up viewing all the folders so the names were all in the cache.

     

    And I have fresh install of Cache Directories, where the main items I changed from default are cache pressure to 4 and enabled Scan User Shares. Plus I've also updated to Win 10 and disabled SMB 1.0 to force SMB 2.0+. My last attempt will be to disable Samba altogether and only use NFS.

  3. On 2/16/2020 at 7:38 AM, jonathanm said:

    if you open a windows command prompt and navigate to the mapped letter and issue a dir does it spin up the drives?

    I'll have to try that next. I uninstalled a few plugins and disabled ProFTP and SSD Trim. Of course I also uninstalled Cache Dirs to see what happens. The only plugins I have enabled now are Dynamix System Buttons and Community Applications.

     

    I just opened the mapped driver letter while watching the Array Devices in the web browser. Each drive powered up in numerical order, from 1 to 8. Windows timed out since each drive had to power up one by one. Maybe that's a normal process without Cache Directories, I don't know. I'll have to put CD back and try the process again.

  4. 6 hours ago, Frank1940 said:

    Make sure you are not indexing for quicker searches.

     

    One thing you can do is just to spin-up all of the disks manually before you start directory browsing.

    I do have a mapped drive letter to the share. Although when I access the share directly using \\IPADDRESS\ it still does the same thing. I checked my mapped drive properties and the indexing option was enabled. I disabled it and it's now going through every file and setting each attribute to disabled. But even after disabling Indexing, the option is still enabled when I go back to properties again.

     

    And of course the most annoying part is that every drive has to spin-up ONE BY ONE! If all 8 could spin-up at the same time would be a bit less aggravating, but still annoying that they even spin-up in the first place.

     

    I am excluding appdata, system plus a few others I didn't want. I only included the two shares I cared about.

     

    There's only two main shares that I have. One has 5,800 files, and the other has 3,200 files. It seems like 8GB of RAM should be able to hold at least 9,000 indexes. But I've noticed every time I transfer files to the array my Cached RAM usage increases as viewed with the System Stats plugin. So I'd assume every time I transfer data to the drives it kicks out the directory cache from RAM. But that would be an issue only while I'm using the Cache Directories plugin. But it seems I have this problem while using the Cache plugin or not, and while transferring data to the drives or not. I think I've even tried to disable viewing thumbnails too. But my folder views are always in Detail mode that doesn't show a thumbnail anyway.

  5. I've been battling this for a long time now. I've tried with Dynamix Cache Directories and with it disabled. I have 8 drives and 1 parity, and an SSD cache drive. When I open my share it pauses for a bit while usually 6 or 7 of the 8 drives spin up. Then the share shows. I don't have any drives grouped for spin up.

     

    I've even tried accessing the share with a rarely used laptop, and it did the same thing. Tried Windows 7 and 10. It seems it's something in the config of the server since both computers did it.

     

    Plugins I have installed:

    Community Applications, Dynamix Cache Directories, Dynamix SSD TRIM, Dynamix System Buttons, Dynamix System Information, Dynamix System Statistics, ProFTPd.

     

    Not sure if any of the plugins are causing it, or if that's even possible. Sometimes I hate just accessing my library for a 3 second look at something because almost all the drives will spin up.

     

    Has anyone run into this before and found a solution?

  6. I just installed this in v6.7.2. The file access seems to work after I press Refresh the file I had played showed up.

    But, I have 5 out 8 disks that spin up every time I open the Share folder in Windows 7. I even tried with thumbnails disabled. And I have Dynamix Cache Dirs installed.

    After the 5 disks spined up I noticed my total reads went up by 12. Why the heck are my drives spinning and reading just opening the share?

  7. 8GB, the max my 2010 motherboard can handle. I don't use many plugins or dockers, but I really do need way more than that. My Dynamix Cache Directories seems to max out my RAM and my drives still spin every time I open the mapped drives. Tried wiping the plugin and reinstalling with stock and altered settings, still spins up. How come this isn't built directly into the source code of UnRaid.

  8. guinea pig

    22 hours ago, itimpi said:

    There are also a very large number of people reporting no problems at all with 6.7 so rushing to roll back can be premature.   The problem with rolling back is that you may end up stuck on an old release unnecessarily.

    Using an old release may not be all that bad. An old release is just a previous new release. Sometimes updating to the latest and greatest causes the guinea pig effect.  [cough]Windows 10[cough]

  9. On 3/6/2019 at 8:50 AM, kizer said:

    Since I've updated to 6.6.7 or even before this doesn't seem to index my files anymore. I installed the latest from CA and even installed the Beta from up above several posts. When I launch the Script I've spun up all my drives and literally watched all my drives. They never seem to get read and when they do spin down check a share which in my case would be TV and Movies which I have set as my Includes and all my drives spin up that should of been indexed. 

     

    Yes I've even used the help and changed the two settings that say read me if your drives spin up.

    Hmm, I think I've recently noticed that too with my v6.6.6. I upgraded to v6.6.6 quite some time ago, but was just checking my cache settings now. I noticed my Stats->Memory->Cached is very low, 806.3 MiB. Usually the cached usage is around 6GB which seems really high usage just for cache. My plugin status was Running. Using plugin 2018.11.18. I've disabled and enabled the cache and now after a few minutes it went up to 806.4 MiB. So maybe it's kinda working, but not fully?

  10. I got no clue either. I've tried to get Dynamix Cache Directories to work without spikes for years. Either I disable User Shares and have lower CPU usage and get disk spin ups while accessing the network share. Or I enable User Shares and get high CPU spikes and still get disk spin ups. I don't think the plugin quite works as it should, default settings or not. The only way to get the cache plugin to work properly is to disable it.

     

    You'd think there would be some form of low level disk API that could be used to access kernel level disk usage to build a directory list and be done with it in 1 minute. Then any time the kernel sees a write to a directory the drive is already spun up and it gets added to the cache in a split second. That way 24/7 CPU spikes while scanning for the cache is not necessary. But who am I tell them how to program their software. I'm just an end user who paid money for it.

  11. Anyone else having problems with Cache Directories or is it just me?

     

    I've been battling this issue for quite a while through many versions. The main problem is after about 20 or 30 days of uptime my CPU gets pegged on one core. Processes seems to show the cache_dirs script with high time usage. I've done a lot of searching on here to read up on other people having the same issue. Some have excluded appdata and/or system and even disabling Scan User Shares with success. I've tried that too while also excluding a couple other directories that I don't need cached.

     

    It's all good for a few weeks, then the CPU stays spiked. I go in the Folder Caching Function and disable the caching. Then I re-enable and everything is good again, until a few weeks later. Also it seemed to have less spinups in the past when I only had 4GB of RAM. I've upgraded to 8GB and I still get spin ups when I open some folders to see files. Even when 'always show icons, never thumbnails' was selected. It's unchecked now, but I have my view in Details mode so it shouldn't be trying to grab icon preview data that spins up the drives. Stats shows almost all of 8GB is used for cache. Which is amazing to think how much information you could put into an 8GB text file.

     

    So I basically have two issues, high CPU and drive spin up when looking in folders. The latter I don't care too much about, but the CPU issue can make a lot of functions lag while also generating excessive heat and using more electricity than necessary.

     

    unRAID v6.5.0

    Dynamix Cache Directories v2016.08.26 v2.1.1

    Folder caching function: enabled

    Suspend during 'Mover' process: yes

    Scan user shares: No

    Min int folder scan: 2

    Max int folder scan: 10

    Excluded folder: appdata, system, + a few others

    Included folders: none

    User defined options: none

     

    Also I don't use a cache drive. Just standard drives and parity.

  12. I just installed this plugin into v6.2.4.

     

    I've noticed when I select Settings->ProFTPd the Lime Tech logo in the upper left of the screen in the banner has a solid white background. Compared to all other pages in unRAID which have the logo with a transparent background.

     

    Not sure if this is a problem in unRAID or just the ProFTPd plugin. It seems like just the plugin since it only happens on that page.

  13. emhttp updates (disk and array values) occur every minute, but are initially disabled. To enable these type of updates it is required to enable notifications (see settings page).

     

    Ok, turning on "System notifications" seemed to have done the trick. The array Reads and Writes are now updating. But at an excruciatingly slow speed of 1 minute as you mentioned. Is there anyway to lower that setting? I swear Dynamix in v5 updated every 2 seconds or something. It's easy to spot visual changes with a 2 second delay. With a 1 minute screen update it's hard to determine if there's a rogue device leeching something. Not quite "real-time".

  14. Look at    'Setting"  >>>  'Display' and then the  "Page update frequency:" setting.  Use 'Help' to determine which one is set and which one you want to use.

     

    I've checked there and it has been on Real-time. To make sure I'm not mistaken here, does everyone's Reads/Write on the Main page update in real time? Mine does not, or even the device status when a new drive powers up I don't see the green status light. I open a separate window and stream a file and nothing changes in the browser until I hit the F5 key. The System Status works in the Dashboard but the Statistics/Array Status does not. Dynamix in v5 worked in real time for Reads/Writes.

     

    When I'm on the Main page I do see some network traffic coming in, about 113kbps every 3 seconds. The network traffic goes away when I go to a different tab or close the browser. So it's like the data is being sent then received, but it's just not being displayed.

  15. I am having the same issue - the graphics card is running extremely hot (I have tried two different cards) Did you resolve this issue?

    I've seen this situation recently in a normal desktop computer while installing Windows 10. Fairly low end video card. But I had the case open while I was installing and felt the graphics card and it was very very hot. But once Windows was loaded I'd assume the power saving features kicked in and it went to a normal cool to the touch.

     

    I've seen this happen many times to a CPU while in DOS mode while I'm guessing power saving features aren't enabled. So maybe that's the case with a certain type of graphics card while in Linux.

  16. I used method 1 on a 5.0.4 that was running for a long time. I uninstalled my Dynamix plugins just in case. Everything went perfectly. I now have 6.2.4 with all my shares and user logins.

    It decided to do a parity check after the first boot. Only 7 hours remaining. :)

    It booted a lot faster than 5.0.4. There used to be one area it would get stuck at during boot for about 1 minute.

     

    One question about the "build-in" Dynamix? It doesn't seem to be live updating anything. The dashboard works and shows live CPU usage, but the Main page doesn't update. I have to keep pressing F5 to refresh the screen and show the current progress/stats. I liked the old Dynamix in 5.0.4, everything updated in realtime.

     

    Something strange I've noticed about the update. I've opened two browsers to the Main page, IE and Firefox. During a parity check they both have the same status, nothing changes. But if I press F5 in either of my browsers to refresh the page, not only does that browser page update, but the other browser page also updates. It's like me pressing F5 forces unRAID to spit out a page update. Anyone seen anything like this?

     

    Thanks a lot for everyone's hard work.

  17. I've done all the entries listed here for only specific access to folders via FTP. It all works okay, I log in with the user name and only the one user share is accessible.

     

    But... I'm using Firefox to FTP into unRAID, and when I select the "Up to higher level directory", link displayed above my share, (adds "../"), I have access to the whole Linux directory structure. Not good. I can poke around and access the passwd file and the vsftpd.user_list file. I'm not even logging in as root.

     

    I've tried to set "SMB Security Settings" for the flash drive to "No Access" for the particular user, but that didn't seem to do anything.

     

    Is there something that can be done to restrict FTP access to ONLY the shares specified?

  18. I installed a new unraid 5.0.5 and dynamix 2.2.10. During the install of Dynamix I was getting a lot of delays and errors pertaining to github certificate and addresses. But the install seemed to work okay.

     

    But every time in the unRAID interface when I click on the Dynamix tab, there's a long delay until all the plugins display on the screen. It starts with just one at the top I think, then just sits there for about 10-15 seconds, then the email, smart, etc plugins display. I've tried this with an older install and the Dynamix menu displays instantly.

     

    I've verified the time is set correctly. Anyone know what could be going on?

     

    This sounds like a problem with your USB stick. Dynamix reads the settings from there each time when you change a page in the GUI.

     

    Easiest probably is to take the USB stick out and run a disk check on it using windows.

    But everything else seems to work okay. Watching the OS load on the monitor just wizzes by. Everything else loads perfectly in the unRAID GUI. That amount of wait that Dynamix does I don't think is related to the USB.

     

    Somehow I think it's related to the delay issues I was getting during the install. Because it has to check for the latest version of every plugin at some point, so I'm assuming it does this when you display the plugin control GUI. If I can fix the certificate issues to github, then I'm guessing the delays will be fixed too.

  19. I installed a new unraid 5.0.5 and dynamix 2.2.10. During the install of Dynamix I was getting a lot of delays and errors pertaining to github certificate and addresses. But the install seemed to work okay.

     

    But every time in the unRAID interface when I click on the Dynamix tab, there's a long delay until all the plugins display on the screen. It starts with just one at the top I think, then just sits there for about 10-15 seconds, then the email, smart, etc plugins display. I've tried this with an older install and the Dynamix menu displays instantly.

     

    I've verified the time is set correctly. Anyone know what could be going on?

  20. This interface is by far the best I've seen. Not only are the real time stats cool, but the other "geeky" information is so cool too. Brings another dimension to my purchase. This should be standard with all downloads of unRAID.

     

    Thank you.

  21. So I guess the question here is "is 24/7/365 referring to spinning time / activity on the drives or being in a box which is powered on but the drives are spun down"?

    I would guess here that 24/7/365 would mean that your drive is spinning and active for 24/7/365.

     

    On a side note, I seem to have one drive now that when it tries to spin up I hear the "spin up" noise for about 3 seconds when it's normally 1 second. It's an original Samsung 2TB drive. Those drives you can distinctly hear the "power up" motor. I suppose if I checked the SMART I'd see the Spin Up flag set a bit high due to long power ups.

     

    I've seen some drives with 1000 to 3000 spin ups in SMART. YMMV..

  22. I don't trust Seagate anything these days. I used to back in 2006.

     

    But now all the failed drives I see in the shop are either Seagate, Toshiba, or Hitachi. In order of failures.

     

    Of course I still see some Western Digital drives. But those are way less often than the others. So I pick the lesser of 4 evils. I've had great success with hundreds of WD drives I've purchased. I know I would not be a happy person if I was trying to save $10 a drive and purchased SGs.

     

    And I'm talking about smaller drives here. Like 500GB to 1.5TB. The Seagate 1TB and 1.5TB drives are the WORST! They seem to last about 1 to 1.5 years until bad sectors start. Hmm, 1TB per year!?!?

     

    I could never purchase a Seagate hard drive now in good conscious. Even if you gave me one I don't think I'd use it for anything of value.

     

    There's been a shift to solid states lately. Mostly on the smaller side. Samsung is "once again" the leader in drives with their Evo series. Just like they used to be with their 2TB HDDs before Seagate bought them out and ruined the product line.

     

    I'm not sure if the Samsung company is still in control of their solid state hard drive plant, but here's a quote from a press release;

    "This transaction was announced in April 2011 along with a series of other agreements between Seagate and Samsung. Seagate is supplying disk drives to Samsung for PCs, notebooks and consumer electronics devices. Samsung is supplying its market-leading semiconductor products for use in Seagate's enterprise solid state drives (SSDs), solid-state hybrid drives and other products."