June 5, 201412 yr /tower/cache i get full speed of the hard drive but when i use any shares that are cached it slows down to array speed as if its transferring to non cached drive. /tower/cache i get 60+MB/s /tower/movies i get 25-40MB/s the file is transferring to /tower/cache/movies that speed is the same as non cached shares. Even when a program downloads a file to the cache drive and then moves it to a cached share it goes very slow lower then 50MB/s and the file is on the Cache drive moving to the Cache drive this should be very fast no? is this normal?
June 6, 201412 yr Author no and i just did test it does not make a difference, when moving a file in unraid on the cache drive with windows its instant but when unraid application does it like couchpotato it goes the speed of the array drives. for example i can move files on cache drive like file1 to folder1 and its instant on windows with smb share when couchpotato moves file on cache drive from 1 folder and transfers it to say /mnt/user/movies which is still moving it on the same drive it goes the speed of the array if i transfer with smb to /mnt/user/movies it goes the speed of the array share movies is cached share so all files appear on the cache drive when i transfer them so they should not slow down to array speed correct?
June 9, 201412 yr Author so no one has this problem? is it just me? i am running cache_dirs and i have 6GB of ram 330mb used 4.6gb cached is that ok? it got so bad today i would transfer at 16MB/s i don't get it and i did a hdparm -tT /dev/sdk and it showed the same result after a reboot speed came back to 40MB/s on cached shares and 75MB/s+ on cache drive share. i am fine with slower transfer speed for cached dirs but not with slow moving files on the same drive. for example a 8gb file i have to wait for the application to move it more then 3minutes when it should move it instant all because its going to /mnt/user/Movies from /mnt/cache/download even thought /mnt/user/Movies is still moving to /mnt/cache/Movies since its cached. I don't remember this happing before i think i would of noticed maybe its 5.0.5 i don't know. did some tests in console show.mkv is in /mnt/cache/download mv show.mkv /mnt/user/Tv\ Shows/show/ = very slow around 40-50MB/s i think mv show.mkv /mnt/cache/Tv\ Shows/show/ = instant
June 10, 201412 yr sorry if this is a stupid question, I dont use cache shares but should you be using the '/mnt/user' based mount points for your moves? it sorta sounds like a move into /mnt/user/Tv\ Shows/, would invoke what ever allocation method you've chosen for that share? After that move (mv show.mkv /mnt/user/Tv\ Shows/show/), on which disk did show.mkv end up? again, above all could be irrelevant for cached shares /edit, yep, was wrong! /mnt/user to be used, and should write to the cache if that option is applied to that particular share. If cached option is set against that share, it shouldnt do as you're experiencing alright
June 10, 201412 yr Author it is writing to cache drive with shares that are set to be cached just very slow array speed compared to directly to cache share disk for the moving of files on cache drive i think Unraid just doesn't know to just move the file and instead is actually reading and then making the file on the same disk so maybe that's why it hits a 50MB/s limit it really should be instant if Unraid knew somehow to just ignore the /mnt/user/share* when its cached and instead just do a mv on the file to the cache dir. i fixed Couchpotato by making it rename files to /mnt/cache/Movies works instant now but i cant figure out a way to do that with sickbeard
June 10, 201412 yr Author no that wont work that's just the download dir anyway's sickbeard will move and rename to correct location and i want to use post processing script. sickbeard would have to rename and move the file to /mnt/cache/tv shows/tvshowname and look for the tv shows in /mnt/user/tv shows/tvshowname but sickbeard only moves and looks in the same location so its not possible like it was with Couchpotato maybe i will just download to non cached share, download speed is not greater then array write speed only thing it would effect is extracting speed i think ahh nvm that would still be probably same
June 25, 201412 yr Did you ever get any further with this? I've been looking at cache'd shares for the past while, and have them integrated now with my larger main shares (Movies & Series) Unfortunately, it looks like I'm having the same issue as yourself. Transmission saves to the cache drive - /mnt/cache/.custom/transmission/torrents/complete Sickbeard picks up from there, and moves to - /mnt/user/Series, which is a cached share Unfortunately it doesnt look like a normal 'mv' operation, as you can see the kb's building up on the file as its moved to /mnt/cache/Series. The normal mv operation should be instantaneous for a move on the same drive (just inode repoint) Same issue with Couchpotato Funnily enough, with Sickbeard anyway, I can manually do the move operation above with the 'mv' command, which is instant. You can then go into Sickbeard, and rescan for files - and it picks up the files on the cached dir (/mnt/cache/Series). You can then do a rename, and it does an instant name change (doesnt copy to main share etc). So the capability of Sickbeard to do instant moves (via 'mv' as shown by the rename) is there - it just doesnt seem to do do so on the initial move - Im presuming it uses rsync, or some other sort of verified copy command
July 1, 201412 yr Author Did you ever get any further with this? I've been looking at cache'd shares for the past while, and have them integrated now with my larger main shares (Movies & Series) Unfortunately, it looks like I'm having the same issue as yourself. Transmission saves to the cache drive - /mnt/cache/.custom/transmission/torrents/complete Sickbeard picks up from there, and moves to - /mnt/user/Series, which is a cached share Unfortunately it doesnt look like a normal 'mv' operation, as you can see the kb's building up on the file as its moved to /mnt/cache/Series. The normal mv operation should be instantaneous for a move on the same drive (just inode repoint) Same issue with Couchpotato Funnily enough, with Sickbeard anyway, I can manually do the move operation above with the 'mv' command, which is instant. You can then go into Sickbeard, and rescan for files - and it picks up the files on the cached dir (/mnt/cache/Series). You can then do a rename, and it does an instant name change (doesnt copy to main share etc). So the capability of Sickbeard to do instant moves (via 'mv' as shown by the rename) is there - it just doesnt seem to do do so on the initial move - Im presuming it uses rsync, or some other sort of verified copy command no i have not had any luck in fact Couchpotato fix i thought i had is not possible since when the Movies folder in cache drive gets moved during the night and when a movie gets downloaded it complains now about ERROR[tato.core.plugins.renamer] Both the "To" and "From" folder have to exist. it has something to do with unraid and how cache shares behave. does anyone have any ideas?
July 11, 201411 yr Author i still cant figure out a way to fix this anyone have any ideas or is this a limitation of unraid.
July 13, 201411 yr Author i dont see how customization will fix this try it out your self mv some files from cache drive to a /mnt/user/ share that is cached you will see it get moved to the cache drive but at a slow speed why? when using mv to move file from cache drive to the same location the cached share will move it to is instant. even worse transferring from another computer over smb to a cached share is slower then transferring to the cache drive why? really cache is useless as it is now because i can just use the array and it would be faster but i would have to keep waking it up.
July 13, 201411 yr Did you ever get any further with this? I've been looking at cache'd shares for the past while, and have them integrated now with my larger main shares (Movies & Series) Unfortunately, it looks like I'm having the same issue as yourself. Transmission saves to the cache drive - /mnt/cache/.custom/transmission/torrents/complete Sickbeard picks up from there, and moves to - /mnt/user/Series, which is a cached share Unfortunately it doesnt look like a normal 'mv' operation, as you can see the kb's building up on the file as its moved to /mnt/cache/Series. The normal mv operation should be instantaneous for a move on the same drive (just inode repoint) Same issue with Couchpotato Funnily enough, with Sickbeard anyway, I can manually do the move operation above with the 'mv' command, which is instant. You can then go into Sickbeard, and rescan for files - and it picks up the files on the cached dir (/mnt/cache/Series). You can then do a rename, and it does an instant name change (doesnt copy to main share etc). So the capability of Sickbeard to do instant moves (via 'mv' as shown by the rename) is there - it just doesnt seem to do do so on the initial move - Im presuming it uses rsync, or some other sort of verified copy command no i have not had any luck in fact Couchpotato fix i thought i had is not possible since when the Movies folder in cache drive gets moved during the night and when a movie gets downloaded it complains now about ERROR[tato.core.plugins.renamer] Both the "To" and "From" folder have to exist. it has something to do with unraid and how cache shares behave. does anyone have any ideas? Ask how others are configuring these add-ons in the User Customizations forum.
July 13, 201411 yr i dont see how customization will fix this try it out your self mv some files from cache drive to a /mnt/user/ share that is cached you will see it get moved to the cache drive but at a slow speed why? The disk is thrashing. when using mv to move file from cache drive to the same location the cached share will move it to is instant. This is a relink and if the user file system were a bit smarter it would relink instead of copying. even worse transferring from another computer over smb to a cached share is slower then transferring to the cache drive why? This occurs in systems very low power CPUs, e.g., Atom or AMD Turion. really cache is useless as it is now because i can just use the array and it would be faster but i would have to keep waking it up.
July 13, 201411 yr Author i dont see how customization will fix this try it out your self mv some files from cache drive to a /mnt/user/ share that is cached you will see it get moved to the cache drive but at a slow speed why? The disk is thrashing. when using mv to move file from cache drive to the same location the cached share will move it to is instant. This is a relink and if the user file system were a bit smarter it would relink instead of copying. even worse transferring from another computer over smb to a cached share is slower then transferring to the cache drive why? This occurs in systems very low power CPUs, e.g., Atom or AMD Turion. really cache is useless as it is now because i can just use the array and it would be faster but i would have to keep waking it up. I see whats happening so i have 100mb/s write speed and 100mb/s read when the file gets moved on the same drive its reading and writing at the same time so it drops to around 50mb/s read and write, this causes everything on the cache drive if accessed by smb to be not streamable as the disk is maxed out during the file move. Array will be faster for almost everything i don't see the point of Cache drive now for smb transfers CPU usage is about the same its a AMD dual core tested a few large files caused it to go to around 60-70% CPU one is going at 40-50mb/s, cache disk share is going at 90-105mb/s
September 8, 201411 yr Author i changed min free space for each share from 0 to 20gb because of a no free space error and then i noticed all the problems of slow cache issues are gone.
Archived
This topic is now archived and is closed to further replies.