Jump to content

nuhll

Members
  • Content Count

    1966
  • Joined

  • Last visited

  • Days Won

    2

Everything posted by nuhll

  1. Thanks for the tip, i dont really need multiple local folders.. i just had it still in there bc i wanted to stay as close as possible to the tutorial.
  2. Not too bad for me, i wasnt using that extra folder anyway... at some point i need to complete restructure everything, but currently its kinda working, so... For the "too late mounting" i guess the best would be one BIG script instead of multiple...?
  3. Didnt really restartet after it worked... but till now. knock on wood. all working. It was really the RO, it seems line mergefs is not supporting too much directorys...??!
  4. Ok, that seems to have fixed that issue. Ill report if i find any issues. Thanks for all your help, again!
  5. I never used the upload folder so i just removed it now it looks more like in the tutorial: mergerfs /mnt/user/Archiv:/mnt/user/mount_rclone/google_vfs /mnt/user/mount_unionfs/google_vfs -o rw,async_read=false,use_ino,allow_other,func.getattr=newest,category.action=all,category.create=ff,cache.files=partial,dropcacheonclose=true I report back after restart. Edit: the mount script is too fast sometimes so i get: docker: Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?. See 'docker run --help'. mv: cannot stat '/mnt/user/appdata/other/mergerfs/mergerfs': No such file or directory /tmp/user.scripts/tmpScripts/rclone mount/script: line 84: mergerfs: command not found ive added a sleep 10 entering the commands now by hand in termianl.
  6. That was the first i did... its not the local permissions... its the remote mount Read-only file system
  7. I never changed these, i tried rw slave, but not difference. But its nothing about radarr. I cant even delete it in temerinal from unraid.. rm: cannot remove '/mnt/user/mount_unionfs/google_vfs/Filme/movie (1995)/movie 1995.avi': Read-only file system theres something wrong with the mergefs mount command mergerfs /mnt/user/Archiv:/mnt/user/rclone_upload/google_vfs:/mnt/user/mount_rclone/google_vfs=RO /mnt/user/mount_unionfs/google_vfs -o rw,async_read=false,use_ino,allow_other,func.getattr=newest,category.action=all,category.create=ff,cache.files=partial,dropcacheonclose=true mnt user archiv is my local storage (should be RW)
  8. Ok ive upgraded unraid and changed it to cache. Still same problem I cant delete \mount_unionfs\google_vfs\Filme\movie (1995)\file.avi root@Unraid-Server:~# rm /mnt/user/mount_unionfs/google_vfs/Filme/movie \ \(1995\)/Jumanji\ 1995.avi rm: cannot remove '/mnt/user/mount_unionfs/google_vfs/Filme/movie (1995)/movie 1995.avi': Read-only file system
  9. Ok, first i install the new update. Thanks. Thats my mount: fusermount -uz /mnt/user/mount_unionfs/google_vfs #old unionfs -o cow,allow_other,direct_io,auto_cache,sync_read /mnt/user/rclone_upload/google_vfs=RO:/mnt/user/Archiv=RW:/mnt/user/mount_rclone/google_vfs=RO /mnt/user/mount_unionfs/google_vfs #new # removing old binary as a precaution rm /bin/mergerfs docker run -v /mnt/user/appdata/other/mergerfs:/build --rm trapexit/mergerfs-static-build mv /mnt/user/appdata/other/mergerfs/mergerfs /bin mergerfs /mnt/user/Archiv:/mnt/user/rclone_upload/google_vfs:/mnt/user/mount_rclone/google_vfs=RO /mnt/user/mount_unionfs/google_vfs -o rw,async_read=false,use_ino,allow_other,func.getattr=newest,category.action=all,category.create=ff,cache.files=partial,dropcacheonclose=true #new
  10. Yeah... i thought the problem is the source, but, its not, its the destination... it cant delete the destination... saomething is wrong with the mount
  11. where? do you mean the volume mapping? /downloads /mnt/user/downloads/ to /downloads /mnt/cache/downloads/? But isnt it recommended to use the user shares..?
  12. Sorry, what exactly you mean by "appdata link"? My appdata is always on "cache only" edit: no smethingis wrong with the mount. I cant even delete the file via smb.. i can delete it, it vanishes and after some refreshes its back.. wtf
  13. Hmm today i found some errors in radarr: 20-1-11 12:23:02.4|Warn|ImportApprovedMovie|Couldn't import movie /downloads/completed/Filme/movie.1995.German.AC3.BDRip.x264-DHARMA-xpost/Jumanji.1995.German.AC3.BDRip.x264-DHARMA.mkv [v0.2.0.1459] System.UnauthorizedAccessException: Access to the path "/Archiv/Filme/movie (1995)/movie 1995.avi" is denied. at System.IO.File.Delete (System.String path) [0x00073] in <254335e8c4aa42e3923a8ba0d5ce8650>:0 at NzbDrone.Common.Disk.DiskProviderBase.DeleteFile (System.String path) [0x00068] in C:\projects\radarr-usby1\src\NzbDrone.Common\Disk\DiskProviderBase.cs:205 at NzbDrone.Core.MediaFiles.RecycleBinProvider.DeleteFile (System.String path) [0x00054] in C:\projects\radarr-usby1\src\NzbDrone.Core\MediaFiles\RecycleBinProvider.cs:90 at NzbDrone.Core.MediaFiles.UpgradeMediaFileService.UpgradeMovieFile (NzbDrone.Core.MediaFiles.MovieFile movieFile, NzbDrone.Core.Parser.Model.LocalMovie localMovie, System.Boolean copyOnly) [0x0005b] in C:\projects\radarr-usby1\src\NzbDrone.Core\MediaFiles\UpgradeMediaFileService.cs:52 at NzbDrone.Core.MediaFiles.MovieImport.ImportApprovedMovie.Import (System.Collections.Generic.List`1[T] decisions, System.Boolean newDownload, NzbDrone.Core.Download.DownloadClientItem downloadClientItem, NzbDrone.Core.MediaFiles.MovieImport.ImportMode importMode) [0x00258] in C:\projects\radarr-usby1\src\NzbDrone.Core\MediaFiles\MovieImport\ImportApprovedMovie.cs:109 Any idea? it cant import some new movies? I can access that file via smb, tho. mount_unionfs\google_vfs\Filme\movie (1995) root@Unraid-Server:~# ls -ls /mnt/user/mount_unionfs/google_vfs/Filme/movie\ * /mnt/user/mount_unionfs/google_vfs/Filme/movie (1995): total 1493104 1493104 -rw-rw-rw- 1 root root 1528938496 Aug 14 2011 movie\ 1995.avi
  14. And yes its np, i also upgraded later.
  15. Is it safe to upgrade if you had problems with log spamming VMs?
  16. I dont think it worked (atleast it didnt installed mergefs), but plex didnt noticed anything missing... mysterios. But good for me. lol
  17. Yes, it will move all files. What projects we are talking about? Only photos? I think the "safest" way would be 1.) create a share CACHE ONLY /mnt/user/*insert your share name here* 2.) create a share Archiv (maybe set cache to YES) /mnt/user/*insert your share name2 here* 3.) create/find a rsync command for moving files older then X to Archiv (use user scripts plugin to run the script every X) Move from /mnt/user/*insert your share name here* to /mnt/user/*insert your share name2 here* Like others already said, you must be very careful where and how you move files on unraid. Is it really that critical if your photos get read from non cache? I mean, they wont be 100s of GB?
  18. So ive read in the internetz and -it means interactive mode, which isnt needed "The -it instructs Docker to allocate a pseudo-TTY connected to the container’s stdin; creating an interactive bash shell in the container." Ive looked at github and you didnt added a mkdir command there, is it needed.. or not? What i really wonder tho is, i also got the TTY error, but thought thats normal... why did everything seems to work... when that command didnt work? O.O
  19. Its literally what youve posted, just chained together, so it starts with Filme, then goes to Series and so on... && rm /mnt/user/appdata/other/speed/* is just there to make my "limit upload bw script" working... yeah ive noticed it does more mb/s then my connection should be capable of
  20. Ok, ive changed it and restartet, seems to work (?). Atleast all dockers seems to have startet. (tehy shouldnt start if mount is not working) I could write and read data to and from \mount_unionfs\google_vfs\ does that mean its working? rename is instant (but i never notcied it was, if im real) Only one problem left (i posted this some pages ago) The upload script doesnt do what it should in the documentation for rclone move it says it will overwrite data, but im not sure if its correct. thousends of 2020/01/04 02:01:02 DEBUG : Name1 (2008)/Name1 2008.mkv: Sizes differ (src 24396751949 vs dst 1720934864) 2020/01/04 02:01:02 DEBUG : Name3 (2017)/Name3 2017.mkv: Sizes differ (src 13663756845 vs dst 4746737011) 2020/01/04 02:01:02 DEBUG : Name4 (2012)/Name4 2012.mkv: Sizes differ (src 23590880172 vs dst 7592177683) 2020/01/04 02:01:02 NOTICE: Name5 (1975)/Name4 1975.mkv: Duplicate object found in destination - ignoring 2020/01/04 02:01:02 DEBUG : Name5 (1975)/Name4 1975.mkv: Sizes differ (src 15120966311 vs dst 4675106354) This are only notices(?), does that mean it will get at some point overwritten? rclone move --rc --rc-addr=192.168.86.103:5573 --rc-user=test --rc-pass=test /mnt/user/Archiv/Filme gdrive_media_vfs:Filme -vv --drive-chunk-size 128M --checkers 4 --fast-list --transfers 2 --exclude .unionfs/** --exclude *fuse_hidden* --exclude *_HIDDEN --exclude .recycle** --exclude *.backup~* --exclude *.partial~* --delete-empty-src-dirs --fast-list --tpslimit 3 --min-age 1y && rm /mnt/user/appdata/other/speed/* && rclone move --rc-addr=192.168.86.103:5573 --rc-user=test --rc-pass=test /mnt/user/Archiv/Serien gdrive_media_vfs:Serien -vv --drive-chunk-size 128M --checkers 4 --fast-list --transfers 2 --exclude .unionfs/** --exclude *fuse_hidden* --exclude *_HIDDEN --exclude .recycle** --exclude *.backup~* --exclude *.partial~* --delete-empty-src-dirs --fast-list --tpslimit 3 --min-age 1y && rm /mnt/user/appdata/other/speed/* && rclone move --rc-addr=192.168.86.103:5573 --rc-user=test --rc-pass=test /mnt/user/Archiv/Musik gdrive_media_vfs:Musik -vv --drive-chunk-size 8M --checkers 4 --fast-list --transfers 2 --exclude .unionfs/** --exclude *fuse_hidden* --exclude *_HIDDEN --exclude .recycle** --exclude *.backup~* --exclude *.partial~* --delete-empty-src-dirs --fast-list --tpslimit 3 --min-age 1y && rm /mnt/user/appdata/other/speed/*
  21. Its always the small things! np!
  22. Just to be sure, after you clicked "on", did you click apply? edit: seems to be working fine for me
  23. https://iperf.fr/iperf-download.php https://www.linode.com/docs/networking/diagnostics/install-iperf-to-diagnose-network-speed-in-linux/ iperf tests are only in RAM so its SSD/HDD unrelated, it just tests the link speed. But i think like johnnie on my Samsung 850 Pro (if i recall correct) i also only getting 300mbs for some time (or GB). If you have a chance to get your hands on a nvme drive, this will greatly improve your performance. They can easily read and write 2000MB/s Corsair Force MP510 960 GB NVMe PCIe Gen3 x4 M.2-SSD (bis zu 3,480 MB/s) is what i use currently for my 10gbit uplink
  24. Thanks. Ill try that and restart and report back. edit: In the mean time... im again a little bit confused. My "extra" directory is missing in your line. (/mnt/user/Archiv - so this wouldnt work for me?) Thats my old command: I dont use rclone upload folder anyway. I run this:
  25. There is even a mover plugin, where you can change pretty much everything. But i still dont get your problem "@Nuhll I now about de the caching options, but the problem as stated is that the entire share will be located on the cache drive.. I ONLY wan't the newest projects to be on there." Thats wrong. If you choose e.g. YES then all new things go to cache (fast), and will be moved to array (when you want) e.g. ive set mine mover to only move if less then 50% is free on cache drive. "Last thing to change is an rsync command to sync the cache to a HDD share for extra duplication of files. (Just now I had 2 ssd drives fail in a 4 drive cache pool.. I sync the pool every day, so nothing lost there but feels a bit safer this way.)" You can add mutliple cache drives and have it protected also. (thats how i do it) "2. Mover is invoked; it checks to see if the 1tb threshold has been hit (it has in this case). 3. Mover moves only the amount of data needed to get under the 1tb threshold to the HDD's. FIFO style (Oldest directories first)" That seems so overcomplicated and useless, if you ask me. If you need that u should hire someone on fiver to create a bash script for some bucks. (but i dont see any reason why you want to do it that way, the built in unraid way (official way) seems perfectly fine for that sort of work you describe.