lukeoslavia

Members
  • Posts

    51
  • Joined

  • Last visited

Posts posted by lukeoslavia

  1. Hello, my server is running version 6.12.3. I have an array with parity and several drives.  I also have a handful of pool/cache pools.

     

    For one of my pools im using an ssd with ZFS as a writecache for media files. The share is set to use the Writecache as its primary storage and the array as secondary storage. When I write files to the share, the write speeds are very slow usually around 4 MB/s sometimes it gets up to ~35 MB/s but thats as fast as Ive seen it go.

     

    On other cache only pools using ZFS and BTRFS the write speed is as fast as I can send it via ethernet (115 MB/s).

     

    Is there perhaps some new configuration needed for using a write cache in unraid 6.12? or maybe I have just configured something wrong. I am attaching a picture of my share settings and any help would be appreciated.382930461_Screenshot2023-07-23151144.thumb.png.a43fdfb468d2707d8ae61ea2c01b2ae6.png 

  2. I am trying to run this on docker desktop. With openvpn I can connect fine, but when I try to use wireguard I get this same series of messages repeating.

    Spoiler
    2023-07-07 10:44:28 2023-07-07 14:44:28,512 DEBG 'start-script' stdout output:
    2023-07-07 10:44:28 [info] Attempting to bring WireGuard interface 'up'...
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,535 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 Warning: `/config/wireguard/wg0.conf' is world accessible
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,554 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 [#] ip link add wg0 type wireguard
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,557 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 [#] wg setconf wg0 /dev/fd/63
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,655 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 [#] ip -4 address add 10.12.178.109 dev wg0
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,667 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 [#] ip link set mtu 1420 up dev wg0
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,742 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 [#] wg set wg0 fwmark 51820
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,744 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 [#] ip -4 route add 0.0.0.0/0 dev wg0 table 51820
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,748 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 [#] ip -4 rule add not fwmark 51820 table 51820
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,753 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 [#] ip -4 rule add table main suppress_prefixlength 0
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,760 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 [#] sysctl -q net.ipv4.conf.all.src_valid_mark=1
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,762 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 [#] iptables-restore -n
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,816 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 Warning: Extension CONNMARK revision 0 not supported, missing kernel module?
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,816 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 Warning: Extension CONNMARK is not supported, missing kernel module?
    2023-07-07 10:44:28 iptables-restore: line 7 failed
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,828 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 [#] ip -4 rule delete table 51820
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,836 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 [#] ip -4 rule delete table main suppress_prefixlength 0
    2023-07-07 10:44:28 
    2023-07-07 10:44:28 2023-07-07 14:44:28,853 DEBG 'start-script' stderr output:
    2023-07-07 10:44:28 [#] ip link delete dev wg0
    2023-07-07 10:44:28 
    2023-07-07 10:44:29 2023-07-07 14:44:29,256 DEBG 'start-script' stdout output:
    2023-07-07 10:44:29 [warn] WireGuard interface failed to come 'up', exit code is '1'

     

    I have tried the default config that gets generated and I made my own with hsand/pia-wg generator but I get the same result either way. Is there something I am not configuring properly?

  3. I am trying to setup SMB multichannel, potentially with RSS as well, between my unraid NAS and my windows server 2022. I have tried several configurations but I just cannot seem to get a connection to the unraid share with multichannel.

     

    Both machines are DL360 Gen9's. The nas has 64gb ram and the windows machine 192gb ram and the processors are different models, but other than that specs are equal. Unraid is version 6.12.2.

     

    What I've tried so far:

    Windows configuration:

    • 4x 1gbe ports in a NIC team (LACP / 802.3ad)
    • Verified multichannel is enabled
    • Verified the nic team has RSS enabled
    • Checked that the interface throughput is 4gbps

    Ignore the first result, I disabled and re-enabled RSS as an attempted fix...

    SMBWindows.png.c6ff07332b001a6f3f9cab596ee771cb.png

     

    Unraid config:

    • I have tried all 4 of the ethernet ports separated and then added to the SMB extra commands:
    server multi channel support = yes
    aio read size = 1
    aio write size = 1
    interfaces = "10.10.30.1;capability=RSS,speed=1000000000" "10.10.30.2;capability=RSS,speed=1000000000" "10.10.30.3;capability=RSS,speed=1000000000" "10.10.30.4;capability=RSS,speed=1000000000"

    This didn't work, I got no additional throughput and wasn't able to copy multiple items at 1gbps even.

     

    • I tried also just enabling Multichannel in the smb settings dropdown without any additional config with the same result.

     

    Current and closet to a good result config:

    • SMB multichannel enabled in the smb settings dropdown.
    • All 4 ethernet ports in an 802.3ad bond (LACP / Mode 4)

     

    With this setting I cannot get a multichannel SMB copy, but I installed the openspeedtest docker to test throughout the process and with this configuration I am getting 1gbps download speed and 3 - 3.5gbps upload. Super odd that it isn't full duplex this way!?

    openspeedtest.thumb.png.b463979c2710136cd1b91cdaa04c59f2.png

    1711258672_unraidspeedtest.thumb.png.82587d0885510cb36afd6cb6d5e005c4.png

     

     

    This is where I currently am. I am not sure if multichannel is not currently working in unraid, or if I am configuring something wrong, but if anyone could help me get this going better I would greatly appreciate it! 

  4. Last week I switched over my NAS from a custom built AMD computer to a DL360 gen9. Since the switch I have added a disc shelf and raid card and changed the gpu to a low profile card.

     

    Every 1-3 days so far I randomly see my docker containers stop working and when I can load the docker page none of the containers appear. I was lucky enough to see the syslog this time when it occured though.

     

    When I set it to errors only I see this:

    Jul  4 10:37:07 NAS kernel: CPU: 6 PID: 56221 Comm: ffmpeg Tainted: P        W  O       6.1.36-Unraid #1
    Jul  4 10:37:07 NAS kernel: Call Trace:
    Jul  4 10:37:09 NAS kernel: CPU: 49 PID: 56430 Comm: nvidia-smi Tainted: P      D W  O       6.1.36-Unraid #1
    Jul  4 10:37:09 NAS kernel: Call Trace:
    Jul  4 10:38:10 NAS kernel: CPU: 2 PID: 56460 Comm: nvidia-smi Tainted: P      D W  O       6.1.36-Unraid #1
    Jul  4 10:38:10 NAS kernel: Call Trace:
    Jul  4 10:41:10 NAS kernel: CPU: 2 PID: 56460 Comm: nvidia-smi Tainted: P      D W  O       6.1.36-Unraid #1
    Jul  4 10:41:10 NAS kernel: Call Trace:
    Jul  4 10:44:10 NAS kernel: CPU: 2 PID: 56460 Comm: nvidia-smi Tainted: P      D W  O       6.1.36-Unraid #1
    Jul  4 10:44:10 NAS kernel: Call Trace:

     

    There are stack traces in the full log as well, but im wondering if this means there is something wrong with the gpu im using or maybe the driver plugin?

  5. On 10/22/2022 at 9:04 PM, CS01-HS said:

    In Live TV -> Advanced I see Default recording path

    Does setting that change where emby stores tmp live TV files?

     

    it does not seem to, I have paths set for movies and tv separately, but the transcoding files are on a separate ssd.

     

    On 10/22/2022 at 9:04 PM, CS01-HS said:

    Well that's easy enough to fix even with an unraid user script.

    Something like this that runs every hour, deleting ts files more than an hour old:

    find /host/path/to/transcode/dir/ -type f -name '*.ts' -mindepth 1 -mmin +60 -delete

     

    You could even restrict it to files above a certain size with -size +100M

     

    I honestly never think to use a script for pretty much anything, but I will give this a shot. I will probably have to modify it a bit to accommodate sporting events.

    Thanks for the tip! 

    • Like 1
  6. 11 hours ago, CS01-HS said:

     

    No sorry, I don't use live TV so I've never tested it.

    I'm guessing they do that for DVR functionality (serves as a reference file which in the standard case is the media itself.)

     

    In the best case my script won't have any effect, in the worst case it'll delete it which could break things.

    If active live TV files can be differentiated by name the script could be tweaked to ignore them, or if not we can infer by size (greater than X.)

     

    What are you trying to solve exactly, because my guess is creation of these large files with live TV is unavoidable.

    I would love to have these large files eliminated so I can use ram as the transcode disk, but like you said, they seem to be intentionally created. I requested a feature to turn off "time-shift" on their forums to which they replied, we have part of the functionality now, and then closed it lol.

     

    My main problem with the large files is that they never get deleted unless I restart the emby server (even when properly closed), which doesn't happen in windows.

  7. On 10/16/2022 at 10:58 AM, ich777 said:

    With Kernel 6.0.0 you have to unload the Kernel module first and then force the correct probe:

    modprobe -rf i915
    modprobe i915 force_probe=56a5

     

    Or you simply create the i915.conf file in the modprobe.d directory:

    mkdir -p /boot/config/modprobe.d
    echo "options i915 force_probe=56a5" > /boot/config/modprobe.d/i915.conf

     

    From our testing with Jellyfin it won't work currently with Kernel 6.0.0 but I will compile a custom build with Kernel 6.0.1 shortly and we will try again.

    @ich777 I have an arc a380 and would like to test it with emby. Could I get the details on your custom build with 6.0.1?

  8. Hello, as of yesterday the container doesn't seem to be starting up privoxy.  Everything else seems fine, but the portion of the logs during start up that used to say Privoxy is listening on port 8118 no longer appears. Has there been a recent change that might have broken that part of the container? If so, is there a version I should rollback to?

    • Upvote 2
  9. Just an update, plugged in a dual port pcie network adapter (intel something or other) and thats working. Not sure why the 4 port on board ports wont work with this unraid instance, but I had a trial usb stick going on the server before to verify I wanted to use this server for unraid, and the 4 ports worked then.

     

    either way, I can use my unraid server again, but id like to know why the onboard nics wont grab an ipaddress.

  10. Hello, Today I moved all of my drives to a different server and when I boot up the new server it will not get an ipv4 or ipv6 address(don't really want v6).

     

    I made a backup of my flash before the move and the first thing I tried was to delete the network.cfg and network-rules.cfg files, since that has saved the day before, however, these files are not on the drive, or the backup.

     

    I cannot seem to boot into the gui, but can get into the safe mode gui, but I still don't know what is stopping the networking.

     

    I would really like to save my array config as I have 24TB of data on the array. Any help would be appreciated! Thanks!

    casnas-diagnostics-20220707-2105.zip

  11. Well, I left the puid and pgid alone, the default they were set to was:

    puid: 99

    pgid: 100

     

    but when I ran Id from the console, it said they were both 1000.

     

    I tried running chmod <PUID>:<PGID> -R /directus/uploads/ from the container, and then from unraid terminal with the host path. but it says chmod: invalid mode: '99:100' (I also tried 1000:1000 since thats what the container reported)

     

    the chown 755 -R /directus/uploads/ commands worked, but didnt seems to fix the issue.

  12. Hello, I am having a couple of minor issues with the container, maybe permission related? 

    When we try to upload any image (or file) we get the following error in the log:

    Error code: EACCES
    Original stack:
    Error: EACCES: permission denied, open '/directus/uploads/90e3355a-57c1-4807-9119-6319c0c54935.png'
    08:00:04 request errored POST 503 /files 21ms

     

    I was hoping maybe you knew of a solution.

     

    Also, when I go to edit my admin account info, when the page opens, a dialog box pops up with

    [FORBIDDEN] You don't have permission to access this.

  13. Has there been any changes to the library monitor by chance?

     

    I added the new plugin to ignore recently modified files, but I've noticed that unmanic doesn't seem to watch the library any more. I set the scanner to ~200 and that is picking things up now, but if I turn that off and just use the Library monitor toggle, nothing seems to be getting added to the queue.

     

    Either way I've worked around it, just wondering if maybe something has changed in terms of watching the library.

  14. 2 hours ago, Josh.5 said:


     

     


    Do the files have a suffix appended when they are still being written to (before the .ts)? If so you can use the path ignore plugin with some regex to ignore those files.

    I can make a plugin to ignore files under a configured age. Eg. Ignore files newer than 1 hour. That will prevent your ones being picked up while still being written to.

    The last option is to not use the library scanner with these files. Use the event monitor. That will only pickup files on completion of writing.

     

    I'm not certain but I don't think they have any suffix. But the plugin you mention sounds about like what I was saying. I know with MCEbuddy there was an option to wait until a file hasn't been modified for 1 minute and up to 60 days or something like that.  

    • Like 1
  15. Feature suggestion: I was recording the formula 1 race this morning and UnManic detected the file, then began converting it before the race was finished recording. If the watcher can wait X amount of minutes since the file was last modified to add it to the queue, it should solve the problem.

     

    My (hopefully) short term fix is to not scan for an .ts files.

  16. Out of curiosity, since there are now required plugins, will I need to be a patreon supporter to use unmanic? I ask because now it seems that in order to re-encode anything, you need a plugin like H265 NVENC / QSV / CPU or H264 NVENC / QSV / CPU.

     

    Also will it be possible to change the container to mp4? it seems like it is just defaulted to mkv now and I dont see any way to change that.

  17. 11 hours ago, Josh.5 said:

    First of all thanks for taking Unmanic for a spin.

    Patreon does not charge until the first of the month. So you hav til then to decide if the additional stuff is worth it for you.
    That being said, the next major release will enable a limited number of plugins for everyone to use without signing into anything.

    Also, it is worth saying that the way that I have written the plugins, they will reprocess files that have already been converted. Eg, if you convert them to hevc now and in a few months time you want to run the plugin that reorders subtitles, it will do that to your library without reencoding the video streams. So you absolutely can process your library while waiting for a plugin to fix that other need of yours.

    Its good to hear some of the plugins are going free, but I also second the removal of multi-language audio and subs. And to a lesser degree seeing the plugins first, but as you explained, that's not as big an issue.

     

    The re-order plugin seems to do its job just fine, but so far, for me anyway, emby still seems to pick a random language unless I set one on each individual player.

     

    That's fine and well for me, but for the rest of my family that doesn't really understand how it all works, it would be great to remove the extra steps for them once and never have to worry about it again.

     

    On the positive side though, your folder watch seems to work better than most of the other programs I've used, and the ease of use goes far beyond anything else so kudos there! 

  18. 2 hours ago, Josh.5 said:

    I can make you a plugin to do that this week. No problem.
    Did you find the plugin for removing images from the video files?

    I did find that plugin, and it did work, but I decided just to go ahead and convert everything to MKV since I cant remove the audio files and subs. If that function becomes available I can definitely use it! but I'm also happy enough to just have everything copied over to the new format.

     

    The container is super easy to use once you figure out a few things,  I just cant help but wonder how much space I could save by getting rid of extra audio tracks! 

  19. 2 hours ago, Josh.5 said:
    3 hours ago, lukeoslavia said:
    I am having some trouble getting started with this container.
     
    I have a large TV library and would like to have it all converted as HEVC mp4 files. If I try to convert to mp4 however, I keep getting errors on most of the files and I cannot figure out how to fix it. When I keep all of the settings the same and try to transcode to HEVC .MKV files, it goes without issue.
     
    My settings are Mp4 Container / AAC audio + Stereo AAC / HEVC NVENC
    Most files output this error, if the file is already an HEVC MP4, it just remuxes it and throws in the stereo AAC track.
     
    
    
    title : s02e12 - Jolly Old St. Dick    encoder : Lavf57.56.101  Duration: 00:22:10.11, start: 0.042989, bitrate: 3256 kb/s    Stream #0:0(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p, 1280x720, 3052 kb/s, 29.97 fps, 29.97 tbr, 90k tbn, 59.94 tbc (default)    Metadata:      handler_name : VideoHandler    Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 193 kb/s (default)    Metadata:      handler_name : SoundHandler    Stream #0:2: Video: png, rgb24(pc), 667x500 [sAR 3779:3779 DAR 667:500], 90k tbr, 90k tbn, 90k tbc (attached pic)Stream mapping:  Stream #0:0 -> #0:0 (h264 (native) -> hevc (hevc_nvenc))  Stream #0:2 -> #0:1 (png (native) -> hevc (hevc_nvenc))  Stream #0:1 -> #0:2 (copy)Press [q] to stop, [?] for help[mp4 @ 0x55c86394f0c0] Could not find tag for codec hevc in stream #1, codec not currently supported in containerCould not write header for output file #0 (incorrect codec parameters ?): Invalid argumentError initializing output stream 0:0 --Conversion failed!
     

     
    Any help would be greatly appreciated! 

    Have you got access to the plugins? There is one in there that will strip out the PNG stream that is causing the error with Unmanic

    So I went ahead and supported your patreon to get that plugin, but didnt see any plugins that could help me reduce the number of audio streams. Is there any current way I can do this. I would like to just pick a single English audio track, or even copy all english audio tracks, but remove any other languages. 

  20. I am having some trouble getting started with this container.

     

    I have a large TV library and would like to have it all converted as HEVC mp4 files. If I try to convert to mp4 however, I keep getting errors on most of the files and I cannot figure out how to fix it. When I keep all of the settings the same and try to transcode to HEVC .MKV files, it goes without issue.

     

    My settings are Mp4 Container / AAC audio + Stereo AAC / HEVC NVENC

    Most files output this error, if the file is already an HEVC MP4, it just remuxes it and throws in the stereo AAC track.

     

    title : s02e12 - Jolly Old St. Dick
         encoder : Lavf57.56.101
       Duration: 00:22:10.11, start: 0.042989, bitrate: 3256 kb/s
         Stream #0:0(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p, 1280x720, 3052 kb/s, 29.97 fps, 29.97 tbr, 90k tbn, 59.94 tbc (default)
         Metadata:
           handler_name : VideoHandler
         Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 193 kb/s (default)
         Metadata:
           handler_name : SoundHandler
         Stream #0:2: Video: png, rgb24(pc), 667x500 [SAR 3779:3779 DAR 667:500], 90k tbr, 90k tbn, 90k tbc (attached pic)
    Stream mapping:
       Stream #0:0 -> #0:0 (h264 (native) -> hevc (hevc_nvenc))
       Stream #0:2 -> #0:1 (png (native) -> hevc (hevc_nvenc))
       Stream #0:1 -> #0:2 (copy)
    Press [q] to stop, [?] for help
    [mp4 @ 0x55c86394f0c0] Could not find tag for codec hevc in stream #1, codec not currently supported in container
    Could not write header for output file #0 (incorrect codec parameters ?): Invalid argument
    Error initializing output stream 0:0 --
    Conversion failed!

     

    Any help would be greatly appreciated! 

  21. I grabbed two of these, one for my unraid box, and one for my pc.

    https://www.amazon.com/HP-Connectx-2-671798-001-666172-001-Refurbished/dp/B07HFKD3NR/ref=sr_1_36?dchild=1&keywords=10gbe+pcie&qid=1596118659&sr=8-36

    Though they were only $29.99 when I got them, not sure why the price hike.

     

    I found this while on amazon though and it may work for you, same thing essentially, just has two ports instead of 1:

    https://www.amazon.com/HP-NC523SFP-2-Port-Adapter-593717-B21/dp/B004JU2MUI/ref=sr_1_23?dchild=1&keywords=10gbe+pcie&qid=1596118795&sr=8-23

     

    Though according to the reviews it seems it will need active cooling or it will overheat. Also there is a red heatshielded Asus RJ-45 10gbe card out there that sells for $49-$149 depending on seller whimsy, but it is not SFP+.