Josh.5

Enable debugging in the settings

I did last week overhaul the incoming task lists. This overhaul opens up the potential of that task list. In the future t will finally give us the ability to start modifying the pending tasks list and perhaps add the ability to shift things around, or modify settings per task before it gets to a worker, save the list between application restarts, mark a file in an ignore list so it's never added again, etc. That was a solid days work on its own. Fun tho.

The issue is the page being loaded does not paginate the query. And the query is not optimised as an SQL dataset. Switching to mysql will not improve page load times. The orm calls for those pages need to be optimised. This is something already on my to-do list and will probably be a few hours of work to do properly when I get the time. No ETA ATM.

I don't qs is configured correctly. And I don't really have a way to test unfortunately. A PR on GitHub would be nice if anyone wants to make the necessary changes and test for me. They should only be a couple of lines.

I'd be interested to know how it is struggling. Sqlite tables can handle millions of table entries without issue. It something is struggling, it's how the query is written and needs to be optimised. It is my opinion that using mysql for this app is a waste of time, but I'm happy to be wrong.

The root folder needs to be removed. As much as it pains me to say it, this docker is not very well put together. I made it with the intent of just spending an hour or 2 getting it working and then leaving it there. So its very slapdash. Sorry. I committed this change to master this morning. So it should be available to you all now.

The stuff I'm working on at the moment will give us the ability to edit the history list (delete them) as well as sort and delete the pending task list. It should hopefully improve performance also with large about a of pending tasks. Not sure when it'll be completed, it's a reasonably large set of changes (I'm already upwards of 10-15 hours on this feature and may be only half way). It's my intention to add some overall stats next. This is definitely a possibility now with how the historic data is stored, I just have not added it to the UI yet.

Sure, is there anything else? I'm getting my pen out... Let me write this down.

It probably needs a small patch to just copy the pgs. I'll look into it at some point this month

It's your config that's the issue. You cannot save bitmap subtitle streams in a mkv container. Use Avi or something that does support it.

Can you paste in the ffmpeg log from the history of that task?

If you are willing to test it, I can buil a dev- tag docker image for you to download. I had issues on my laptop getting it playing nicely.

Updated the first post with new instructions...

Yea. The "latest" tag now has all the nvenc stuff added. You can get rid of that "dev-hw-encoding" tag now. Thanks.

That is awesome! Perhaps I will setup the Nvidia drivers on my unraid. There isn't an error. It's just a warning message saying the nvenc_hvec encoder is depreciated. I guess that is that anyway. Thanks for testing. I'll update the unraid template and merge all these changes.

Perfect. So to get this working, you setup the Linuxserver.io Nvidia plugin on your unraid. Then on the unmanic configuration you added the extra parameter: --runtime=nvidia Then added 2 new docker parameters: NVIDIA_VISIBLE_DEVICES=GPU GUID NVIDIA_DRIVER_CAPABILITIES=all And that's it. Is this right?

Awesome. Great to hear the container works for access to the GPU. I'll need to update the unraid template with what changes you made. Could you please send me a screenshot?

As far as I could tell, nvenc_hevc is an older now deprecated encoder. Use the newer hevc_nvenc one? I don't know what the difference is (if there Is any), but using the nvenc_hvec one will give you a warning at the start of your ffmpeg conversion logs

Sounds good

They are locked in. I plan on adding "advanced settings" later in the future, but for now, this is how it is.

I'd be curious to know if you do get reduced size on the outputs with nvenc. I found that while the conversion is fast, the results on all of my sample files were much bigger. I may be doing something wrong, but I think the CPU encoding is far superior. For example, I have a 10mb h264 file. If I convert it to h265 with the lib265 encoder, it reduces to a 4.2mb file in 25 seconds. The hvec_nvenc encoder transcoding the same h264 10mb file completed the task in 7seconds, but increased the file size to 17mb. I played around with all the buffers and stuff, and it was a lot of dicking around to get nowhere. If this was a trans code from a large 4k file to a compressed 720p, then I think it would be worth having the nvenc encoder, but for keeping the same quality, I do not think it will do what you need.

There is a new docker image available for anyone who is game enough to try it. Edit the Unmanic docker config in Unraid and set the docker image repository to 'josh5/unmanic:dev-hw-encoding' I have not tested this docker image with nvidia or intel HW accelerated encoding yet (and I don't want to as its just too much effort for minimal if any return). Testing it out running unmanic nativity works fine. In theory, if you follow the same steps used to enable plex HW encoding with the linuxserver.io Plex container, then it should work. Thanks.

I've done a bunch of stuff this week. I'm not sure about being out of beta, but the code is starting to become more structured to a permanent standard which means we're getting closer to being out of beta. I think the app is pretty close to a point now where no more major changes will require a clean install or anything. There is one other thing I need to do yet and that is to move all the task queues to the database. That change may or may not yet require a clean install. Once that is done, I think I'll push unmanic out if beta. Today I'm testing Nvidia hardware encoding changes (not yet available via docker) so far so good.

There would be a fair amount of work involved in making this happen. I would probably guess around 20+ hours and then a crap ton of fiddling with it because videos come in all kinds of different shapes with different names for the subtitle streams etc. This could easily sink down a rabbit hole that just is not worth it for this application. I won't delete the issue on GitHub, but unless someone else wants to take on that project, it probably won't get done.

Not sure about sshfs, but in the past someone had an issue with a cifs mount. They needed a slightly different setup to make it work: https://github.com/Josh5/unmanic/blob/master/docker/docker-compose-cifs.yml