trekkiedj
-
Posts
91 -
Joined
-
Last visited
Content Type
Profiles
Forums
Downloads
Store
Gallery
Bug Reports
Documentation
Landing
Posts posted by trekkiedj
-
-
@Josh.5 no rush my friend. We all have higher priorities than our media collection 🙂
Just to summarize my wish list:
- Hardware encoding by passing through the Nvidia GPU now drivers are supported by unraid (similar to Plex passthrough)
- Ability to append a specified string to the filename of the converted file to force Sonarr and Radarr to re-scan the file and not download a HEVC version unnecessarily.
- Ability to Schedule conversions to "off-peak hours"
-
For me the other almost imperitive addition would be to be able to automatically add a string to the converted filename (something like "re-encode") which will then force Radarr/Sonarr to reanalyse the file and note the new codec.
Without the renaming option, Radarr and Sonarr wont re check the file and will still think it is h264 or mpeg4 and when a h265 file is available, re-download it which is a waste of time.
-
@Josh.5 I have found a small bug. Where the file-type (therefore extension) differs pre and post conversion, the file gets re-added back into the queue on next scan. See below where the same three files previously encoded have been re-added because the original was MP4 or TS or AVI
Edit: It seems to add new files without checking whether conversion is necessary. I recently upgraded a movie to 4k HEVC and it has added that to the queue.
-
18 hours ago, ice pube said:
Would love to get GPU transcoding in this docker with the new nvidia LSIO plugin.
I second this. It would make the encoding much quicker
-
34 minutes ago, Josh.5 said:
This is not hard coded. This is a request from an open browser. Check on your network what device is 192.168.0.12, it will have an open browser tab looking at the webUI dashboard.
This will be polling every 5 seconds for an update for the workers.
These logs are already on my todo list to move to their own file like I did with the main service logs and implement a log rotation of 7 days
Ahh yes, the ip in my log is my laptop. so that makes sense.
-
3 minutes ago, itimpi said:
I agree it can change as I have a different value displayed when I run Unmanic under docker. However I have made a few installs under Linux on SBC systems and they all seem to show that address. I guess I was wondering what is the meaning of it if it is not a system that is actually on my local LAN.
I'm getting this which is incidentally one IP under the server address:
[I 190211 18:44:30 web:2162] 200 GET /?ajax=pendingTasks&format=html (192.168.1.130) 539.42ms
@Josh.5 I am also getting this:
[W 190211 18:53:30 pyinotify:929] Event queue overflowed.
[2019-02-11 18:53:50,778 pyinotify WARNING] Event queue overflowed. -
8 minutes ago, itimpi said:
I am seeing messages displayed of the form:
304 GET /?ajax=workersInfo (192.168.0.12) 7.13ms
What is strange is I do not see where that IP address has come from. It is NOT the address of the system running Unmanic. It is almost as if that address is hard-coded somewhere?
thats not the address i see. I think its different from install to install
-
8 minutes ago, Josh.5 said:
Yea you guys were right. I made a mistake with the config that cased it to try and export our logger to the settings file... oops.
As you predicted this broke things like running a scan on start as the settings file was corrupted and everything reverted to defaults.
There is an update building now. Once you have it just open the web UI to the settings tab and click the "Submit" button to save the settings (this will over write the buggered settings file). Make sure you also double check that all the settings are correct, they have likely reverted back to the defaults.
I've added an update to my todo list (https://github.com/Josh5/unmanic/issues/21) that will add a layer of protection against this in the future. This will be easy enough to implement.
Thanks for the report
Yep, thats sorted it. Thanks!
-
2 hours ago, itimpi said:
Interesting! It was working for me previously so I assume this is a bug introduced with the reworking of the logging capabilities?
That was my thought
24 minutes ago, Josh.5 said:I'll take a look this morning
Sent from my ONE E1003 using Tapatalk
Thanks buddy
-
7 minutes ago, itimpi said:
Have you set the option to scan on starting the container? If not I have found I get a similar delay.
Yes, but the container is not saving the settings and on further looking into the logs, i can see this when i try to set that setting:
2019-02-11T11:51:05:ERROR:Unmanic - [FORMATTED] - Exception in writing settings to file: - Object of type 'Logger' is not JSON serializable
-
Hi @Josh.5, The latest commit takes a long time to build any sort of queue and sits idle. It does eventually (maybe an hour) start to build one and start encoding. The following entry appears in the log:
2019-02-11T10:41:20:ERROR:Unmanic - [FORMATTED] - Exception in reading saved settings from file: - Expecting value: line 56 column 15 (char 1519)
-
-
Really petty, but its annoying me that i dont have a docker icon for this. What URL should i be pointing to for the icon?
-
2 hours ago, Ezzy91 said:
Not seen this myself. I would hazard a guess that it must be unraid itself.
-
@Josh.5I have been running this for 24 hours now and everything seems 100% rock solid. Thanks for your hard work!
-
1 hour ago, zAdok said:
Agreed. So far so good!
-
18 minutes ago, Josh.5 said:
I've pushed an update to the docker container again tonight. There was an issue with the new method for parsing progress information. It was piping it to a temp file to read. This was somehow falling over as soon as you give it a file with a decent size but at random times (anywhere from 30MB to 60MB). I missed this as all my test files are 10MB or less. I've refactored this code and added support for elapsed time, time position, frame, fps, speed, bitrate and file size along with percent. While this information is now available, I have yet to implement it in the worker elements of the WebUI. But I'll see if I can throw that together this week. If you care to look at what info is there, you can open http://{UNMANIC_IP}:{UNMANIC_PORT}/?ajax=workersInfo while you are converting to see all your jobs information in json format.
PS.
This is now version 0.0.1-beta3 (displayed in the bottom left of the WebUI)
Trying this now. Thanks again Josh
-
1 hour ago, Josh.5 said:
What are the characters of this file:
Storage Wars - S12E09 - Let's Give \udce2\udc80\udc98Em Something to Tonka About - WEBDL-720p - h264 AAC.mkv
I have a funny feeling that this is not longer a problem and that somehow the file's names managed to make it through the conversion process and written to this history in this messed up state.
The changes made on the last update should prevent this from happening again. So if it does happen again please report it to me. I will see if I can come up with a tidy way to gracefully handle this error in the webUI so it does not error out quite so hard...
Not sure to be honest.
Just adding that mine has stopped encoding too as the above.
-
4 minutes ago, Josh.5 said:
@trekkiedj can you please try from your unraid terminal copying the file `/mnt/user/appdata/unmanic/.unmanic/config/history.json`
(This was the default location. If you have changed your appdata folder it may be different on your machine)From the looks of things there is something in your file history that is causing a problem. If you could give me this file it may help me figure it out. Also once you have a copy of it for me to debug, deleting it may be enough to set you right again so you can access the webUI
And deleting it fixed the issue, thanks Josh!
-
2 minutes ago, Josh.5 said:
@trekkiedj can you please try from your unraid terminal copying the file `/mnt/user/appdata/unmanic/.unmanic/config/history.json`
(This was the default location. If you have changed your appdata folder it may be different on your machine)From the looks of things there is something in your file history that is causing a problem. If you could give me this file it may help me figure it out. Also once you have a copy of it for me to debug, deleting it may be enough to set you right again so you can access the webUI
Here it is
-
12 minutes ago, Josh.5 said:
I tested a bunch of files on this unicode error. I thought I had it right. Are you able to give me the exact characters that you are having a problem with?
should say also, it is now encoding. Just no WebUI
-
10 minutes ago, Josh.5 said:
I tested a bunch of files on this unicode error. I thought I had it right. Are you able to give me the exact characters that you are having a problem with?
I set the library folder to a single movie (8 mile) and this is whats in the log:
'clean_effects': 0, 'comment': 0, 'default': 0, 'dub': 0, 'forced': 0, 'hearing_impaired': 0, 'karaoke': 0, 'lyrics': 0, 'original': 0, 'timed_thumbnails': 0, 'visual_impaired': 0}, 'duration': '6627.796000', 'duration_ts': 6627796, 'height': 1080, 'index': 10, 'r_frame_rate': '0/0', 'start_pts': 0, 'start_time': '0.000000', 'tags': {'BPS': '3866', 'BPS-eng': '3866', 'DURATION': '01:45:06.289000000', 'DURATION-eng': '01:45:06.289000000', 'NUMBER_OF_BYTES': '3047830', 'NUMBER_OF_BYTES-eng': '3047830', 'NUMBER_OF_FRAMES': '484', 'NUMBER_OF_FRAMES-eng': '484', '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The " "Sun') 64-bit", '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am " "The Sun') 64-bit", '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18', '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 ' '21:52:18', 'language': 'ger', 'title': 'Forced'}, 'time_base': '1/1000', 'width': 1920}, {'avg_frame_rate': '0/0', 'codec_long_name': 'DVD subtitles', 'codec_name': 'dvd_subtitle', 'codec_tag': '0x0000', 'codec_tag_string': '[0][0][0][0]', 'codec_time_base': '0/1', 'codec_type': 'subtitle', 'disposition': {'attached_pic': 0, 'clean_effects': 0, 'comment': 0, 'default': 0, 'dub': 0, 'forced': 0, 'hearing_impaired': 0, 'karaoke': 0, 'lyrics': 0, 'original': 0, 'timed_thumbnails': 0, 'visual_impaired': 0}, 'duration': '6627.796000', 'duration_ts': 6627796, 'height': 1080, 'index': 11, 'r_frame_rate': '0/0', 'start_pts': 0, 'start_time': '0.000000', 'tags': {'BPS': '9567', 'BPS-eng': '9567', 'DURATION': '01:48:03.299000000', 'DURATION-eng': '01:48:03.299000000', 'NUMBER_OF_BYTES': '7753322', 'NUMBER_OF_BYTES-eng': '7753322', 'NUMBER_OF_FRAMES': '1481', 'NUMBER_OF_FRAMES-eng': '1481', '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The " "Sun') 64-bit", '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am " "The Sun') 64-bit", '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18', '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 ' '21:52:18', 'language': 'ita'}, 'time_base': '1/1000', 'width': 1920}, {'avg_frame_rate': '0/0', 'codec_long_name': 'DVD subtitles', 'codec_name': 'dvd_subtitle', 'codec_tag': '0x0000', 'codec_tag_string': '[0][0][0][0]', 'codec_time_base': '0/1', 'codec_type': 'subtitle', 'disposition': {'attached_pic': 0, 'clean_effects': 0, 'comment': 0, 'default': 0, 'dub': 0, 'forced': 0, 'hearing_impaired': 0, 'karaoke': 0, 'lyrics': 0, 'original': 0, 'timed_thumbnails': 0, 'visual_impaired': 0}, 'duration': '6627.796000', 'duration_ts': 6627796, 'height': 1080, 'index': 12, 'r_frame_rate': '0/0', 'start_pts': 0, 'start_time': '0.000000', 'tags': {'BPS': '7001', 'BPS-eng': '7001', 'DURATION': '01:42:51.245000000', 'DURATION-eng': '01:42:51.245000000', 'NUMBER_OF_BYTES': '5400890', 'NUMBER_OF_BYTES-eng': '5400890', 'NUMBER_OF_FRAMES': '1444', 'NUMBER_OF_FRAMES-eng': '1444', '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The " "Sun') 64-bit", '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am " "The Sun') 64-bit", '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18', '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 ' '21:52:18', 'language': 'jpn'}, 'time_base': '1/1000', 'width': 1920}, {'avg_frame_rate': '0/0', 'codec_long_name': 'DVD subtitles', 'codec_name': 'dvd_subtitle', 'codec_tag': '0x0000', 'codec_tag_string': '[0][0][0][0]', 'codec_time_base': '0/1', 'codec_type': 'subtitle', 'disposition': {'attached_pic': 0, 'clean_effects': 0, 'comment': 0, 'default': 0, 'dub': 0, 'forced': 0, 'hearing_impaired': 0, 'karaoke': 0, 'lyrics': 0, 'original': 0, 'timed_thumbnails': 0, 'visual_impaired': 0}, 'duration': '6627.796000', 'duration_ts': 6627796, 'height': 1080, 'index': 13, 'r_frame_rate': '0/0', 'start_pts': 0, 'start_time': '0.000000', 'tags': {'BPS': '8468', 'BPS-eng': '8468', 'DURATION': '01:48:03.299000000', 'DURATION-eng': '01:48:03.299000000', 'NUMBER_OF_BYTES': '6862870', 'NUMBER_OF_BYTES-eng': '6862870', 'NUMBER_OF_FRAMES': '1481', 'NUMBER_OF_FRAMES-eng': '1481', '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The " "Sun') 64-bit", '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am " "The Sun') 64-bit", '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18', '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 ' '21:52:18', 'language': 'nob'}, 'time_base': '1/1000', 'width': 1920}, {'avg_frame_rate': '0/0', 'codec_long_name': 'DVD subtitles', 'codec_name': 'dvd_subtitle', 'codec_tag': '0x0000', 'codec_tag_string': '[0][0][0][0]', 'codec_time_base': '0/1', 'codec_type': 'subtitle', 'disposition': {'attached_pic': 0, 'clean_effects': 0, 'comment': 0, 'default': 0, 'dub': 0, 'forced': 0, 'hearing_impaired': 0, 'karaoke': 0, 'lyrics': 0, 'original': 0, 'timed_thumbnails': 0, 'visual_impaired': 0}, 'duration': '6627.796000', 'duration_ts': 6627796, 'height': 1080, 'index': 14, 'r_frame_rate': '0/0', 'start_pts': 0, 'start_time': '0.000000', 'tags': {'BPS': '10040', 'BPS-eng': '10040', 'DURATION': '01:48:03.299000000', 'DURATION-eng': '01:48:03.299000000', 'NUMBER_OF_BYTES': '8137322', 'NUMBER_OF_BYTES-eng': '8137322', 'NUMBER_OF_FRAMES': '1481', 'NUMBER_OF_FRAMES-eng': '1481', '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The " "Sun') 64-bit", '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am " "The Sun') 64-bit", '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18', '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 ' '21:52:18', 'language': 'por'}, 'time_base': '1/1000', 'width': 1920}, {'avg_frame_rate': '0/0', 'codec_long_name': 'DVD subtitles', 'codec_name': 'dvd_subtitle', 'codec_tag': '0x0000', 'codec_tag_string': '[0][0][0][0]', 'codec_time_base': '0/1', 'codec_type': 'subtitle', 'disposition': {'attached_pic': 0, 'clean_effects': 0, 'comment': 0, 'default': 0, 'dub': 0, 'forced': 0, 'hearing_impaired': 0, 'karaoke': 0, 'lyrics': 0, 'original': 0, 'timed_thumbnails': 0, 'visual_impaired': 0}, 'duration': '6627.796000', 'duration_ts': 6627796, 'height': 1080, 'index': 15, 'r_frame_rate': '0/0', 'start_pts': 0, 'start_time': '0.000000', 'tags': {'BPS': '9314', 'BPS-eng': '9314', 'DURATION': '01:48:03.299000000', 'DURATION-eng': '01:48:03.299000000', 'NUMBER_OF_BYTES': '7548556', 'NUMBER_OF_BYTES-eng': '7548556', 'NUMBER_OF_FRAMES': '1481', 'NUMBER_OF_FRAMES-eng': '1481', '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The " "Sun') 64-bit", '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am " "The Sun') 64-bit", '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18', '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 ' '21:52:18', 'language': 'spa'}, 'time_base': '1/1000', 'width': 1920}, {'avg_frame_rate': '0/0', 'codec_long_name': 'DVD subtitles', 'codec_name': 'dvd_subtitle', 'codec_tag': '0x0000', 'codec_tag_string': '[0][0][0][0]', 'codec_time_base': '0/1', 'codec_type': 'subtitle', 'disposition': {'attached_pic': 0, 'clean_effects': 0, 'comment': 0, 'default': 0, 'dub': 0, 'forced': 0, 'hearing_impaired': 0, 'karaoke': 0, 'lyrics': 0, 'original': 0, 'timed_thumbnails': 0, 'visual_impaired': 0}, 'duration': '6627.796000', 'duration_ts': 6627796, 'height': 1080, 'index': 16, 'r_frame_rate': '0/0', 'start_pts': 0, 'start_time': '0.000000', 'tags': {'BPS': '8872', 'BPS-eng': '8872', 'DURATION': '01:48:03.299000000', 'DURATION-eng': '01:48:03.299000000', 'NUMBER_OF_BYTES': '7190207', 'NUMBER_OF_BYTES-eng': '7190207', 'NUMBER_OF_FRAMES': '1481', 'NUMBER_OF_FRAMES-eng': '1481', '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The " "Sun') 64-bit", '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am " "The Sun') 64-bit", '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18', '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 ' '21:52:18', 'language': 'swe'}, 'time_base': '1/1000', 'width': 1920}]} DEBUG:root:LibraryOptimiser - [FFMPEGHandle] File already hevc - /library/Movies/8 Mile (2002).mkv INFO:root:LibraryOptimiser - [LibraryScanner] File does not need to be processed - /library/Movies/8 Mile (2002).mkv ERROR:tornado.application:Uncaught exception GET / (192.168.1.130) HTTPServerRequest(protocol='http', host='192.168.1.131:8888', method='GET', uri='/', version='HTTP/1.1', remote_ip='192.168.1.130') Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/tornado/web.py", line 1590, in _execute result = method(*self.path_args, **self.path_kwargs) File "/app/webserver/main.py", line 51, in get self.render("main.html", time_now=time.time()) File "/usr/lib/python3.6/site-packages/tornado/web.py", line 766, in render html = self.render_string(template_name, **kwargs) File "/usr/lib/python3.6/site-packages/tornado/web.py", line 907, in render_string return t.generate(**namespace) File "/usr/lib/python3.6/site-packages/tornado/template.py", line 346, in generate return execute() File "main_html.generated.py", line 120, in _tt_execute if isinstance(_tt_tmp, _tt_string_types): _tt_tmp = _tt_utf8(_tt_tmp) # main-completed-tasks.html:20 (via main.html:216, page_layout.html:123) File "/usr/lib/python3.6/site-packages/tornado/escape.py", line 199, in utf8 return value.encode("utf-8") UnicodeEncodeError: 'utf-8' codec can't encode characters in position 35-37: surrogates not allowed ERROR:tornado.access:500 GET / (192.168.1.130) 422.43ms
-
Hi @Josh.5. The latest update is not functioning for me at all. Still cannot access the webui even if set to a single folder, and now nothing is converting at all. No disk activity or cpu activity.
This is what i see when trying to access the webui
-
Just a quick note to say that i have done some testing on various files and I have seen no performance increase by using tmpfs over cache pool. given that some of the files could be fairly large and so as to not starve unraid, I have set up a unmanicache share using the SSD cache pool only and this works really well.
[Support] Josh5 - Unmanic - Library Optimiser
in Docker Containers
Posted
I found a fork of this container on Github that makes use of the Nvidia drivers. However.... the master fork they used still has some of the old bugs in it. Does anyone know anything about python to fix this? I dont!
https://github.com/scottcase/unmanic