trekkiedj

I set the library folder to a single movie (8 mile) and this is whats in the log: 'clean_effects': 0, 'comment': 0, 'default': 0, 'dub': 0, 'forced': 0, 'hearing_impaired': 0, 'karaoke': 0, 'lyrics': 0, 'original': 0, 'timed_thumbnails': 0, 'visual_impaired': 0}, 'duration': '6627.796000', 'duration_ts': 6627796, 'height': 1080, 'index': 10, 'r_frame_rate': '0/0', 'start_pts': 0, 'start_time': '0.000000', 'tags': {'BPS': '3866', 'BPS-eng': '3866', 'DURATION': '01:45:06.289000000', 'DURATION-eng': '01:45:06.289000000', 'NUMBER_OF_BYTES': '3047830', 'NUMBER_OF_BYTES-eng': '3047830', 'NUMBER_OF_FRAMES': '484', 'NUMBER_OF_FRAMES-eng': '484', '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The " "Sun') 64-bit", '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am " "The Sun') 64-bit", '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18', '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 ' '21:52:18', 'language': 'ger', 'title': 'Forced'}, 'time_base': '1/1000', 'width': 1920}, {'avg_frame_rate': '0/0', 'codec_long_name': 'DVD subtitles', 'codec_name': 'dvd_subtitle', 'codec_tag': '0x0000', 'codec_tag_string': '[0][0][0][0]', 'codec_time_base': '0/1', 'codec_type': 'subtitle', 'disposition': {'attached_pic': 0, 'clean_effects': 0, 'comment': 0, 'default': 0, 'dub': 0, 'forced': 0, 'hearing_impaired': 0, 'karaoke': 0, 'lyrics': 0, 'original': 0, 'timed_thumbnails': 0, 'visual_impaired': 0}, 'duration': '6627.796000', 'duration_ts': 6627796, 'height': 1080, 'index': 11, 'r_frame_rate': '0/0', 'start_pts': 0, 'start_time': '0.000000', 'tags': {'BPS': '9567', 'BPS-eng': '9567', 'DURATION': '01:48:03.299000000', 'DURATION-eng': '01:48:03.299000000', 'NUMBER_OF_BYTES': '7753322', 'NUMBER_OF_BYTES-eng': '7753322', 'NUMBER_OF_FRAMES': '1481', 'NUMBER_OF_FRAMES-eng': '1481', '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The " "Sun') 64-bit", '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am " "The Sun') 64-bit", '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18', '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 ' '21:52:18', 'language': 'ita'}, 'time_base': '1/1000', 'width': 1920}, {'avg_frame_rate': '0/0', 'codec_long_name': 'DVD subtitles', 'codec_name': 'dvd_subtitle', 'codec_tag': '0x0000', 'codec_tag_string': '[0][0][0][0]', 'codec_time_base': '0/1', 'codec_type': 'subtitle', 'disposition': {'attached_pic': 0, 'clean_effects': 0, 'comment': 0, 'default': 0, 'dub': 0, 'forced': 0, 'hearing_impaired': 0, 'karaoke': 0, 'lyrics': 0, 'original': 0, 'timed_thumbnails': 0, 'visual_impaired': 0}, 'duration': '6627.796000', 'duration_ts': 6627796, 'height': 1080, 'index': 12, 'r_frame_rate': '0/0', 'start_pts': 0, 'start_time': '0.000000', 'tags': {'BPS': '7001', 'BPS-eng': '7001', 'DURATION': '01:42:51.245000000', 'DURATION-eng': '01:42:51.245000000', 'NUMBER_OF_BYTES': '5400890', 'NUMBER_OF_BYTES-eng': '5400890', 'NUMBER_OF_FRAMES': '1444', 'NUMBER_OF_FRAMES-eng': '1444', '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The " "Sun') 64-bit", '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am " "The Sun') 64-bit", '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18', '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 ' '21:52:18', 'language': 'jpn'}, 'time_base': '1/1000', 'width': 1920}, {'avg_frame_rate': '0/0', 'codec_long_name': 'DVD subtitles', 'codec_name': 'dvd_subtitle', 'codec_tag': '0x0000', 'codec_tag_string': '[0][0][0][0]', 'codec_time_base': '0/1', 'codec_type': 'subtitle', 'disposition': {'attached_pic': 0, 'clean_effects': 0, 'comment': 0, 'default': 0, 'dub': 0, 'forced': 0, 'hearing_impaired': 0, 'karaoke': 0, 'lyrics': 0, 'original': 0, 'timed_thumbnails': 0, 'visual_impaired': 0}, 'duration': '6627.796000', 'duration_ts': 6627796, 'height': 1080, 'index': 13, 'r_frame_rate': '0/0', 'start_pts': 0, 'start_time': '0.000000', 'tags': {'BPS': '8468', 'BPS-eng': '8468', 'DURATION': '01:48:03.299000000', 'DURATION-eng': '01:48:03.299000000', 'NUMBER_OF_BYTES': '6862870', 'NUMBER_OF_BYTES-eng': '6862870', 'NUMBER_OF_FRAMES': '1481', 'NUMBER_OF_FRAMES-eng': '1481', '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The " "Sun') 64-bit", '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am " "The Sun') 64-bit", '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18', '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 ' '21:52:18', 'language': 'nob'}, 'time_base': '1/1000', 'width': 1920}, {'avg_frame_rate': '0/0', 'codec_long_name': 'DVD subtitles', 'codec_name': 'dvd_subtitle', 'codec_tag': '0x0000', 'codec_tag_string': '[0][0][0][0]', 'codec_time_base': '0/1', 'codec_type': 'subtitle', 'disposition': {'attached_pic': 0, 'clean_effects': 0, 'comment': 0, 'default': 0, 'dub': 0, 'forced': 0, 'hearing_impaired': 0, 'karaoke': 0, 'lyrics': 0, 'original': 0, 'timed_thumbnails': 0, 'visual_impaired': 0}, 'duration': '6627.796000', 'duration_ts': 6627796, 'height': 1080, 'index': 14, 'r_frame_rate': '0/0', 'start_pts': 0, 'start_time': '0.000000', 'tags': {'BPS': '10040', 'BPS-eng': '10040', 'DURATION': '01:48:03.299000000', 'DURATION-eng': '01:48:03.299000000', 'NUMBER_OF_BYTES': '8137322', 'NUMBER_OF_BYTES-eng': '8137322', 'NUMBER_OF_FRAMES': '1481', 'NUMBER_OF_FRAMES-eng': '1481', '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The " "Sun') 64-bit", '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am " "The Sun') 64-bit", '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18', '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 ' '21:52:18', 'language': 'por'}, 'time_base': '1/1000', 'width': 1920}, {'avg_frame_rate': '0/0', 'codec_long_name': 'DVD subtitles', 'codec_name': 'dvd_subtitle', 'codec_tag': '0x0000', 'codec_tag_string': '[0][0][0][0]', 'codec_time_base': '0/1', 'codec_type': 'subtitle', 'disposition': {'attached_pic': 0, 'clean_effects': 0, 'comment': 0, 'default': 0, 'dub': 0, 'forced': 0, 'hearing_impaired': 0, 'karaoke': 0, 'lyrics': 0, 'original': 0, 'timed_thumbnails': 0, 'visual_impaired': 0}, 'duration': '6627.796000', 'duration_ts': 6627796, 'height': 1080, 'index': 15, 'r_frame_rate': '0/0', 'start_pts': 0, 'start_time': '0.000000', 'tags': {'BPS': '9314', 'BPS-eng': '9314', 'DURATION': '01:48:03.299000000', 'DURATION-eng': '01:48:03.299000000', 'NUMBER_OF_BYTES': '7548556', 'NUMBER_OF_BYTES-eng': '7548556', 'NUMBER_OF_FRAMES': '1481', 'NUMBER_OF_FRAMES-eng': '1481', '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The " "Sun') 64-bit", '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am " "The Sun') 64-bit", '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18', '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 ' '21:52:18', 'language': 'spa'}, 'time_base': '1/1000', 'width': 1920}, {'avg_frame_rate': '0/0', 'codec_long_name': 'DVD subtitles', 'codec_name': 'dvd_subtitle', 'codec_tag': '0x0000', 'codec_tag_string': '[0][0][0][0]', 'codec_time_base': '0/1', 'codec_type': 'subtitle', 'disposition': {'attached_pic': 0, 'clean_effects': 0, 'comment': 0, 'default': 0, 'dub': 0, 'forced': 0, 'hearing_impaired': 0, 'karaoke': 0, 'lyrics': 0, 'original': 0, 'timed_thumbnails': 0, 'visual_impaired': 0}, 'duration': '6627.796000', 'duration_ts': 6627796, 'height': 1080, 'index': 16, 'r_frame_rate': '0/0', 'start_pts': 0, 'start_time': '0.000000', 'tags': {'BPS': '8872', 'BPS-eng': '8872', 'DURATION': '01:48:03.299000000', 'DURATION-eng': '01:48:03.299000000', 'NUMBER_OF_BYTES': '7190207', 'NUMBER_OF_BYTES-eng': '7190207', 'NUMBER_OF_FRAMES': '1481', 'NUMBER_OF_FRAMES-eng': '1481', '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES ' 'NUMBER_OF_BYTES', '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The " "Sun') 64-bit", '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am " "The Sun') 64-bit", '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18', '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 ' '21:52:18', 'language': 'swe'}, 'time_base': '1/1000', 'width': 1920}]} DEBUG:root:LibraryOptimiser - [FFMPEGHandle] File already hevc - /library/Movies/8 Mile (2002).mkv INFO:root:LibraryOptimiser - [LibraryScanner] File does not need to be processed - /library/Movies/8 Mile (2002).mkv ERROR:tornado.application:Uncaught exception GET / (192.168.1.130) HTTPServerRequest(protocol='http', host='192.168.1.131:8888', method='GET', uri='/', version='HTTP/1.1', remote_ip='192.168.1.130') Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/tornado/web.py", line 1590, in _execute result = method(*self.path_args, **self.path_kwargs) File "/app/webserver/main.py", line 51, in get self.render("main.html", time_now=time.time()) File "/usr/lib/python3.6/site-packages/tornado/web.py", line 766, in render html = self.render_string(template_name, **kwargs) File "/usr/lib/python3.6/site-packages/tornado/web.py", line 907, in render_string return t.generate(**namespace) File "/usr/lib/python3.6/site-packages/tornado/template.py", line 346, in generate return execute() File "main_html.generated.py", line 120, in _tt_execute if isinstance(_tt_tmp, _tt_string_types): _tt_tmp = _tt_utf8(_tt_tmp) # main-completed-tasks.html:20 (via main.html:216, page_layout.html:123) File "/usr/lib/python3.6/site-packages/tornado/escape.py", line 199, in utf8 return value.encode("utf-8") UnicodeEncodeError: 'utf-8' codec can't encode characters in position 35-37: surrogates not allowed ERROR:tornado.access:500 GET / (192.168.1.130) 422.43ms

Hi @Josh.5. The latest update is not functioning for me at all. Still cannot access the webui even if set to a single folder, and now nothing is converting at all. No disk activity or cpu activity. This is what i see when trying to access the webui

Just a quick note to say that i have done some testing on various files and I have seen no performance increase by using tmpfs over cache pool. given that some of the files could be fairly large and so as to not starve unraid, I have set up a unmanicache share using the SSD cache pool only and this works really well.

@Josh.5 What @BomB191 said ^^^. This work is brilliant and no rush. Don't worry at all.

@Josh.5 Stellar work as always mate. Thanks so much. Just FYI I still get the Ascii unicode error if i try to point it to my movie library (the same as when it was LibraryOptimiser) Added my comment to the error on Github.

Thanks, i now have it running fine... almost! @Josh.5 - I have a large library, and i dont know if it is related, but if i point the container to my entire TV series library, after a few minutes the WebUI page gets replaced with the following: Traceback (most recent call last): File "/usr/local/lib/python3.5/dist-packages/tornado/web.py", line 1590, in _execute result = method(*self.path_args, **self.path_kwargs) File "/app/webserver/main.py", line 51, in get self.render("main.html", time_now=time.time()) File "/usr/local/lib/python3.5/dist-packages/tornado/web.py", line 766, in render html = self.render_string(template_name, **kwargs) File "/usr/local/lib/python3.5/dist-packages/tornado/web.py", line 907, in render_string return t.generate(**namespace) File "/usr/local/lib/python3.5/dist-packages/tornado/template.py", line 346, in generate return execute() File "main_html.generated.py", line 89, in _tt_execute if isinstance(_tt_tmp, _tt_string_types): _tt_tmp = _tt_utf8(_tt_tmp) # main-pending-tasks.html:7 (via main.html:195, page_layout.html:123) File "/usr/local/lib/python3.5/dist-packages/tornado/escape.py", line 199, in utf8 return value.encode("utf-8") UnicodeEncodeError: 'utf-8' codec can't encode character '\udce2' in position 48: surrogates not allowed The processes seem to still be running in the background as the log reflects this but the WebUI is non-functional. It's not happening if i just select a single show folder.

I really think we could do with some guidance from @Josh.5 as to how to configure this in unraid. This is an awesome container that solves many of my problems, if only i could get it working correctly! Notwithstanding that, this is really good work.

@itimpi Would you mind screenshotting your container page? I am having a nightmare getting this to work!

@Josh.5I cant work out how to get the to the GUI

@SpaceInvaderOne Likewise... I used at least 6 of your videos in the last month! @Ashe Out of interest, how many threads have you pinned for @Josh.5's container?

Just to add now i have been using for a week: Still cant seem to get the container to encode the Movie library as above. With TV series I did some playing on using the SSD cache pool vs /tmp on the RAM and saw no noticeable performance increase. Other than that, it is rock solid and works a treat.

@Josh.5 Just an update on the crashing. It seems it is something to do with encoding. It only happens if the Movies path is used. I removed some movies it was having issues with but then became apparent that it was every movie!:

@Josh.5 this for me is a really exciting development. As a huge media fan, this solves a major hurdle in getting my library of some 150 odd series and nearly 2500 movies optimised to the latest standard. Thanks so much for your work on this!

Also, i guess the only other thought I have on this would be to have the ability to schedule this. Say overnight or any fixed schedule.

OK so i found that the container would crash if i mapped container path /library/Movies to /mnt/user/Movies and then another mapped path of /library/Series to /mnt/user/Series The configuration below though works just fine:

I tried adding both paths as you suggested and nothing really happened. It didn't attempt to find and transcode h264/avi files.

And totally agree with @SpaceInvaderOne. This is amazing work. Thanks so much.

@Josh.5 That path option would work fine for me. Will the container at this point accept more than one path variable?

I am extremely impressed. I do have a couple of thoughts though: I noticed that you mentioned that it would run as two threads, one for the main library conversion and one to monitor new additions. I haven't seen this is the case as only one transcode is happening at any one time and new additions are remaining unconverted. I like many will likely have separate shares for movies and series. How will this cope with that? I don't want to just enter /mnt/user as the Library path for obvious reasons. I just want /mnt/user/Series and /mnt/user/Movies Got to say though that this is stellar work and i don't know why someone hasn't thought of it before! Well done that man!

Testing this now. If this works as well as i hope, this could be the solution i have been looking for for ages! Thanks so much!

All the connections seem ok at the back of the drive cage. I will check the tray is fully seated later today. I will also do a check of the flash drive later. Thanks for your help.

As a side thought, could my docker.cfg have anything to do with this. The attached file has a datestamp of June and doesnt appear to reflect the current dockers at all. docker.cfg

Disk 13 failed this morning. The docker issue has been ongoing since my upgrade to 6 final. I am currently shifting files off Disk 13 and removing it from the array completely for RMA. I had some slack in terms of space so all is ok there.

Attached. Thanks tower-diagnostics-20150804-1515.zip

Thanks BRiT but both my shares (appdata and docker) are set to Cache Only. (see attached)