Jump to content

trekkiedj

Members
  • Posts

    91
  • Joined

  • Last visited

Posts posted by trekkiedj

  1. @Josh.5 no rush my friend. We all have higher priorities than our media collection 🙂 

     

    Just to summarize my wish list:

    • Hardware encoding by passing through the Nvidia GPU now drivers are supported by unraid (similar to Plex passthrough)
    • Ability to append a specified string to the filename of the converted file to force Sonarr and Radarr to re-scan the file and not download a HEVC version unnecessarily.
    • Ability to Schedule conversions to "off-peak hours"
  2. For me the other almost imperitive addition would be to be able to automatically add a string to the converted filename (something like "re-encode") which will then force Radarr/Sonarr to reanalyse the file and note the new codec.

     

    Without the renaming option, Radarr and Sonarr wont re check the file and will still think it is h264 or mpeg4 and when a h265 file is available, re-download it which is a waste of time.

  3. @Josh.5 I have found a small bug. Where the file-type (therefore extension) differs pre and post conversion, the file gets re-added back into the queue on next scan. See below where the same three files previously encoded have been re-added because the original was MP4 or TS or AVI

     

    Edit: It seems to add new files without checking whether conversion is necessary. I recently upgraded a movie to 4k HEVC and it has added that to the queue.

    Untitled.png

  4. 34 minutes ago, Josh.5 said:

    This is not hard coded. This is a request from an open browser. Check on your network what device is 192.168.0.12, it will have an open browser tab looking at the webUI dashboard.

    This will be polling every 5 seconds for an update for the workers.

    These logs are already on my todo list to move to their own file like I did with the main service logs and implement a log rotation of 7 days

    Ahh yes, the ip in my log is my laptop. so that makes sense.

  5. 3 minutes ago, itimpi said:

    I agree it can change as I have a different value displayed when I run Unmanic under docker.   However I have made a few installs under Linux on SBC systems and they all seem to show that address.   I guess I was wondering what is the meaning of it if it is not a system that is actually on my local LAN.

    I'm getting this which is incidentally one IP under the server address:

     

    [I 190211 18:44:30 web:2162] 200 GET /?ajax=pendingTasks&format=html (192.168.1.130) 539.42ms

     

    @Josh.5 I am also getting this:

     

     

    [W 190211 18:53:30 pyinotify:929] Event queue overflowed.
    [2019-02-11 18:53:50,778 pyinotify WARNING] Event queue overflowed.

     

  6. 8 minutes ago, itimpi said:

    I am seeing messages displayed of the form:

    
    304 GET /?ajax=workersInfo (192.168.0.12) 7.13ms

    What is strange is I do not see where that IP address has come from.  It is NOT the address of the system running Unmanic.   It is almost as if that address is hard-coded somewhere?

    thats not the address i see. I think its different from install to install

  7. 8 minutes ago, Josh.5 said:

    @trekkiedj @itimpi

     

    Yea you guys were right. I made a mistake with the config that cased it to try and export our logger to the settings file... oops.

    As you predicted this broke things like running a scan on start as the settings file was corrupted and everything reverted to defaults.

    There is an update building now. Once you have it just open the web UI to the settings tab and click the "Submit" button to save the settings (this will over write the buggered settings file). Make sure you also double check that all the settings are correct, they have likely reverted back to the defaults. 

     

    I've added an update to my todo list (https://github.com/Josh5/unmanic/issues/21) that will add a layer of protection against this in the future. This will be easy enough to implement.

     

    Thanks for the report

    Yep, thats sorted it. Thanks!

  8. 7 minutes ago, itimpi said:

    Have you set the option to scan on starting the container?    If not I have found I get a similar delay.

    Yes, but the container is not saving the settings and on further looking into the logs, i can see this when i try to set that setting:

     

    2019-02-11T11:51:05:ERROR:Unmanic - [FORMATTED] - Exception in writing settings to file: - Object of type 'Logger' is not JSON serializable

  9. 2 hours ago, Ezzy91 said:

    This is an awesome app! i've been waiting for some time for something like this. 

    Does anyone else get 100% CPU usage on 1 core when its idle? 

    For Testing i've allocated everything to run on 0/4 so there is nothing on the others

    and unmanic has 1/5,2/6,3/7 - it jumps around which core its using 

    image.png.8c7960ab7beef97eb746732b9aa8ef85.png

    image.thumb.png.8c8b327540fc49722a88fc17fa235db4.png

    Not seen this myself. I would hazard a guess that it must be unraid itself.

  10. 18 minutes ago, Josh.5 said:

    @BomB191

    @zAdok

    @trekkiedj

    I've pushed an update to the docker container again tonight. There was an issue with the new method for parsing progress information. It was piping it to a temp file to read. This was somehow falling over as soon as you give it a file with a decent size but at random times (anywhere from 30MB to 60MB). I missed this as all my test files are 10MB or less. I've refactored this code and added support for elapsed time, time position, frame, fps, speed, bitrate and file size along with percent. While this information is now available, I have yet to implement it in the worker elements of the WebUI. But I'll see if I can throw that together this week. If you care to look at what info is there, you can open http://{UNMANIC_IP}:{UNMANIC_PORT}/?ajax=workersInfo while you are converting to see all your jobs information in json format.

     

    PS.

    This is now version 0.0.1-beta3 (displayed in the bottom left of the WebUI)

    Trying this now. Thanks again Josh

  11. 1 hour ago, Josh.5 said:

    What are the characters of this file:
     

    
    Storage Wars - S12E09 - Let's Give \udce2\udc80\udc98Em Something to Tonka About - WEBDL-720p - h264 AAC.mkv

    I have a funny feeling that this is not longer a problem and that somehow the file's names managed to make it through the conversion process and written to this history in this messed up state.

    The changes made on the last update should prevent this from happening again. So if it does happen again please report it to me. I will see if I can come up with a tidy way to gracefully handle this error in the webUI so it does not error out quite so hard...

    Not sure to be honest.

     

    Just adding that mine has stopped encoding too as the above.

  12. 4 minutes ago, Josh.5 said:

    @trekkiedj can you please try from your unraid terminal copying the file `/mnt/user/appdata/unmanic/.unmanic/config/history.json`
    (This was the default location. If you have changed your appdata folder it may be different on your machine)

    From the looks of things there is something in your file history that is causing a problem. If you could give me this file it may help me figure it out. Also once you have a copy of it for me to debug, deleting it may be enough to set you right again so you can access the webUI

    And deleting it fixed the issue, thanks Josh!

  13. 2 minutes ago, Josh.5 said:

    @trekkiedj can you please try from your unraid terminal copying the file `/mnt/user/appdata/unmanic/.unmanic/config/history.json`
    (This was the default location. If you have changed your appdata folder it may be different on your machine)

    From the looks of things there is something in your file history that is causing a problem. If you could give me this file it may help me figure it out. Also once you have a copy of it for me to debug, deleting it may be enough to set you right again so you can access the webUI

    Here it is

    history.json

  14. 10 minutes ago, Josh.5 said:

    I tested a bunch of files on this unicode error. I thought I had it right. Are you able to give me the exact characters that you are having a problem with?

    I set the library folder to a single movie (8 mile) and this is whats in the log:

     

    'clean_effects': 0,
    'comment': 0,
    'default': 0,
    'dub': 0,
    'forced': 0,
    'hearing_impaired': 0,
    'karaoke': 0,
    'lyrics': 0,
    'original': 0,
    'timed_thumbnails': 0,
    'visual_impaired': 0},
    'duration': '6627.796000',
    'duration_ts': 6627796,
    'height': 1080,
    'index': 10,
    'r_frame_rate': '0/0',
    'start_pts': 0,
    'start_time': '0.000000',
    'tags': {'BPS': '3866',
    'BPS-eng': '3866',
    'DURATION': '01:45:06.289000000',
    'DURATION-eng': '01:45:06.289000000',
    'NUMBER_OF_BYTES': '3047830',
    'NUMBER_OF_BYTES-eng': '3047830',
    'NUMBER_OF_FRAMES': '484',
    'NUMBER_OF_FRAMES-eng': '484',
    '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES '
    'NUMBER_OF_BYTES',
    '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES '
    'NUMBER_OF_BYTES',
    '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The "
    "Sun') 64-bit",
    '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am "
    "The Sun') 64-bit",
    '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18',
    '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 '
    '21:52:18',
    'language': 'ger',
    'title': 'Forced'},
    'time_base': '1/1000',
    'width': 1920},
    {'avg_frame_rate': '0/0',
    'codec_long_name': 'DVD subtitles',
    'codec_name': 'dvd_subtitle',
    'codec_tag': '0x0000',
    'codec_tag_string': '[0][0][0][0]',
    'codec_time_base': '0/1',
    'codec_type': 'subtitle',
    'disposition': {'attached_pic': 0,
    'clean_effects': 0,
    'comment': 0,
    'default': 0,
    'dub': 0,
    'forced': 0,
    'hearing_impaired': 0,
    'karaoke': 0,
    'lyrics': 0,
    'original': 0,
    'timed_thumbnails': 0,
    'visual_impaired': 0},
    'duration': '6627.796000',
    'duration_ts': 6627796,
    'height': 1080,
    'index': 11,
    'r_frame_rate': '0/0',
    'start_pts': 0,
    'start_time': '0.000000',
    'tags': {'BPS': '9567',
    'BPS-eng': '9567',
    'DURATION': '01:48:03.299000000',
    'DURATION-eng': '01:48:03.299000000',
    'NUMBER_OF_BYTES': '7753322',
    'NUMBER_OF_BYTES-eng': '7753322',
    'NUMBER_OF_FRAMES': '1481',
    'NUMBER_OF_FRAMES-eng': '1481',
    '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES '
    'NUMBER_OF_BYTES',
    '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES '
    'NUMBER_OF_BYTES',
    '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The "
    "Sun') 64-bit",
    '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am "
    "The Sun') 64-bit",
    '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18',
    '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 '
    '21:52:18',
    'language': 'ita'},
    'time_base': '1/1000',
    'width': 1920},
    {'avg_frame_rate': '0/0',
    'codec_long_name': 'DVD subtitles',
    'codec_name': 'dvd_subtitle',
    'codec_tag': '0x0000',
    'codec_tag_string': '[0][0][0][0]',
    'codec_time_base': '0/1',
    'codec_type': 'subtitle',
    'disposition': {'attached_pic': 0,
    'clean_effects': 0,
    'comment': 0,
    'default': 0,
    'dub': 0,
    'forced': 0,
    'hearing_impaired': 0,
    'karaoke': 0,
    'lyrics': 0,
    'original': 0,
    'timed_thumbnails': 0,
    'visual_impaired': 0},
    'duration': '6627.796000',
    'duration_ts': 6627796,
    'height': 1080,
    'index': 12,
    'r_frame_rate': '0/0',
    'start_pts': 0,
    'start_time': '0.000000',
    'tags': {'BPS': '7001',
    'BPS-eng': '7001',
    'DURATION': '01:42:51.245000000',
    'DURATION-eng': '01:42:51.245000000',
    'NUMBER_OF_BYTES': '5400890',
    'NUMBER_OF_BYTES-eng': '5400890',
    'NUMBER_OF_FRAMES': '1444',
    'NUMBER_OF_FRAMES-eng': '1444',
    '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES '
    'NUMBER_OF_BYTES',
    '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES '
    'NUMBER_OF_BYTES',
    '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The "
    "Sun') 64-bit",
    '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am "
    "The Sun') 64-bit",
    '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18',
    '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 '
    '21:52:18',
    'language': 'jpn'},
    'time_base': '1/1000',
    'width': 1920},
    {'avg_frame_rate': '0/0',
    'codec_long_name': 'DVD subtitles',
    'codec_name': 'dvd_subtitle',
    'codec_tag': '0x0000',
    'codec_tag_string': '[0][0][0][0]',
    'codec_time_base': '0/1',
    'codec_type': 'subtitle',
    'disposition': {'attached_pic': 0,
    'clean_effects': 0,
    'comment': 0,
    'default': 0,
    'dub': 0,
    'forced': 0,
    'hearing_impaired': 0,
    'karaoke': 0,
    'lyrics': 0,
    'original': 0,
    'timed_thumbnails': 0,
    'visual_impaired': 0},
    'duration': '6627.796000',
    'duration_ts': 6627796,
    'height': 1080,
    'index': 13,
    'r_frame_rate': '0/0',
    'start_pts': 0,
    'start_time': '0.000000',
    'tags': {'BPS': '8468',
    'BPS-eng': '8468',
    'DURATION': '01:48:03.299000000',
    'DURATION-eng': '01:48:03.299000000',
    'NUMBER_OF_BYTES': '6862870',
    'NUMBER_OF_BYTES-eng': '6862870',
    'NUMBER_OF_FRAMES': '1481',
    'NUMBER_OF_FRAMES-eng': '1481',
    '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES '
    'NUMBER_OF_BYTES',
    '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES '
    'NUMBER_OF_BYTES',
    '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The "
    "Sun') 64-bit",
    '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am "
    "The Sun') 64-bit",
    '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18',
    '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 '
    '21:52:18',
    'language': 'nob'},
    'time_base': '1/1000',
    'width': 1920},
    {'avg_frame_rate': '0/0',
    'codec_long_name': 'DVD subtitles',
    'codec_name': 'dvd_subtitle',
    'codec_tag': '0x0000',
    'codec_tag_string': '[0][0][0][0]',
    'codec_time_base': '0/1',
    'codec_type': 'subtitle',
    'disposition': {'attached_pic': 0,
    'clean_effects': 0,
    'comment': 0,
    'default': 0,
    'dub': 0,
    'forced': 0,
    'hearing_impaired': 0,
    'karaoke': 0,
    'lyrics': 0,
    'original': 0,
    'timed_thumbnails': 0,
    'visual_impaired': 0},
    'duration': '6627.796000',
    'duration_ts': 6627796,
    'height': 1080,
    'index': 14,
    'r_frame_rate': '0/0',
    'start_pts': 0,
    'start_time': '0.000000',
    'tags': {'BPS': '10040',
    'BPS-eng': '10040',
    'DURATION': '01:48:03.299000000',
    'DURATION-eng': '01:48:03.299000000',
    'NUMBER_OF_BYTES': '8137322',
    'NUMBER_OF_BYTES-eng': '8137322',
    'NUMBER_OF_FRAMES': '1481',
    'NUMBER_OF_FRAMES-eng': '1481',
    '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES '
    'NUMBER_OF_BYTES',
    '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES '
    'NUMBER_OF_BYTES',
    '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The "
    "Sun') 64-bit",
    '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am "
    "The Sun') 64-bit",
    '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18',
    '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 '
    '21:52:18',
    'language': 'por'},
    'time_base': '1/1000',
    'width': 1920},
    {'avg_frame_rate': '0/0',
    'codec_long_name': 'DVD subtitles',
    'codec_name': 'dvd_subtitle',
    'codec_tag': '0x0000',
    'codec_tag_string': '[0][0][0][0]',
    'codec_time_base': '0/1',
    'codec_type': 'subtitle',
    'disposition': {'attached_pic': 0,
    'clean_effects': 0,
    'comment': 0,
    'default': 0,
    'dub': 0,
    'forced': 0,
    'hearing_impaired': 0,
    'karaoke': 0,
    'lyrics': 0,
    'original': 0,
    'timed_thumbnails': 0,
    'visual_impaired': 0},
    'duration': '6627.796000',
    'duration_ts': 6627796,
    'height': 1080,
    'index': 15,
    'r_frame_rate': '0/0',
    'start_pts': 0,
    'start_time': '0.000000',
    'tags': {'BPS': '9314',
    'BPS-eng': '9314',
    'DURATION': '01:48:03.299000000',
    'DURATION-eng': '01:48:03.299000000',
    'NUMBER_OF_BYTES': '7548556',
    'NUMBER_OF_BYTES-eng': '7548556',
    'NUMBER_OF_FRAMES': '1481',
    'NUMBER_OF_FRAMES-eng': '1481',
    '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES '
    'NUMBER_OF_BYTES',
    '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES '
    'NUMBER_OF_BYTES',
    '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The "
    "Sun') 64-bit",
    '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am "
    "The Sun') 64-bit",
    '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18',
    '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 '
    '21:52:18',
    'language': 'spa'},
    'time_base': '1/1000',
    'width': 1920},
    {'avg_frame_rate': '0/0',
    'codec_long_name': 'DVD subtitles',
    'codec_name': 'dvd_subtitle',
    'codec_tag': '0x0000',
    'codec_tag_string': '[0][0][0][0]',
    'codec_time_base': '0/1',
    'codec_type': 'subtitle',
    'disposition': {'attached_pic': 0,
    'clean_effects': 0,
    'comment': 0,
    'default': 0,
    'dub': 0,
    'forced': 0,
    'hearing_impaired': 0,
    'karaoke': 0,
    'lyrics': 0,
    'original': 0,
    'timed_thumbnails': 0,
    'visual_impaired': 0},
    'duration': '6627.796000',
    'duration_ts': 6627796,
    'height': 1080,
    'index': 16,
    'r_frame_rate': '0/0',
    'start_pts': 0,
    'start_time': '0.000000',
    'tags': {'BPS': '8872',
    'BPS-eng': '8872',
    'DURATION': '01:48:03.299000000',
    'DURATION-eng': '01:48:03.299000000',
    'NUMBER_OF_BYTES': '7190207',
    'NUMBER_OF_BYTES-eng': '7190207',
    'NUMBER_OF_FRAMES': '1481',
    'NUMBER_OF_FRAMES-eng': '1481',
    '_STATISTICS_TAGS': 'BPS DURATION NUMBER_OF_FRAMES '
    'NUMBER_OF_BYTES',
    '_STATISTICS_TAGS-eng': 'BPS DURATION NUMBER_OF_FRAMES '
    'NUMBER_OF_BYTES',
    '_STATISTICS_WRITING_APP': "mkvmerge v20.0.0 ('I Am The "
    "Sun') 64-bit",
    '_STATISTICS_WRITING_APP-eng': "mkvmerge v20.0.0 ('I Am "
    "The Sun') 64-bit",
    '_STATISTICS_WRITING_DATE_UTC': '2018-07-03 21:52:18',
    '_STATISTICS_WRITING_DATE_UTC-eng': '2018-07-03 '
    '21:52:18',
    'language': 'swe'},
    'time_base': '1/1000',
    'width': 1920}]}
    DEBUG:root:LibraryOptimiser - [FFMPEGHandle] File already hevc - /library/Movies/8 Mile (2002).mkv
    INFO:root:LibraryOptimiser - [LibraryScanner] File does not need to be processed - /library/Movies/8 Mile (2002).mkv
    ERROR:tornado.application:Uncaught exception GET / (192.168.1.130)
    
    HTTPServerRequest(protocol='http', host='192.168.1.131:8888', method='GET', uri='/', version='HTTP/1.1', remote_ip='192.168.1.130')
    
    Traceback (most recent call last):
    File "/usr/lib/python3.6/site-packages/tornado/web.py", line 1590, in _execute
    result = method(*self.path_args, **self.path_kwargs)
    File "/app/webserver/main.py", line 51, in get
    self.render("main.html", time_now=time.time())
    File "/usr/lib/python3.6/site-packages/tornado/web.py", line 766, in render
    html = self.render_string(template_name, **kwargs)
    File "/usr/lib/python3.6/site-packages/tornado/web.py", line 907, in render_string
    return t.generate(**namespace)
    File "/usr/lib/python3.6/site-packages/tornado/template.py", line 346, in generate
    return execute()
    File "main_html.generated.py", line 120, in _tt_execute
    if isinstance(_tt_tmp, _tt_string_types): _tt_tmp = _tt_utf8(_tt_tmp) # main-completed-tasks.html:20 (via main.html:216, page_layout.html:123)
    File "/usr/lib/python3.6/site-packages/tornado/escape.py", line 199, in utf8
    return value.encode("utf-8")
    UnicodeEncodeError: 'utf-8' codec can't encode characters in position 35-37: surrogates not allowed
    ERROR:tornado.access:500 GET / (192.168.1.130) 422.43ms

     

×
×
  • Create New...