Jump to content
HaveAGitGat

[Support] HaveAGitGat - Tdarr: Audio/Video Library Analytics & Transcode Automation

320 posts in this topic Last Reply

Recommended Posts

I believe I solved my issue - I had forgotten to set the transcoder cache folder in the tdarr webui. 

Share this post


Link to post

I’m having a problem with tdarr because it creates temporary files with mkv extension and other tools are picking up that file as a new movie.

 

I describe the problem in detail here https://github.com/HaveAGitGat/Tdarr/issues/172.

 

Would you consider creating temp files with .partial extension instead of mkv to fix this problem? Thanks. 

Share this post


Link to post
Posted (edited)
On 2/29/2020 at 2:04 AM, Bruno said:

I’m having a problem with tdarr because it creates temporary files with mkv extension and other tools are picking up that file as a new movie.

 

I describe the problem in detail here https://github.com/HaveAGitGat/Tdarr/issues/172.

 

Would you consider creating temp files with .partial extension instead of mkv to fix this problem? Thanks. 

Have you considered having your temp files in a folder not scanned my what ever tool is picking it up only takes making another share and pointing it there. alternatively if you have enough ram to you do it in /tmp

Edited by nicksphone
spelling

Share this post


Link to post

Awesome Docker! Thank you so much!!! :)

 

One thing I noticed: While using an nvidia card to transcode, if I cancel all workers mid-transcode, the streams do not seem to get released until I stop the docker. If I let them finish, they release as expected. (watching using 'watch nvidia-smi' in Putty)

Share this post


Link to post

Anyone else having this issue?

Exception in callback of async function: TypeError [ERR_MISSING_ARGS]: The "message" argument must be specified
at ChildProcess.target._send (internal/child_process.js:649:13)
at ChildProcess.target.send (internal/child_process.js:634:19)
at getNewTask (server/main.js:3118:39)
at server/main.js:2389:11
at runWithEnvironment (packages/meteor.js:1286:24)

I updated Unraid to 6.8.3 and began noticing that no files were progressing in the Tdarr interface. All of them just say 'Calculating'. 

Share this post


Link to post

I'm having trouble using the "Tiered FFMPEG NVENC settings depending on resolution" plugin with ID "Tdarr_Plugin_d5d3_iiDrakeii_FFMPEG_NVENC_Tiered_MKV". It says it can't find my GPU.

 

Command:

/home/Tdarr/Tdarr/bundle/programs/server/assets/app/ffmpeg/ffmpeg42/ffmpeg -c:v h264_cuvid -i '/home/Tdarr/Media/Television/Stranger Things/Season 03/Stranger Things - S03E01 - Chapter One- Suzie, Do You Copy [HDTV-1080p].mkv' -map 0 -dn -c:v hevc_nvenc -pix_fmt p010le -rc:v vbr_hq -qmin 0 -cq:V 31 -b:v 2500k -maxrate:v 5000k -preset slow -rc-lookahead 32 -spatial_aq:v 1 -aq-strength:v 8 -a53cc 0 -c:a copy -c:s copy '/home/Tdarr/cache/Stranger Things - S03E01 - Chapter One- Suzie, Do You Copy [HDTV-1080p]-TdarrCacheFile-p1cwX-Dg.mkv'

ffmpeg version N-95955-g12bbfc4 Copyright (c) 2000-2019 the FFmpeg developers

built with gcc 7 (Ubuntu 7.4.0-1ubuntu1~18.04.1)

configuration: --prefix=/home/z/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/z/ffmpeg_build/include --extra-ldflags=-L/home/z/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/z/bin --enable-gpl --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree

libavutil 56. 36.101 / 56. 36.101

libavcodec 58. 64.101 / 58. 64.101

libavformat 58. 35.101 / 58. 35.101

libavdevice 58. 9.101 / 58. 9.101

libavfilter 7. 67.100 / 7. 67.100

libswscale 5. 6.100 / 5. 6.100

libswresample 3. 6.100 / 3. 6.100

libpostproc 55. 6.100 / 55. 6.100

Guessed Channel Layout for Input Stream #0.1 : 5.1

Input #0, matroska,webm, from '/home/Tdarr/Media/Television/Stranger Things/Season 03/Stranger Things - S03E01 - Chapter One- Suzie, Do You Copy [HDTV-1080p].mkv':

Metadata:

encoder :

libebml v1.3.5 + libmatroska v1.4.8

creation_time : 2019-07-04T07:03:27.000000Z

Duration: 00:50:33.63, start: 0.000000, bitrate: 7850 kb/s

Chapter #0:0: start 306.015000, end 354.521000

Metadata:

title : Intro start

Chapter #0:1: start 354.521000, end 3033.632000

Metadata:

title : Intro end

Stream #0:0: Video: h264 (Main), yuv420p(progressive), 1920x1080 [SAR 1:1 DAR 16:9], 23.98 fps, 23.98 tbr, 1k tbn, 47.95 tbc (default)

Metadata:

BPS-eng : 7205368

DURATION-eng : 00:50:33.573000000

NUMBER_OF_FRAMES-eng: 72733

NUMBER_OF_BYTES-eng: 2732251549

_STATISTICS_WRITING_APP-eng: mkvmerge v21.0.0 ('Tardigrades Will Inherit The Earth') 64-bit

_STATISTICS_WRITING_DATE_UTC-eng: 2019-07-04 07:03:27

_STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES

Stream #0:1(eng): Audio: eac3, 48000 Hz, 5.1, fltp (default)

...

Stream #0:29 -> #0:29 (copy)

Stream #0:30 -> #0:30 (copy)

Stream #0:31 -> #0:31 (copy)

Stream #0:32 -> #0:32 (copy)

Press [q] to stop, [?] for help

[hevc_nvenc @ 0x55aaaad84e40] Codec not supported

[hevc_nvenc @ 0x55aaaad84e40] No capable devices found

Error initializing output stream 0:0 -- Error while opening encoder for output stream #0:0 - maybe incorrect parameters such as bit_rate, rate, width or height

Conversion failed!

 

I have an EVGA GeForce GTX 760, obv an older card. nvidia-smi doesn't support it.

Tue Mar 10 13:54:11 2020
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 440.59       Driver Version: 440.59       CUDA Version: 10.2     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX 760     Off  | 00000000:08:00.0 N/A |                  N/A |
|  0%   35C    P0    N/A /  N/A |      0MiB /  1997MiB |     N/A      Default |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|    0                    Not Supported                                       |
+-----------------------------------------------------------------------------+

However my linuxserver/plex and linuxserver/emby containers do manage to use it for hardware transcoding. I made sure to set all the correct Docker template variables including --runtime=nvidia, NVIDIA_DRIVER_CAPABILITIES=all, NVIDIA_VISIBLE_DEVICES=<GPU ID>, I have Linuxserver Unraid Nvidia 6.8.3 installed. Any tips? I would really like to be able to transcode on the GPU, I've been brutally punishing my CPU for days slowly transcoding on Unmanic :(

Share this post


Link to post
22 hours ago, ZooMass said:

I'm having trouble using the "Tiered FFMPEG NVENC settings depending on resolution" plugin with ID "Tdarr_Plugin_d5d3_iiDrakeii_FFMPEG_NVENC_Tiered_MKV". It says it can't find my GPU.

 


Command:

/home/Tdarr/Tdarr/bundle/programs/server/assets/app/ffmpeg/ffmpeg42/ffmpeg -c:v h264_cuvid -i '/home/Tdarr/Media/Television/Stranger Things/Season 03/Stranger Things - S03E01 - Chapter One- Suzie, Do You Copy [HDTV-1080p].mkv' -map 0 -dn -c:v hevc_nvenc -pix_fmt p010le -rc:v vbr_hq -qmin 0 -cq:V 31 -b:v 2500k -maxrate:v 5000k -preset slow -rc-lookahead 32 -spatial_aq:v 1 -aq-strength:v 8 -a53cc 0 -c:a copy -c:s copy '/home/Tdarr/cache/Stranger Things - S03E01 - Chapter One- Suzie, Do You Copy [HDTV-1080p]-TdarrCacheFile-p1cwX-Dg.mkv'

ffmpeg version N-95955-g12bbfc4 Copyright (c) 2000-2019 the FFmpeg developers

built with gcc 7 (Ubuntu 7.4.0-1ubuntu1~18.04.1)

configuration: --prefix=/home/z/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/z/ffmpeg_build/include --extra-ldflags=-L/home/z/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/z/bin --enable-gpl --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree

libavutil 56. 36.101 / 56. 36.101

libavcodec 58. 64.101 / 58. 64.101

libavformat 58. 35.101 / 58. 35.101

libavdevice 58. 9.101 / 58. 9.101

libavfilter 7. 67.100 / 7. 67.100

libswscale 5. 6.100 / 5. 6.100

libswresample 3. 6.100 / 3. 6.100

libpostproc 55. 6.100 / 55. 6.100

Guessed Channel Layout for Input Stream #0.1 : 5.1

Input #0, matroska,webm, from '/home/Tdarr/Media/Television/Stranger Things/Season 03/Stranger Things - S03E01 - Chapter One- Suzie, Do You Copy [HDTV-1080p].mkv':

Metadata:

encoder :

libebml v1.3.5 + libmatroska v1.4.8

creation_time : 2019-07-04T07:03:27.000000Z

Duration: 00:50:33.63, start: 0.000000, bitrate: 7850 kb/s

Chapter #0:0: start 306.015000, end 354.521000

Metadata:

title : Intro start

Chapter #0:1: start 354.521000, end 3033.632000

Metadata:

title : Intro end

Stream #0:0: Video: h264 (Main), yuv420p(progressive), 1920x1080 [SAR 1:1 DAR 16:9], 23.98 fps, 23.98 tbr, 1k tbn, 47.95 tbc (default)

Metadata:

BPS-eng : 7205368

DURATION-eng : 00:50:33.573000000

NUMBER_OF_FRAMES-eng: 72733

NUMBER_OF_BYTES-eng: 2732251549

_STATISTICS_WRITING_APP-eng: mkvmerge v21.0.0 ('Tardigrades Will Inherit The Earth') 64-bit

_STATISTICS_WRITING_DATE_UTC-eng: 2019-07-04 07:03:27

_STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES

Stream #0:1(eng): Audio: eac3, 48000 Hz, 5.1, fltp (default)

...

Stream #0:29 -> #0:29 (copy)

Stream #0:30 -> #0:30 (copy)

Stream #0:31 -> #0:31 (copy)

Stream #0:32 -> #0:32 (copy)

Press [q] to stop, [?] for help

[hevc_nvenc @ 0x55aaaad84e40] Codec not supported

[hevc_nvenc @ 0x55aaaad84e40] No capable devices found

Error initializing output stream 0:0 -- Error while opening encoder for output stream #0:0 - maybe incorrect parameters such as bit_rate, rate, width or height

Conversion failed!

 

I have an EVGA GeForce GTX 760, obv an older card. nvidia-smi doesn't support it.


Tue Mar 10 13:54:11 2020
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 440.59       Driver Version: 440.59       CUDA Version: 10.2     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX 760     Off  | 00000000:08:00.0 N/A |                  N/A |
|  0%   35C    P0    N/A /  N/A |      0MiB /  1997MiB |     N/A      Default |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|    0                    Not Supported                                       |
+-----------------------------------------------------------------------------+

However my linuxserver/plex and linuxserver/emby containers do manage to use it for hardware transcoding. I made sure to set all the correct Docker template variables including --runtime=nvidia, NVIDIA_DRIVER_CAPABILITIES=all, NVIDIA_VISIBLE_DEVICES=<GPU ID>, I have Linuxserver Unraid Nvidia 6.8.3 installed. Any tips? I would really like to be able to transcode on the GPU, I've been brutally punishing my CPU for days slowly transcoding on Unmanic :(

are you trying to pass through the same gpu to all 3? if so as soon as one grabs it the others think is not there anymore its not like windows where multiple programs can use it at once. disable the plex and emby gpu pass though and try it again. also turn on the Linux FFmpeg NVENC binary in options see if that helps.

Share this post


Link to post
On 3/8/2020 at 2:28 PM, TheSuperNINJ4 said:

Anyone else having this issue?


Exception in callback of async function: TypeError [ERR_MISSING_ARGS]: The "message" argument must be specified
at ChildProcess.target._send (internal/child_process.js:649:13)
at ChildProcess.target.send (internal/child_process.js:634:19)
at getNewTask (server/main.js:3118:39)
at server/main.js:2389:11
at runWithEnvironment (packages/meteor.js:1286:24)

I updated Unraid to 6.8.3 and began noticing that no files were progressing in the Tdarr interface. All of them just say 'Calculating'. 

i looks like an issue i had before we had backups, goto backups see if you have one before the update. if so click the clear button. restart tdarr, restore the backup, restart again. that should fix it if you have not changed any locations in the settings for file locations if its the same issue i had. if thats not it tag haveagit on your reply

Share this post


Link to post

Is there a way to not include a folder in the libraries section? I have a download folder in one of my shares I want to ignore. 

Share this post


Link to post

Hi,

I am switching to AIO to use transcoding. 

First topic: how can I enable my Intel iGPU within tdarr? I have already passed it to the container.

Second topic: which profile do you suggest to transcode all h265 files to h264 leaving everything else alone? Adjusted settings for the different resolutions would be nice.

 

Thanks.

 

Happy user here.

Share this post


Link to post
On 3/11/2020 at 11:34 AM, nicksphone said:

i looks like an issue i had before we had backups, goto backups see if you have one before the update. if so click the clear button. restart tdarr, restore the backup, restart again. that should fix it if you have not changed any locations in the settings for file locations if its the same issue i had. if thats not it tag haveagit on your reply

Yeah, looks like that still didn't do it. Thanks for replying though.

@HaveAGitGat Any ideas? Thanks.

Share this post


Link to post
On 3/3/2020 at 2:59 PM, nicksphone said:

Have you considered having your temp files in a folder not scanned my what ever tool is picking it up only takes making another share and pointing it there. alternatively if you have enough ram to you do it in /tmp

Problem is not with tmp dir. It's when tdarr is copying from tmp dir to output dir.

Share this post


Link to post
On 3/8/2020 at 9:28 AM, TheSuperNINJ4 said:

Anyone else having this issue?


Exception in callback of async function: TypeError [ERR_MISSING_ARGS]: The "message" argument must be specified
at ChildProcess.target._send (internal/child_process.js:649:13)
at ChildProcess.target.send (internal/child_process.js:634:19)
at getNewTask (server/main.js:3118:39)
at server/main.js:2389:11
at runWithEnvironment (packages/meteor.js:1286:24)

I updated Unraid to 6.8.3 and began noticing that no files were progressing in the Tdarr interface. All of them just say 'Calculating'. 

Update; I switched to the AIO container and things seem to be working again. I didn't make any changes to the standalone container configs, so I am not sure why it started having issues, but the AIO is operating fine! Great Job @HaveAGitGat !

Share this post


Link to post

Hi,
I want to transcode every hevc file to h264 since my igpu doesn't support hevc.
Which profile should I use?

Thanks.

I am using tdarr-aio and it is working like a charm

Gesendet von meinem MI 8 mit Tapatalk

Share this post


Link to post

I just finished setting up the QSV version of Tdarr on my Unraid server.

 

I'm working on converting my entire library to H265.

 

The problem is though is that I'm not seeing any plugins for QSV. Does anyone have a QSV H265 plugin they could share?

 

Lately I've just been using this plugin:

 

"FFMPEG H265

[Contains built-in filter] This plugin transcodes non h265 files into h265 mkv using default settings. Audio/subtitles not affected." 

 

I like it since I know that the audio wont be affected at all, only the video. I'm looking for something similar.

 

 

Share this post


Link to post
On 3/13/2020 at 12:41 AM, Bruno said:

Problem is not with tmp dir. It's when tdarr is copying from tmp dir to output dir.

If I get time I’ll put that in the next update. 

Share this post


Link to post
On 3/13/2020 at 12:41 PM, TheSuperNINJ4 said:

Update; I switched to the AIO container and things seem to be working again. I didn't make any changes to the standalone container configs, so I am not sure why it started having issues, but the AIO is operating fine! Great Job @HaveAGitGat !

Glad it’s working :). 

Share this post


Link to post
On 3/20/2020 at 7:20 PM, darkreeper said:

Hi,
I want to transcode every hevc file to h264 since my igpu doesn't support hevc.
Which profile should I use?

Thanks.

I am using tdarr-aio and it is working like a charm

Gesendet von meinem MI 8 mit Tapatalk
 

Which CPU/iGPU do you have? 

Share this post


Link to post
On 3/21/2020 at 9:47 PM, jeremytodd1 said:

I just finished setting up the QSV version of Tdarr on my Unraid server.

 

I'm working on converting my entire library to H265.

 

The problem is though is that I'm not seeing any plugins for QSV. Does anyone have a QSV H265 plugin they could share?

 

Lately I've just been using this plugin:

 

"FFMPEG H265

[Contains built-in filter] This plugin transcodes non h265 files into h265 mkv using default settings. Audio/subtitles not affected." 

 

I like it since I know that the audio wont be affected at all, only the video. I'm looking for something similar.

 

 

As I sent on Reddit:

 

`if you add the transcode customisable plugin and use the following transcode arguments for HandBrake then qsv should work:
-Z "Very Fast 720p30" -e qsv_h265 --all-audio
So the plugin in the plugin stack should look something like this: https://imgur.com/a/Kz79oCX
Hope that helps.

`

 

You can add an option to pass through audio so it’s not affected.

 

Check the audio section here:

https://handbrake.fr/docs/en/latest/cli/command-line-reference.html

Share this post


Link to post
On 3/11/2020 at 4:54 PM, ice pube said:

Is there a way to not include a folder in the libraries section? I have a download folder in one of my shares I want to ignore. 

Yes there’s a section in the library source settings where you can specify things to ignore. 

Share this post


Link to post
On 3/7/2020 at 11:54 PM, DoeBoye said:

Awesome Docker! Thank you so much!!! :)

 

One thing I noticed: While using an nvidia card to transcode, if I cancel all workers mid-transcode, the streams do not seem to get released until I stop the docker. If I let them finish, they release as expected. (watching using 'watch nvidia-smi' in Putty)

Ok I’ll add an issue on Github for that.

Share this post


Link to post
Which CPU/iGPU do you have? 
@HaveAGitGat
I have an i3-4130. HW transcoding with a h264 video is working with Jellyfin pretty well. But the iGPU doesn't support QVC I am using VAAPI.
Is this possible as well with tdarr-aio?

Gesendet von meinem MI 8 mit Tapatalk

Share this post


Link to post

Hey guys. I'm having some trouble with file permissions after a transcode. Media directories are nobody:users 666 (rwrwrw). UID and PGID are 99 and 100 in the container settings for Tdarr. However, after a transcode, when Tdarr copies the new file to the original location, the file permissions are root:root 644. This causes problems when I need to write to those directories later.

 

I have tried adding "-e UMASK_SET=0000" to the Extra Parameters section in the container and this has had no effect. I've also tried UMASK. I've also added these as variables in the container settins with no such lock. For kicks, I've tried other UMASK values and no change.

 

Any ideas or suggestions?

Share this post


Link to post

I have a HUGE library full of Videos and I'm a littler leary about releasing this Docker on it. So of course for testing I created a Dummy folder for it to play in

 

In the past I put a flag on my files so they couldn't be deleted unless I unflag them I'm assuming Tdarr can't delete my files either so it would more than likely scan, copy to temp folder, transcode and put back into the directory my files reside. Is it going to continue to process the files it can't delete or will it flag them in the database as done and move on?

Share this post


Link to post
I have a HUGE library full of Videos and I'm a littler leary about releasing this Docker on it. So of course for testing I created a Dummy folder for it to play in
 
In the past I put a flag on my files so they couldn't be deleted unless I unflag them I'm assuming Tdarr can't delete my files either so it would more than likely scan, copy to temp folder, transcode and put back into the directory my files reside. Is it going to continue to process the files it can't delete or will it flag them in the database as done and move on?
What exactly do you mean with "delete"? Tdarr is processing the files to a temp dir and moves the files back in the source folder. You can specify a different output folder if you want to.
If tdarr encounters a problem with a file it is going to mark it and move it to a separate tab.
I have added an image for clarification.
7ceed49b6023115bc58f1b67168ff371.jpg

Gesendet von meinem MI 8 mit Tapatalk

Share this post


Link to post

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.