[Support] HaveAGitGat - Tdarr: Audio/Video Library Analytics & Transcode Automation


Recommended Posts

2 hours ago, nickp85 said:

Tdarr seems to be constantly writing data to my cache but not actually writing anything.  If Tdarr is running I constantly see a 2MB/s write going to my cache.  It stops immediately after stopping the container.  My libraries are set to only operate for 4 hours a day and this write activity seems to be constant.  How can I get it to stop?

Have a read of this issue (towards the end there is a mention of a possible workaround) ... 

 

Link to comment
On 6/13/2020 at 10:36 PM, nickp85 said:

Tdarr seems to be constantly writing data to my cache but not actually writing anything.  If Tdarr is running I constantly see a 2MB/s write going to my cache.  It stops immediately after stopping the container.  My libraries are set to only operate for 4 hours a day and this write activity seems to be constant.  How can I get it to stop?

I had the same problem, though I think the writes are technically coming from MongoDB which Tdarr uses: 

 

I just disabled Tdarr and MongoDB until I need them, which isn't ideal...

Link to comment

Hey guys, I asked about an issue I had a bit ago. The suggested fix was to clear the database and that does seem to have fixed my initial issue, however I am now having trouble restoring from my backup. 

 

1494813023_2020-06-1812_17_52-Tdarr.thumb.png.b1c861c0de53eaa7b3ae725a3c83cc47.png

This is the first time I have needed to restore from a backup, so it's possible I am missing a step. I tried both containers, tdarr and tdarr_aio. tdarr_aio saves its backups as unzipped folders, but tdarr saves its backups as zipped folders? Zipping the folder from my tdarr_aio backup was the only way I could get the file to show up in the backup list.

Link to comment
16 hours ago, GigaGrim said:

Hey guys, I asked about an issue I had a bit ago. The suggested fix was to clear the database and that does seem to have fixed my initial issue, however I am now having trouble restoring from my backup. 

 

1494813023_2020-06-1812_17_52-Tdarr.thumb.png.b1c861c0de53eaa7b3ae725a3c83cc47.png

This is the first time I have needed to restore from a backup, so it's possible I am missing a step. I tried both containers, tdarr and tdarr_aio. tdarr_aio saves its backups as unzipped folders, but tdarr saves its backups as zipped folders? Zipping the folder from my tdarr_aio backup was the only way I could get the file to show up in the backup list.

are those files extracted in the location mentioned? if they are might be a DB write error and with that you will have to wait for the havagit to reply

Link to comment
On 6/18/2020 at 12:34 PM, GigaGrim said:

Hey guys, I asked about an issue I had a bit ago. The suggested fix was to clear the database and that does seem to have fixed my initial issue, however I am now having trouble restoring from my backup. 

 

1494813023_2020-06-1812_17_52-Tdarr.thumb.png.b1c861c0de53eaa7b3ae725a3c83cc47.png

This is the first time I have needed to restore from a backup, so it's possible I am missing a step. I tried both containers, tdarr and tdarr_aio. tdarr_aio saves its backups as unzipped folders, but tdarr saves its backups as zipped folders? Zipping the folder from my tdarr_aio backup was the only way I could get the file to show up in the backup list.

BUMP

 

Anyone have any idea what my issue might be?

Link to comment
On 6/22/2020 at 1:37 PM, GigaGrim said:

BUMP

 

Anyone have any idea what my issue might be?

did you zip the folder or the files in the folder and any sub files and folders in it? i think it zips the content of the root backup folder and not the folder its self

Edited by nicksphone
Link to comment
On 5/16/2020 at 7:30 PM, aron7676 said:

@HaveAGitGat I think I have troubleshot as much as I can. Do you have any ideas? 

Not mentioned above, but I do have this checked on the options page too:

image.png.b3e723900b00bf11589ee3aff58feb4d.png

 

I rolled back to an older version even, to get an older driver (6.8.0-rc5).

 

For whatever reason it is not seeing or passing through the driver info.



I WAS able to get it partially working by creating a read only path from host /usr/lib64 to container /usr/lib64. I am sure this is wrong and will cause things to catch on fire later, but got a few transcodes going. a few are still erroring out though. 

 

 


 

Has anybody been able to sort out this problem with the conversion not been able to load libnvcuvid.so.1? I have tried all the options quote above, and am running the latest 6.8.3 Nvidia Build, the AIO version of the docker.

Edited by pupmeister
Link to comment
9 hours ago, pupmeister said:

Has anybody been able to sort out this problem with the conversion not been able to load libnvcuvid.so.1? I have tried all the options quote above, and am running the latest 6.8.3 Nvidia Build, the AIO version of the docker.

which plugin are you using to transcode?

 

can you transcode on cpu only plugin?

do you have the all nvidia card info in the config some people forget to click on the advanced tab to add the --runtime=nvidia as well as the other 2 lines?

 

have you tried removing tdarr and the folder and doing a fresh install using the comunity plugins version as they are now all rolled into one?

 

 

Edited by nicksphone
Link to comment
17 hours ago, abra8c said:

The health check option has found files with errors and I know for sure that they have frames with strange artifacts.
What can I do with those files? Is there an option to repair the errors?

you can try an index rebuild or their are a site or two you can upload a file to for them to try to fix it for free. otherwise i hope you are able to find another copy of it as i do not know of any other way to fix it besides editing the file and cutting that bit out. 

Link to comment
On 6/26/2020 at 7:07 PM, nicksphone said:

which plugin are you using to transcode?

Tdarr_Plugin_MC93_Migz1FFMPEG Migz-Transcode Using Nvidia GPU & FFMPEG

can you transcode on cpu only plugin?
Yes can transcode on CPU, only has a problem with GPU (I used the CPU plugin of the above to test)
do you have the all nvidia card info in the config some people forget to click on the advanced tab to add the --runtime=nvidia as well as the other 2 lines?

Yes all are passed through and working as you can see from a check with nvidia-smi that I didtdarr_docker.png.fc2524585d9874f4abae13a664ccff41.png

I also stopped any other dockers that use the GPU and I a do not have any VM's currently installed or running

have you tried removing tdarr and the folder and doing a fresh install using the comunity plugins version as they are now all rolled into one?

Tried a reinstall. I run the Tdarr aio version of the docker

tdarr_aio.png.ea14bb2c81d0c70925a41c15867dcf01.png

 

 

I have answered your questions in blue above to the best of abilities. I know that the GPU is working, because I can get it to pass through to Emby and

unmanic. I did stop both these dockers during my testing to ensure that I did not interefere.

 

Thanks

Stephen

 

Link to comment
15 hours ago, pupmeister said:

I have answered your questions in blue above to the best of abilities. I know that the GPU is working, because I can get it to pass through to Emby and

unmanic. I did stop both these dockers during my testing to ensure that I did not interefere.

 

Thanks

Stephen

 

in options 
Linux FFmpeg NVENC binary (3.4.5 for unRAID compatibility) set to on?

 

try this plugin its the one i use the most seems to fail on less files

Tdarr_Plugin_d5d3_iiDrakeii_FFMPEG_NVENC_Tiered_MKV

Edited by nicksphone
Link to comment
1 hour ago, nicksphone said:

in options 
Linux FFmpeg NVENC binary (3.4.5 for unRAID compatibility) set to on?

 

try this plugin its the one i use the most seems to fail on less files

Tdarr_Plugin_d5d3_iiDrakeii_FFMPEG_NVENC_Tiered_MKV

Yes Linux FFmpeg NVENC binary (3.4.5 for unRAID compatibility) is on.

 

I actually found a solution that seems to work in thread on handbrake on Reddit, and was not mentioned in the posts that I read or needed for the other containers that use the GPU.

Add a variable NVIDIA_DRIVER_CAPABILITIES and set the value to all .

 

Seems to be working now.

 

Thanks for trying to help me.

Link to comment
On 6/25/2020 at 2:59 PM, nicksphone said:

did you zip the folder or the files in the folder and any sub files and folders in it? i think it zips the content of the root backup folder and not the folder its self

Thank you, the problem ended up being that the folder was zipped up one folder higher than required.

 

After reloading the backup my original problem returned, but after doing the database clear and reverting from backup again it worked!

Link to comment
12 hours ago, pupmeister said:

Yes Linux FFmpeg NVENC binary (3.4.5 for unRAID compatibility) is on.

 

I actually found a solution that seems to work in thread on handbrake on Reddit, and was not mentioned in the posts that I read or needed for the other containers that use the GPU.

Add a variable NVIDIA_DRIVER_CAPABILITIES and set the value to all .

 

Seems to be working now.

 

Thanks for trying to help me.

sorry thats what i ment by the other 2 lines sorry should of been more detailed about the nvidia question.

Link to comment
  • 2 weeks later...

@HaveAGitGat i am using an hdhomerun tunner and when trying to convert the SD recordings i get the following errors any ideas?

 

Command:

/home/Tdarr/Tdarr/bundle/programs/server/assets/app/ffmpeg/ffmpeg345/ffmpeg -c:v h264_cuvid -i '/home/Tdarr/Media/tv/tv/Chasing Classic Cars (2008)/Season 06/Chasing Classic Cars (2008) - S06E20 - Backyard Finds.ts' -map 0 -dn -c:v hevc_nvenc -pix_fmt p010le -rc:v vbr_hq -qmin 0 -cq:v 30 -b:v 2000k -maxrate:v 4000k -preset slow -rc-lookahead 32 -spatial_aq:v 1 -aq-strength:v 8 -a53cc 0 -c:a copy -c:s copy 'Chasing Classic Cars (2008) - S06E20 - Backyard Finds-TdarrCacheFile-uZQID7A4V.mkv'

Last 200 lines of CLI log:

shellThread

ffmpeg version 3.4.5 Copyright (c) 2000-2018 the FFmpeg developers

built with gcc 7 (Ubuntu 7.4.0-1ubuntu1~18.04.1)

configuration: --prefix=/home/z/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/z/ffmpeg_build/include --extra-ldflags=-L/home/z/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/z/bin --enable-gpl --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree

libavutil 55. 78.100 / 55. 78.100

libavcodec 57.107.100 / 57.107.100

libavformat 57. 83.100 / 57. 83.100

libavdevice 57. 10.100 / 57. 10.100

libavfilter 6.107.100 / 6.107.100

libswscale 4. 8.100 / 4. 8.100

libswresample 2. 9.100 / 2. 9.100

libpostproc 54. 7.100 / 54. 7.100

[mpegts @ 0x5631df7e12e0] start time for stream 2 is not set in estimate_timings_from_pts

Input #0, mpegts, from '/home/Tdarr/Media/tv/tv/Chasing Classic Cars (2008)/Season 06/Chasing Classic Cars (2008) - S06E20 - Backyard Finds.ts':

Duration: 00:26:28.63, start: 1.448000, bitrate: 3791 kb/s

Program 1

Metadata:

service_name : Service01

service_provider: FFmpeg

Stream #0:0[0x100]: Video: h264 (Main) ([27][0][0][0] / 0x001B), yuv420p(progressive), 1024x576 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 90k tbn, 50 tbc

Stream #0:1[0x101](eng): Audio: mp2 ([3][0][0][0] / 0x0003), 48000 Hz, stereo, s16p, 128 kb/s

Stream #0:2[0x102](eng): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)

Stream mapping:

Stream #0:0 -> #0:0 (h264 (h264_cuvid) -> hevc (hevc_nvenc))

Stream #0:1 -> #0:1 (copy)

Stream #0:2 -> #0:2 (copy)

Press [q] to stop, [?] for help

Output #0, matroska, to 'Chasing Classic Cars (2008) - S06E20 - Backyard Finds-TdarrCacheFile-uZQID7A4V.mkv':

Metadata:

encoder : Lavf57.83.100

Stream #0:0: Video: hevc (hevc_nvenc) (Main 10), p010le, 1024x576 [SAR 1:1 DAR 16:9], q=0--1, 2000 kb/s, 25 fps, 1k tbn, 25 tbc

Metadata:

encoder : Lavc57.107.100 hevc_nvenc

Side data:

cpb: bitrate max/min/avg: 4000000/0/2000000 buffer size: 4000000 vbv_delay: -1

Stream #0:1(eng): Audio: mp2 (P[0][0][0] / 0x0050), 48000 Hz, stereo, s16p, 128 kb/s

Stream #0:2(eng): Subtitle: dvb_subtitle ([255][255][255][255] / 0xFFFFFFFF)

frame= 76 fps=0.0 q=23.0 size= 0kB time=00:00:03.16 bitrate= 0.0kbits/s speed=6.31x

frame= 179 fps=179 q=25.0 size= 0kB time=00:00:07.20 bitrate= 0.0kbits/s speed=7.18x

frame= 275 fps=183 q=29.0 size= 1kB time=00:00:11.08 bitrate= 0.8kbits/s speed=7.36x

frame= 357 fps=178 q=24.0 size= 174kB time=00:00:14.42 bitrate= 98.9kbits/s speed=7.19x

frame= 452 fps=180 q=22.0 size= 912kB time=00:00:18.12 bitrate= 412.4kbits/s speed=7.21x

frame= 557 fps=185 q=23.0 size= 1947kB time=00:00:22.32 bitrate= 714.7kbits/s speed= 7.4x

frame= 657 fps=187 q=22.0 size= 3059kB time=00:00:26.35 bitrate= 951.0kbits/s speed=7.49x

frame= 750 fps=186 q=28.0 size= 4065kB time=00:00:30.07 bitrate=1107.2kbits/s speed=7.47x

frame= 851 fps=188 q=25.0 size= 4629kB time=00:00:34.12 bitrate=1111.0kbits/s speed=7.54x

frame= 947 fps=188 q=28.0 size= 5450kB time=00:00:37.94 bitrate=1176.7kbits/s speed=7.55x

frame= 1044 fps=189 q=28.0 size= 6069kB time=00:00:41.80 bitrate=1189.2kbits/s speed=7.56x

frame= 1142 fps=189 q=26.0 size= 6552kB time=00:00:45.84 bitrate=1170.9kbits/s speed= 7.6x

frame= 1241 fps=190 q=24.0 size= 7420kB time=00:00:49.70 bitrate=1223.0kbits/s speed=7.61x

frame= 1338 fps=190 q=22.0 size= 7420kB time=00:00:53.59 bitrate=1134.2kbits/s speed=7.62x

frame= 1362 fps=166 q=23.0 size= 8082kB time=00:00:54.57 bitrate=1213.1kbits/s speed=6.66x

frame= 1462 fps=168 q=27.0 size= 8082kB time=00:00:58.64 bitrate=1128.9kbits/s speed=6.74x

frame= 1556 fps=169 q=28.0 size= 9318kB time=00:01:02.32 bitrate=1224.7kbits/s speed=6.78x

frame= 1652 fps=170 q=27.0 size= 10163kB time=00:01:06.16 bitrate=1258.3kbits/s speed=6.82x

frame= 1748 fps=171 q=25.0 size= 10537kB time=00:01:10.03 bitrate=1232.6kbits/s speed=6.86x

frame= 1846 fps=172 q=26.0 size= 11240kB time=00:01:13.92 bitrate=1245.6kbits/s speed= 6.9x

frame= 1945 fps=173 q=24.0 size= 12371kB time=00:01:17.92 bitrate=1300.5kbits/s speed=6.95x

frame= 2042 fps=174 q=27.0 size= 13017kB time=00:01:21.79 bitrate=1303.7kbits/s speed=6.98x

frame= 2143 fps=175 q=29.0 size= 13017kB time=00:01:25.82 bitrate=1242.4kbits/s speed=7.02x

frame= 2240 fps=176 q=27.0 size= 14036kB time=00:01:29.68 bitrate=1282.0kbits/s speed=7.05x

frame= 2335 fps=177 q=28.0 size= 15186kB time=00:01:33.55 bitrate=1329.8kbits/s speed=7.08x

frame= 2432 fps=177 q=26.0 size= 15186kB time=00:01:37.41 bitrate=1277.0kbits/s speed= 7.1x

frame= 2526 fps=178 q=29.0 size= 16429kB time=00:01:41.11 bitrate=1331.1kbits/s speed=7.11x

frame= 2619 fps=178 q=23.0 size= 16963kB time=00:01:44.83 bitrate=1325.6kbits/s speed=7.12x

frame= 2718 fps=179 q=24.0 size= 16963kB time=00:01:48.84 bitrate=1276.8kbits/s speed=7.15x

frame= 2810 fps=179 q=29.0 size= 18099kB time=00:01:52.53 bitrate=1317.5kbits/s speed=7.16x

frame= 2907 fps=179 q=27.0 size= 19134kB time=00:01:56.40 bitrate=1346.6kbits/s speed=7.17x

frame= 2991 fps=179 q=27.0 size= 19134kB time=00:01:59.76 bitrate=1308.8kbits/s speed=7.16x

frame= 3085 fps=179 q=28.0 size= 20036kB time=00:02:03.45 bitrate=1329.5kbits/s speed=7.16x

frame= 3177 fps=179 q=28.0 size= 21018kB time=00:02:07.17 bitrate=1353.9kbits/s speed=7.17x

frame= 3273 fps=179 q=29.0 size= 22028kB time=00:02:11.01 bitrate=1377.3kbits/s speed=7.18x

frame= 3364 fps=179 q=28.0 size= 22028kB time=00:02:14.71 bitrate=1339.6kbits/s speed=7.19x

frame= 3457 fps=180 q=24.0 size= 23048kB time=00:02:18.40 bitrate=1364.2kbits/s speed=7.19x

frame= 3551 fps=180 q=23.0 size= 23815kB time=00:02:22.28 bitrate=1371.1kbits/s speed=7.21x

frame= 3647 fps=180 q=24.0 size= 24177kB time=00:02:25.96 bitrate=1356.9kbits/s speed=7.21x

frame= 3742 fps=180 q=23.0 size= 24847kB time=00:02:29.83 bitrate=1358.5kbits/s speed=7.22x

frame= 3841 fps=181 q=25.0 size= 25035kB time=00:02:33.69 bitrate=1334.4kbits/s speed=7.23x

frame= 3940 fps=181 q=24.0 size= 25862kB time=00:02:37.72 bitrate=1343.2kbits/s speed=7.25x

frame= 4030 fps=181 q=24.0 size= 25862kB time=00:02:41.25 bitrate=1313.8kbits/s speed=7.24x

frame= 4126 fps=181 q=26.0 size= 26882kB time=00:02:45.12 bitrate=1333.7kbits/s speed=7.25x

frame= 4223 fps=182 q=25.0 size= 27616kB time=00:02:48.98 bitrate=1338.8kbits/s speed=7.26x

frame= 4319 fps=182 q=25.0 size= 28021kB time=00:02:52.84 bitrate=1328.0kbits/s speed=7.27x

frame= 4412 fps=182 q=25.0 size= 28021kB time=00:02:56.56 bitrate=1300.1kbits/s speed=7.28x

[matroska @ 0x5631df81fc20] Application provided invalid, non monotonically increasing dts to muxer in stream 2: 170207 >= 168633

av_interleaved_write_frame(): Invalid argument

frame= 4469 fps=181 q=25.0 Lsize= 29405kB time=00:02:58.89 bitrate=1346.5kbits/s speed=7.23x

video:26361kB audio:2796kB subtitle:163kB other streams:0kB global headers:0kB muxing overhead: 0.292736%

Conversion failed!

Edited by nicksphone
posted log
Link to comment
  • 3 weeks later...
  • 2 weeks later...

Hi, 

 

I was looking over @SpaceInvaderOne videos for anything left to utilise (I've implemented pretty much all his videos up to now 😁) and I found the process of transcoding my media.

 

I downloaded Unmanic but it kept crashing my browser within minutes, so I've moved over to Tdarr. I have a few questions if someone would be kind enough to answer before I take the plunge;

 

1) I currently have Sonarr/Radarr set to aim for a profile of x265 1080 quality media. Can I set Tdarr to only transcode media once a certain quality has been reached, ie I don't want Tdarr wasting its time converting a 480/720 media file. 

2) What sort of space saving could I look at achieving? 1080 is good enough for me but I want to maintain surround sound. 

3) What is the difference between Tdarr and Tdarr_AIO? 

4) Lastly, once converted to the final file, can Sonarr/Radarr acknowledge that it is the "final" version that I am after and cease with monitoring as to prevent further download and overwriting? 

 

Many thanks. 

Edited by LoneTraveler
Link to comment
3 hours ago, LoneTraveler said:

Hi, 

 

I was looking over @SpaceInvaderOne videos for anything left to utilise (I've implemented pretty much all his videos up to now 😁) and I found the process of transcoding my media.

 

I downloaded Unmanic but it kept crashing my browser within minutes, so I've moved over to Tdarr. I have a few questions if someone would be kind enough to answer before I take the plunge;

 

1) I currently have Sonarr/Radarr set to aim for a profile of x265 1080 quality media. Can I set Tdarr to only transcode media once a certain quality has been reached, ie I don't want Tdarr wasting its time converting a 480/720 media file. 

2) What sort of space saving could I look at achieving? 1080 is good enough for me but I want to maintain surround sound. 

3) What is the difference between Tdarr and Tdarr_AIO? 

4) Lastly, once converted to the final file, can Sonarr/Radarr acknowledge that it is the "final" version that I am after and cease with monitoring as to prevent further download and overwriting? 

 

Many thanks. 

hello 

the answer to question 3  is tdarr aio is the only one that is needed now. the tdarr used to require a separate mongo database and now tdarr aio has it built-in

  • Thanks 1
Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.