[[Support] auto-yt-dl]

On 1/10/2024 at 4:00 PM, gellux said:

just installed - inputted youtube url - doesn't work

 

 

Hi, could u please update the application and try again?

[[Support] auto-yt-dl]

On 4/8/2023 at 2:20 PM, DevXen said:

Haven't had time to check out the update. I'll mess with it this weekend after work. But did we get the option to add the YouTube id and the name to the files yet by chance?

For the moment the options for the naming of the files have not changed. 

 

You can either:

 

A.: Dump all videos in one single folder, each file named after the video title

B.: Save the videos in separate folders for each channel (Folder named after Channel / Video after title)

C.: Save the videos after the plex youtube agent sheme (Folder named: [channel-id] and video named [video-id]) 

[[Support] auto-yt-dl]

I just pushed an update. This docker now uses yt-dlp instead of pytube. yt-dlp receives updates and fixes much faster, which I hope will ensure that there are no more long lasting outages.

 

As this was I relatively big update, any feedback and bug reports are welcome!

[[Support] auto-yt-dl]

On 4/1/2023 at 8:48 PM, comet424 said:

got a 500 Error Server internal error...  and the log for the app is 

```

text  error  warn  system  array  login  

WARNING:werkzeug: * Running on all addresses.
   WARNING: This is a development server. Do not use it in a production deployment.
INFO:werkzeug: * Running on http://172.17.0.7:5000/ (Press CTRL+C to quit)
ERROR:app:Exception on / [GET]
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/flask/app.py", line 2070, in wsgi_app
    response = self.full_dispatch_request()
  File "/usr/local/lib/python3.9/site-packages/flask/app.py", line 1515, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/usr/local/lib/python3.9/site-packages/flask/app.py", line 1513, in full_dispatch_request
    rv = self.dispatch_request()
  File "/usr/local/lib/python3.9/site-packages/flask/app.py", line 1499, in dispatch_request
    return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args)
  File "/app/app.py", line 17, in index
    monitoredPlaylist = pytubDef.returnMonitoredPlaylist()
  File "/app/pytubDef/__init__.py", line 429, in returnMonitoredPlaylist
    logstr = logstr + monitoredPlaylistArray[len(monitoredPlaylistArray) - 1].title
  File "/usr/local/lib/python3.9/site-packages/pytube/contrib/playlist.py", line 351, in title
    return self.sidebar_info[0]['playlistSidebarPrimaryInfoRenderer'][
  File "/usr/local/lib/python3.9/site-packages/pytube/contrib/playlist.py", line 93, in sidebar_info
    self._sidebar_info = self.initial_data['sidebar'][
KeyError: 'sidebar'
INFO:werkzeug:192.168.0.227 - - [01/Apr/2023 14:46:15] "GET / HTTP/1.1" 500 -
 * Serving Flask app 'app' (lazy loading)
 * Environment: production
   WARNING: This is a development server. Do not use it in a production deployment.
   Use a production WSGI server instead.
 * Debug mode: off
```

 

 

12 hours ago, vipermo said:

Same thing here just installed it so come here to see why.  
now I see it’s been reported
 

Thanks for reporting. I am currently working on rewriting the container to use yt-dlp instead of pytube, as it seems to receive updates faster and more reliable. I hope I can push the update tommorow

[[Support] auto-yt-dl]

13 hours ago, DevXen said:

Hey i found an issue. - Youtube has changed usernames to have a @ in the beginning. and i think thats causing an issue.

For example I want to get all the videos of this channel: https://www.youtube.com/@8BitUniverse/videos

 

which it doesn't add, and the log shows:

WARNING:root:Illegal channel-URL
WARNING:root:Illegal playlist-URL

Thanks for posting, I am able to reproduce this issue.

 

There will be an update which recognizes the new channel urls.
Meanwhile you can just use the old channel urls, they are still working. On most channels its posted in the channel info. Also you can use websites like this one to get the channel url.

[[Support] auto-yt-dl]

The container should work now, sorry for the long wait.

Currently the download speed is low, I am looking in to it.

[[Support] auto-yt-dl]

On 11/4/2022 at 4:21 AM, donniedice said:

Here's a screenshot. The title names / folder names. It would be cool if it was the actual channel name/video name.

 

Also.. It may be just me, but I haven't had any downloads in the last 4 days. I'll double check all my docker settings to be sure.

Did you go to the settings and press "Disable naming for Youtube-Agent"?

[[Support] auto-yt-dl]

It seems like there were changes to youtube which resulted in a bug in pytube, the library this docker uses to download the videos.

I´ll update the container as soon as pytube gets updated.

[[Support] auto-yt-dl]

44 minutes ago, Justin Scholz said:

Moin Ich Habe Jetzt Vor Kurzem Wohl wieder bemerken Müssen das der Downloader Nichts Mehr Herunterläd

 

Was ist das & Wie Kann ich das Beheben? Der Downloader Lief Bei Mir Fast 1 Ganzen Monat Durch Habe den Docker auch schon neugestartet. aber Tritt Trotzdem Immer wieder auf.

 

Seit wan das so ist seit dem 13.09 Zieht der Nichts Mehr.

 

Es ist jetzt ein Update verfügbar, damit funktioniert es bei mir wieder reibungslos. Das Problem war scheinbar auf Shorts beschränkt, daher ist es mir nicht aufgefallen.

 

--

 

The problem should be fixed with the update. It seems like only shorts were effected, which is why I didn´t notice it.

 

[[Support] auto-yt-dl]

22 hours ago, DevXen said:

Any word on adding the ability to append the YouTubeID to the file and folder names?

 

Hey,

currently I am only interested in fixing bugs. I wanted to work on higher resolutions and naming but I am currently working on a project for study. I don´t think I will add new features till Christmas.

 

22 hours ago, DevXen said:

I was thinking of editing the docker container myself to do that. But I wouldn't know how to edit the container directly or if you can even edit them. Or if they have to just be loaded from the GitHub for changes. And if I could any update would remove that.. So I'm not sure if that's worth it. So I haven't looked into it yet.

 

If you want to contribute or edit the container to your needs, you can download the project on Github here. Basically you´ll need to edit the files accordingly to your needs and then build the container with docker (there are plenty of tutorials on Youtube).  If your build then is without issues you can create a pull request on github, I will test it, and then merge it to the main branch. This would make it available to everyone via an update.

[[Support] auto-yt-dl]

13 hours ago, donniedice said:Also, for some reason it's not properly naming folders after channels. It's also not properly naming files.

Can you give me more information? Or some examples? 
 

Regarding the format/resolution, I am looking into it. But I am not sure how much time it will take.

 

PS: Anyone is welcome to contribute on github

[[Support] auto-yt-dl]

12 hours ago, DevXen said:

Hey, I noticed my container keeps stopping. even though it's set to auto run. it'll run. and mostly get videos. anyways today i had a minute so i checked the log and it has this in it:

 

Checking for new Videos
Checking for new Videos
Traceback (most recent call last):
File "/usr/local/lib/python3.9/urllib/request.py", line 1346, in do_open
h.request(req.get_method(), req.selector, req.data, headers,
File "/usr/local/lib/python3.9/http/client.py", line 1285, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/usr/local/lib/python3.9/http/client.py", line 1331, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/usr/local/lib/python3.9/http/client.py", line 1280, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/usr/local/lib/python3.9/http/client.py", line 1040, in _send_output
self.send(msg)
File "/usr/local/lib/python3.9/http/client.py", line 980, in send
self.connect()
File "/usr/local/lib/python3.9/http/client.py", line 1447, in connect
super().connect()
File "/usr/local/lib/python3.9/http/client.py", line 946, in connect
self.sock = self._create_connection(
File "/usr/local/lib/python3.9/socket.py", line 823, in create_connection
for res in getaddrinfo(host, port, 0, SOCK_STREAM):
File "/usr/local/lib/python3.9/socket.py", line 954, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -3] Temporary failure in name resolution

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/app/main.py", line 13, in <module>
pytubDef.loop()
File "/app/pytubDef/__init__.py", line 296, in loop
playlistArray = returnMonitoredPlaylist()
File "/app/pytubDef/__init__.py", line 399, in returnMonitoredPlaylist
logstr = logstr + monitoredPlaylistArray[monitoredPlaylistArray.__len__() - 1].title
File "/usr/local/lib/python3.9/site-packages/pytube/contrib/playlist.py", line 351, in title
return self.sidebar_info[0]['playlistSidebarPrimaryInfoRenderer'][
File "/usr/local/lib/python3.9/site-packages/pytube/contrib/playlist.py", line 93, in sidebar_info
self._sidebar_info = self.initial_data['sidebar'][
File "/usr/local/lib/python3.9/site-packages/pytube/contrib/playlist.py", line 81, in initial_data
self._initial_data = extract.initial_data(self.html)
File "/usr/local/lib/python3.9/site-packages/pytube/contrib/playlist.py", line 58, in html
self._html = request.get(self.playlist_url)
File "/usr/local/lib/python3.9/site-packages/pytube/request.py", line 53, in get
response = _execute_request(url, headers=extra_headers, timeout=timeout)
File "/usr/local/lib/python3.9/site-packages/pytube/request.py", line 37, in _execute_request
return urlopen(request, timeout=timeout) # nosec
File "/usr/local/lib/python3.9/urllib/request.py", line 214, in urlopen
return opener.open(url, data, timeout)
File "/usr/local/lib/python3.9/urllib/request.py", line 517, in open
response = self._open(req, data)
File "/usr/local/lib/python3.9/urllib/request.py", line 534, in _open
result = self._call_chain(self.handle_open, protocol, protocol +
File "/usr/local/lib/python3.9/urllib/request.py", line 494, in _call_chain
result = func(*args)
File "/usr/local/lib/python3.9/urllib/request.py", line 1389, in https_open
return self.do_open(http.client.HTTPSConnection, req,
File "/usr/local/lib/python3.9/urllib/request.py", line 1349, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error [Errno -3] Temporary failure in name resolution>

olution>

 

It seems like its not an issue with the program itself, but for some reason the name resolution (DNS Services, I guess?) fail. I've uploaded an update which prevents the docker from stopping, and just ignoring this error.

[[Support] auto-yt-dl]

On 4/24/2022 at 4:35 PM, LarsW said:

 

I currently don't have access to my own server, so I can't test it at the moment. Can you open the config.ini in the app data folder and change log = False to log = True? After running the docker again, there should be two files: flaskDEBUG and mainDEBUG.

 

I have the suspicion that it's actually the pytube library which is causing these issues.

 

As suspected, pytube was / is the issue. It currently has an critical issue. I updated the docker to use youtube-dl if pytube fails. Sadly you will have to delete the links, which have not been downloaded from the appdata/<ChannelName>.txt file to download them.

[[Support] auto-yt-dl]

14 hours ago, Astryl said:

Use a production WSGI server instead.
* Debug mode: off
WARNING:werkzeug: * Running on all addresses.

WARNING: This is a development server. Do not use it in a production deployment.

INFO:werkzeug: * Running on http://172.17.0.9:5000/ (Press CTRL+C to quit)
ERROR:root:Something went wrong while checkig for new Videos from Biographics

 

Wanted to start using this to build my Plex youtube library since you've included the youtube-agent schema and I couldn't get meta data to load properly when trying to use TubeSync. However, adding anything via the GUI does not work; and after manually adding a channel to the monitoredChannels.txt I get this error with no other errors.

 

Any ideas?

 

 

I currently don't have access to my own server, so I can't test it at the moment. Can you open the config.ini in the app data folder and change log = False to log = True? After running the docker again, there should be two files: flaskDEBUG and mainDEBUG.

 

I have the suspicion that it's actually the pytube library which is causing these issues.

[[Support] auto-yt-dl]

The docker container has been updated to adress the issues mentioned by DevXen.

[[Support] auto-yt-dl]

9 minutes ago, DevXen said:

So i've done a bunch of testing. and i've taken spaces out of my download folder and brackets, i've moved it to the array. and it'll only let me add one channel or playlist but its not downloading it. even if i manually add it, it'll show but not download. hmm.

 

I think I have a lead on the issue. I hope I can publish a update later today or tomorrow.

 

Note: There seems to be a common misconception that the app will download the whole channel when added. This is not the case as the app will only download new videos. It is however possible to download all videos by deleting the content of the <channelName>.txt in the appdata folder.

[[Support] auto-yt-dl]

4 hours ago, DevXen said:

yup. here's another one i just tried. when i paste it and click add. the page refreshes and its not listed.

 

https://www.youtube.com/playlist?list=PLimhOT0Avg-RrTX14TmLCSeB90wCK69x-

 

but the log for the container shows this:

192.168.0.2 - - [10/Apr/2022 13:41:47] "POST /index.html HTTP/1.1" 200 -
192.168.0.2 - - [10/Apr/2022 13:42:10] "[36mGET /static/style.css HTTP/1.1[0m" 304 -

not sure if thats important or not.

 

also not sure why it has 192.168.0.2 listed. thats the pc i'm not. not my server.

howerver when i added the Ryan George the full channel. it did add that and got all his videos. just not the playlists. strange.

 

 

 

I am not sure if I am reproducing the same bug as you are experiencing. On the first try I was able to add the playlist without issues.

But when I "spammed" the GUI, it becomes unresponsive and no new channels or videos can be added/removed. Even after restarting the container.
I am investigating, I will come back on this when I find out what is causing this.

 

Meanwhile, you could try to add the playlist manually. This should be able to be done by adding a new line with the channel-URL to monitoredPlaylist.txt

[[Support] auto-yt-dl]

5 hours ago, DevXen said:

is there a way to add playlists? i was able to add a channel but not any of the playlists i've tried. however the appdata has a empty file named monitoredplaylists.txt

was thinking i'd rather get specific playlists and their updates vs getting the whole channel.

 

thanks,

-Dev

yes, you should be able to add playlists. Have you made sure the playlist are public?

[[Support] auto-yt-dl]

8 hours ago, keithcroshaw said:

Hmm thanks for the response.

They are allllll 720p for some reason.

I love how simple this container is, and it actually works great.

Would love for a way to expose some setting for the resolution to I could see what I told it to do vs what it's doing.

 

I will look into this, but as of right now I don´t have much time to invest, I would not expect major updates until summer, depending on when my exams are done.

But anyone is welcome to improve the project by opening a Pull Request on GitHub

[[Support] auto-yt-dl]

On 3/29/2022 at 6:31 AM, keithcroshaw said:

Thanks a lot for this container, it's the most reliable that I can find.

I don't see an option for resolution settings, at least in the web UI.

Is that hidden somewhere in a config file?  I don't see it in Config.ini

 

 

Thanks for the feedback! At the moment there is no option to specify the resolution. This project uses pytube, which should get the highest available resolution. 

[[Support] auto-yt-dl]

On 2/15/2022 at 12:16 AM, loz678 said:

when i start the container:

 

Starting loop....
Checking for new Videos
Traceback (most recent call last):
File "main.py", line 8, in <module>
pytubDef.loop()
File "/app/pytubDef/__init__.py", line 202, in loop
channelArray = returnMonitoredChannels()
File "/app/pytubDef/__init__.py", line 256, in returnMonitoredChannels
channelURLs = monitoredChannelsFile.readlines()
io.UnsupportedOperation: not readable

 

I had this error once when installing the Docker for the first time. Since then I was not able to reproduce this error. For me simply trying to restart worked.

I suggest just to try to restart and see if it works. If it doesn't feel free to reply.

[[Support] auto-yt-dl]

1 hour ago, jj_uk said:

Does this docker still work? After adding a YT channel and clicking "Add", the input box is cleared and nothing happens. The screen looks exactly as it did previously. 

 

Yes. Can you dm me the link you put in the box? Then I will try to investigate 

[[Support] auto-yt-dl]

On 9/16/2021 at 12:06 PM, wildfire305 said:

I have NOT tried "turning it off and back on again". Should I?

The intention was to know if the bug is reproducible. I was not able to reproduce the bug. Did you try to go to the appdata/auto-yt-dl folder and empty the monitoredChannel.txt (also delete the pre-written text) ?

 

On 9/16/2021 at 11:34 PM, rikki said:

im running AMD Turion™ II Neo N54L Dual-Core @ 2200 MHz if that help narrow down the problem if you want aly log let me know

 

Do you also have this issue?

[[Support] auto-yt-dl]

1 hour ago, rikki said:

working well still for me one outher thing if possable any way to show something is downloading in the web ui

That’s a great idea but at the moment I don’t have time. I will take a look at this after addressing the issue above. 

[[Support] auto-yt-dl]

21 hours ago, wildfire305 said:

I get an error after installing it. I pasted the log below.

 

 

 

Starting loop....
Checking for new Videos
Traceback (most recent call last):
File "main.py", line 8, in <module>
pytubDef.loop()
File "/app/pytubDef/__init__.py", line 141, in loop
checkForNewURL(channelArray[m])
File "/app/pytubDef/__init__.py", line 147, in checkForNewURL
for n in range(selectedChannel.video_urls.__len__()):
File "/usr/local/lib/python3.8/site-packages/pytube/helpers.py", line 89, in __len__
self.generate_all()
File "/usr/local/lib/python3.8/site-packages/pytube/helpers.py", line 105, in generate_all
next_item = next(self.gen)
File "/usr/local/lib/python3.8/site-packages/pytube/contrib/playlist.py", line 281, in url_generator
for page in self._paginate():
File "/usr/local/lib/python3.8/site-packages/pytube/contrib/playlist.py", line 118, in _paginate
json.dumps(extract.initial_data(self.html))
File "/usr/local/lib/python3.8/site-packages/pytube/contrib/channel.py", line 78, in html
self._html = request.get(self.videos_url)
File "/usr/local/lib/python3.8/site-packages/pytube/request.py", line 53, in get
response = _execute_request(url, headers=extra_headers, timeout=timeout)
File "/usr/local/lib/python3.8/site-packages/pytube/request.py", line 37, in _execute_request
return urlopen(request, timeout=timeout) # nosec
File "/usr/local/lib/python3.8/urllib/request.py", line 222, in urlopen
return opener.open(url, data, timeout)
File "/usr/local/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/local/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/local/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/local/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/local/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found

Does it happen immediately after installation? Did you try to reinstall it? Is there anything special about your system? I will take a look at it as soon as possible but at the moment I don’t have much time.