Redxd

G'day all, I've had this issue every since I tried out Portainer a few years back. For some reason ever since then my network interface name for all of my dockers shows has the UID instead of the name that's set in the docker-compose file which is 'eth1.2' I remember deep diving into the docker config files on /boot/ back when it happened but could never find the fix. I think this also might be causing my dockers to not auto start after a reboot/dirty shutdown due to the UID changing. I have to compose down them all then bring them back up for them to all work.

I've always done what you've shown there in my docker-compose.yml file and it worked previously. I always had weird issues where once you set it, and the image was built you could never change it no matter how many times you changed the URL itself. I've now just created two dockers from scratch with the label set correctly and the images haven't shown. Unsure exactly what's happening.

I just changed my docker disk format from BTRFS to XFS due to heaps of errors in my unraid log showing up. Quick google showed a rebuild of the disk was the easiest way to resolve (ignore) it. I stopped the docker service, chose an XFS disk format instead and started it again. I have a user made bridged docker network where all of my dockers have access to so they are able to send logs to my log collector even if they don't have an external IP. Everything was all good up until I tried to start a PostgreSQL docker when there was already one started for another web service. Then I got the error Intrigued why changing only the format of the disk caused this I jumped back to the old disk to confirm I wasn't going crazy and both of the PostgreSQL dockers started up perfectly fine with no port conflicts. They are both being composed using the exact same docker stack, although each in a different stack. I then did a docker inspect on the same docker, composed in both the BTRFS and XFS disk formats, and here is the main difference (minus different ID's etc). The BTRFS 'Ports' section is empty, but the XFS section has the following. "Ports": { "5432/tcp": [ { "HostIp": "0.0.0.0", "HostPort": "5432" }, { "HostIp": "::", "HostPort": "5432" } ] }, Am I running into a bug? Or have I been using a bug with BTRFS and XFS is the correct way it should be?

I'd also been keen to see the imfile module included in the default OS so I can onforward logs like /var/log/ipmifan which generates temp readings from my motherboards IPMI and adjust the fans accordingly.

It's exactly what I did!

With Youtube URL's now changed, has anyone figured out how to download a full channel when 'Usernames' are no longer being accepted? {"level":"error","msg":"There was an error downloading the video: ERROR: u'' is not a valid URL. Set --default-search \"ytsearch\" (or run youtube-dl \"ytsearch:\" ) to search YouTube\n[youtube:user] destinws2: Downloading channel page\n[youtube:playlist] UU6107grRI4m0o2-emgoDnAA: Downloading webpage\n[download] Downloading playlist: Uploads from SmarterEveryDay\n[youtube:playlist] UU6107grRI4m0o2-emgoDnAA: Downloading page #1\nERROR: u'content_html'\n","time":"2020-07-27T13:50:46Z"} {"level":"info","msg":"returning response: {Error ERROR_DOWNLOADING There was an error downloading the target Download: DownloadVideo: ERROR: u'' is not a valid URL. Set --default-search \"ytsearch\" (or run youtube-dl \"ytsearch:\" ) to search YouTube\n[youtube:user] destinws2: Downloading channel page\n[youtube:playlist] UU6107grRI4m0o2-emgoDnAA: Downloading webpage\n[download] Downloading playlist: Uploads from SmarterEveryDay\n[youtube:playlist] UU6107grRI4m0o2-emgoDnAA: Downloading page #1\nERROR: u'content_html'\n}","time":"2020-07-27T13:50:46Z"}

I second this request. I have an X11 that has FAN1-7 and also FANAB

I've just updated the docker as well and i'm getting the same error message. Docker doesn't even start. usermod: no changes groupmod: GID '100' already exists {"level":"info","msg":"Initiating db","time":"2020-01-14T07:23:08Z"} {"level":"error","msg":"database.load: could not read file: json: cannot unmarshal string into Go struct field DownloadTarget.CheckingInterval of type int","time":"2020-01-14T07:23:08Z"} {"level":"fatal","msg":"\u003cnil\u003e","time":"2020-01-14T07:23:08Z"} I also removed the image completely and re-downloaded it just in case, still same issue. I checked the permissions on the json config files and they are exactly the same as what's set in the docker config.

I've just got back from holidays and the docker is working pretty good now. One thing I have started to notice is that every once and a while (maybe when it does it's check for new videos) the docker will consume 100% CPU on my server (As shown on the dashboard) and slow down everything else. This has happened before though while pre-clearing disks and it wasn't the CPU that was maxing it, it was the IO wait time increasing. It goes straight back to normal when i kill the auto-yt docker. What information can I provide to help diagnose it?

I just tried manually within the docker using the same command but changing the 'bestvideo[ext=mp4]' to just 'best'. This downloaded normal like any other time but it included video. I think when choosing the 'bestvideo' option it's just doing video and it may also be missing the audio part and then needing to join the two?

I'm able to get the whole channel to download now by choose the quality as MP4, it doesn't work when set to 'Any'. With MP4 selected the videos download in the background but my guess is the 'channel' dosn't get added to the bottom of the gui until all videos are downloaded. I have noticed that all the videos it does download don't have any audio. Nothing in the logs about it. {"level":"info","msg":"received a request to add a target","time":"2019-12-20T11:02:27Z"} {"level":"info","msg":"executing youtube-dl command: /usr/local/bin/youtube-dl -j --playlist-end 1 https://www.youtube.com/user/destinws2","time":"2019-12-20T11:02:27Z"} {"level":"info","msg":"DOWNLOAD: {https://www.youtube.com/user/destinws2 Video And Audio Uploads from SmarterEveryDay mp4 [] 12-20-2019 11:02:35 Channel %(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s}","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"downloading video","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"{ youtube-dl --ignore-errors bestvideo[ext=mp4] downloads/%(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s https://www.youtube.com/user/destinws2}","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"executing youtube-dl command: /usr/local/bin/youtube-dl --ignore-errors -f bestvideo[ext=mp4] -o downloads/%(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s https://www.youtube.com/user/destinws2","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"DOWNLOAD: {https://www.youtube.com/user/destinws2 Video And Audio Uploads from SmarterEveryDay mp4 [] 12-20-2019 11:02:35 Channel %(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s}","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"downloading video","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"{ youtube-dl --ignore-errors bestvideo[ext=mp4] downloads/%(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s https://www.youtube.com/user/destinws2}","time":"2019-12-20T11:02:35Z"} {"level":"info","msg":"executing youtube-dl command: /usr/local/bin/youtube-dl --ignore-errors -f bestvideo[ext=mp4] -o downloads/%(uploader)s [%(channel_id)s]/%(upload_date)s %(title)s_[%(id)s].%(ext)s https://www.youtube.com/user/destinws2","time":"2019-12-20T11:02:35Z"}

I have tried a few different custom paths in troubleshooting this. With a /channels/ folder (created and not created) No channels folder so just / /Downloads/ but then in the logs it must already prefix Downloads show it was showing up as downloads/downloads/

i've tried multiple scenarios with the custom output path. Even the default it dosn't work.

This is the docker settings I have set. Downloads location pointing to my array and config file pointing to my cache directory.

No matter what i set the download folder path to be, or what customised path I set, I'm always getting the same error messages in the logs. I've tried a two different youtube channels but get the same error. {"level":"info","msg":"received a request to add a target","time":"2019-12-14T08:09:58Z"} {"level":"info","msg":"executing youtube-dl command: /usr/local/bin/youtube-dl -j --playlist-end 1 https://youtube.com/users/destinws2","time":"2019-12-14T08:09:58Z"} {"level":"error","msg":"From GetMetadata(): unexpected end of JSON input","time":"2019-12-14T08:10:02Z"} {"level":"info","msg":"adding {https://youtube.com/users/destinws2 Video And Audio any [] 12-14-2019 08:10:02 Channel /%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s} to DB","time":"2019-12-14T08:10:02Z"} {"level":"info","msg":"DOWNLOAD: {https://youtube.com/users/destinws2 Video And Audio any [] 12-14-2019 08:10:02 Channel /%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s}","time":"2019-12-14T08:10:02Z"} {"level":"info","msg":"downloading video","time":"2019-12-14T08:10:02Z"} {"level":"info","msg":"{ youtube-dl --ignore-errors bestvideo[ext=any] downloads/%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s https://youtube.com/users/destinws2}","time":"2019-12-14T08:10:02Z"} {"level":"info","msg":"executing youtube-dl command: /usr/local/bin/youtube-dl --ignore-errors -f bestvideo[ext=any] -o downloads/%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s https://youtube.com/users/destinws2","time":"2019-12-14T08:10:02Z"} {"level":"error","msg":"exit status 1/usr/local/bin/youtube-dl --ignore-errors -f bestvideo[ext=any] -o downloads/%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s https://youtube.com/users/destinws2","time":"2019-12-14T08:10:05Z"} {"level":"info","msg":"updating latest downloaded video id","time":"2019-12-14T08:10:05Z"} {"level":"info","msg":"latest downloaded video id updated successfully","time":"2019-12-14T08:10:05Z"} {"level":"info","msg":"updating download history","time":"2019-12-14T08:10:05Z"} {"level":"info","msg":"[{https://youtube.com/users/destinws2 Video And Audio any [] 12-14-2019 08:10:02 Channel /%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s}]","time":"2019-12-14T08:10:05Z"} {"level":"info","msg":"returning response: {Error ERROR_DOWNLOADING There was an error downloading the target Download: DownloadVideo: exit status 1}","time":"2019-12-14T08:10:05Z"} {"level":"info","msg":"got this data: {channels}","time":"2019-12-14T08:10:06Z"} {"level":"info","msg":"getting all channels from channels.json","time":"2019-12-14T08:10:06Z"} {"level":"info","msg":"successfully read all channels","time":"2019-12-14T08:10:06Z"} {"level":"info","msg":"[{https://youtube.com/users/destinws2 Video And Audio any [] 12-14-2019 08:10:02 Channel /%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s}]","time":"2019-12-14T08:10:06Z"} {"level":"info","msg":"got this data: {channels}","time":"2019-12-14T08:10:43Z"} {"level":"info","msg":"getting all channels from channels.json","time":"2019-12-14T08:10:43Z"} {"level":"info","msg":"successfully read all channels","time":"2019-12-14T08:10:43Z"} {"level":"info","msg":"[{https://youtube.com/users/destinws2 Video And Audio any [] 12-14-2019 08:10:02 Channel /%(uploader)s_[UC2LVhJH_9cT2XKp0VAfsKOQ]/%(title)s_[%(id)s].%(ext)s%(uploader)s/video/%(title)s.%(ext)s}]","time":"2019-12-14T08:10:43Z"}