February 13, 20224 yr On 1/28/2022 at 11:16 AM, Crocs said: Your Redis variable is set up wrong. It's just the IP address, your variable should be '192.168.1.70'. No 'http://' or '6379' Let me know if that works! Not sure about them, but changing that to remove the http:// and the port helped me get it working. Thanks!
March 5, 20224 yr Hi - Need to be able to specify a different port for Redis - Is this possible please?
March 7, 20224 yr Author On 3/5/2022 at 12:30 PM, Chad Kunsman said: Hi - Need to be able to specify a different port for Redis - Is this possible please? https://github.com/bbilly1/tubearchivist#redis-on-a-custom-port
March 16, 20224 yr I think there's an issue with Elasticsearch data, for some reason after I restarted elasticsearch I lost everything, and when I checked the folder where /data is mapped, it's empty. I attached to the container, and it seems elasticsearch actually stores data in /usr/share/elasticsearch/data and not /data, seems that by editing that var manually and replacing the path fixed it for me. It's kind of annoying, because I already downloaded like 10K videos and lost everything in ES but I'm lucky to have good enoug internet haha Edited March 16, 20224 yr by Mihai
March 27, 20224 yr On 3/7/2022 at 5:19 PM, Crocs said: https://github.com/bbilly1/tubearchivist#redis-on-a-custom-port I tried to follow this, but whenever --port 6380 exists in the post argument the following error is returned and the container shuts down immediately. The RDB file contains AUX module data I can't load: no matching module 'scdtype00' This is with and without the module load argument.
March 27, 20224 yr @RoyalAbyss I was able to get port 6380 working for me by clicking "Add another Path, Port, Variable, Label or Device" and configuring this:
March 27, 20224 yr Can't seem to get to the web interface. I have all 3 components installed (all fresh installs earlier today 3/27/22). Starting up TubeArchivist and watching the log, here's what I see: { "name" : "836da9956d52", "cluster_name" : "docker-cluster", "cluster_uuid" : "i9vUPW4tTtCDEv1hRtg5KA", "version" : { "number" : "7.14.1", "build_flavor" : "default", "build_type" : "docker", "build_hash" : "66b55ebfa59c92c15db3f69a335d500018b3331e", "build_date" : "2021-08-26T09:01:05.390870785Z", "build_snapshot" : false, "lucene_version" : "8.9.0", "minimum_wire_compatibility_version" : "6.8.0", "minimum_index_compatibility_version" : "6.0.0-beta1" }, "tagline" : "You Know, for Search" } run startup checks minial required elasticsearch version: 7.17, please update to recommended version. run startup checks minial required elasticsearch version: 7.17, please update to recommended version. run startup checks minial required elasticsearch version: 7.17, please update to recommended version. run startup checks minial required elasticsearch version: 7.17, please update to recommended version. run startup checks minial required elasticsearch version: 7.17, please update to recommended version. [uWSGI] getting INI configuration from uwsgi.ini *** Starting uWSGI 2.0.20 (64bit) on [Sun Mar 27 14:37:32 2022] *** compiled with version: 10.2.1 20210110 on 26 March 2022 12:58:35 os: Linux-5.10.28-Unraid #1 SMP Wed Apr 7 08:23:18 PDT 2021 nodename: 8f7ded6e4c5b machine: x86_64 clock source: unix detected number of CPU cores: 12 current working directory: /app writing pidfile to /tmp/project-master.pid detected binary path: /usr/local/bin/uwsgi !!! no internal routing support, rebuild with pcre support !!! uWSGI running as root, you can use --uid/--gid/--chroot options *** WARNING: you are running uWSGI as root !!! (use the --uid flag) *** your processes number limit is 256696 your memory page size is 4096 bytes detected max file descriptor number: 40960 lock engine: pthread robust mutexes thunder lock: disabled (you can enable it with --thunder-lock) uwsgi socket 0 bound to TCP address :8080 fd 3 uWSGI running as root, you can use --uid/--gid/--chroot options *** WARNING: you are running uWSGI as root !!! (use the --uid flag) *** Python version: 3.10.3 (main, Mar 17 2022, 05:23:29) [GCC 10.2.1 20210110] *** Python threads support is disabled. You can enable it with --enable-threads *** Python main interpreter initialized at 0x558333ab52c0 uWSGI running as root, you can use --uid/--gid/--chroot options *** WARNING: you are running uWSGI as root !!! (use the --uid flag) *** your server socket listen backlog is limited to 100 connections your mercy for graceful operations on workers is 60 seconds mapped 154000 bytes (150 KB) for 1 cores *** Operational MODE: single process *** run startup checks minial required elasticsearch version: 7.17, please update to recommended version. VACUUM: pidfile removed. Any thoughts? When I try going to http://192.168.0.19:8000 I get: Latest version of Chrome. No port conflicts for port 8000 Edited March 27, 20224 yr by JasonK
March 27, 20224 yr @JasonK I had the same problem and all you have to do is go to Elasticsearch-ES and modify the image to use 7.17.1 instead of 7.14.1, and then restart main TubeArchivist container. It will then take a few minutes for the migrations to run and so on, but it should work. Edited March 27, 20224 yr by Mihai
March 28, 20224 yr 1 hour ago, Mihai said: @JasonK I had the same problem and all you have to do is go to Elasticsearch-ES and modify the image to use 7.17.1 instead of 7.14.1, and then restart main TubeArchivist container. It will then take a few minutes for the migrations to run and so on, but it should work. Thanks! That fixed it for me J
March 28, 20224 yr Hi there Thanks for the work, I just have two three questsions: - I have downloaded a video in the wrong (way to big format) how can I redownload the video (I have already deleted it from the server)? - How can I change (explanation for a dummy) the output file name for the videos? I'd like it to be "%Name%_%Date%.%ext%" - Is it possible to set different quality profiles for different channels? For example I don't need 1080p for cooking channels, but I want it for educational ones. With this step it is possible to save hundreds of GB of space. Cheers Edited March 28, 20224 yr by Doublemyst Clarifications
March 29, 20224 yr Quick question. Installed all the containers and I keep having an issue with the ElasticSearch Container not starting Here are the logs {"type": "server", "timestamp": "2022-03-28T19:52:35,597-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-enrich]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-eql]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-fleet]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-graph]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-identity-provider]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,599-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-ilm]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,599-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-logstash]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,599-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-ml]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-monitoring]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-ql]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-rollup]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-security]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-shutdown]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-sql]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-stack]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-text-structure]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-voting-only-node]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,602-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-watcher]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,602-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "no plugins loaded" } {"type": "server", "timestamp": "2022-03-28T19:52:35,676-04:00", "level": "ERROR", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "uncaught exception in thread [main]", "stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes];", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:157) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:77) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:112) ~[elasticsearch-cli-7.17.1.jar:7.17.1]", "at org.elasticsearch.cli.Command.main(Command.java:77) ~[elasticsearch-cli-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:122) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80) ~[elasticsearch-7.17.1.jar:7.17.1]", "Caused by: org.elasticsearch.ElasticsearchException: failed to bind service", "at org.elasticsearch.node.Node.<init>(Node.java:1093) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.node.Node.<init>(Node.java:309) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) ~[elasticsearch-7.17.1.jar:7.17.1]", "... 6 more", "Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes", "at sun.nio.fs.UnixException.translateToIOException(UnixException.java:90) ~[?:?]", "at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106) ~[?:?]", uncaught exception in thread [main] "at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) ~[?:?]", "at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:397) ~[?:?]", "at java.nio.file.Files.createDirectory(Files.java:700) ~[?:?]", "at java.nio.file.Files.createAndCheckIsDirectory(Files.java:807) ~[?:?]", "at java.nio.file.Files.createDirectories(Files.java:793) ~[?:?]", "at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:300) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:224) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:298) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.node.Node.<init>(Node.java:429) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.node.Node.<init>(Node.java:309) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) ~[elasticsearch-7.17.1.jar:7.17.1]", "... 6 more"] } ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes]; Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90) at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106) at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) at java.base/sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:397) at java.base/java.nio.file.Files.createDirectory(Files.java:700) at java.base/java.nio.file.Files.createAndCheckIsDirectory(Files.java:807) at java.base/java.nio.file.Files.createDirectories(Files.java:793) at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:300) at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:224) at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:298) at org.elasticsearch.node.Node.<init>(Node.java:429) at org.elasticsearch.node.Node.<init>(Node.java:309) at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:157) at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:77) at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:112) at org.elasticsearch.cli.Command.main(Command.java:77) at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:122) at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80) For complete error details, refer to the log at /usr/share/elasticsearch/logs/docker-cluster.log ** Press ANY KEY to close this window ** A little help would be appreciated. Thanks
March 29, 20224 yr Author 3 hours ago, Liqwid_Kirk said: Quick question. Installed all the containers and I keep having an issue with the ElasticSearch Container not starting Here are the logs {"type": "server", "timestamp": "2022-03-28T19:52:35,597-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-enrich]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-eql]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-fleet]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-graph]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-identity-provider]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,599-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-ilm]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,599-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-logstash]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,599-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-ml]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-monitoring]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-ql]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-rollup]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-security]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-shutdown]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-sql]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-stack]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-text-structure]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-voting-only-node]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,602-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-watcher]" } {"type": "server", "timestamp": "2022-03-28T19:52:35,602-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "no plugins loaded" } {"type": "server", "timestamp": "2022-03-28T19:52:35,676-04:00", "level": "ERROR", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "uncaught exception in thread [main]", "stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes];", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:157) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:77) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:112) ~[elasticsearch-cli-7.17.1.jar:7.17.1]", "at org.elasticsearch.cli.Command.main(Command.java:77) ~[elasticsearch-cli-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:122) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80) ~[elasticsearch-7.17.1.jar:7.17.1]", "Caused by: org.elasticsearch.ElasticsearchException: failed to bind service", "at org.elasticsearch.node.Node.<init>(Node.java:1093) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.node.Node.<init>(Node.java:309) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) ~[elasticsearch-7.17.1.jar:7.17.1]", "... 6 more", "Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes", "at sun.nio.fs.UnixException.translateToIOException(UnixException.java:90) ~[?:?]", "at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106) ~[?:?]", uncaught exception in thread [main] "at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) ~[?:?]", "at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:397) ~[?:?]", "at java.nio.file.Files.createDirectory(Files.java:700) ~[?:?]", "at java.nio.file.Files.createAndCheckIsDirectory(Files.java:807) ~[?:?]", "at java.nio.file.Files.createDirectories(Files.java:793) ~[?:?]", "at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:300) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:224) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:298) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.node.Node.<init>(Node.java:429) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.node.Node.<init>(Node.java:309) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) ~[elasticsearch-7.17.1.jar:7.17.1]", "at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) ~[elasticsearch-7.17.1.jar:7.17.1]", "... 6 more"] } ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes]; Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90) at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106) at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) at java.base/sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:397) at java.base/java.nio.file.Files.createDirectory(Files.java:700) at java.base/java.nio.file.Files.createAndCheckIsDirectory(Files.java:807) at java.base/java.nio.file.Files.createDirectories(Files.java:793) at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:300) at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:224) at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:298) at org.elasticsearch.node.Node.<init>(Node.java:429) at org.elasticsearch.node.Node.<init>(Node.java:309) at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:157) at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:77) at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:112) at org.elasticsearch.cli.Command.main(Command.java:77) at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:122) at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80) For complete error details, refer to the log at /usr/share/elasticsearch/logs/docker-cluster.log ** Press ANY KEY to close this window ** A little help would be appreciated. Thanks Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes Looks like a permissions error. Make sure that your UID and GID are set to 1000 and 0 and that your mount point (appdata) has the same permissions.
March 29, 20224 yr Author 14 hours ago, Doublemyst said: Hi there Thanks for the work, I just have two three questsions: - I have downloaded a video in the wrong (way to big format) how can I redownload the video (I have already deleted it from the server)? - How can I change (explanation for a dummy) the output file name for the videos? I'd like it to be "%Name%_%Date%.%ext%" - Is it possible to set different quality profiles for different channels? For example I don't need 1080p for cooking channels, but I want it for educational ones. With this step it is possible to save hundreds of GB of space. Cheers Hey! - Just do a rescan filesystem in TA and that will remove the video. From there you can redownload in a different format. - Output name is not a feature that TA yet supports. As it was built to be an "all-in-one solution, it was built from the ground up thinking that we'd never need this feature. As things are changing, and people are requesting different feature, it's something that we're looking into. But for the time being, it's simply not possible -If you go to the channel in TA, you can click “configure” and change the settings per channel If you need any more immediate support, come on over to our discord! Edited March 29, 20224 yr by Crocs
March 29, 20224 yr 6 hours ago, Crocs said: Looks like a permissions error. Make sure that your UID and GID are set to 1000 and 0 and that your mount point (appdata) has the same permissions. How do you change the permissions for the appdata? Also, do I add the UID and GID permissions to the ES container itself?
March 29, 20224 yr Author 7 hours ago, Liqwid_Kirk said: How do you change the permissions for the appdata? Also, do I add the UID and GID permissions to the ES container itself? Can you share a screenshot of you ES and TA container setups?
March 29, 20224 yr Quote Can you share a screenshot of you ES and TA container setups? I did change the password for elasticsearch, but I made it the same in the TA container Edited March 30, 20224 yr by Liqwid_Kirk forgot to quote Croc
March 31, 20224 yr Author AS OF 3/30/2022 CHANGE YOUR TubeArchivist-ES CONTAINER REPO TO "bbilly1/tubearchivist-es:latest" FOR AUTOMATIC UPDATES GOING FORWARD
April 1, 20224 yr On 3/29/2022 at 6:06 AM, Crocs said: Hey! - Just do a rescan filesystem in TA and that will remove the video. From there you can redownload in a different format. - Output name is not a feature that TA yet supports. As it was built to be an "all-in-one solution, it was built from the ground up thinking that we'd never need this feature. As things are changing, and people are requesting different feature, it's something that we're looking into. But for the time being, it's simply not possible -If you go to the channel in TA, you can click “configure” and change the settings per channel If you need any more immediate support, come on over to our discord! Hi thanks for the reply. I've found the quality per channel setting (thanks again for reply), but didn't try it out yet, as if I download in the wrong quality, I don't know how to redownload a file. I've tried to run the "Rescan filesystem", but the deleted file still persists. Am I doing something wrong? I have deleted the video file from the SFTP folder, on which it was downloaded from tubearchivist. Then I went to settings and launched "Rescan filesystem". There is no progression bar, but I left it open for several hours. I had only 3 videos downloaded in total, 1 of which was deleted. But even then the deleted video is still shown under "home" and if i rescan subscriptions, the deleted video isn't shown in the download list que. SOLUTION: The reason was available in the Docker Log File. In the folder, in which I was downloading the youtube videos from tubearchive I had other files (like .txt file which I used before for the youtube-dl). Here is the Error message which was available in the logs: unexpected: NotADirectoryError(20, 'Not a directory') Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task R = retval = fun(args, **kwargs) File "/usr/local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in protected_call return self.run(args, **kwargs) File "/app/home/tasks.py", line 205, in rescan_filesystem scan_filesystem() File "/app/home/src/index/filesystem.py", line 290, in scan_filesystem filesystem_handler = FilesystemScanner() File "/app/home/src/index/filesystem.py", line 31, in init self.all_downloaded = self.get_all_downloaded() File "/app/home/src/index/filesystem.py", line 46, in get_all_downloaded channel_files = os.listdir(channel_path) NotADirectoryError: [Errno 20] Not a directory: '/youtube/config1080p+.txt' Edited April 2, 20224 yr by Doublemyst Solution added
April 1, 20224 yr Author 5 hours ago, Doublemyst said: Hi thanks for the reply. I've found the quality per channel setting (thanks again for reply), but didn't try it out yet, as if I download in the wrong quality, I don't know how to redownload a file. I've tried to run the "Rescan filesystem", but the deleted file still persists. Am I doing something wrong? I have deleted the video file from the SFTP folder, on which it was downloaded from tubearchivist. Then I went to settings and launched "Rescan filesystem". There is no progression bar, but I left it open for several hours. I had only 3 videos downloaded in total, 1 of which was deleted. But even then the deleted video is still shown under "home" and if i rescan subscriptions, the deleted video isn't shown in the download list que. https://discord.com/invite/AFwz8nE7BK Can you come to our discord server and we can diagnose further?
May 23, 20224 yr On 9/25/2021 at 2:14 PM, muppie said: I’ve filled out the redis IP and elasticsearch IP in the template and I’ve tried to review the screenshots again and to me they look the same. Attaching it here: I cannot spot any errors. If I add port to the redis IP it is duplicated in the logs (as IP:6379:6379) so I removed it. You need to add a new variable. I had this same problem and the port change is what was causing it. I figured that out by disabling my legit redis and using the default port and it worked. so I went back in and messed with it and read the wiki more. and I just changed the host port on the archivist redis. Edited May 23, 20224 yr by jlineberry24
June 29, 20224 yr On 3/28/2022 at 11:56 PM, Crocs said: Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes Looks like a permissions error. Make sure that your UID and GID are set to 1000 and 0 and that your mount point (appdata) has the same permissions. I am having this same issue but I'm hesitant to change the permissions like this. I know some of my containers are set to 99 and 100. Wouldn't change the appdata mount point to 1000 and 0 cause issues with them? Please disregard. I understand what you mean about mount point and also found the steps in the wiki so I'm all set. Thank you! Edited July 4, 20224 yr by jfs9112 Misunderstanding
July 6, 20224 yr So when I installed this, I left my Youtube Media Path to "mnt/user/" and now I have about 15 folders under there now, if I move them to a subfolder and change the setting on the container, will it work as if nothing happened, or do I have to do the import process?
July 22, 20223 yr Is there a way to use match filter? Many channels are doing YT shorts, and I don't want to back those up. I only enjoy their long form videos of the channels I've subbed.
July 31, 20223 yr So in order to get this to work I needed to: manually change the permissions on /mnt/user/appdata/TubeArchivist/es to get elastisearch to properly load Changing the permissions wasn't enough so I also needed to add PID and GID environment variables to the elastisearch container. install their version of redis as it would not connect my already installed and functioning version of redis add a TA_HOST environment variable to the main archive, which I only discovered I needed to do after manually probing the log files from the terminal, as the log would close instantly from the unraid docker interface Container loaded fine, and would not let me log in manually specify a non-default TA_USER and TA_PASSWORD, still wouldn't let me log in. go into the container terminal once it stopped closing immediately and hunt down a python script in /app called manage.py execute python manage.py createsuperuser python manage.py drf_create_token %myusername% finally able to log in. Several of these things are because the compose that's rolled into the CA repository is either missing documentation, missing variables, missing options, or does not handle bad startups gracefully.
August 4, 20223 yr I am having some issues... It was about 5 days ago there was an update for tubearchivist that broke it... it fails to start even after waiting a few days for a new update... I have since uninstalled the docker and reinstalled it... and still fails to start... dies within a second or so... anyone else having this happen? where in this docker or what commands should I run to collect logs... I am a bit lost when it comes to dockers
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.