[Support] Crocs - Tube Archivist

Crocs

By Crocs
in Docker Containers

Recommended Posts

smikwily Noob

smikwily

Posted
Posted
On 1/28/2022 at 11:16 AM, Crocs said:

Your Redis variable is set up wrong.

 

It's just the IP address, your variable should be '192.168.1.70'.

 

No 'http://' or '6379'

 

Let me know if that works!


Not sure about them, but changing that to remove the http:// and the port helped me get it working. Thanks!

Link to comment
  • 3 weeks later...
  • Replies 142
  • Created
  • Last Reply

Top Posters In This Topic

Popular Days

Top Posters In This Topic

Popular Days

Popular Posts

msherman83
msherman83

Hello, Same issue as the others above on a fresh install. It seems for some reason you need to change the ./es folder to 777 to get the es container to write to it.   Access the Unraid

Vyressi
Vyressi

So in order to get this to work I needed to:   manually change the permissions on /mnt/user/appdata/TubeArchivist/es to get elastisearch to properly load Changing the permissions w

kuuki
kuuki

Set tag to "redislabs/rejson:2.0.11" works fine

Posted Images

  • 2 weeks later...
Mihai Apprentice

Mihai

Posted
Posted (edited)

I think there's an issue with Elasticsearch data, for some reason after I restarted elasticsearch I lost everything, and when I checked the folder where /data is mapped, it's empty.

I attached to the container, and it seems elasticsearch actually stores data in /usr/share/elasticsearch/data and not /data, seems that by editing that var manually and replacing the path fixed it for me. It's kind of annoying, because I already downloaded like 10K videos and lost everything in ES :) but I'm lucky to have good enoug internet haha

Edited by Mihai
Link to comment
  • 2 weeks later...
JasonK Apprentice

JasonK

Posted
Posted (edited)

Can't seem to get to the web interface.  I have all 3 components installed (all fresh installs earlier today 3/27/22). 

 

image.thumb.png.0aff600ad1d7cb06c58ecb8bfc5e1606.png

 

Starting up TubeArchivist and watching the log, here's what I see:

 

image.thumb.png.99b476049dac7affbcfc45d7be3f10a0.png

  

{
"name" : "836da9956d52",
"cluster_name" : "docker-cluster",
"cluster_uuid" : "i9vUPW4tTtCDEv1hRtg5KA",
"version" : {

"number" : "7.14.1",
"build_flavor" : "default",
"build_type" : "docker",
"build_hash" : "66b55ebfa59c92c15db3f69a335d500018b3331e",
"build_date" : "2021-08-26T09:01:05.390870785Z",
"build_snapshot" : false,
"lucene_version" : "8.9.0",
"minimum_wire_compatibility_version" : "6.8.0",
"minimum_index_compatibility_version" : "6.0.0-beta1"
},
"tagline" : "You Know, for Search"
}
run startup checks
minial required elasticsearch version: 7.17, please update to recommended version.

run startup checks
minial required elasticsearch version: 7.17, please update to recommended version.

run startup checks
minial required elasticsearch version: 7.17, please update to recommended version.

run startup checks
minial required elasticsearch version: 7.17, please update to recommended version.

run startup checks
minial required elasticsearch version: 7.17, please update to recommended version.

[uWSGI] getting INI configuration from uwsgi.ini
*** Starting uWSGI 2.0.20 (64bit) on [Sun Mar 27 14:37:32 2022] ***
compiled with version: 10.2.1 20210110 on 26 March 2022 12:58:35

os: Linux-5.10.28-Unraid #1 SMP Wed Apr 7 08:23:18 PDT 2021
nodename: 8f7ded6e4c5b
machine: x86_64
clock source: unix
detected number of CPU cores: 12
current working directory: /app
writing pidfile to /tmp/project-master.pid
detected binary path: /usr/local/bin/uwsgi
!!! no internal routing support, rebuild with pcre support !!!
uWSGI running as root, you can use --uid/--gid/--chroot options
*** WARNING: you are running uWSGI as root !!! (use the --uid flag) ***

your processes number limit is 256696
your memory page size is 4096 bytes
detected max file descriptor number: 40960
lock engine: pthread robust mutexes
thunder lock: disabled (you can enable it with --thunder-lock)
uwsgi socket 0 bound to TCP address :8080 fd 3
uWSGI running as root, you can use --uid/--gid/--chroot options
*** WARNING: you are running uWSGI as root !!! (use the --uid flag) ***

Python version: 3.10.3 (main, Mar 17 2022, 05:23:29) [GCC 10.2.1 20210110]

*** Python threads support is disabled. You can enable it with --enable-threads ***
Python main interpreter initialized at 0x558333ab52c0
uWSGI running as root, you can use --uid/--gid/--chroot options
*** WARNING: you are running uWSGI as root !!! (use the --uid flag) ***

your server socket listen backlog is limited to 100 connections
your mercy for graceful operations on workers is 60 seconds
mapped 154000 bytes (150 KB) for 1 cores
*** Operational MODE: single process ***
run startup checks
minial required elasticsearch version: 7.17, please update to recommended version.

VACUUM: pidfile removed.

 

Any thoughts?  When I try going to http://192.168.0.19:8000 I get:

 

image.png.198af5d22b8e48ee894f0697349969bc.png

 

Latest version of Chrome.  No port conflicts for port 8000

Edited by JasonK
Link to comment
Mihai Apprentice

Mihai

Posted
Posted (edited)

@JasonK I had the same problem and all you have to do is go to Elasticsearch-ES and modify the image to use 7.17.1 instead of 7.14.1, and then restart main TubeArchivist container. It will then take a few minutes for the migrations to run and so on, but it should work.


image.thumb.png.1dcb8e41e9f148f4f089daec246ad446.png

Edited by Mihai
Link to comment
JasonK Apprentice

JasonK

Posted
Posted
1 hour ago, Mihai said:

@JasonK I had the same problem and all you have to do is go to Elasticsearch-ES and modify the image to use 7.17.1 instead of 7.14.1, and then restart main TubeArchivist container. It will then take a few minutes for the migrations to run and so on, but it should work.


image.thumb.png.1dcb8e41e9f148f4f089daec246ad446.png

Thanks!  That fixed it for me :)

 

J

Link to comment
Doublemyst Apprentice

Doublemyst

Posted
Posted (edited)

Hi there

 

Thanks for the work, I just have two three questsions:

- I have downloaded a video in the wrong (way to big format) how can I redownload the video (I have already deleted it from the server)?

- How can I change (explanation for a dummy) the output file name for the videos? I'd like it to be "%Name%_%Date%.%ext%"

- Is it possible to set different quality profiles for different channels? For example I don't need 1080p for cooking channels, but I want it for educational ones. With this step it is possible to save hundreds of GB of space.

 

Cheers

Edited by Doublemyst
Clarifications
Link to comment
Liqwid_Kirk Noob

Liqwid_Kirk

Posted
Posted

Quick question.

 

Installed all the containers and I keep having an issue with the ElasticSearch Container not starting

 

Here are the logs 

  

{"type": "server", "timestamp": "2022-03-28T19:52:35,597-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-enrich]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-eql]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-fleet]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-graph]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-identity-provider]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,599-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-ilm]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,599-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-logstash]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,599-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-ml]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-monitoring]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-ql]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-rollup]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-security]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-shutdown]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-sql]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-stack]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-text-structure]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-voting-only-node]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,602-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-watcher]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,602-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "no plugins loaded" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,676-04:00", "level": "ERROR", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "uncaught exception in thread [main]", 
"stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes];",
"at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:157) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:77) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:112) ~[elasticsearch-cli-7.17.1.jar:7.17.1]",
"at org.elasticsearch.cli.Command.main(Command.java:77) ~[elasticsearch-cli-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:122) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80) ~[elasticsearch-7.17.1.jar:7.17.1]",
"Caused by: org.elasticsearch.ElasticsearchException: failed to bind service",
"at org.elasticsearch.node.Node.<init>(Node.java:1093) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.node.Node.<init>(Node.java:309) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) ~[elasticsearch-7.17.1.jar:7.17.1]",
"... 6 more",
"Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes",
"at sun.nio.fs.UnixException.translateToIOException(UnixException.java:90) ~[?:?]",
"at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106) ~[?:?]",
uncaught exception in thread [main]
"at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) ~[?:?]",
"at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:397) ~[?:?]",
"at java.nio.file.Files.createDirectory(Files.java:700) ~[?:?]",
"at java.nio.file.Files.createAndCheckIsDirectory(Files.java:807) ~[?:?]",
"at java.nio.file.Files.createDirectories(Files.java:793) ~[?:?]",
"at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:300) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:224) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:298) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.node.Node.<init>(Node.java:429) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.node.Node.<init>(Node.java:309) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) ~[elasticsearch-7.17.1.jar:7.17.1]",
"... 6 more"] }
ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes];
Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes
        at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90)
        at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106)
        at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)
        at java.base/sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:397)
        at java.base/java.nio.file.Files.createDirectory(Files.java:700)
        at java.base/java.nio.file.Files.createAndCheckIsDirectory(Files.java:807)
        at java.base/java.nio.file.Files.createDirectories(Files.java:793)
        at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:300)
        at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:224)
        at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:298)
        at org.elasticsearch.node.Node.<init>(Node.java:429)
        at org.elasticsearch.node.Node.<init>(Node.java:309)
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234)
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234)
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434)
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166)
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:157)
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:77)
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:112)
        at org.elasticsearch.cli.Command.main(Command.java:77)
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:122)
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80)
For complete error details, refer to the log at /usr/share/elasticsearch/logs/docker-cluster.log

** Press ANY KEY to close this window **

 

A little help would be appreciated.

Thanks 

Link to comment
Crocs Rookie

Crocs

Posted
  • Author
Posted
3 hours ago, Liqwid_Kirk said:

Quick question.

 

Installed all the containers and I keep having an issue with the ElasticSearch Container not starting

 

Here are the logs 

  

{"type": "server", "timestamp": "2022-03-28T19:52:35,597-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-enrich]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-eql]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-fleet]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-graph]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,598-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-identity-provider]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,599-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-ilm]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,599-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-logstash]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,599-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-ml]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-monitoring]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-ql]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-rollup]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,600-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-security]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-shutdown]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-sql]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-stack]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-text-structure]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,601-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-voting-only-node]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,602-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "loaded module [x-pack-watcher]" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,602-04:00", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "no plugins loaded" }
{"type": "server", "timestamp": "2022-03-28T19:52:35,676-04:00", "level": "ERROR", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name": "docker-cluster", "node.name": "97fe1207fe92", "message": "uncaught exception in thread [main]", 
"stacktrace": ["org.elasticsearch.bootstrap.StartupException: ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes];",
"at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:157) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:77) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:112) ~[elasticsearch-cli-7.17.1.jar:7.17.1]",
"at org.elasticsearch.cli.Command.main(Command.java:77) ~[elasticsearch-cli-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:122) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80) ~[elasticsearch-7.17.1.jar:7.17.1]",
"Caused by: org.elasticsearch.ElasticsearchException: failed to bind service",
"at org.elasticsearch.node.Node.<init>(Node.java:1093) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.node.Node.<init>(Node.java:309) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) ~[elasticsearch-7.17.1.jar:7.17.1]",
"... 6 more",
"Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes",
"at sun.nio.fs.UnixException.translateToIOException(UnixException.java:90) ~[?:?]",
"at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106) ~[?:?]",
uncaught exception in thread [main]
"at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) ~[?:?]",
"at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:397) ~[?:?]",
"at java.nio.file.Files.createDirectory(Files.java:700) ~[?:?]",
"at java.nio.file.Files.createAndCheckIsDirectory(Files.java:807) ~[?:?]",
"at java.nio.file.Files.createDirectories(Files.java:793) ~[?:?]",
"at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:300) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:224) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:298) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.node.Node.<init>(Node.java:429) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.node.Node.<init>(Node.java:309) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434) ~[elasticsearch-7.17.1.jar:7.17.1]",
"at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166) ~[elasticsearch-7.17.1.jar:7.17.1]",
"... 6 more"] }
ElasticsearchException[failed to bind service]; nested: AccessDeniedException[/usr/share/elasticsearch/data/nodes];
Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes
        at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:90)
        at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106)
        at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)
        at java.base/sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:397)
        at java.base/java.nio.file.Files.createDirectory(Files.java:700)
        at java.base/java.nio.file.Files.createAndCheckIsDirectory(Files.java:807)
        at java.base/java.nio.file.Files.createDirectories(Files.java:793)
        at org.elasticsearch.env.NodeEnvironment.lambda$new$0(NodeEnvironment.java:300)
        at org.elasticsearch.env.NodeEnvironment$NodeLock.<init>(NodeEnvironment.java:224)
        at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:298)
        at org.elasticsearch.node.Node.<init>(Node.java:429)
        at org.elasticsearch.node.Node.<init>(Node.java:309)
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:234)
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:234)
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:434)
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:166)
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:157)
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:77)
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:112)
        at org.elasticsearch.cli.Command.main(Command.java:77)
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:122)
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:80)
For complete error details, refer to the log at /usr/share/elasticsearch/logs/docker-cluster.log

** Press ANY KEY to close this window **

 

A little help would be appreciated.

Thanks  

Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes

Looks like a permissions error.

Make sure that your UID and GID are set to 1000 and 0 and that your mount point (appdata) has the same permissions.

Link to comment
Crocs Rookie

Crocs

Posted
  • Author
Posted (edited)
14 hours ago, Doublemyst said:

Hi there

 

Thanks for the work, I just have two three questsions:

- I have downloaded a video in the wrong (way to big format) how can I redownload the video (I have already deleted it from the server)?

- How can I change (explanation for a dummy) the output file name for the videos? I'd like it to be "%Name%_%Date%.%ext%"

- Is it possible to set different quality profiles for different channels? For example I don't need 1080p for cooking channels, but I want it for educational ones. With this step it is possible to save hundreds of GB of space.

 

Cheers

Hey!

- Just do a rescan filesystem in TA and that will remove the video. From there you can redownload in a different format.
- Output name is not a feature that TA yet supports. As it was built to be an "all-in-one solution, it was built from the ground up thinking that we'd never need this feature. As things are changing, and people are requesting different feature, it's something that we're looking into. But for the time being, it's simply not possible :(

-If you go to the channel in TA, you can click “configure” and change the settings per channel :)

If you need any more immediate support, come on over to our discord!

Edited by Crocs
  • Thanks 2
Link to comment
Liqwid_Kirk Noob

Liqwid_Kirk

Posted
Posted
6 hours ago, Crocs said:

Looks like a permissions error.

Make sure that your UID and GID are set to 1000 and 0 and that your mount point (appdata) has the same permissions.

 

How do you change the permissions for the appdata? Also, do I add the UID and GID permissions to the ES container itself?

Link to comment
Doublemyst Apprentice

Doublemyst

Posted
Posted (edited)
On 3/29/2022 at 6:06 AM, Crocs said:

Hey!

- Just do a rescan filesystem in TA and that will remove the video. From there you can redownload in a different format.
- Output name is not a feature that TA yet supports. As it was built to be an "all-in-one solution, it was built from the ground up thinking that we'd never need this feature. As things are changing, and people are requesting different feature, it's something that we're looking into. But for the time being, it's simply not possible :(

-If you go to the channel in TA, you can click “configure” and change the settings per channel :)

If you need any more immediate support, come on over to our discord!

 

Hi thanks for the reply. I've found the quality per channel setting (thanks again for reply), but didn't try it out yet, as if I download in the wrong quality, I don't know how to redownload a file.

I've tried to run the "Rescan filesystem", but the deleted file still persists. Am I doing something wrong? I have deleted the video file from the SFTP folder, on which it was downloaded from tubearchivist. Then I went to settings and launched "Rescan filesystem". There is no progression bar, but I left it open for several hours. I had only 3 videos downloaded in total, 1 of which was deleted. But even then the deleted video is still shown under "home" and if i rescan subscriptions, the deleted video isn't shown in the download list que.

 

 

SOLUTION:

The reason was available in the Docker Log File. In the folder, in which I was downloading the youtube videos from tubearchive I had other files (like .txt file which I used before for the youtube-dl). Here is the Error message which was available in the logs: 

unexpected: NotADirectoryError(20, 'Not a directory')
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
R = retval = fun(args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in protected_call
return self.run(args, **kwargs)
File "/app/home/tasks.py", line 205, in rescan_filesystem
scan_filesystem()
File "/app/home/src/index/filesystem.py", line 290, in scan_filesystem
filesystem_handler = FilesystemScanner()
File "/app/home/src/index/filesystem.py", line 31, in init
self.all_downloaded = self.get_all_downloaded()
File "/app/home/src/index/filesystem.py", line 46, in get_all_downloaded
channel_files = os.listdir(channel_path)
NotADirectoryError: [Errno 20] Not a directory: '/youtube/config1080p+.txt'

 

Edited by Doublemyst
Solution added
Link to comment
Crocs Rookie

Crocs

Posted
  • Author
Posted
5 hours ago, Doublemyst said:

 

Hi thanks for the reply. I've found the quality per channel setting (thanks again for reply), but didn't try it out yet, as if I download in the wrong quality, I don't know how to redownload a file.

I've tried to run the "Rescan filesystem", but the deleted file still persists. Am I doing something wrong? I have deleted the video file from the SFTP folder, on which it was downloaded from tubearchivist. Then I went to settings and launched "Rescan filesystem". There is no progression bar, but I left it open for several hours. I had only 3 videos downloaded in total, 1 of which was deleted. But even then the deleted video is still shown under "home" and if i rescan subscriptions, the deleted video isn't shown in the download list que.

https://discord.com/invite/AFwz8nE7BK

 

Can you come to our discord server and we can diagnose further?

Link to comment
  • 1 month later...
jlineberry24 Noob

jlineberry24

Posted
Posted (edited)
On 9/25/2021 at 2:14 PM, muppie said:

I’ve filled out the redis IP and elasticsearch IP in the template and I’ve tried to review the screenshots again and to me they look the same. Attaching it here:

 

I cannot spot any errors. If I add port to the redis IP it is duplicated in the logs (as IP:6379:6379) so I removed it.

DCA796EC-E861-4C44-A1A2-D9266780E86B.jpeg

You need to add a new variable. I had this same problem and the port change is what was causing it. I figured that out by disabling my legit redis and using the default port and it worked. so I went back in and messed with it and read the wiki more.

and I just changed the host port on the archivist redis.

rp.jpg

cp.jpg

Edited by jlineberry24
Link to comment
  • 1 month later...
jfs9112 Noob

jfs9112

Posted
Posted (edited)
On 3/28/2022 at 11:56 PM, Crocs said: 
Likely root cause: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodes

Looks like a permissions error.

Make sure that your UID and GID are set to 1000 and 0 and that your mount point (appdata) has the same permissions.

I am having this same issue but I'm hesitant to change the permissions like this. I know some of my containers are set to 99 and 100. Wouldn't change the appdata mount point to 1000 and 0 cause issues with them?

 

Please disregard. I understand what you mean about mount point and also found the steps in the wiki so I'm all set. Thank you!

Edited by jfs9112
Misunderstanding
  • Thanks 1
Link to comment
WesleyM96 Noob

WesleyM96

Posted
Posted

So when I installed this, I left my Youtube Media Path to "mnt/user/" and now I have about 15 folders under there now, if I move them to a subfolder and change the setting on the container, will it work as if nothing happened, or do I have to do the import process?

Link to comment
  • 3 weeks later...
  • 2 weeks later...
Vyressi Noob

Vyressi

Posted
Posted

So in order to get this to work I needed to:

 

  1. manually change the permissions on /mnt/user/appdata/TubeArchivist/es to get elastisearch to properly load
  2. Changing the permissions wasn't enough so I also needed to add PID and GID environment variables to the elastisearch container.
  3. install their version of redis as it would not connect my already installed and functioning version of redis
  4. add a TA_HOST environment variable to the main archive, which I only discovered I needed to do after manually probing the log files from the terminal, as the log would close instantly from the unraid docker interface
  5. Container loaded fine, and would not let me log in
  6. manually specify a non-default TA_USER and TA_PASSWORD, still wouldn't let me log in.
  7. go into the container terminal once it stopped closing immediately and hunt down a python script in /app called manage.py
  8. execute  
    python manage.py createsuperuser
python manage.py drf_create_token %myusername%

     

  9. finally able to log in.

Several of these things are because the compose that's rolled into the CA repository is either missing documentation, missing variables, missing options, or does not handle bad startups gracefully. 

  • Upvote 4
Link to comment
mathomas3 Contributor

mathomas3

Posted
Posted

I am having some issues...

 

It was about 5 days ago there was an update for tubearchivist that broke it... it fails to start even after waiting a few days for a new update... I have since uninstalled the docker and reinstalled it... and still fails to start... dies within a second or so... anyone else having this happen?

 

where in this docker or what commands should I run to collect logs... I am a bit lost when it comes to dockers

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
Go to topic listing