2 hours ago, KrisMin said:

Of what I have read, there is no hard cap on the storage size per node and the number is just a strong suggestion from the dev team.

Someone in the forum did some math with hes years of statistics data and came up with a conlcusion that a theoretical limit would be aound 40TB of per IP subnet if IP filters work like we think they do. That number is based on hes statistics that a ~5% of all data gets trashed and therefor a pool of >40TB would never fill up, because 40TB would be the line in which point ingress = trashed. Of course if in the future an average Ingress rate increases, then the max pool size would also be larger.
On our case (running nodes on docker), I would keep a single node size less or equal to 24TB, because it's less risky. If one node gets a bad reputation for some reason, then you still have other good ones to compensate and you could easily increase their size if needed.

I started two identical nodes running on the same machine and the same network. Somehow one of them got uptime warning (from one us. sattelite) and lowered its uptime score, even tho they are identical in terms of availability and uptime. How did that happen, I have no idea. Must be some kind of bug. If I see this happening again, then I'll investigate it some more. Hopefully it was just once.

Awesome info, thanks for sharing.

 

Do you have a link to that storj forum? 

 

I think you're still suggesting that I run 2 nodes at once but just that I wait until the first one is fully vetted and operational to spin up the second one but still yet don't exceed a 40TB as there's likely no point, right?

Here: https://forum.storj.io/t/storj-node-maximum-size/7922/13?u=cryptopumpkin

Yeah, probably the best option for us would be to run 8TB or 10TB nodes and only start a next one after the first one gets vetted.

I do not know If the second one will still get vetted twice slower than the first one or will it get it as fast as the first one. Need to test or ask from the official forum about that.

Thanks!

 

I can confirm, when I started my second node, my ingress on 1st node slowed, I do not know if it slowed my vet time. Do you know if I can check number of passed audits? I just see 100% not the actual count.

 

Why do you think 5 8TB nodes would be more efficient than 2 20TB nodes?

 

Hi, thank you for this docker.

Since Storj say the node needs to do his update automaticaly and have the latest version.

Does this docker always download the latest version directly from storj?

or you need to update it on your side?

I want to be sure that if you not there in 6-9 months my node will not stop working or stop being updated.

 

Thank you

4 hours ago, cybex said:

Hi, thank you for this docker.

Since Storj say the node needs to do his update automaticaly and have the latest version.

Does this docker always download the latest version directly from storj?

or you need to update it on your side?

I want to be sure that if you not there in 6-9 months my node will not stop working or stop being updated.

 

Thank you

The docker will Update automatically assuming you have this function turned on on unraid for all your docker containers. This usually achieved through auto update plugin:

 

Edited January 22, 20215 yr by MrChunky

7 hours ago, srfnmnk said:

Thanks!

 

I can confirm, when I started my second node, my ingress on 1st node slowed, I do not know if it slowed my vet time. Do you know if I can check number of passed audits? I just see 100% not the actual count.

 

Why do you think 5 8TB nodes would be more efficient than 2 20TB nodes?

 

I really do appreciate the passion to get an optimal setup. However, this discussion should really be had on storj forums directly. The people there will be much more knowledgeable about these topics and you can probably find the answers you are seeking already there.

5 hours ago, MrChunky said:

for all your docker containers

Hi @Squid is there any way as of yet to specify only certain docker containers for auto-update?

 

Thanks

5 hours ago, MrChunky said:

I really do appreciate the passion to get an optimal setup. However, this discussion should really be had on storj forums directly. The people there will be much more knowledgeable about these topics and you can probably find the answers you are seeking already there.

Agree, thank you. will move deep storj conversation over there.

1 hour ago, srfnmnk said:

Hi @Squid is there any way as of yet to specify only certain docker containers for auto-update?

 

Thanks

Sure, you can turn autoupdate on-off for every container individually via Unraid Auto-update Appliations plugin. Just go in to this app (under settings) and you'll find docker tab and auto-update toggle buttons there.

Edited January 22, 20215 yr by KrisMin

3 hours ago, KrisMin said:

Auto-update Appliations

Ohhh yeah -- totally forgot about this plugin, thanks! 

On 1/14/2021 at 5:26 PM, KrisMin said:

I had a same issue. Apparently when running the first time

-e SETUP=true --mount type=bind,source="/mnt/user/storj/<identityfolder>/",destination=/app/identity  --mount type=bind,source="/mnt/user/storj/<datafolder>/",destination=/app/config

is needed.

 

@KrisMin Thank you for pointing this out. I tested it and it seems that indeed something has changed in unraid docker implementation since I last created a node. This argument is now necessary on the first run. I added this info to the template and the topic.

Update about running this thing on "cache preferred" mode. Looks like storj has some silly rule built in which returns an error and switched the node offline when the space runs below  ~450GB. 
This rule makes no sense to me, why...?

 

2021-01-27T19:29:00.600Z ERROR piecestore:cache error getting current used space: {"error": "context canceled; context canceled; context canceled; context canceled; context canceled; context canceled", "errorVerbose": "group:\n--- context canceled\n--- context canceled\n--- context canceled\n--- context canceled\n--- context canceled\n--- context canceled"}
Error: piecestore monitor: disk space requirement not met

 

So I had to switch the cache off for my storj share. As soon as I did that, the node started working again.
Maybe there's some workaround on this? Would more exprerienced Unraid users would even prefer to run such thing on cache preferred? I suspect it would put less stress on HDD's when done so.

Edited January 27, 20215 yr by KrisMin

17 hours ago, KrisMin said:

cache preferred

I think you shouldn't use cache preferred -- you should use cache "yes" then mover will move it over and the df -h command will see the free space on your underlying drives, not the space on the cache. It's working for me with cache "yes". When I log into the docker image I also see the proper space for the mount as well.

Solved

 

 

I guys i'm new to this.

 

I'm at the point to start my docker and i always got the error 

 

2021-01-28T16:04:52.630Z INFO Configuration loaded {"Location": "/app/config/config.yaml"}
Error: storagenode configuration already exists (/app/config)

 

 

My config in extre parameters 

-e SETUP=true --mount type=bind,source="/mnt/user/storj/identity/storagenode/",destination=/app/identity  --mount type=bind,source="/mnt/user/storj/config/",destination=/app/config

 

My bad i forgot to remove the -e SETUP=true

 

 

In identity/storagenode folder i got all my .cert and .key

 

and

 

config folder look like this

 

 

thx all

Edited January 28, 20215 yr by francrouge
forgot to remove the -e SETUP=true

8 hours ago, srfnmnk said:

I think you shouldn't use cache preferred -- you should use cache "yes" then mover will move it over and the df -h command will see the free space on your underlying drives, not the space on the cache. It's working for me with cache "yes". When I log into the docker image I also see the proper space for the mount as well.

Thanks! I think that should be written in OP - to use as Cache = yes.

1 hour ago, KrisMin said:

Thanks! I think that should be written in OP - to use as Cache = yes.

Yeah I think both "Yes" and "No" have merit depending on the circumstances.

 

But prefer and Only are no-no I would think.

11 hours ago, KrisMin said:

Thanks! I think that should be written in OP - to use as Cache = yes.

Everyone has a different setup... This is an Unraid issue not a docker/ storj issue I would say.

I am curious how the mover doesn't corrupt / break the WAL or other database files. Maybe mover doesn't move locked files? I would prefer to keep the db files on the cache in the /appconfig but figuring out how to get the nested mounts to work got a bit iffy. 

20 minutes ago, srfnmnk said:

I am curious how the mover doesn't corrupt / break the WAL or other database files. Maybe mover doesn't move locked files? I would prefer to keep the db files on the cache in the /appconfig but figuring out how to get the nested mounts to work got a bit iffy. 

Yes, mover doesn't move locked files. Files that are currently in use by a process are locked, this is true for any process on the unraid system as far as I know.

 

In theory this means that if storj starts using files differently it can breaker mover functionality. Seems to be working fine at the moment... But I think in the long run it is quite risky to have mover running on the storj folders. One thing that could be done is to use mover for the data chunks but not for the folders where the databases are... Just speculating though.

Edited January 29, 20215 yr by MrChunky

7 hours ago, MrChunky said:

One thing that could be done is to use mover for the data chunks but not for the folders where the databases are

Right, that's what I wanted to do but the organization of the files and data is nested and challenging to get to mount to the docker properly. As you said, it seems to be working. If that changes I will let you know. I have periodic backups of the databases so I could recover in the event of an issue. 

FYI for anyone running a node here. The official Storj node GUI is crappy, but luckily for us, there's one awesome Grafana dashboard available for nodes statistics.

https://forum.storj.io/t/prometheus-storj-exporter/1939

Give it a go.

Edited January 30, 20215 yr by KrisMin

Just setting this up for the first time and i cant get past this error.
 

Error: piecestore monitor: error verifying location and/or readability of storage directory: open config/storage/storage-dir-verification: no such file or directory

 

Hello,

i am trying to install the docker but i am receiving this error

 

root@localhost:# /usr/local/emhttp/plugins/dynamix.docker.manager/scripts/docker run -d --name='storagenode-v3' --net='br0' --ip='192.168.1.230' -e TZ="Europe/Athens" -e HOST_OS="Unraid" -e 'TCP_PORT_28967'='28967' -e 'WALLET'='0xa605c08349a0d6ee8972ec004c1a2da525c55a2d' -e 'EMAIL'='********' -e 'ADDRESS'='******:28967' -e 'STORAGE'='3TB' -e 'TCP_PORT_14002'='14002' -e 'BANDWIDTH'='' -e SETUP=true --mount type=bind,source="/mnt/user/storj/identity/storagenode/",destination=/app/identity  --mount type=bind,source="/mnt/user/storj3/data/“,destination=/app/config 'storjlabs/storagenode:latest'

The command failed.

2 hours ago, atithasos said:

Hello,

i am trying to install the docker but i am receiving this error

 

root@localhost:# /usr/local/emhttp/plugins/dynamix.docker.manager/scripts/docker run -d --name='storagenode-v3' --net='br0' --ip='192.168.1.230' -e TZ="Europe/Athens" -e HOST_OS="Unraid" -e 'TCP_PORT_28967'='28967' -e 'WALLET'='0xa605c08349a0d6ee8972ec004c1a2da525c55a2d' -e 'EMAIL'='********' -e 'ADDRESS'='******:28967' -e 'STORAGE'='3TB' -e 'TCP_PORT_14002'='14002' -e 'BANDWIDTH'='' -e SETUP=true --mount type=bind,source="/mnt/user/storj/identity/storagenode/",destination=/app/identity  --mount type=bind,source="/mnt/user/storj3/data/“,destination=/app/config 'storjlabs/storagenode:latest'

The command failed.

 

Hard to say just from the information you have given. May be the TCP port is already in use, may be the mount path are not working properly.

Anyone else getting the error:

 

ERROR contact:service ping satellite failed {"Satellite ID":