THought I would share the answer as I needed to play to get it working...

 

 

if you are going to use NVIDIA dont forget the runtime=nvidea setting for extra parameters

The network can be bridge setting I choose to use br0

 

Important thing is to get to the files which are in config and user.

Because I used sillytavern on the desktop initially I know what files to edit or where to add various bits.

(I would recommend doing this to get familiar with sillytavern files and setup)

 

Hope it helps someone, because it took me a few hours to work it all out reading the docker files!

 

 

Edited February 4, 20242 yr by tigga69

Thanks for this post, I try mimic your layout and settings couldn't get pass to start the docker.

 

Here my logs:

# -- SERVER PLUGIN CONFIGURATION --
enableServerPlugins: false
The listen parameter is set to false. If you can't connect to the server, edit the "docker/config/config.yaml" file and restart the container.
The whitelistMode parameter is set to true. If you can't connect to the server, edit the "docker/config/config.yaml" file and restart the container.

On 2/4/2024 at 4:23 PM, Rath said:

Thanks for this post, I try mimic your layout and settings couldn't get pass to start the docker.

 

Here my logs:

# -- SERVER PLUGIN CONFIGURATION --
enableServerPlugins: false
The listen parameter is set to false. If you can't connect to the server, edit the "docker/config/config.yaml" file and restart the container.
The whitelistMode parameter is set to true. If you can't connect to the server, edit the "docker/config/config.yaml" file and restart the container.

 

You'll need to edit your /mnt/user/appdata/Silly Tavern/config/config.yaml

changing:

 

listen: true

whitelistMode: false

securityOverride: true

Edited February 11, 20242 yr by brainbone_

I got that working. Thank you very much for that, but can anybody tell me now how to do the same with SillyTaven extras?

at the moment I have two solutions neither of which Im happy with and want to post.

1. I have xrtras running on my PC - yeh it defeats the purpose of running on a server

2. I got a version working using docker compose but its a pain to keep updated!  

 

when I have spare time, I'll publish my working answer,

Hi

 

I followed your guide above and it's been working great however I think recently sillytavern moved there data structure about. Do you happen to know what best way to map the folders is. I noticed that upon update I have to enter my API keys again so wondering if they are not stored in a persistent way. Thanks again for the screenshots you provided they were really helpful.

10 hours ago, Jordand said:

Hi

 

I followed your guide above and it's been working great however I think recently sillytavern moved there data structure about. Do you happen to know what best way to map the folders is. I noticed that upon update I have to enter my API keys again so wondering if they are not stored in a persistent way. Thanks again for the screenshots you provided they were really helpful.

 

Read the SillyTavern migration guide. Basically they got rid of the public folder for user data folders so you'll have to update your AppData container path. My docker config looks like this now.

Edited July 4, 20242 yr by originade