All docker apps have disappeared + strange warnings on Fix common problems

shry8 · January 3

Hello,

The other day I restarted my server because it was behaving strangely and since then all my docker apps have disappeared ("No Docker containers installed" under Docker tab).

I had a look at the appdata folder and it looks empty.

I tried running the Fix common problems plugin and I get these strange warnings:

Share appdata references non existent pool cache
Share downloads references non existent pool cache
Share isos references non existent pool cache
Share media references non existent pool cache
Share system references non existent pool cache

I double checked and I do have a Pool named cache, and each share is pointing to it so I think I should be all good there.

Could you help me find out what happened there and how to solve this?

thanks!

itimpi · January 3

You are likely to get better informed feedback if you attach your system’s diagnostics zip file to your next post in this thread.

shry8 · January 4

9 hours ago, itimpi said:

You are likely to get better informed feedback if you attach your system’s diagnostics zip file to your next post in this thread.

ah sorry, here it is: server-diagnostics-20240104-0913.zip

itimpi · January 4

It looks as though that is because your 'cache' pool has failed to mount and is not visible to the system at the moment. Not sure how to interpret the error messages in the syslog and thus the best way to proceed. @JorgeB is likely to be the best for having a good suggestion.

JorgeB · January 4

If the log tree is the only issue this may help:

btrfs rescue zero-log /dev/nvme0n1p1

Then re-start the array

shry8 · January 4

35 minutes ago, JorgeB said:
If the log tree is the only issue this may help:
btrfs rescue zero-log /dev/nvme0n1p1
Then re-start the array

thanks! I tried that and I do not have the alerts anymore.

Though now when I went to the Docker screen I got an alert message "Docker Service failed to start."

Here is the new diagnosis file: server-diagnostics-20240104-1054.zip

Thanks for your help, I am not technical enough for these issues unfortunately 😅

JorgeB · January 4

Docker image is corrupt, delete and re-create.

shry8 · January 4

17 minutes ago, JorgeB said:

Docker image is corrupt, delete and re-create.

thanks, looks fixed!

Last question, since all my Dockers have disappeared, can I just restore them using the flash backups? Or is it going to mess with the fixes we just did?

itimpi · January 4

7 minutes ago, shry8 said:

can I just restore them using the flash backups?

Doing this via Apps->Previous apps puts them back with previous settings intact.

shry8 · January 4

1 hour ago, itimpi said:

Doing this via Apps->Previous apps puts them back with previous settings intact.

oh that's really handy!

So I did that but unfortunately none of my dockers works anymore, for ex:

Komga won't start, the logs say I am trying to write on a read-only db
Navidrome won't start either:
Quote

time="2024-01-04T12:26:44Z" level=error msg="Error disabling foreign_keys" error="unable to open database file: no such file or directory"
time="2024-01-04T12:26:44Z" level=fatal msg="Database could not be opened!" error="unable to open database file: no such file or directory"
Photoprism has an "unable to establish a connection to the server" error if I try to reach the GUI

server-diagnostics-20240104-1325.zip

Let me know if I can still ask questions here, or if each issues should be dealt with separately!

trurl · January 4

Your appdata and system shares have files on the array. This is probably the result of having Docker enabled without a cache drive.

Disable Docker in Settings and see if you can get all that moved to cache. Mover won't replace files so there will probably be some manual cleanup with Dynamix File Manager.

You also need to change Docker from macvlan to ipvlan.

The main problem though is your cache is still read-only so you will have to fix that before you can do anything else.

shry8 · January 4

12 minutes ago, trurl said:

Your appdata and system shares have files on the array. This is probably the result of having Docker enabled without a cache drive.

Disable Docker in Settings and see if you can get all that moved to cache. Mover won't replace files so there will probably be some manual cleanup with Dynamix File Manager.

You also need to change Docker from macvlan to ipvlan.

The main problem though is your cache is still read-only so you will have to fix that before you can do anything else.

So I have disabled Docker, went into Main-> Move.

But could you help me to do the following?

change Docker from macvlan to ipvlan
change my cache to read/write

thanks!

trurl · January 4

Mover isn't going to work with read-only cache.

ipvlan is in the Docker Settings.

You might try scrub on cache, but you may have to backup and reformat. Maybe @JorgeB can suggest what to do.

shry8 · January 4

3 minutes ago, trurl said:

ipvlan is in the Docker Settings.

ahh ok I was in basic view, ok done!

shry8 · January 6

On 1/4/2024 at 2:29 PM, trurl said:

Mover isn't going to work with read-only cache.

ipvlan is in the Docker Settings.

You might try scrub on cache, but you may have to backup and reformat. Maybe @JorgeB can suggest what to do.

sorry @JorgeB, do you have an idea of what I could try to do to put my cache in read/write?

thanks!

JorgeB · January 7

Since there are additional issues besides the log tree I would recommend backing up and re-formatting the pool.

shry8 · January 7

8 hours ago, JorgeB said:

Since there are additional issues besides the log tree I would recommend backing up and re-formatting the pool.

It seems to have worked, thank you!

trurl · January 7

Post new diagnostics if you want us to check

shry8 · January 7

4 minutes ago, trurl said:

Post new diagnostics if you want us to check

here they are, thank you! server-diagnostics-20240107-1855.zip

trurl · January 7

50 minutes ago, shry8 said:

It seems to have worked, thank you!

Why do you say that? Diagnostics says cache is unmountable.

Since you have docker enabled without cache, all that has been recreated on disk1. Disable Docker in Settings until we get cache working again and all that moved back to cache where it belongs.

shry8 · January 7

9 minutes ago, trurl said:

Why do you say that? Diagnostics says cache is unmountable.

Since you have docker enabled without cache, all that has been recreated on disk1. Disable Docker in Settings until we get cache working again and all that moved back to cache where it belongs.

oh right sorry! It wasn't displaying that message right after the formatting and I only tried to open dockers -- since I could open them I assumed the problem had been fixed.

ok I have disabled docker!

trurl · January 7

Can you format cache?

shry8 · January 7

51 minutes ago, trurl said:

Can you format cache?

That's what I did, I stopped the array, then formated it. I just tried it again and I get the "Unmountable: Unsupported or no file system " error again once I start back the array

trurl · January 7

You can't format cache unless the array is already started.

How are you formatting it without the array started?

shry8 · January 7

10 minutes ago, trurl said:

You can't format cache unless the array is already started.

How are you formatting it without the array started?

ah I followed a wrong post online, ok I did it, there seem to be no error on the cache drive anymore: server-diagnostics-20240107-2205.zip

All docker apps have disappeared + strange warnings on Fix common problems

Recommended Posts

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Link to comment

Join the conversation