Unraid is "Unable to write to Docker Image" :(

[Jukes]

Hi,

 

let me start with this: I am a total noob . 

 

I think I did something very stupid. I have 2 NVME-SSDs as a Cache-Pool and I removed the second and put it in another NVME-Slot on the Motherboard (for PCIE-Lane-Reasons). I restarted Unraid and I had "Missing Devices"-Errors. So I stopped the array, disabled the second nvme. Started it und then stopped the array again and added it again. But now I have this big problem:

 

Fix Common Problems says: "Unable to write to Docker Image" and all of my dockers have problems.

And when I want to Update a Docker it says: "Error: open /var/lib/docker/tmp/GetImageBlob180878140: read-only file system"

 

What can I do here? 
 

[JorgeB]

Please post the diagnostics: Tools -> Diagnostics

[Jukes]

Allright, sorry. Here you go!

jukes-server-diagnostics-20201029-1126.zip

[JorgeB]

Docker image is corrupt, delete and recreate.

 

Also good to check this:

https://forums.unraid.net/topic/46802-faq-for-unraid-v6/?do=findComment&comment=700582

 

[Jukes]

Thank you! I don't lose my Appdata doing this? And what about my Docker Applications like Plex?

[JorgeB]

No, look at the link.

 

 

[Jukes]

okay, perfect! Thank you very much

 

One quick question: Is this the right path for the new docker image: /mnt/user/system/docker/docker.img?

 

I cant choose the cache-drive

[ChatNoir]

It will depend how you managed the system share. Is it on Cache Prefer or Only ?

[Jukes]

The "appdata-share" is on "Prefer : Cache". Should I change this? 

[ChatNoir]

I am no expert, but I think you are mixing things.

• The system share is where the file docker.img is stored. In there is store the generic images pulled from the internet. The path you mention looks OK for me. If you want to have it on your cache drive, you have to make sure that the system share is indeed on your cache (Prefer would be good).
• The appdata share is where your dockers are writing the files specific to your system. They are generally best on an SSD too, so the setting you have currently (Prefer) looks OK.

[Jukes]

yes, you are right! It all worked! Now I can use my docker again.

 

But there are more problems now , I don't know whats going on:

 

1. Problem: my 2nd SSD in the Cache-Pool is in the cache-pool and displayed as unassigned device?!

 

2. My VMs stopped working. They are not booting anymore.

[JorgeB]

Please post current diags.

[Jukes]

Thank you, I'm very grateful for your help!

 

Now this is happening  "Docker Service failed to start."

 

Diagnostics are down below!

jukes-server-diagnostics-20201030-1739.zip

[JorgeB]

Diags are after rebooting, but by the looks of it one of the cache devices dropped offline, run a scrub and make sure all errors are corrected, see here for more info.

[Jukes]

Scrubbing doesn't work for me. Always NVME-Missing-Errors. So I decided to remove my Cache completely and start fresh again.

 

I set all my shares to "Cache:Yes" so that the mover moves the files to the array. This worked, but not all files were moved. There a still 1,74GB on my Cache-Drive, that the mover won't touch. Do you maybe have a solution for this pariticular problem? (I have Disabled Dockers and VMs)

[JorgeB]

We'd need to see the log, with mover logging enable.

[itimpi]

11 minutes ago, Jukes said:

There a still 1,74GB on my Cache-Drive, that the mover won't touch. Do you maybe have a solution for this pariticular problem? (I have Disabled Dockers and VMs)

Are you sure there are actual files there (if so which ones) rather than this simply being the file system overhead?

[JorgeB]

23 minutes ago, itimpi said:

file system overhead?

Yeah, missed the low usage, mostly likely fs overhead, but easy to check if there's anything still there.

[Jukes]

Yes, there are definetly files still on the cache. One is the libvert.img and appdata-files from plex. You can look at the pictures. And here is my log and diagnostics. 

 

Archiv.zip

[ChatNoir]

The mover cannot touch used files. Did you deactivate the Docker service before running Mover ?

[Jukes]

no, I deactived the Docker service afterwards. What can I do now?

[JorgeB]

Then

51 minutes ago, JorgeB said:

We'd need to see the log, with mover logging enable.

 

[Jukes]

here it is! 

syslog-2.txt.zip

[JorgeB]

That's not the full syslog, please post diags instead.

[Jukes]

oh, sorry. Thank you for your help! I really appreciate it. Here are the diagnostics

jukes-server-diagnostics-20201102-1721.zip