Cache pool keep going read only. How can I reformat it and start over?

[flyize]

I've tried deleting the pool, starting the array, stopping, and readding the cache. But that doesn't seem to reformat things. How can I do that? Or is there a better solution to fix my read only problem?

truffle-diagnostics-20230613-0852.zip

[JorgeB]

Initial issue was because the pool ran out of space:

 

Jun 12 15:26:09 Truffle kernel: BTRFS: error (device nvme1n1p1: state A) in btrfs_finish_ordered_io:3329: errno=-28 No space left

 

You have two different capacity devices using raid0, in case you're not aware it will only be able to use 2 x smallest device capacity, you can change to single profile to use full pool capacity.

 

To re-format the pool stop the array, click on the first device of the pool and then click "erase", then start array and you will have the option to format the pool.

[flyize]

The pool (cache_media) shows that its 1.3TB, so its currently using the whole thing. I mean, I think. But maybe I screwed something up when I attempted to recreate it?

 

Also, is the pool not able to recover on its own from filling up? This pool is a landing place for new media. My understanding was that if it fills up, things would just write to the array until space opened up, and that eventually the pool would recover on its own. Is that not the case?

[JorgeB]

5 minutes ago, flyize said:

The pool (cache_media) shows that its 1.3TB, so its currently using the whole thing. I mean, I think.

It's not, after recreating balance to single profile.

[JorgeB]

5 minutes ago, flyize said:

Also, is the pool not able to recover on its own from filling up?

You should avoid completely filling up COW filesystems like btrfs or zfs, make sure you set the appropriate share(s) and pool floor and if you are using user shares it will stop writing at that point or spill over to the array.

[flyize]

I have the minimum free space setup for the share (set to 100GB, larger than anything I think I'd write to it), but is there a pool specific setting that I need as well?

[itimpi]

Just now, flyize said:

I have the minimum free space setup for the share (set to 100GB, larger than anything I think I'd write to it), but is there a pool specific setting that I need as well?

There is a value you can set on a pool by clicking on the pool on the Main tab.   

[flyize]

I promised that I looked before asking, but I don't see it.

[itimpi]

2 minutes ago, flyize said:

I promised that I looked before asking, but I don't see it.

It is one of the last settings in the first section just before the disk warning and critical thresholds

[flyize]

I'm an idiot. Thanks!

 

edit: If running out of space is bad, any reason there isn't something other than 0 that goes in there by default?

Edited June 13, 2023 by flyize

[JorgeB]

7 minutes ago, flyize said:

any reason there isn't something other than 0 that goes in there by default?

It is no longer 0 since v6.12, though for your pool it wouldn't work anyway because the free space was incorrectly reported the way the pool was configured.

[flyize]

I'm now seeing uncorrectable errors on this pool during a scrub. I assume that means I need to reformat. As mentioned above, do I just need to click 'erase'?

[JorgeB]

If you backed up everything you could you can erase and re-format.