Everything posted by Flatbed0563
-
ZFS integrity during 2 disk resilver
Thx for the info, that is actually a relief
-
ZFS integrity during 2 disk resilver
Thx for the response. Can I trust that each resilver will not corrupt any data, as the rebuild will calculate from a potentially faulty drive?
-
ZFS integrity during 2 disk resilver
Hi all, I recently moved to zfs raidz2 for my main storage, the day after putting everything up again, I got 2 drives giving me smart warnings (current pending sector and offline uncorrectable error). I was planning on replacing the drives and resilver. However, I am wondering, how confident can I be about data integrity during the resilver. Can I be absolutely sure that if data gets corrupted due to a third drive failure, unraid will either correct or notify me?
-
Slow transfer speed moving everything between zfs pools
I think I figured it out. Looking at the drive numbers of the pool I am transferring to, I noticed one of the drives is an SMR model. So the move from those drives was pretty fast, but the move to is extremely slow due to that one drive probably?
-
Slow transfer speed moving everything between zfs pools
It does to some extend. However, the unraid mover was able to move the files from the storage array to the zfs pool a lot faster than the zfs send command is currently performing at. I would’ve expected similar or better performance moving from pool to pool.
-
Slow transfer speed moving everything between zfs pools
trantor-diagnostics-20240507-1039.zip
-
Slow transfer speed moving everything between zfs pools
I recently switched from the standard unpaid storage array to a zfs pool and want to move everything to another zfs pool. As the mover does not seem an option I tried the zfs send command. While it is working, the transfer speed is extremely slow (5-30MB/s). Looking at the disks however, they seem to be idling most of the time while one cpu thread is constantly sitting at 100%. Is there a way to speed up this process? Also tried rsync to see if it would be faster but no luck there also.
-
Mover not working after clean reboot while moving?
Hi all, I recently restarted my server without realizing the mover was still running (clean reboot via the webgui). After boot, I noticed higher than usual cache drive storage used, so I thought to run the mover manually... which completed immediately. Calculating the share storage usage on each disk, I should be getting around 250GB cache usage, whereas unraid reports 320GB being used on my 1TB pool. I read somewhere that rebooting while the mover is running might leave some files stuck in cache forever, so I have some questions: Is there a possibility that my files were corrupted during move due to my reboot? How can I make sure stuck files are unstuck?
-
Installing extensions on postgreSQL docker container
hmmm, started from 15, and switching to the tensorchord/pgvecto-rs:pg15-v0.1.11 seems to have worked seamlessly for me actually, at least no errors in indexing, and the image counts in the stats seem to be the same as before the switch...
-
[Question] 2 zfs drive pools for 3-2-1 backup?
Hi All, I currently have a cloud server where I use duplicati to backup all its contents to an external hard drive every night (using the unassigned devices). To have a true 3-2-1 backup strategy, I swap out this external hard drive with another one that I store at another location. Because the external hard drives are full now, I want to switch to a drive pool system that can be scaled dynamically and which can be parity protected. I was thinking of buying a QNAP TR-004U, putting it in the individual drives configuration and configuring 2 zfs-pools (1 pool for each backup drive set) in unraid. 1 pool would be active at any given time and swapped out for the other pool every once in a while. Some questions I have on this setup: Would this even work? Will unraid complain a lot when a drive pool is not active? Can the capacity of the vdev be increased similarly to current unraid drive arrays? From what I understand, vdevs cannot scale in number of drives (planned for future update), but if I were to swap out and rebuild 1 drive at a time, would that increase the capacity? Thx in advance
-
Installing extensions on postgreSQL docker container
Hi all, I currently have an Immich container, which uses a separate PostgreSQL database in the backend. Due to a recent update, the server does not boot up because it tries to use the vectors extension in PostgreSQL, which is not installed. When looking up how to install extensions, the results mostly say I should console into the docker, clone the git repo and install it, but I have some questions whether this is the clean way of doing it. I always thought that everything done in the docker console command line is a sandboxed environment installed from the docker image, so if I update my docker container in the future, will it also remove the extension I installed with the command line? I guess the extensions also need to be updated, so if I install it via the container console, I would probably have to manually update it as well? Is there a way to embed this in the container config so that it will install and update the extension at startup of the container? This is the step plan I found: console in the PostgreSQL container and install tools needed to install the extension: apk add --no-cache git build-base clang llvm15-dev llvm15 clone the git repo of the extension in a temp folder cd /tmp git clone --branch v0.5.1 https://github.com/pgvector/pgvector.git cd pgvector compile and install the extension make make install after this, the extension should be installed and ready to use in Immich, as that container installs the extension on the database itself on startup is this correct?