TapIt

I'm unable to stop my array or shutdown my machine. It looks like there is a sync file system going with a few cores pegged at 100%. Any idea how to stop the array or reboot? In the processes I see this process taking up a lot of cpu. root 9495 39.6 0.1 836004 134392 ? Ssl Jan23 5382:38 /usr/local/sbin/shfs /mnt/user -disks 127 -o default_permissions,allow_other,noatime -o remember=330 Thanks for any help. leaf-diagnostics-20230201-1019.zip

I've been seeing sporadic crashes, about once a month, with no clear consistent repro. Does anyone know a way to get the logs from before the server crashed and restarted? Attached is a screen shot from the ikvm when the server crashed.

Attached the diagnostics with the array started. leaf-diagnostics-20221104-1222.zip

I’m pretty sure it is dead. I attached the diagnostics to the original post. thanks again.

Thanks for the quick response. Just to confirm the next steps, I should just physically replace the dead NVME drive with a new one. Assign that new one to the slot of the dead one and start the array back up. BTRFS will then repair the raid 1 and the cache should be good to go?

One of the drives in my cache pool suddenly died, thankful it was a raid 1 and I was able to recover the data to a folder on my array following these instructions. Now that I have the data on the array in a temp folder how can I get the cache recovered or get the data into the right spots in the array? Should I just be copying the data to the array backed shared location for each area? Such as /cache/sharefolder/files -> /array/temp/files -> /array/sharefolder/files? or once I replace the broken drive should I just take the files from the temp directory and put them back on the cache. leaf-diagnostics-20221103-1905.zip

If someone hits the same issue it turns out that if you follow the template and directly put your data on a cache like /mnt/ssd_cache/appdata/ instead of /mnt/user/appdata whenever mover gets invoked it will move your files off the cache. To fix this you need to use the user path instead of the ssd cache directly.

I recently migrated from MariaDB to Postgres 14 for my nextcloud instance. After it working for a few hours it appears the database went down and I'm no longer able to start up the container. Does anyone have an idea whats going on or how to fix it? 2022-07-15 19:28:41.617 PDT [1] LOG: starting PostgreSQL 14.4 (Debian 14.4-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit 2022-07-15 19:28:41.617 PDT [1] LOG: listening on IPv4 address "0.0.0.0", port 5432 2022-07-15 19:28:41.617 PDT [1] LOG: listening on IPv6 address "::", port 5432 2022-07-15 19:28:41.618 PDT [1] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" 2022-07-15 19:28:41.621 PDT [61] LOG: database system was shut down at 2022-07-15 19:28:41 PDT 2022-07-15 19:28:41.628 PDT [1] LOG: database system is ready to accept connections 2022-07-15 20:38:58.591 PDT [534] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 20:38:58.591 PDT [534] DETAIL: Key (fileid)=(669277) already exists. 2022-07-15 20:38:58.591 PDT [534] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-15 20:38:58.592 PDT [533] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 20:38:58.592 PDT [533] DETAIL: Key (fileid)=(617227) already exists. 2022-07-15 20:38:58.592 PDT [533] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-15 20:49:22.731 PDT [676] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 20:49:22.731 PDT [676] DETAIL: Key (fileid)=(598104) already exists. 2022-07-15 20:49:22.731 PDT [676] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-15 20:51:15.567 PDT [721] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 20:51:15.567 PDT [721] DETAIL: Key (fileid)=(617234) already exists. 2022-07-15 20:51:15.567 PDT [721] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-15 20:51:15.567 PDT [720] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 20:51:15.567 PDT [720] DETAIL: Key (fileid)=(617151) already exists. 2022-07-15 20:51:15.567 PDT [720] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-15 20:51:15.603 PDT [722] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 20:51:15.603 PDT [722] DETAIL: Key (fileid)=(617107) already exists. 2022-07-15 20:51:15.603 PDT [722] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-15 20:51:19.705 PDT [725] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 20:51:19.705 PDT [725] DETAIL: Key (fileid)=(617230) already exists. 2022-07-15 20:51:19.705 PDT [725] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-15 21:25:24.379 PDT [1135] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 21:25:24.379 PDT [1135] DETAIL: Key (fileid)=(669277) already exists. 2022-07-15 21:25:24.379 PDT [1135] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-15 21:25:24.404 PDT [1136] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 21:25:24.404 PDT [1136] DETAIL: Key (fileid)=(617227) already exists. 2022-07-15 21:25:24.404 PDT [1136] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-15 21:28:46.939 PDT [1202] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 21:28:46.939 PDT [1202] DETAIL: Key (fileid)=(598104) already exists. 2022-07-15 21:28:46.939 PDT [1202] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-15 22:01:31.796 PDT [1839] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 22:01:31.796 PDT [1839] DETAIL: Key (fileid)=(669277) already exists. 2022-07-15 22:01:31.796 PDT [1839] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-15 22:01:31.797 PDT [1840] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 22:01:31.797 PDT [1840] DETAIL: Key (fileid)=(617227) already exists. 2022-07-15 22:01:31.797 PDT [1840] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-15 22:29:43.628 PDT [2224] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 22:29:43.628 PDT [2224] DETAIL: Key (fileid)=(617234) already exists. 2022-07-15 22:29:43.628 PDT [2224] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-15 22:31:47.146 PDT [2261] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 22:31:47.146 PDT [2261] DETAIL: Key (fileid)=(598104) already exists. 2022-07-15 22:31:47.146 PDT [2261] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-15 23:42:54.219 PDT [2883] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 23:42:54.219 PDT [2883] DETAIL: Key (fileid)=(669277) already exists. 2022-07-15 23:42:54.219 PDT [2883] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-15 23:42:54.221 PDT [2884] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-15 23:42:54.221 PDT [2884] DETAIL: Key (fileid)=(617227) already exists. 2022-07-15 23:42:54.221 PDT [2884] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-16 02:48:26.223 PDT [4045] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-16 02:48:26.223 PDT [4045] DETAIL: Key (fileid)=(669277) already exists. 2022-07-16 02:48:26.223 PDT [4045] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-16 02:48:26.235 PDT [4044] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-16 02:48:26.235 PDT [4044] DETAIL: Key (fileid)=(617227) already exists. 2022-07-16 02:48:26.235 PDT [4044] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-16 03:37:21.562 PDT [4367] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-16 03:37:21.562 PDT [4367] DETAIL: Key (fileid)=(669277) already exists. 2022-07-16 03:37:21.562 PDT [4367] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-16 03:37:21.562 PDT [4368] ERROR: duplicate key value violates unique constraint "oc_filecache_extended_pkey" 2022-07-16 03:37:21.562 PDT [4368] DETAIL: Key (fileid)=(617227) already exists. 2022-07-16 03:37:21.562 PDT [4368] STATEMENT: INSERT INTO "oc_filecache_extended" ("fileid", "upload_time") VALUES($1, $2) 2022-07-16 05:00:16.151 PDT [62] PANIC: could not open file "pg_commit_ts": No such file or directory 2022-07-16 05:00:16.162 PDT [1] LOG: checkpointer process (PID 62) was terminated by signal 6: Aborted 2022-07-16 05:00:16.162 PDT [1] LOG: terminating any other active server processes 2022-07-16 05:00:16.171 PDT [1] LOG: all server processes terminated; reinitializing 2022-07-16 05:00:16.201 PDT [1] FATAL: could not open directory "pg_notify": No such file or directory 2022-07-16 05:00:16.203 PDT [1] LOG: database system is shut down 2022-07-16 09:36:58.772 PDT [1] FATAL: could not open directory "pg_notify": No such file or directory 2022-07-16 09:36:58.774 PDT [1] LOG: database system is shut down 2022-07-16 09:37:09.363 PDT [1] FATAL: could not open directory "pg_notify": No such file or directory 2022-07-16 09:37:09.366 PDT [1] LOG: database system is shut down 2022-07-16 10:04:43.220 PDT [1] FATAL: could not open directory "pg_notify": No such file or directory 2022-07-16 10:04:43.222 PDT [1] LOG: database system is shut down PostgreSQL Database directory appears to contain a database; Skipping initialization PostgreSQL Database directory appears to contain a database; Skipping initialization PostgreSQL Database directory appears to contain a database; Skipping initialization

I'm still seeing this with 6.10.2. error: Error Domain=NSPOSIXErrorDomain Code=19 "Operation not supported by device" UserInfo={DIErrorVerboseInfo=Failed to initialize IO manager: Failed opening folder for entries reading}

The web ui isn't showing any plugins. Has anyone figured out how to get the webui to show plugins or is there some other way to install plugins? Thanks!