rutherford

There was an excellent Verge podcast “A impossible journey into self-hosting” recently about self-hosting that sited many sources. Immich dev, and book author Cory Doctorow (en-shitification of www) …. Now I forgot where I was going with this… it’ll come back to me…. scraping data to make it easier to move providers. Apparently Facebook scraped MySpace data and told the new users they’d never spy on them or advertise (?) to them. That all changed and now we’re locked in. Doctorow puts many ideas forward, one of which make that shit legal and required to support. It’s what those guys did - and now when a big outfit provides an API, they shut it down frequently because of security concerns. Which might be valid, but near impossible to police. I’d love to see these ideas adopted. I’d love to see my Google Drive stuff mirrored, automatically in Nextcloud so the move would be gradual and easy to undo. I’d also like to see you guys not get destroyed in court by these big dogs. i recently used the Google Takeout tool for Google photos to Immich. The json files, metadata hodgepodge mismatched garbage in there, I have to run it through several other tools just to make it make sense. And there are still outliers. At least it’s something Google offers, but it seems purposefully shitty. just curious if you’ve seen that stuff, know what I’m talking about, and would be interested in speaking about it.

I got the cables replaced. What should I do to see if the problems are fixed? Run more SMART tests? Which ones? Thanks so much @JorgeB! Also (and this might already exist?) a wiki page explaining what errors to look for, what they might indicate, and some steps to take. Then when steps are taken, the follow up tests. I could write this! If you can point me in the right direction to start. thanks!

I have a SATA controller card with two mini-sas outlets that each go to four sata connectors. I’ve been getting a couple of SMART errors that are related to cable failure. Currently Cable Matters https://www.newegg.com/p/0ZF-00KY-00055 I thought I’d try the only other cable available, a red one. ? Any other ideas? Enlabs cable https://www.newegg.com/p/238-00A4-00013 Maybe this Supermicro cable? https://www.ebay.com/itm/394792492777?mkcid=16&mkevt=1&mkrid=711-127632-2357-0&ssspo=8wteuw_otge&sssrc=4429486&ssuid=7SLFFgxaSbi&var=&widget_ver=artemis&media=COPY thanks

In the future, I'd like to see the Docker template a little better formatted, and hardware acceleration options. Also: how to begin the big Google photo migration would be great too.

Looks like the dev didn't add a thread to the Docker support area, so I'm going to start this thread. Space Invader One howto's part 1: A closer look at Immich before you switch youtube part 2: how to actually set it up youtube support at github for us unRaiders, the docker template in Community Applications read me first project home also at github https://immich.app/ github v1.95.0 release notes I installed Spaceinvader1's Docker "PostgreSQL_Immich" You DO have to change the tensorchord Repository to "tensorchord/pgvecto-rs:pg16-v0.2.0" I believe you have to setup the initial database. Drop into the PostgreSQL_Immich Docker Command Line Interface CLI, left click on the docker image, select >_Console # psql -U postgres -W Password: psql (15.5 (Debian 15.5-1.pgdg120+1)) Type "help" for help. postgres=# CREATE USER immich WITH PASSWORD 'immichpass'; CREATE ROLE postgres=# CREATE DATABASE immichdb TEMPLATE template0 ENCODING 'UNICODE'; CREATE DATABASE postgres=# ALTER DATABASE immichdb OWNER TO immich; ALTER DATABASE postgres=# GRANT ALL PRIVILEGES ON DATABASE immichdb TO immich; GRANT postgres=# ALTER USER immich WITH SUPERUSER; ALTER ROLE postgres=# (*re SUPERUSER: i was getting the "earthdistance" error in immich logs, and that additional command seemed to sort that out) reverse proxy. cool, SWAG included a template for it! cd /mnt/user/appdata/swag/nginx/proxy-confs cp immich.subdomain.conf.sample immich.subdomain.conf nano immich.subdomain.conf couple of changes in here: this is your subdomain. I'm using photos.mydomain.com server_name immich.*; to server_name photos.*; this is the name of our docker. Mine's called "immich". This is in two spots in the file. set $upstream_app immich-server; to set $upstream_app immich; correct the port. I had to change mine to 8081. Also two places in the file. set $upstream_port 3001; to set $upstream_port 8080; There is some wizardry happening here. I'm sure it's supposed to be 8081. That's what I'm looking at when, locally, I hit the web GUI and it goes to http://192.168.11.54:8081/. BUT the SWAG .conf file has the 8081. In fact, if I go to http://192.168.11.54:8080, I get sabnzbd. <shrug> That should be it, you should be up and running. As immich is "under heavy development" you want to turn off auto-update so you don't discover a busted install randomly. Install Squid's "Auto Update Applications". This will enable: unraid gui > Settings > Auto update applications (scroll to bottom of page) > Docker auto update settings <tab> Turn off Immich Autoupdate. BACKUP BACKUP BACKUP This is the first dive into IRRIPLACEABLE self-hosted files. If you use Immich, and it's got pics of your kid in it, that would be SUPER BUMMER if you lost your stuff (my github request). Here's my backup system: install CA > "user scripts" also from Squid This will enable unraid gui > Settings > User Scripts (scroll down) alright! Here come these scripts: New script. Gear > Edit script This one is "backup postgresql DBs" #!/bin/bash ############################## ## VARIABLES ## ############################## DATE=$(date +"%Y-%m-%d.%H%M") BACKUP_DIR="/mnt/disks/TOSHIBA_EXTERNAL_USB/unraid-postgresql" EMAIL="[email protected]" # Perform the database backup docker exec -t PostgreSQL_Immich pg_dumpall -c -U postgres | gzip > $BACKUP_DIR/$DATE.PostgreSQL_Immich.sql.tar.gz # Rotate backups to keep the 7 most recent ls -t $BACKUP_DIR/*Immich.sql.tar.gz | tail -n +8 | xargs rm -f # Perform the database backup docker exec -t postgresql15 pg_dumpall -c -U postgres | gzip > $BACKUP_DIR/$DATE.postgresql15_nextcloud.sql.tar.gz # Rotate backups to keep the 7 most recent ls -t $BACKUP_DIR/*nextcloud.sql.tar.gz | tail -n +8 | xargs rm -f this one is called "immich" #!/bin/bash rsync -av --progress /mnt/user/memories/immich/library /mnt/disks/TOSHIBA_EXTERNAL_USB/immich rsync -av --progress /mnt/user/memories/immich/upload /mnt/disks/TOSHIBA_EXTERNAL_USB/immich rsync -av --progress /mnt/user/memories/immich/profile /mnt/disks/TOSHIBA_EXTERNAL_USB/immich The first one does a pg_dump from the immich database into a compressed .tar.gz file, that I like. I also like the date naming convention. Makes me feel good seeing all those dates in my file list. I copy this stuff to an external USB drive that I mount via Unassigned Devices. This is the source docs that are important https://immich.app/docs/administration/backup-and-restore The backup of the actual jpgs and mov files happens in the "immich" script via rsync, and just copies the stuff over to that external drive. In the future, I'm going to setup a syncthing with a buddy to copy EVERYTHING over to his server. Syncthing at unraid forums Also: do a dry run on a backup and restore. I've had to do this twice, and I hate it, but it happened with those breaking updates I referenced above. Good luck! Be safe. Profit. Below is old stuff. Might help someone who's in the weeds. =========================================================================================== Working now, here's my setup. installed docker "immich" ghcr.io/imagegenius/immich, imagegenius. Via regular unRaid APPS tab. Had to change default port from 8080 to 8081 installed docker "postgresql14" library/postgres:14, jj9987 installed docker "redis" library/redis, jj9987 Setup SWAG reverse proxy remember to change "Network Type" on the immich Docker to whatever your proxy dockers use. created /mnt/user/appdata/swag/nginx/proxy-confs/immich.subdomain.conf For some reason this would only work pointing to 8080, vs the unraid-local-ip:8081 My subdomain is photos.mywebsite.com You also need to add "photos" or whatever your subdomain is gonna be, to the field in Docker SWAG Setup Importing the Google Takeout. I had 10 files at 50GB each. I extracted each of the zip files into the same folder. Windows combined the folders and files just fine. Did a couple test runs with a handful of folders to make sure it worked. I tried github simulot immich go, but it made way too many mis-dated imports. hundreds and hundreds of pics from year 0, or maybe it was year 36947... so I went along with github mattwilson1024 google photos exif. The trick here is that I'm on Windows 11, and can't run this stuff. So I installed Git For Windows. That gave me yarn from the cmd.exe command line. It also installed some other cli program, "git bash" and "git CMD," but I had the command yarn in the regular CLI after installing Git For Windows, so I just went with that. From the mattwilson git page, green Code button, download ZIP file. Unzipped that to the desktop, gave me files and folders. I created a couple more folders Desktop/processed, Desktop/failed, and the source was Desktop/takeout. Go into C:\Users\user\Desktop\google-photos-exif-master ran "yarn". It did some stuff. then the longer command that started flying through all my stuff: yarn start --inputDir "C:\Users\user\Desktop\takeout" --outputDir "C:\Users\user\Desktop\processed" --errorDir "C:\Users\user\Desktop\error" I had 687 files in my error directory (143k in processed directory), only about 1/2% error rate. <meh> Following along with directions in the immich post here, I'll call it post 1340, I run exiftool (github) on the problem files in error directory. It's a perl program. Happily, perl came along with the MINGW64 git-hub for windows thingy. $ perl exiftool -all= -tagsfromfile @ -all:all -unsafe -icc_profile /d/error/ Looks like most of the errors are from screenshots that saved as PNG but exiftool reports "Error: Not a valid PNG, looks more like a JPG" <shrug> I am a little concerned that all my albums will be gone. At the moment, all the files in d/processed have gone into that folder with zero subfolders at all. The immich post 1340 says I have to deal with all my albums first individually. Hmmmm, I hope the google-photos-exif mattwilson1024 tool did something and added some gallery meta data into the files... we'll see. hmmm 1 directories scanned 68 image files updated 270 files weren't updated due to errors $ yarn start --inputDir "/d/error/" --outputDir "/d/processed2/" --errorDir "/d/error2/" nice! That went through nicely and ended up with: 30 error files and their other weird data files. Mostly HEIC files. sorted another 347 files. Half videos looks like. Manually move those 347 into the /d/processed folder Move external drive to server. Something got borked with the postgres connection. The unRaid>Immich>logs are showing loads of failure to connect [Nest] 921 - 10/25/2023, 11:29:57 AM ERROR [TypeOrmModule] Unable to connect to the database. Retrying (3)... error: password authentication failed for user "postgres" But: I get into the postgres container, and am able to connect via psql no problem. I'll try creating a different database, user and pass see if that helps. This database is already populated, and the error reporting might be dog shit (user auth error vs database full error) That worked. Got a few errors (watching log go by) about undefined request failed with HTTP code 503, but after less than a minute it sorted itself out. Start regular immich import for the whole kitten-caboodle. badda bing This process loses all the albums. I forget where the details were for preserving albums. I think it's below in my "history stuff." Most important source is our unRaid github docker maintainer page https://github.com/imagegenius/docker-immich =====================history stuff below here======================== Wiping current setup, starting from https://documentation.immich.app/docs/install/unraid already a couple of changes in there Editing /boot/config/plugins/compose.manager/projects/Immich/.env added DB_PORT=5432 TYPESENSE_API_KEY=xxxxxxxxxxxx DB_PASSWORD=xxxxxxxxxxxx # The values below this line do not need to be changed ################################################################################### DB_HOSTNAME=xxx.xxx.xxx.xxx DB_USERNAME=xxxxxxxxxxxx DB_DATABASE_NAME=xxxxxxxxxxxx DB_PORT=5432 Another question here: from the documentation.immich.app unraid stuff "if you're using an existing database docker click here..." I can do this without using an external Postgres14 docker??? Seems like that would be easier. Will it be as good/fast? From other installations that can use mysql, it's supposed to be faster to setup a mysql connection, otherwise it will use a flat-file or built in sql-express or something to organize itself but it's not supposed to be as good. And, follow up, how many thousands of entries will I have to have (entries = pics,vids) for it to be noticeable? Finished that piece, clicked Save Changes and Compose Up. My pop-up window went immediately to Connection Closed, and Done. I go to unRaid Docker page, and there's nothing in there. So much for several minutes depending on my hardware... hmmmm I do still see the Immich entry at the bottom of the Docker page under the Compose section, but it doesn't look like the picture. Going to try this again from defaults, and NOT using that external PostgreSQL container... there we go, now something is happening. I must've edited a file incorrectly. Now on unRaid Docker page I have "several entries," namely: 8 of them: 1. immich_machine_learning 2. immich_microservices 3. immich_postgres 4. immich_proxy 5. immich_redis 6. immich_server 7. immich_typesense 8. immich_web Immich docker requires PostgreSQL 14, I installed that docker with defaults (unraidstaticIP:5432). Must set password. requires REDIS, I already have that installed. Used defaults - though I have no idea what the password is, if I ever set one to connect to REDIS. Need to connect to Postgres database. Error message from Immich Log [Nest] 1002 - 10/06/2023, 9:50:14 AM ERROR [TypeOrmModule] Unable to connect to the database. Retrying (3)... error: database "immich" does not exis So I supposed I'll have to connect myself, create database and username etc. click unraid GUI > Dashboard > Postgresql > commandline # psql -U postgres -W<enter> Password: psql (14.9 (Debian 14.9-1.pgdg120+1)) Type "help" for help. postgres=# create database immich;<enter> CREATE DATABASE postgres=# create user immuser with encrypted password 'thispass';<enter> CREATE ROLE postgres=# grant all privileges on database immich to immuser;<enter> GRANT postgres=# \q<enter> # exit<enter> you should have set password on your Docker Settings for postgreSQL 14 Immich docker not quite running yet, getting weird error real similar to this https://github.com/nextcloud/docker/issues/1529#issuecomment-875552116 SWAG proxy setup. There is no template for Immich, so I used /mnt/user/appdata/swag/nginx/proxy-confs/_template.subdomain.conf.sample created /mnt/user/appdata/swag/nginx/proxy-confs/immich.subdomain.conf * below, I had changed the Immich Docker template from 8080 to 8081, already had a service on 8080. I'm still getting a "welcome to your SWAG instance" boiler plate page, the Immich Docker isn't really up yet I think. server { listen 443 ssl http2; listen [::]:443 ssl http2; server_name immich.*; include /config/nginx/ssl.conf; client_max_body_size 0; location / { include /config/nginx/proxy.conf; include /config/nginx/resolver.conf; set $upstream_app immich; set $upstream_port 8081; set $upstream_proto https; proxy_pass $upstream_proto://$upstream_app:$upstream_port; } https://github.com/imagegenius/docker-immich https://immich.app/docs/install/unraid https://www.reddit.com/r/selfhosted/comments/x44qzi/immich_on_unraid/

I have a bunch of stuff I really don't want to loose. Pictures, and files. What would be a simple way to keep another copy of the stuff? Incase I get drive corruption and end up with loads of <unknownfile.1> or the lost+found stuff.? How about 1 or 2 external (or internal?) hard drives that just mirror stuff? And what Docker would I use to handle that?

Got a smart report that wasn't green. Is this hard drive dying? thanks! smartctl 7.3 2022-02-28 r5338 [x86_64-linux-6.1.38-Unraid] (local build) Copyright (C) 2002-22, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Model Family: Seagate BarraCuda 3.5 (SMR) Device Model: ST8000DM004-2CX188 Serial Number: WCT02XA2 LU WWN Device Id: 5 000c50 0aa8b48e1 Firmware Version: 0001 User Capacity: 8,001,563,222,016 bytes [8.00 TB] Sector Sizes: 512 bytes logical, 4096 bytes physical Rotation Rate: 5425 rpm Device is: In smartctl database 7.3/5440 ATA Version is: ACS-3 T13/2161-D revision 5 SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s) Local Time is: Thu Aug 31 12:38:00 2023 PDT SMART support is: Available - device has SMART capability. SMART support is: Enabled AAM feature is: Unavailable APM feature is: Unavailable Rd look-ahead is: Enabled Write cache is: Enabled DSN feature is: Unavailable ATA Security is: Disabled, NOT FROZEN [SEC1] Wt Cache Reorder: Unavailable === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x82) Offline data collection activity was completed without error. Auto Offline Data Collection: Enabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: ( 0) seconds. Offline data collection capabilities: (0x7b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. Conveyance Self-test supported. Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time: ( 1) minutes. Extended self-test routine recommended polling time: ( 957) minutes. Conveyance self-test routine recommended polling time: ( 2) minutes. SCT capabilities: (0x30a5) SCT Status supported. SCT Data Table supported. SMART Attributes Data Structure revision number: 10 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAGS VALUE WORST THRESH FAIL RAW_VALUE 1 Raw_Read_Error_Rate POSR-- 079 057 006 - 78677104 3 Spin_Up_Time PO---- 091 091 000 - 0 4 Start_Stop_Count -O--CK 100 100 020 - 124 5 Reallocated_Sector_Ct PO--CK 100 100 010 - 0 7 Seek_Error_Rate POSR-- 093 060 045 - 1786659013 9 Power_On_Hours -O--CK 041 041 000 - 51888h+54m+57.822s 10 Spin_Retry_Count PO--C- 100 100 097 - 0 12 Power_Cycle_Count -O--CK 100 100 020 - 110 183 Runtime_Bad_Block -O--CK 100 100 000 - 0 184 End-to-End_Error -O--CK 100 100 099 - 0 187 Reported_Uncorrect -O--CK 100 100 000 - 0 188 Command_Timeout -O--CK 100 099 000 - 0 0 2 189 High_Fly_Writes -O-RCK 100 100 000 - 0 190 Airflow_Temperature_Cel -O---K 067 050 040 - 33 (Min/Max 28/42) 191 G-Sense_Error_Rate -O--CK 100 100 000 - 0 192 Power-Off_Retract_Count -O--CK 100 100 000 - 1285 193 Load_Cycle_Count -O--CK 083 083 000 - 34085 194 Temperature_Celsius -O---K 033 050 000 - 33 (0 11 0 0 0) 195 Hardware_ECC_Recovered -O-RC- 079 064 000 - 78677104 197 Current_Pending_Sector -O--C- 100 100 000 - 0 198 Offline_Uncorrectable ----C- 100 100 000 - 0 199 UDMA_CRC_Error_Count -OSRCK 200 192 000 - 11 240 Head_Flying_Hours ------ 100 253 000 - 42340h+46m+51.869s 241 Total_LBAs_Written ------ 100 253 000 - 73097535729 242 Total_LBAs_Read ------ 100 253 000 - 1677000598822 ||||||_ K auto-keep |||||__ C event count ||||___ R error rate |||____ S speed/performance ||_____ O updated online |______ P prefailure warning General Purpose Log Directory Version 1 SMART Log Directory Version 1 [multi-sector log support] Address Access R/W Size Description 0x00 GPL,SL R/O 1 Log Directory 0x01 SL R/O 1 Summary SMART error log 0x02 SL R/O 5 Comprehensive SMART error log 0x03 GPL R/O 5 Ext. Comprehensive SMART error log 0x04 GPL,SL R/O 8 Device Statistics log 0x06 SL R/O 1 SMART self-test log 0x07 GPL R/O 1 Extended self-test log 0x08 GPL R/O 2 Power Conditions log 0x09 SL R/W 1 Selective self-test log 0x0c GPL R/O 2048 Pending Defects log 0x10 GPL R/O 1 NCQ Command Error log 0x11 GPL R/O 1 SATA Phy Event Counters log 0x21 GPL R/O 1 Write stream error log 0x22 GPL R/O 1 Read stream error log 0x24 GPL R/O 512 Current Device Internal Status Data log 0x30 GPL,SL R/O 9 IDENTIFY DEVICE data log 0x80-0x9f GPL,SL R/W 16 Host vendor specific log 0xa1 GPL,SL VS 24 Device vendor specific log 0xa2 GPL VS 8160 Device vendor specific log 0xa6 GPL VS 192 Device vendor specific log 0xa8-0xa9 GPL,SL VS 136 Device vendor specific log 0xab GPL VS 1 Device vendor specific log 0xb0 GPL VS 9048 Device vendor specific log 0xbe-0xbf GPL VS 65535 Device vendor specific log 0xc0 GPL,SL VS 1 Device vendor specific log 0xc1 GPL,SL VS 16 Device vendor specific log 0xc3 GPL,SL VS 8 Device vendor specific log 0xc4 GPL,SL VS 24 Device vendor specific log 0xd1 GPL VS 264 Device vendor specific log 0xd3 GPL VS 1920 Device vendor specific log 0xe0 GPL,SL R/W 1 SCT Command/Status 0xe1 GPL,SL R/W 1 SCT Data Transfer SMART Extended Comprehensive Error Log Version: 1 (5 sectors) No Errors Logged SMART Extended Self-test Log Version: 1 (1 sectors) No self-tests have been logged. [To run self-tests, use: smartctl -t] SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 1 0 0 Not_testing 2 0 0 Not_testing 3 0 0 Not_testing 4 0 0 Not_testing 5 0 0 Not_testing Selective self-test flags (0x0): After scanning selected spans, do NOT read-scan remainder of disk. If Selective self-test is pending on power-up, resume after 0 minute delay. SCT Status Version: 3 SCT Version (vendor specific): 522 (0x020a) Device State: Active (0) Current Temperature: 33 Celsius Power Cycle Min/Max Temperature: 28/42 Celsius Lifetime Min/Max Temperature: 11/50 Celsius Under/Over Temperature Limit Count: 0/0 SCT Temperature History Version: 2 Temperature Sampling Period: 3 minutes Temperature Logging Interval: 59 minutes Min/Max recommended Temperature: 14/55 Celsius Min/Max Temperature Limit: 10/60 Celsius Temperature History Size (Index): 128 (108) Index Estimated Time Temperature Celsius 109 2023-08-26 06:55 34 *************** 110 2023-08-26 07:54 35 **************** 111 2023-08-26 08:53 34 *************** 112 2023-08-26 09:52 34 *************** 113 2023-08-26 10:51 33 ************** 114 2023-08-26 11:50 33 ************** 115 2023-08-26 12:49 34 *************** 116 2023-08-26 13:48 34 *************** 117 2023-08-26 14:47 35 **************** 118 2023-08-26 15:46 35 **************** 119 2023-08-26 16:45 35 **************** 120 2023-08-26 17:44 36 ***************** 121 2023-08-26 18:43 36 ***************** 122 2023-08-26 19:42 37 ****************** ... ..( 7 skipped). .. ****************** 2 2023-08-27 03:34 37 ****************** 3 2023-08-27 04:33 36 ***************** 4 2023-08-27 05:32 35 **************** 5 2023-08-27 06:31 36 ***************** 6 2023-08-27 07:30 35 **************** 7 2023-08-27 08:29 34 *************** ... ..( 2 skipped). .. *************** 10 2023-08-27 11:26 34 *************** 11 2023-08-27 12:25 35 **************** ... ..( 4 skipped). .. **************** 16 2023-08-27 17:20 35 **************** 17 2023-08-27 18:19 36 ***************** 18 2023-08-27 19:18 36 ***************** 19 2023-08-27 20:17 36 ***************** 20 2023-08-27 21:16 37 ****************** ... ..( 2 skipped). .. ****************** 23 2023-08-28 00:13 37 ****************** 24 2023-08-28 01:12 36 ***************** ... ..( 4 skipped). .. ***************** 29 2023-08-28 06:07 36 ***************** 30 2023-08-28 07:06 35 **************** 31 2023-08-28 08:05 35 **************** 32 2023-08-28 09:04 36 ***************** 33 2023-08-28 10:03 36 ***************** 34 2023-08-28 11:02 35 **************** ... ..( 2 skipped). .. **************** 37 2023-08-28 13:59 35 **************** 38 2023-08-28 14:58 34 *************** 39 2023-08-28 15:57 35 **************** ... ..( 9 skipped). .. **************** 49 2023-08-29 01:47 35 **************** 50 2023-08-29 02:46 34 *************** 51 2023-08-29 03:45 34 *************** 52 2023-08-29 04:44 34 *************** 53 2023-08-29 05:43 35 **************** 54 2023-08-29 06:42 34 *************** 55 2023-08-29 07:41 34 *************** 56 2023-08-29 08:40 34 *************** 57 2023-08-29 09:39 33 ************** ... ..( 12 skipped). .. ************** 70 2023-08-29 22:26 33 ************** 71 2023-08-29 23:25 34 *************** 72 2023-08-30 00:24 33 ************** ... ..( 4 skipped). .. ************** 77 2023-08-30 05:19 33 ************** 78 2023-08-30 06:18 32 ************* 79 2023-08-30 07:17 32 ************* 80 2023-08-30 08:16 33 ************** ... ..( 2 skipped). .. ************** 83 2023-08-30 11:13 33 ************** 84 2023-08-30 12:12 34 *************** ... ..( 6 skipped). .. *************** 91 2023-08-30 19:05 34 *************** 92 2023-08-30 20:04 35 **************** 93 2023-08-30 21:03 35 **************** 94 2023-08-30 22:02 35 **************** 95 2023-08-30 23:01 34 *************** ... ..( 6 skipped). .. *************** 102 2023-08-31 05:54 34 *************** 103 2023-08-31 06:53 33 ************** ... ..( 4 skipped). .. ************** 108 2023-08-31 11:48 33 ************** SCT Error Recovery Control command not supported Device Statistics (GP Log 0x04) Page Offset Size Value Flags Description 0x01 ===== = = === == General Statistics (rev 1) == 0x01 0x008 4 110 --- Lifetime Power-On Resets 0x01 0x010 4 51888 --- Power-on Hours 0x01 0x018 6 73097593968 --- Logical Sectors Written 0x01 0x020 6 171869828 --- Number of Write Commands 0x01 0x028 6 1677139020043 --- Logical Sectors Read 0x01 0x030 6 2360625388 --- Number of Read Commands 0x01 0x038 6 - --- Date and Time TimeStamp 0x03 ===== = = === == Rotating Media Statistics (rev 1) == 0x03 0x008 4 51672 --- Spindle Motor Power-on Hours 0x03 0x010 4 1178 --- Head Flying Hours 0x03 0x018 4 34085 --- Head Load Events 0x03 0x020 4 0 --- Number of Reallocated Logical Sectors 0x03 0x028 4 0 --- Read Recovery Attempts 0x03 0x030 4 0 --- Number of Mechanical Start Failures 0x03 0x038 4 0 --- Number of Realloc. Candidate Logical Sectors 0x03 0x040 4 1285 --- Number of High Priority Unload Events 0x04 ===== = = === == General Errors Statistics (rev 1) == 0x04 0x008 4 2 --- Number of Reported Uncorrectable Errors 0x04 0x010 4 3 --- Resets Between Cmd Acceptance and Completion 0x05 ===== = = === == Temperature Statistics (rev 1) == 0x05 0x008 1 33 --- Current Temperature 0x05 0x010 1 33 --- Average Short Term Temperature 0x05 0x018 1 34 --- Average Long Term Temperature 0x05 0x020 1 46 --- Highest Temperature 0x05 0x028 1 0 --- Lowest Temperature 0x05 0x030 1 44 --- Highest Average Short Term Temperature 0x05 0x038 1 17 --- Lowest Average Short Term Temperature 0x05 0x040 1 37 --- Highest Average Long Term Temperature 0x05 0x048 1 19 --- Lowest Average Long Term Temperature 0x05 0x050 4 0 --- Time in Over-Temperature 0x05 0x058 1 55 --- Specified Maximum Operating Temperature 0x05 0x060 4 420 --- Time in Under-Temperature 0x05 0x068 1 13 --- Specified Minimum Operating Temperature 0x06 ===== = = === == Transport Statistics (rev 1) == 0x06 0x008 4 397 --- Number of Hardware Resets 0x06 0x010 4 149 --- Number of ASR Events 0x06 0x018 4 11 --- Number of Interface CRC Errors |||_ C monitored condition met ||__ D supports DSN |___ N normalized value Pending Defects log (GP Log 0x0c) No Defects Logged SATA Phy Event Counters (GP Log 0x11) ID Size Value Description 0x000a 2 8 Device-to-host register FISes sent due to a COMRESET 0x0001 2 0 Command failed due to ICRC error 0x0003 2 0 R_ERR response for device-to-host data FIS 0x0004 2 0 R_ERR response for host-to-device data FIS 0x0006 2 0 R_ERR response for device-to-host non-data FIS 0x0007 2 0 R_ERR response for host-to-device non-data FIS rubble-diagnostics-20230831-1239.zip

Look up going south? Keeping track of metadata and stats? This is Roon bread and butter. I suggest a test: get the weirdest album you have. Rip it, using standard naming stuff, and see if Roon will recognize it. Once you have the FLACs, you should be good to go.

Yeah, I’m not that helpful here! Sorry. Only that I DO have lots of ripping experience and it was 100% in EAC. So, if I were you, I would spend about 5 minutes on Roon ripping before bailing for something else. Once it’s ripped: done! Back to Roon happy land.

I like it! Roon software is awesome. But, and I’m talking without real knowledge here, the CD ripping aspect of Roon isn't what it’s famous for. another piece of software is dbpoweramp that does an outstanding job of batch processing. Roon is best for exactly what I think we all use it for: music experience in our daily listening. Metadata pics suggestions

I’d like to suggest using different software for ripping. Exact Audio Copy has been the gold standard for ripping audio for years and years. here are resources for that route: https://www.exactaudiocopy.de https://eacguide.github.io/

Check out Crafty 4 for one Docker multiple worlds

Wow, this is fabulous. Thanks in advance!

@scytherbladez the reddit comment below looked pretty helpful for repairing databases. But as you said you rolled back and it's working again. My setup: Repository: lscr.io/linuxserver/plex then in the Plex UX: Settings > General: Version 1.32.1.6999 Ah there are the versions you're talking about, github. https://github.com/linuxserver/docker-plex Releases 1.32.1.6999-91e1e2e2c-ls167 But if going from one version to a newer breaks it, there still may be something going on with only your database. Are you going to stay on ls163 from here on out? How about nuking and rebuilding? The most annoying part about that is losing the watched/unwatched statuses; but it would probably get you back up and running.

Interesting. Huh. I’ll try that out!

What does that look like on the Main page? Is that a second disk cache drive?

I was thinking this yes. In what manner should I add this extra cache drive to array (mark it as not included or something)? Or leave as unassigned device?

I'd like to split out my plex data folder to another hard drive. I added another SSD to the server, it's currently under Unassigned Devices. What's the best way to set this up? thanks! Plex docker > Settings Repository: lscr.io/linuxserver/plex Appdata: /mnt/user/appdata/plex appdata user share settings: Use cache pool: Only Select cache pool: Cache

Swapped out some memory, moved a couple of the stick from server into my desktop and ran memtest86 last night. Still going in the morning! Good grief. But apparently enough to tell: FAIL. haha, love the font and schtick of this usb bootable test. I can't tell if this is both sticks or ram, or one of them: which one? Not that I wouldn't want a pair, but for selling them, I should know. https://www.memtest86.com/troubleshooting.htm looks like I just Chuck em both. Or I’ll sell them as FAIL memory. <shrug> I’m so happy I found a smoking gun. MemTest86-Report-20230408-235658.html

Got this wrapped up, and finished and we're all good. Seems to be back up and running AOK. The backup, format, and restore was a bit stressful. My Plex library had to get rolled back a couple days - I don't remember setting that backup up <shrug> thank goodness it worked out. Ed's video here walked me through those steps. This project is done. I will setup weekly CA Backups V2, and keep an occasional eye on the logs for more errors. Thank you very much @JorgeB !

@couzin2000 hmmm looks like you can specify large Java versions. Third (?) sticky post on this thread talks about Java versions at the binhex documentation here https://github.com/binhex/documentation/blob/master/docker/faq/minecraftserver.md does any of that help? I moved on to Crafty 4 where you can host multiple servers at once, and use any Java version you like. I think. It’s been a year or so since I’ve messed with it.

I didn't see the format option for assigning the xfs/btrfs drive. Found it. Click on the blue "Cache" then you can select the format of the drive. For me I changed it to XFS, hit Apply, Done, Start Array. Format all unmountable disks. Stop array, change format back to btrfs, format it, copy the goods back. My Unassigned Devices drive wasn't coming up default because I had to re MOUNT the drive. Then it came up and I used the following command to get it all back <fingers crossed>: rsync --progress -avzh /mnt/disks/6VM78N1T/cache-drive-thurs/ /mnt/cache/ Takes me about 45 minutes to copy over 7GB of uncompressed files.

Also on this topic, I used rsync to copy the whole cache drive to another unused drive in my system with this command rsync /mnt/user/appdata --progress -avzh /mnt/user/appdata /mnt/disks/6VM78N1T/appdata-thurs/ I think I got rsync from Nerd Tools

Over here I'm troubleshooting this issue. I amazon'ed a CPU and RAM ... and additional cache drive, so I'm going to git'er'dun. You suggest using the additional drive for drive to store the appdata backups? from Backup, via CA Backup, and leave those tar files over there? Sounds good! thank you.

I've ran into an issue of some btrfs file corruption on my primary cache drive, includes appdata. Will installing a second drive as a cache pool help avoid this sort of thing in the future? I'm not concerned with speed, only reliability.