Jump to content

rutherford

Members
  • Posts

    664
  • Joined

  • Last visited

Posts posted by rutherford

  1. There was an excellent Verge podcast “A impossible journey into self-hosting” recently about self-hosting that sited many sources. Immich dev, and book author Cory Doctorow (en-shitification of www) …. Now I forgot where I was going with this… it’ll come back to me….


    scraping data to make it easier to move providers. Apparently Facebook scraped MySpace data and told the new users they’d never spy on them or advertise (?) to them. That all changed and now we’re locked in. Doctorow puts many ideas forward, one of which make that shit legal and required to support. It’s what those guys did - and now when a big outfit provides an API, they shut it down frequently because of security concerns. Which might be valid, but near impossible to police. 
     

    I’d love to see these ideas adopted. I’d love to see my Google Drive stuff mirrored, automatically in Nextcloud so the move would be gradual and easy to undo. I’d also like to see you guys not get destroyed in court by these big dogs.

     

    i recently used the Google Takeout tool for Google photos to Immich. The json files, metadata hodgepodge mismatched garbage in there, I have to run it through several other tools just to make it make sense. And there are still outliers. At least it’s something Google offers, but it seems purposefully shitty. 
     

    just curious if you’ve seen that stuff, know what I’m talking about, and would be interested in speaking about it.

  2. I got the cables replaced. What should I do to see if the problems are fixed? Run more SMART tests? Which ones? Thanks so much @JorgeB! Also (and this might already exist?) a wiki page explaining what errors to look for, what they might indicate, and some steps to take. Then when steps are taken, the follow up tests. I could write this! If you can point me in the right direction to start. thanks!

     

     

     

     

    IMG_5482.JPG

  3. I have a SATA controller card with two mini-sas outlets that each go to four sata connectors. I’ve been getting a couple of SMART errors that are related to cable failure. 
     

    Currently Cable Matters 

    https://www.newegg.com/p/0ZF-00KY-00055

     

    I thought I’d try the only other cable available, a red one. ? Any other ideas?

     

    Enlabs cable

    https://www.newegg.com/p/238-00A4-00013

     

     

    Maybe this Supermicro cable?

    https://www.ebay.com/itm/394792492777?mkcid=16&mkevt=1&mkrid=711-127632-2357-0&ssspo=8wteuw_otge&sssrc=4429486&ssuid=7SLFFgxaSbi&var=&widget_ver=artemis&media=COPY
     

    thanks

  4. Looks like the dev didn't add a thread to the Docker support area, so I'm going to start this thread.

     

    Space Invader One howto's

    part 1: A closer look at Immich before you switch youtube

    part 2: how to actually set it up youtube

     

    support at github for us unRaiders, the docker template in Community Applications
    read me first
    project home also at github https://immich.app/

    github v1.95.0 release notes

     

    I installed Spaceinvader1's Docker "PostgreSQL_Immich"

    You DO have to change the tensorchord Repository to "tensorchord/pgvecto-rs:pg16-v0.2.0"

     

    129814732_tensorcord2.02024-02-21163547.thumb.png.f272a23d019e4cde90fbdde8be61f998.png  1711445901_immichcontainersettings.thumb.png.673b71ba4b7ec84a32983b8024375d45.png

     

    I believe you have to setup the initial database. 

     

    Drop into the PostgreSQL_Immich Docker Command Line Interface CLI, left click on the docker image, select >_Console

    # psql -U postgres -W
    Password: 
    psql (15.5 (Debian 15.5-1.pgdg120+1))
    Type "help" for help.
    postgres=# CREATE USER immich WITH PASSWORD 'immichpass';
    CREATE ROLE
    postgres=# CREATE DATABASE immichdb TEMPLATE template0 ENCODING 'UNICODE';
    CREATE DATABASE
    postgres=# ALTER DATABASE immichdb OWNER TO immich;
    ALTER DATABASE
    postgres=# GRANT ALL PRIVILEGES ON DATABASE immichdb TO immich;
    GRANT
    postgres=# ALTER USER immich WITH SUPERUSER;
    ALTER ROLE
    postgres=#

    (*re SUPERUSER: i was getting the "earthdistance" error in immich logs, and that additional command seemed to sort that out)

     

    reverse proxy. cool, SWAG included a template for it!

    cd /mnt/user/appdata/swag/nginx/proxy-confs
    cp immich.subdomain.conf.sample immich.subdomain.conf
    nano immich.subdomain.conf

     

    couple of changes in here:

     

    this is your subdomain. I'm using photos.mydomain.com

    server_name immich.*;

    to

    server_name photos.*;

     

    this is the name of our docker. Mine's called "immich". This is in two spots in the file.

    set $upstream_app immich-server;

    to

    set $upstream_app immich;

     

    correct the port. I had to change mine to 8081. Also two places in the file.

    set $upstream_port 3001;

    to

    set $upstream_port 8080;

     

    There is some wizardry happening here. I'm sure it's supposed to be 8081. That's what I'm looking at when, locally, I hit the web GUI and it goes to http://192.168.11.54:8081/. BUT the SWAG .conf file has the 8081. In fact, if I go to http://192.168.11.54:8080, I get sabnzbd. <shrug>

     

    That should be it, you should be up and running.

     

    As immich is "under heavy development" you want to turn off auto-update so you don't discover a busted install randomly.

     

    Install Squid's "Auto Update Applications". This will enable:

    unraid gui > Settings > Auto update applications (scroll to bottom of page) > Docker auto update settings <tab>

    Turn off Immich Autoupdate.

     

    2027577319_Screenshot2024-03-08082549.png.32f0d0397837ac94063e261e9ae77b82.png

     

     

     

    BACKUP BACKUP BACKUP

    This is the first dive into IRRIPLACEABLE self-hosted files. If you use Immich, and it's got pics of your kid in it, that would be SUPER BUMMER if you lost your stuff (my github request). Here's my backup system:

     

    install CA > "user scripts" also from Squid

    This will enable unraid gui > Settings > User Scripts (scroll down)

     

    1087281565_Screenshot2024-03-08083802.thumb.png.0fc740b1a7ce5b31d19019b295a70a20.png

     

    alright! Here come these scripts:

    New script.

    Gear > Edit script

    This one is "backup postgresql DBs"

    #!/bin/bash
    
    ##############################
    ##        VARIABLES         ##
    ##############################
    DATE=$(date +"%Y-%m-%d.%H%M")
    BACKUP_DIR="/mnt/disks/TOSHIBA_EXTERNAL_USB/unraid-postgresql"
    EMAIL="[email protected]"
    
    # Perform the database backup
    docker exec -t PostgreSQL_Immich pg_dumpall -c -U postgres | gzip > $BACKUP_DIR/$DATE.PostgreSQL_Immich.sql.tar.gz
    
    # Rotate backups to keep the 7 most recent
    ls -t $BACKUP_DIR/*Immich.sql.tar.gz | tail -n +8 | xargs rm -f
    
    # Perform the database backup
    docker exec -t postgresql15 pg_dumpall -c -U postgres | gzip > $BACKUP_DIR/$DATE.postgresql15_nextcloud.sql.tar.gz
    
    # Rotate backups to keep the 7 most recent
    ls -t $BACKUP_DIR/*nextcloud.sql.tar.gz | tail -n +8 | xargs rm -f

     

    this one is called "immich"

    #!/bin/bash
    rsync -av --progress /mnt/user/memories/immich/library /mnt/disks/TOSHIBA_EXTERNAL_USB/immich
    rsync -av --progress /mnt/user/memories/immich/upload /mnt/disks/TOSHIBA_EXTERNAL_USB/immich
    rsync -av --progress /mnt/user/memories/immich/profile /mnt/disks/TOSHIBA_EXTERNAL_USB/immich

     

    The first one does a pg_dump from the immich database into a compressed .tar.gz file, that I like. I also like the date naming convention. Makes me feel good seeing all those dates in my file list. I copy this stuff to an external USB drive that I mount via Unassigned Devices.

     

    This is the source docs that are important

    https://immich.app/docs/administration/backup-and-restore

     

    The backup of the actual jpgs and mov files happens in the "immich" script via rsync, and just copies the stuff over to that external drive.

     

    In the future, I'm going to setup a syncthing with a buddy to copy EVERYTHING over to his server. Syncthing at unraid forums

     

    Also: do a dry run on a backup and restore. I've had to do this twice, and I hate it, but it happened with those breaking updates I referenced above. Good luck! Be safe. Profit.

     

     

     

     

     

     

     

     

    Below is old stuff. Might help someone who's in the weeds.

    ===========================================================================================

     

     

    Working now, here's my setup.

     

    installed docker "immich" ghcr.io/imagegenius/immich, imagegenius. Via regular unRaid APPS tab.

    Had to change default port from 8080 to 8081

     

    installed docker "postgresql14" library/postgres:14, jj9987

     

    installed docker "redis" library/redis, jj9987

     

    Setup SWAG reverse proxy

    remember to change "Network Type" on the immich Docker to whatever your proxy dockers use.

     

    created /mnt/user/appdata/swag/nginx/proxy-confs/immich.subdomain.conf

    Spoiler

    server {
        listen 443 ssl;
        listen [::]:443 ssl;

        server_name photos.*;

        include /config/nginx/ssl.conf;

        client_max_body_size 0;

        location / {
            include /config/nginx/proxy.conf;
            include /config/nginx/resolver.conf;
            set $upstream_app immich;
            set $upstream_port 8080;
            set $upstream_proto http;
            proxy_pass $upstream_proto://$upstream_app:$upstream_port;
        }

    For some reason this would only work pointing to 8080, vs the unraid-local-ip:8081 

    My subdomain is photos.mywebsite.com

    You also need to add "photos" or whatever your subdomain is gonna be, to the field in Docker SWAG Setup

     

    Importing the Google Takeout. I had 10 files at 50GB each. I extracted each of the zip files into the same folder. Windows combined the folders and files just fine. Did a couple test runs with a handful of folders to make sure it worked.

     

    I tried github simulot immich go, but it made way too many mis-dated imports. hundreds and hundreds of pics from year 0, or maybe it was year 36947... so I went along with github mattwilson1024 google photos exif. The trick here is that I'm on Windows 11, and can't run this stuff. So I installed Git For Windows. That gave me yarn from the cmd.exe command line. It also installed some other cli program, "git bash" and "git CMD," but I had the command yarn in the regular CLI after installing Git For Windows, so I just went with that.

     

    From the mattwilson git page, green Code button, download ZIP file. Unzipped that to the desktop, gave me files and folders.

     

    I created a couple more folders Desktop/processed, Desktop/failed, and the source was Desktop/takeout. Go into 

    C:\Users\user\Desktop\google-photos-exif-master

    ran "yarn". It did some stuff.

     

    then the longer command that started flying through all my stuff:

    yarn start --inputDir "C:\Users\user\Desktop\takeout" --outputDir "C:\Users\user\Desktop\processed" --errorDir "C:\Users\user\Desktop\error"

     

     

    1.thumb.png.e658220b0518b888b0aaa81f8d07e243.png

     

     

    I had 687 files in my error directory (143k in processed directory), only about 1/2% error rate. <meh>

    Following along with directions in the immich post here, I'll call it post 1340, I run exiftool (github) on the problem files in error directory. It's a perl program. Happily, perl came along with the MINGW64 git-hub for windows thingy.

     

    $ perl exiftool -all= -tagsfromfile @ -all:all -unsafe -icc_profile /d/error/

     

    Looks like most of the errors are from screenshots that saved as PNG but exiftool reports "Error: Not a valid PNG, looks more like a JPG" <shrug>

     

    I am a little concerned that all my albums will be gone. At the moment, all the files in d/processed have gone into that folder with zero subfolders at all. The immich post 1340 says I have to deal with all my albums first individually. Hmmmm, I hope the google-photos-exif mattwilson1024 tool did something and added some gallery meta data into the files... we'll see.

     

    hmmm

           1 directories scanned
        68 image files updated
      270 files weren't updated due to errors

     

    $ yarn start --inputDir "/d/error/" --outputDir "/d/processed2/" --errorDir "/d/error2/"

    nice! That went through nicely and ended up with:

    30 error files and their other weird data files. Mostly HEIC files.

    sorted another 347 files. Half videos looks like.

    Manually move those 347 into the /d/processed folder

     

    Move external drive to server.

     

    Something got borked with the postgres connection. The unRaid>Immich>logs are showing loads of failure to connect

    [Nest] 921  - 10/25/2023, 11:29:57 AM   ERROR [TypeOrmModule] Unable to connect to the database. Retrying (3)...
    error: password authentication failed for user "postgres"

     

    But: I get into the postgres container, and am able to connect via psql no problem. I'll try creating a different database, user and pass see if that helps. This database is already populated, and the error reporting might be dog shit (user auth error vs database full error)

     

    That worked. Got a few errors (watching log go by) about undefined request failed with HTTP code 503, but after less than a minute it sorted itself out.

     

    Start regular immich import for the whole kitten-caboodle.

     

    1991577225_Screenshot2023-10-25173324.png.83c03ea7fdfda7f3d58b64492d5fe11b.png

     

    badda bing

     

    This process loses all the albums. I forget where the details were for preserving albums. I think it's below in my "history stuff."

     

    Most important source is our unRaid github docker maintainer page https://github.com/imagegenius/docker-immich

     

     

     

     

     

     

     

     

     

     

    =====================history stuff below here========================

     

    Wiping current setup, starting from https://documentation.immich.app/docs/install/unraid

    already a couple of changes in there

    Editing /boot/config/plugins/compose.manager/projects/Immich/.env

    added DB_PORT=5432

    TYPESENSE_API_KEY=xxxxxxxxxxxx
    DB_PASSWORD=xxxxxxxxxxxx
    
    # The values below this line do not need to be changed
    ###################################################################################
    DB_HOSTNAME=xxx.xxx.xxx.xxx
    DB_USERNAME=xxxxxxxxxxxx
    DB_DATABASE_NAME=xxxxxxxxxxxx
    DB_PORT=5432

     

    Another question here: from the documentation.immich.app unraid stuff "if you're using an existing database docker click here..." I can do this without using an external Postgres14 docker??? Seems like that would be easier. Will it be as good/fast? From other installations that can use mysql, it's supposed to be faster to setup a mysql connection, otherwise it will use a flat-file or built in sql-express or something to organize itself but it's not supposed to be as good. And, follow up, how many thousands of entries will I have to have (entries = pics,vids) for it to be noticeable?

     

    Finished that piece, clicked Save Changes and Compose Up. My pop-up window went immediately to Connection Closed, and Done. I go to unRaid Docker page, and there's nothing in there. So much for several minutes depending on my hardware... hmmmm I do still see the Immich entry at the bottom of the Docker page under the Compose section, but it doesn't look like the picture.

     

    Going to try this again from defaults, and NOT using that external PostgreSQL container...

    there we go, now something is happening. I must've edited a file incorrectly.

     

    Now on unRaid Docker page I have "several entries," namely: 8 of them:

    1. immich_machine_learning

    2. immich_microservices

    3. immich_postgres

    4. immich_proxy

    5. immich_redis

    6. immich_server

    7. immich_typesense

    8. immich_web

     

     

     

     

    Immich docker requires PostgreSQL 14, I installed that docker with defaults (unraidstaticIP:5432). Must set password.

    requires REDIS, I already have that installed. Used defaults - though I have no idea what the password is, if I ever set one to connect to REDIS.

     

    Need to connect to Postgres database. Error message from Immich Log

    [Nest] 1002  - 10/06/2023, 9:50:14 AM   ERROR [TypeOrmModule] Unable to connect to the database. Retrying (3)...
    error: database "immich" does not exis

    So I supposed I'll have to connect myself, create database and username etc.

     

    click unraid GUI > Dashboard > Postgresql > commandline

     

    # psql -U postgres -W<enter>
    Password: 
    psql (14.9 (Debian 14.9-1.pgdg120+1))
    Type "help" for help.
    
    postgres=# create database immich;<enter>
    CREATE DATABASE
    postgres=# create user immuser with encrypted password 'thispass';<enter>
    CREATE ROLE
    postgres=# grant all privileges on database immich to immuser;<enter>
    GRANT
    postgres=# \q<enter>
    # exit<enter>

     

     

    you should have set password on your Docker Settings for postgreSQL 14

     

     

     

     

    Immich docker not quite running yet, getting weird error

    Quote

    [Nest] 2865  - 10/06/2023, 9:51:40 PM   ERROR [TypeOrmModule] Unable to connect to the database. Retrying (9)...
    QueryFailedError: relation "migrations" already exists

        at PostgresQueryRunner.query (/app/immich/server/node_modules/typeorm/driver/postgres/PostgresQueryRunner.js:211:19)
        at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
        at async PostgresQueryRunner.executeQueries (/app/immich/server/node_modules/typeorm/query-runner/BaseQueryRunner.js:424:13)
        at async PostgresQueryRunner.createTable (/app/immich/server/node_modules/typeorm/driver/postgres/PostgresQueryRunner.js:410:9)
        at async MigrationExecutor.createMigrationsTableIfNotExist (/app/immich/server/node_modules/typeorm/migration/MigrationExecutor.js:351:13)
        at async MigrationExecutor.executePendingMigrations (/app/immich/server/node_modules/typeorm/migration/MigrationExecutor.js:129:9)
        at async DataSource.runMigrations (/app/immich/server/node_modules/typeorm/data-source/DataSource.js:260:35)
        at async DataSource.initialize (/app/immich/server/node_modules/typeorm/data-source/DataSource.js:148:17)
    [Nest] 2865  - 10/06/2023, 9:51:40 PM   ERROR [ExceptionHandler] relation "migrations" already exists
    QueryFailedError: relation "migrations" already exists

    real similar to this

    https://github.com/nextcloud/docker/issues/1529#issuecomment-875552116

     

     

     

    SWAG proxy setup. There is no template for Immich, so I used /mnt/user/appdata/swag/nginx/proxy-confs/_template.subdomain.conf.sample

     

    created /mnt/user/appdata/swag/nginx/proxy-confs/immich.subdomain.conf

    * below, I had changed the Immich Docker template from 8080 to 8081, already had a service on 8080. I'm still getting a "welcome to your SWAG instance" boiler plate page, the Immich Docker isn't really up yet I think.

     

    server {
        listen 443 ssl http2;
        listen [::]:443 ssl http2;
    
        server_name immich.*;
    
        include /config/nginx/ssl.conf;
    
        client_max_body_size 0;
    	
    	location / {
    	    include /config/nginx/proxy.conf;
            include /config/nginx/resolver.conf;
            set $upstream_app immich;
            set $upstream_port 8081;
            set $upstream_proto https;
            proxy_pass $upstream_proto://$upstream_app:$upstream_port;
        }

     

     

     

    https://github.com/imagegenius/docker-immich

    https://immich.app/docs/install/unraid

    https://www.reddit.com/r/selfhosted/comments/x44qzi/immich_on_unraid/

     

     

     

     

    redis settings 2023-10-07 195722.png

    postgresql14 settings-192-168-11-53-Dashboard-UpdateContainer-2023-10-07-19_56_43.png

    immich settings-192-168-11-53-Dashboard-UpdateContainer-2023-10-07-19_54_28.png

    image.png

    Screenshot 2023-12-29 184258.png

    • Like 1
    • Thanks 1
  5. I have a bunch of stuff I really don't want to loose. Pictures, and files. What would be a simple way to keep another copy of the stuff? Incase I get drive corruption and end up with loads of <unknownfile.1> or the lost+found stuff.?

    How about 1 or 2 external (or internal?) hard drives that just mirror stuff? And what Docker would I use to handle that?

  6. Got a smart report that wasn't green. Is this hard drive dying? thanks!

     

     

    smartctl 7.3 2022-02-28 r5338 [x86_64-linux-6.1.38-Unraid] (local build)
    Copyright (C) 2002-22, Bruce Allen, Christian Franke, www.smartmontools.org
    
    === START OF INFORMATION SECTION ===
    Model Family:     Seagate BarraCuda 3.5 (SMR)
    Device Model:     ST8000DM004-2CX188
    Serial Number:    WCT02XA2
    LU WWN Device Id: 5 000c50 0aa8b48e1
    Firmware Version: 0001
    User Capacity:    8,001,563,222,016 bytes [8.00 TB]
    Sector Sizes:     512 bytes logical, 4096 bytes physical
    Rotation Rate:    5425 rpm
    Device is:        In smartctl database 7.3/5440
    ATA Version is:   ACS-3 T13/2161-D revision 5
    SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
    Local Time is:    Thu Aug 31 12:38:00 2023 PDT
    SMART support is: Available - device has SMART capability.
    SMART support is: Enabled
    AAM feature is:   Unavailable
    APM feature is:   Unavailable
    Rd look-ahead is: Enabled
    Write cache is:   Enabled
    DSN feature is:   Unavailable
    ATA Security is:  Disabled, NOT FROZEN [SEC1]
    Wt Cache Reorder: Unavailable
    
    === START OF READ SMART DATA SECTION ===
    SMART overall-health self-assessment test result: PASSED
    
    General SMART Values:
    Offline data collection status:  (0x82)	Offline data collection activity
    					was completed without error.
    					Auto Offline Data Collection: Enabled.
    Self-test execution status:      (   0)	The previous self-test routine completed
    					without error or no self-test has ever 
    					been run.
    Total time to complete Offline 
    data collection: 		(    0) seconds.
    Offline data collection
    capabilities: 			 (0x7b) SMART execute Offline immediate.
    					Auto Offline data collection on/off support.
    					Suspend Offline collection upon new
    					command.
    					Offline surface scan supported.
    					Self-test supported.
    					Conveyance Self-test supported.
    					Selective Self-test supported.
    SMART capabilities:            (0x0003)	Saves SMART data before entering
    					power-saving mode.
    					Supports SMART auto save timer.
    Error logging capability:        (0x01)	Error logging supported.
    					General Purpose Logging supported.
    Short self-test routine 
    recommended polling time: 	 (   1) minutes.
    Extended self-test routine
    recommended polling time: 	 ( 957) minutes.
    Conveyance self-test routine
    recommended polling time: 	 (   2) minutes.
    SCT capabilities: 	       (0x30a5)	SCT Status supported.
    					SCT Data Table supported.
    
    SMART Attributes Data Structure revision number: 10
    Vendor Specific SMART Attributes with Thresholds:
    ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
      1 Raw_Read_Error_Rate     POSR--   079   057   006    -    78677104
      3 Spin_Up_Time            PO----   091   091   000    -    0
      4 Start_Stop_Count        -O--CK   100   100   020    -    124
      5 Reallocated_Sector_Ct   PO--CK   100   100   010    -    0
      7 Seek_Error_Rate         POSR--   093   060   045    -    1786659013
      9 Power_On_Hours          -O--CK   041   041   000    -    51888h+54m+57.822s
     10 Spin_Retry_Count        PO--C-   100   100   097    -    0
     12 Power_Cycle_Count       -O--CK   100   100   020    -    110
    183 Runtime_Bad_Block       -O--CK   100   100   000    -    0
    184 End-to-End_Error        -O--CK   100   100   099    -    0
    187 Reported_Uncorrect      -O--CK   100   100   000    -    0
    188 Command_Timeout         -O--CK   100   099   000    -    0 0 2
    189 High_Fly_Writes         -O-RCK   100   100   000    -    0
    190 Airflow_Temperature_Cel -O---K   067   050   040    -    33 (Min/Max 28/42)
    191 G-Sense_Error_Rate      -O--CK   100   100   000    -    0
    192 Power-Off_Retract_Count -O--CK   100   100   000    -    1285
    193 Load_Cycle_Count        -O--CK   083   083   000    -    34085
    194 Temperature_Celsius     -O---K   033   050   000    -    33 (0 11 0 0 0)
    195 Hardware_ECC_Recovered  -O-RC-   079   064   000    -    78677104
    197 Current_Pending_Sector  -O--C-   100   100   000    -    0
    198 Offline_Uncorrectable   ----C-   100   100   000    -    0
    199 UDMA_CRC_Error_Count    -OSRCK   200   192   000    -    11
    240 Head_Flying_Hours       ------   100   253   000    -    42340h+46m+51.869s
    241 Total_LBAs_Written      ------   100   253   000    -    73097535729
    242 Total_LBAs_Read         ------   100   253   000    -    1677000598822
                                ||||||_ K auto-keep
                                |||||__ C event count
                                ||||___ R error rate
                                |||____ S speed/performance
                                ||_____ O updated online
                                |______ P prefailure warning
    
    General Purpose Log Directory Version 1
    SMART           Log Directory Version 1 [multi-sector log support]
    Address    Access  R/W   Size  Description
    0x00       GPL,SL  R/O      1  Log Directory
    0x01           SL  R/O      1  Summary SMART error log
    0x02           SL  R/O      5  Comprehensive SMART error log
    0x03       GPL     R/O      5  Ext. Comprehensive SMART error log
    0x04       GPL,SL  R/O      8  Device Statistics log
    0x06           SL  R/O      1  SMART self-test log
    0x07       GPL     R/O      1  Extended self-test log
    0x08       GPL     R/O      2  Power Conditions log
    0x09           SL  R/W      1  Selective self-test log
    0x0c       GPL     R/O   2048  Pending Defects log
    0x10       GPL     R/O      1  NCQ Command Error log
    0x11       GPL     R/O      1  SATA Phy Event Counters log
    0x21       GPL     R/O      1  Write stream error log
    0x22       GPL     R/O      1  Read stream error log
    0x24       GPL     R/O    512  Current Device Internal Status Data log
    0x30       GPL,SL  R/O      9  IDENTIFY DEVICE data log
    0x80-0x9f  GPL,SL  R/W     16  Host vendor specific log
    0xa1       GPL,SL  VS      24  Device vendor specific log
    0xa2       GPL     VS    8160  Device vendor specific log
    0xa6       GPL     VS     192  Device vendor specific log
    0xa8-0xa9  GPL,SL  VS     136  Device vendor specific log
    0xab       GPL     VS       1  Device vendor specific log
    0xb0       GPL     VS    9048  Device vendor specific log
    0xbe-0xbf  GPL     VS   65535  Device vendor specific log
    0xc0       GPL,SL  VS       1  Device vendor specific log
    0xc1       GPL,SL  VS      16  Device vendor specific log
    0xc3       GPL,SL  VS       8  Device vendor specific log
    0xc4       GPL,SL  VS      24  Device vendor specific log
    0xd1       GPL     VS     264  Device vendor specific log
    0xd3       GPL     VS    1920  Device vendor specific log
    0xe0       GPL,SL  R/W      1  SCT Command/Status
    0xe1       GPL,SL  R/W      1  SCT Data Transfer
    
    SMART Extended Comprehensive Error Log Version: 1 (5 sectors)
    No Errors Logged
    
    SMART Extended Self-test Log Version: 1 (1 sectors)
    No self-tests have been logged.  [To run self-tests, use: smartctl -t]
    
    SMART Selective self-test log data structure revision number 1
     SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
        1        0        0  Not_testing
        2        0        0  Not_testing
        3        0        0  Not_testing
        4        0        0  Not_testing
        5        0        0  Not_testing
    Selective self-test flags (0x0):
      After scanning selected spans, do NOT read-scan remainder of disk.
    If Selective self-test is pending on power-up, resume after 0 minute delay.
    
    SCT Status Version:                  3
    SCT Version (vendor specific):       522 (0x020a)
    Device State:                        Active (0)
    Current Temperature:                    33 Celsius
    Power Cycle Min/Max Temperature:     28/42 Celsius
    Lifetime    Min/Max Temperature:     11/50 Celsius
    Under/Over Temperature Limit Count:   0/0
    
    SCT Temperature History Version:     2
    Temperature Sampling Period:         3 minutes
    Temperature Logging Interval:        59 minutes
    Min/Max recommended Temperature:     14/55 Celsius
    Min/Max Temperature Limit:           10/60 Celsius
    Temperature History Size (Index):    128 (108)
    
    Index    Estimated Time   Temperature Celsius
     109    2023-08-26 06:55    34  ***************
     110    2023-08-26 07:54    35  ****************
     111    2023-08-26 08:53    34  ***************
     112    2023-08-26 09:52    34  ***************
     113    2023-08-26 10:51    33  **************
     114    2023-08-26 11:50    33  **************
     115    2023-08-26 12:49    34  ***************
     116    2023-08-26 13:48    34  ***************
     117    2023-08-26 14:47    35  ****************
     118    2023-08-26 15:46    35  ****************
     119    2023-08-26 16:45    35  ****************
     120    2023-08-26 17:44    36  *****************
     121    2023-08-26 18:43    36  *****************
     122    2023-08-26 19:42    37  ******************
     ...    ..(  7 skipped).    ..  ******************
       2    2023-08-27 03:34    37  ******************
       3    2023-08-27 04:33    36  *****************
       4    2023-08-27 05:32    35  ****************
       5    2023-08-27 06:31    36  *****************
       6    2023-08-27 07:30    35  ****************
       7    2023-08-27 08:29    34  ***************
     ...    ..(  2 skipped).    ..  ***************
      10    2023-08-27 11:26    34  ***************
      11    2023-08-27 12:25    35  ****************
     ...    ..(  4 skipped).    ..  ****************
      16    2023-08-27 17:20    35  ****************
      17    2023-08-27 18:19    36  *****************
      18    2023-08-27 19:18    36  *****************
      19    2023-08-27 20:17    36  *****************
      20    2023-08-27 21:16    37  ******************
     ...    ..(  2 skipped).    ..  ******************
      23    2023-08-28 00:13    37  ******************
      24    2023-08-28 01:12    36  *****************
     ...    ..(  4 skipped).    ..  *****************
      29    2023-08-28 06:07    36  *****************
      30    2023-08-28 07:06    35  ****************
      31    2023-08-28 08:05    35  ****************
      32    2023-08-28 09:04    36  *****************
      33    2023-08-28 10:03    36  *****************
      34    2023-08-28 11:02    35  ****************
     ...    ..(  2 skipped).    ..  ****************
      37    2023-08-28 13:59    35  ****************
      38    2023-08-28 14:58    34  ***************
      39    2023-08-28 15:57    35  ****************
     ...    ..(  9 skipped).    ..  ****************
      49    2023-08-29 01:47    35  ****************
      50    2023-08-29 02:46    34  ***************
      51    2023-08-29 03:45    34  ***************
      52    2023-08-29 04:44    34  ***************
      53    2023-08-29 05:43    35  ****************
      54    2023-08-29 06:42    34  ***************
      55    2023-08-29 07:41    34  ***************
      56    2023-08-29 08:40    34  ***************
      57    2023-08-29 09:39    33  **************
     ...    ..( 12 skipped).    ..  **************
      70    2023-08-29 22:26    33  **************
      71    2023-08-29 23:25    34  ***************
      72    2023-08-30 00:24    33  **************
     ...    ..(  4 skipped).    ..  **************
      77    2023-08-30 05:19    33  **************
      78    2023-08-30 06:18    32  *************
      79    2023-08-30 07:17    32  *************
      80    2023-08-30 08:16    33  **************
     ...    ..(  2 skipped).    ..  **************
      83    2023-08-30 11:13    33  **************
      84    2023-08-30 12:12    34  ***************
     ...    ..(  6 skipped).    ..  ***************
      91    2023-08-30 19:05    34  ***************
      92    2023-08-30 20:04    35  ****************
      93    2023-08-30 21:03    35  ****************
      94    2023-08-30 22:02    35  ****************
      95    2023-08-30 23:01    34  ***************
     ...    ..(  6 skipped).    ..  ***************
     102    2023-08-31 05:54    34  ***************
     103    2023-08-31 06:53    33  **************
     ...    ..(  4 skipped).    ..  **************
     108    2023-08-31 11:48    33  **************
    
    SCT Error Recovery Control command not supported
    
    Device Statistics (GP Log 0x04)
    Page  Offset Size        Value Flags Description
    0x01  =====  =               =  ===  == General Statistics (rev 1) ==
    0x01  0x008  4             110  ---  Lifetime Power-On Resets
    0x01  0x010  4           51888  ---  Power-on Hours
    0x01  0x018  6     73097593968  ---  Logical Sectors Written
    0x01  0x020  6       171869828  ---  Number of Write Commands
    0x01  0x028  6   1677139020043  ---  Logical Sectors Read
    0x01  0x030  6      2360625388  ---  Number of Read Commands
    0x01  0x038  6               -  ---  Date and Time TimeStamp
    0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
    0x03  0x008  4           51672  ---  Spindle Motor Power-on Hours
    0x03  0x010  4            1178  ---  Head Flying Hours
    0x03  0x018  4           34085  ---  Head Load Events
    0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
    0x03  0x028  4               0  ---  Read Recovery Attempts
    0x03  0x030  4               0  ---  Number of Mechanical Start Failures
    0x03  0x038  4               0  ---  Number of Realloc. Candidate Logical Sectors
    0x03  0x040  4            1285  ---  Number of High Priority Unload Events
    0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
    0x04  0x008  4               2  ---  Number of Reported Uncorrectable Errors
    0x04  0x010  4               3  ---  Resets Between Cmd Acceptance and Completion
    0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
    0x05  0x008  1              33  ---  Current Temperature
    0x05  0x010  1              33  ---  Average Short Term Temperature
    0x05  0x018  1              34  ---  Average Long Term Temperature
    0x05  0x020  1              46  ---  Highest Temperature
    0x05  0x028  1               0  ---  Lowest Temperature
    0x05  0x030  1              44  ---  Highest Average Short Term Temperature
    0x05  0x038  1              17  ---  Lowest Average Short Term Temperature
    0x05  0x040  1              37  ---  Highest Average Long Term Temperature
    0x05  0x048  1              19  ---  Lowest Average Long Term Temperature
    0x05  0x050  4               0  ---  Time in Over-Temperature
    0x05  0x058  1              55  ---  Specified Maximum Operating Temperature
    0x05  0x060  4             420  ---  Time in Under-Temperature
    0x05  0x068  1              13  ---  Specified Minimum Operating Temperature
    0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
    0x06  0x008  4             397  ---  Number of Hardware Resets
    0x06  0x010  4             149  ---  Number of ASR Events
    0x06  0x018  4              11  ---  Number of Interface CRC Errors
                                    |||_ C monitored condition met
                                    ||__ D supports DSN
                                    |___ N normalized value
    
    Pending Defects log (GP Log 0x0c)
    No Defects Logged
    
    SATA Phy Event Counters (GP Log 0x11)
    ID      Size     Value  Description
    0x000a  2            8  Device-to-host register FISes sent due to a COMRESET
    0x0001  2            0  Command failed due to ICRC error
    0x0003  2            0  R_ERR response for device-to-host data FIS
    0x0004  2            0  R_ERR response for host-to-device data FIS
    0x0006  2            0  R_ERR response for device-to-host non-data FIS
    0x0007  2            0  R_ERR response for host-to-device non-data FIS

     

    rubble-diagnostics-20230831-1239.zip

  7. 5 hours ago, tampano said:

    Not sure if the place is relevant (where if not?). I'm happily using the Binhex Minecraft server on my Unraid machine. The question is: is there a way to manage multiple worlds? Not simultaneously, but I'd like to change which world is handled by the server. Does it make sense?

    Check out Crafty 4 for one Docker multiple worlds 

  8. @scytherbladez the reddit comment below looked pretty helpful for repairing databases. But as you said you rolled back and it's working again.

    My setup:

    Repository: lscr.io/linuxserver/plex

    then in the Plex UX: Settings > General: Version 1.32.1.6999

     

    Ah there are the versions you're talking about, github.

    https://github.com/linuxserver/docker-plex

    Releases 1.32.1.6999-91e1e2e2c-ls167

     

    But if going from one version to a newer breaks it, there still may be something going on with only your database. Are you going to stay on ls163 from here on out?

     

    How about nuking and rebuilding? The most annoying part about that is losing the watched/unwatched statuses; but it would probably get you back up and running.

     

     

     

     

  9. 7 minutes ago, wgstarks said:

    copy the appdata folder to the new location preserving all attributes and change your docker’s appdata config to point to the new plex folder it should work

    I was thinking this yes. In what manner should I add this extra cache drive to array (mark it as not included or something)? Or leave as unassigned device?

  10. Swapped out some memory, moved a couple of the stick from server into my desktop and ran memtest86 last night. Still going in the morning! Good grief. But apparently enough to tell: FAIL. haha, love the font and schtick of this usb bootable test.

     

    I can't tell if this is both sticks or ram, or one of them: which one? Not that I wouldn't want a pair, but for selling them, I should know.

     

    https://www.memtest86.com/troubleshooting.htm

    looks like I just Chuck em both. Or I’ll sell them as FAIL memory. <shrug>
     

    I’m so happy I found a smoking gun. 

     

     

     

    IMG_2775.JPG

    IMG_2776.JPG

    IMG_2777.JPG

    MemTest86-Report-20230408-235658.html

  11. Got this wrapped up, and finished and we're all good. Seems to be back up and running AOK. The backup, format, and restore was a bit stressful. My Plex library had to get rolled back a couple days - I don't remember setting that backup up <shrug> thank goodness it worked out. Ed's video here walked me through those steps.

    This project is done.

    I will setup weekly CA Backups V2, and keep an occasional eye on the logs for more errors.

    Thank you very much @JorgeB !

     

     

     

    • Like 1
  12. @couzin2000 hmmm looks like you can specify large Java versions. Third (?) sticky post on this thread talks about Java versions at the binhex documentation here

    https://github.com/binhex/documentation/blob/master/docker/faq/minecraftserver.md

     

    does any of that help?

     

    I moved on to Crafty 4 where you can host multiple servers at once, and use any Java version you like. I think. It’s been a year or so since I’ve messed with it. 

    • Thanks 1
  13. I didn't see the format option for assigning the xfs/btrfs drive.

    Found it. Click on the blue "Cache" then you can select the format of the drive. For me I changed it to XFS, hit Apply, Done, Start Array. Format all unmountable disks. Stop array, change format back to btrfs, format it, copy the goods back. My Unassigned Devices drive wasn't coming up default because I had to re MOUNT the drive. Then it came up and I used the following command to get it all back <fingers crossed>:

     

    rsync --progress -avzh /mnt/disks/6VM78N1T/cache-drive-thurs/ /mnt/cache/

     

    Takes me about 45 minutes to copy over 7GB of uncompressed files.

     

    no format option.png

×
×
  • Create New...