Kosti

OK, long time no see, so I fired up UNRAID, updated, parity checks containers updated and got it up to date as its been offline due to a rookie mistake sometime back under this thread HERE I have really been able to get things running smoothly, just seems some things are broken, even some cron jobs I had don't work again, but that's another story. My currently problem is launching WEBGUI from a Docker container it doesn't complete the IP address and while I have tried to use all sorts of options in network type such as Bridged, Custom Network, Br0, no matter it just seems to not open the GUI either no IP address or will not open at all depending on which option I use for network. Under Management Options I can see the IP address as well as a name.local as the local access URLs. The Unraid server is on the same VLAN and the machine I am using to accessing it and open up a webGUI, this is the result in the photos. I have changed my home LAN network considerably with new routers, Firewall rules, based on ubiquiti gear, so I suspect something on my network is preventing things from talking to each other, especially within the UNRAID enviroment, most likely how I have setup my home network and VLANS but nothing stands out. When I try nslookup, it does resolves the name, same with dig command, from IP to name, but not name to IP in the reverse via dig -x, so not sure if that's a FW rule preventing it or my DHCP / DNS is misbehaving? On my UDM SE I have firewall rules for interVLAN blocked and I have added the TLD names in Unraid to assist, but it seems something else is going on. If I open the link as shown in the image and then add the IP address of the Unraid server manually, the WEBGUI fires up and work as normal. But if I close the WEBGUI, try again I have to manually add in the IP's. Note that I have Zone Base Firewall rules to allow access to things like Jellyfin and these work fine from various TVs and devices. I have not tried static IP address yet, or trying to add a hostname file on the boot USB of UNRAID just not sure if that is even possible, however I figured if I am on the same VLAN the FW rules shouldn't apply, but I'm guessing its something to do with my ZBF rules on the UDM SE? I'm looking for some options and idea's as right now going to try a setup Wireshark but have limited knowledge on using this tool, figured I'd ask here to see if anyone has had similar challenges

Never mind, Im an idiot!!! I simply booted up, removed from pool, added it back, picked btrfs and not zfs encryption this time and formatted again once I restarted the array. Now I noticed where there passphrase comes in, by choosing zfs encryption Now I will go ahead and attempt to rebuild my docker and reset the servers tasks Thank you @JorgeB and apologies for wasting your time...I'm a noob! and was being thrown off by not thinking straight and should've just kept it simple

Just to clarify I do not need to recover I just need to format in order to start again since I have forgotten my passphrase, so not sure if this has any relevance to the procedure, but will boot up the server and find UFS explorer Can I confirm if I should format the cache drive while in unraid GUI or outside unraid?

Thank you for suggesting this @JorgeB , there use to be a ddrescue or similar app under the nerd pack. I am at a loss as to why the format of the cache drive has resulting this is being in an unknown state I will give the UFS Explorer a go tonight and provide an update Cheers Kosti

Ok I have tried to format the cache drive and it still shows up as LURKS FS and unmountable Is this because this was zfs encrypted? /dev/nvme1n1p1: UUID="xxxxxxxx-xxxx-xxxx-xxxx-fxxxxxx" TYPE="crypto_LUKS Do I need to run some sort of disc rescue?

Just circling back here, Is there a guide on how to recover from a cache storage forced format given folders are intact on the shares and backup folders showing zero bytes? Do I need to start from scratch? If starting from scratch how should I clean up the old directories of docker containers etc without leaving behind junk? Does formatting filesystems to ZFS as single drives offer anything other than capabilities for snapshots or keep this as xfs & btrfs and work on improving the script of backing up to external drive? Would love a nudge in the right direction Cheers Kosti

So a new year and time to revisit my unraid server that has been shutdown for over a year due to forgetting my passkey PW for the array to startup. My original thread is HERE I tried to go back to a previous build but that had no affect on the PW and the array staying offline. Only option was to choose a format. The cache drive is since I forgot the PW was the only encryption drive as I had changed the format of the cache drive from XFS to ZFS so I could do snap shots. But something happened and it asked for my passphrase and I've been stuck since. Now 2025 I plan to just format the cache drive and start the array. I can see all my shares and folders are accessible with the exception of the docker and vm filesystems as these all resided on the cache drive which is now waiting to be formatted and the GUI shows it as FS:LURKS unmountable wrong filesystem. All apps and folders and addons are visible and accessible and while I had a backup it appears even the backup script was not doing what I thought it was doing - more on that later. My ASK Once I format the cache drive, I assume I will I need to reconfigure every docker container that I had and used from scratch even if the folders are on the designated drives? While Im at it, I plan on changing what the server is used for as in the past it ran jellyfin, but nowadays its just easier to stream from services anything I feel like watching and 1080p is fine for me and the family with no real demand for the hoards of movies I acquired over the years. I plan on adding a suitable apple Time Machine storage for multiple MACS and add home assistant and a few small dockers. Really need to good tool for photos on our apple phones too. Lancache is a must at my place too As for VM's, I may try my hand at running an arcade emulation and see if I can make use of the 2080 GPU sitting in the server doing nothing like a Minecraft server or a CS:GO for the kids play, not really sure what sort of grunt I will need to make that work.. Now for my backup script I tried to use the option for when I inserted a UBD drive to back up the files of selected folders and directories and used this thread HERE I am not sure what went wrong as my external HDD 20TB HDD has all the shares backed up and can be access all files except the backup of the cache drive as all files show 0 bytes which I assume is possibly due to it being ZFS and or encrypted or both? Not sure as I also had a backup of my unraid USB stick too and that also is 0 bytes..meh! Next ASK ZFS, I do like the idea of snapshots, do I reformat all drives as single raid 1 ZFS drives just to have this feature, what are people doing as my NAS is simple all the same drives 12TB x 4 with 1 parity and 1 cache Im running 7.0.0 and ready to format, I usually base my configurations and builds using ibracorp and space invader tutorials

OK, thanks guys, I am going to attempt to downgrade and see what happens as either way I am locked out due to making the passphrase in the first place, should've stuck with dumbo 123! Only encryption done is the cache drive, no other drive and that I changed the cache drive from XFS to ZFS Will be a good test, but when I get a chance to turn it on, I am going to give this a try as potentially only the cache drive will need reformatting

Sorry been stuck with work and no time to play with the server as its been shutdown since I can't bring up the array. so one more question before I close this out as resolved Can I revert to my previous unraid version of 6.9 and will this resolve my passphrase issue? Is there a way I can restore to this from a back up of the USB as I went from 6.9.2-->6.14 but I am pretty sure I backed up the USB and most of the unraid before I went to a newer version of unraid I know its a long shot but just maybe I can trick the system, the only issue I can see is maybe the cache drive went from XFS to ZFS encryption, damn it I just don't want to reinstall everything Now looking at Bitwardern or similar to manage my PW since my grey matter is failing me - I'm such an idiot !

Spewing really didn't want to rebuild it - damn Im such an idiot

Thanks, how many times can I keep trying to guess it?

So I had a power outage and server rebooted only to find the array stopped due to missing key. I do not recall the passphrase I used sometime back when I converted my cache drive to zfs when 6.12.4 was released Am I shit out of luck to reset the key? Being the cache drive is the only zfs formate file system is there a simple recovery method? The permit reformat - will that destroy all the content of the 4 x 12TB & Parity drives? I do have a backup to an external 20TB drive mainly the folders that I wanted to backup, not sure if it included dockers or the USB drive on that backup. If I remove the cache from the array & format it will it bring me back to the same place with a missing key or is the encryption across the whole array? Only the cache drive is formatted as ZFS and for some reason I'd chosen encryption just not sure if its only on this cache drive and I can get the array started again? What Options are available for stupidity?

Quick update, as mover just finished however only a few folders "moved" and some stayed on the disks for example Domain Isos System |->Docker |->Libvirt These above folders are empty folders but were not created either on the cache nvme with the exception of the System folders? But mover did not delete folders when it moves the docker& livirt, Does mover not create empty directories and remove them from the current drive? Should I move Domains & isos manually to the cache drive and delete the System folder from the disk? Also in the appdata folder from the disk shows 20 folders but move function only moved 17, All folders remained in disk as well, should I manually move them? I have not started the VMs or Docker at present just not sure if I need to manually move them and clean up the disks manually or I've broken something I also see my ZFS memory is at 99% full

Thanks for the tips! Even though there was no duplications it wouldn't migrate files with the move function, so I manually moved these folders from cache to disk (x) then formatted the nvme to ZFS encrypted and set the move function from array-->cache and ran mover. Now the files are being moved off the array and onto cache via the move function. However I think I did break something as I did delete a folder that was empty for my backups as I have a modified script to backup too external USB using rsync but this now fails rsync: [sender] change_dir "/mnt/user/backups#342#200#235#012/mnt/user" failed: No such file or directory (2) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1336) [sender=3.2.7] true Not sure how to fix this up? does it matter who executes the script either root or use?

Quick question, Sorry if it doesn't belong here but Im wanting to ZFS my cache name drive and tried to move everything off the cache to the array but mover doesn't fire up? Have cache-->array for the following' appsdata isos domains system I've even stopped the docker and VM libvert etc still doesn't move, now I can only assume it doesn't overwrite existing same files or copies of the same folder, so they are either duplicates or I stuffed up somewhere Is it safe to delete these if they exist on the array and move them later after I reformat the cache drive to zfs or just leave it as btrfs?

Hey All Just want to thanks the UNRAID team and LT Family as I finally made the leap of faith from 6.92-->6.12.4 with no really issues detected in the logs. I performed the usual steps of backing up the flash drive, backed up my folders to an external 20TB HDD, updated all apps and plugins, stopped docker, VMs and the array then proceeded with the update process. Once rebooted, the array restarted and I enabled the docker and VM's again. Love the GUI, and ZFS, but I do not know if I will convert my xfs to zfs even though all my drive sizes are the same and since my unraid server is just a basic NAS with some docker stuff, it all went smoothly. While snap shots are good my external Rclone backup seems to do the trick for now. I did loose my Docker Folders, so I see I need to remove the old plugin and grab the new folder view plugin, I assume it will not retain my old structure but that gives me something to do while I play around, my previous 6.9.2 was up for about 70days without any issues from my last reboot due to a power failure, I really need to get new batteries for my UPS.. Thank you again, and I do hope those having issues are solved quickly PEACE Kosti

Greta, thanks Yep seems its detected [2023-07-26 21:18:04,801]::[InvokeAI]::INFO --> InvokeAI version 3.0.0[0m [2023-07-26 21:18:04,801]::[InvokeAI]::INFO --> Root directory = /home/invokeuser/userfiles[0m [2023-07-26 21:18:04,801]::[InvokeAI]::DEBUG --> Internet connectivity is True[0m [2023-07-26 21:18:05,101]::[InvokeAI]::DEBUG --> Config file=/home/invokeuser/userfiles/configs/models.yaml[0m [2023-07-26 21:18:05,101]::[InvokeAI]::INFO --> GPU device = cuda NVIDIA GeForce RTX 2070[0m [2023-07-26 21:18:05,101]::[InvokeAI]::DEBUG --> Maximum RAM cache size: 6.0 GiB[0m [2023-07-26 21:18:05,104]::[InvokeAI]::INFO --> Scanning /home/invokeuser/userfiles/models for new models[0m [2023-07-26 21:18:05,303]::[InvokeAI]::INFO --> Scanned 0 files and directories, imported 0 models[0m [2023-07-26 21:18:05,303]::[InvokeAI]::INFO --> Model manager service initialized[0m O[0m: Application startup complete.

Hey Buddy Just wanted to say thank you for creating this! I have just installed as per your guide although for a while I couldn't figure out why my docker was filling up but after a few spaceinvader docker videos (this guy is a rock star) I was able to complete the install and launch the container..Woot Woot! I haven't generated anything yet, just wondering how to confirm the GPU is being used as I have an Nvidia GeForce RTX 2070 GPU Also are there any good guides for using prompts including negative prompts and which model to use, as I am a total noob so still finding my way around. Again thank you for this ! PEACE Kosti

Hey All Sorry this is an old thread, but I was setting up the back up script with email notifications, but I couldn't get gmail working as "Less secure app access" is no longer supported by Google, and I don't want to use 2FA at the moment on the email account. Is there an alternative to getting email notifications via SMTP as I tried outlook mail but this also failed for me. TIA PEACE Kosti

Hey All, I know this is an old thread, however I want to back up the entire share content of my unraid server to a USB disk. Can I use copy and paste to use this script by @Tracker and just modify the directory's folder names right, do I need to name my unassigned drive to HDDBackup Backup to match this line in the above script logger Unmounting Ext. HDDBackup Backup -t $PROG_NAME Let me know PEACE Kosti

I will need to confirm, again, thanks for the heads up buddy! Phew, checked the FS and all XFS on my data drives and cache drives using btrfs OK I kicked off a new pre clear it's about 50% in no major concerns so far only a few temp alerts reaching 46 Deg C..Fingers crossed

OK, so perhaps I should uninstall this plugin and use Unassigned Devices Preclear as mentioned in the top of the page..facepalm to self.. Is the error related to the plugin and the drive is ok, will remove the old one run the new plugin and come back in about 20+ hrs PEACE Kosti

Damn, its been ages since I touched anything with Unraid since I initially set it up and added the pre clear under the tools - disk utilities Apologies for the noobness, I assume I am out of date with the tool and perhaps this is the cause and maybe using depreciated apps? How can I confirm, EDIT - I believe its from gfjardim Also have a warning or attention stating Checked my Unraid Version 6.9.2 2021-04-07 Hope this helps PEACE Kosti

Wow, its been a while, So I ran a pre clear on a 20TB just delivered from Amazon, but some error, not sure if its the drive or something within my setup as I also had a parity check running at the same time I kicked off the pre clear. Here is a log from pre clear icon, as I only ran 1 pass, how do I dig deeper to find out the cause? May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 9534201+0 records out May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 19994668695552 bytes (20 TB, 18 TiB) copied, 97922.6 s, 204 MB/s May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 9534916+0 records in May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 9534915+0 records out May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 19996166062080 bytes (20 TB, 18 TiB) copied, 97935 s, 204 MB/s May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 9535610+0 records in May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 9535609+0 records out May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 19997621485568 bytes (20 TB, 18 TiB) copied, 97947.3 s, 204 MB/s May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 9536316+0 records in May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 9536315+0 records out May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 19999102074880 bytes (20 TB, 18 TiB) copied, 97959.6 s, 204 MB/s May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 9537012+0 records in May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 9537011+0 records out May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 20000561692672 bytes (20 TB, 18 TiB) copied, 97971.9 s, 204 MB/s May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 9537023+1 records in May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 9537023+1 records out May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-Read: dd output: 20000588955136 bytes (20 TB, 18 TiB) copied, 97972.1 s, 204 MB/s May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: Pre-read: pre-read verification failed! May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: S.M.A.R.T.: Error: May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: S.M.A.R.T.: May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: S.M.A.R.T.: ATTRIBUTE INITIAL NOW STATUS May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: S.M.A.R.T.: Reallocated_Sector_Ct 0 0 - May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: S.M.A.R.T.: Power_On_Hours 0 27 Up 27 May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: S.M.A.R.T.: Reported_Uncorrect 0 0 - May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: S.M.A.R.T.: Airflow_Temperature_Cel 26 51 Up 25 May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: S.M.A.R.T.: Current_Pending_Sector 0 0 - May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: S.M.A.R.T.: Offline_Uncorrectable 0 0 - May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: S.M.A.R.T.: UDMA_CRC_Error_Count 0 0 - May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: S.M.A.R.T.: SMART overall-health self-assessment test result: PASSED May 02 19:30:38 preclear_disk_ZVT8CP1P_23673: error encountered, exiting... Not sure what other info is needed, pls let me know if there is something I need tp worry about or re run the pre clear now that the parity check has finished. PEACE Kosti

OK, success! Although perhaps my issue was with the "file name" as the way I copied it, was through Krusader in a docker to move the file however when I looked at it with MC Midnight Commander, it had ._au-syd.prod.surfshark_openvpn_udp.ovpn So after I edited the file I created a new one name au-syd_surfshark_openvpn_udp.ovpn and moved "remote" and qbittorrent is now working...Yeah! However some errors in log file what I was hoping to confirm how to resolve, in particular the last line Options error.. 2022-01-24 08:23:29,552 DEBG 'start-script' stdout output:
[info] Starting OpenVPN (non daemonised)...

2022-01-24 08:23:29,738 DEBG 'start-script' stdout output: 2022-01-24 08:23:29 DEPRECATED OPTION: --cipher set to 'AES-256-CBC' but missing in --data-ciphers (AES-256-GCM:AES-128-GCM). Future OpenVPN version will ignore --cipher for cipher negotiations. Add 'AES-256-CBC' to --data-ciphers or change --cipher 'AES-256-CBC' to --data-ciphers-fallback 'AES-256-CBC' to silence this warning. 2022-01-24 08:23:29,738 DEBG 'start-script' stdout output: 2022-01-24 08:23:29 WARNING: file 'credentials.conf' is group or others accessible 2022-01-24 08:23:29,738 DEBG 'start-script' stdout output: 2022-01-24 08:23:29 WARNING: --ping should normally be used with --ping-restart or --ping-exit 2022-01-24 08:23:29,818 DEBG 'start-script' stdout output: 2022-01-24 08:23:29 WARNING: 'link-mtu' is used inconsistently, local='link-mtu 1633', remote='link-mtu 1581' 2022-01-24 08:23:29 WARNING: 'auth' is used inconsistently, local='auth SHA512', remote='auth [null-digest]' 

2022-01-24 08:23:30 Options error: Unrecognized option or missing or extra parameter(s) in [PUSH-OPTIONS]:7: block-outside-dns (2.5.5)

 Also one more basic question, do I need to open these ports on my home ISP router (6881) previously I've not needed to do this but I assume I do however I do not need these open 8118, 8585) right Cheers Kosti