sonofdbn

Members
  • Posts

    485
  • Joined

  • Last visited

Posts posted by sonofdbn

  1. I'm with @Sissy on this. For a long time I used an adapter to run the flashdrive off a USB header on the motherboard, so it was of course inside the case. Was quite happy until one day the flashdrive died. Then I had to open up the server to replace the drive. Much as I love my Fractal Design R5, for me the glass side panel is incredibly difficult to align (too much flex) and closing it up while it's vertical involves a bit of non-techie thumping.

     

    (I could place the server on its side, where replacing the panel is a bit easier, but my SATA cables seem to be quite sensitive, so didn't want to do that. Also, with 10 hard drives, it's not a trivial matter to move the server around.)

     

    I had to test a few times to find out whether the problem was with the flash drive or the adapter - I think in the end it was indeed a dying flash drive. But after that I thought I might as well just stick the flash drive into one of the USB ports on top of the case. At the very least there would be no worrying about whether the adapter was working.

     

    No one else comes near the server, and in my (untidy) situation, there are some many other things that are more likely to be dislodged or knocked over (ethernet cables, UPS cables, network switches and their power cords, etc.)

     

    One possible additional advantage to mounting the flashdrive externally, admittedly not tested yet, is that it might be useful if I have a dualboot server. On my other server, I have Win11 installed on an NVME drive that is passed through to a VM. Usually unRAID runs on the server and I access Win11 via the VM. The BIOS boot order is unRAID first, then the Win11 drive.

     

    A week or so ago, I managed to mess up the VM (I think when I tried to run WSL2) and could only access Windows by booting into the NVME drive directly. This meant fiddling with the BIOS to change boot device order so that I could boot directly into Windows, trying a Windows fix, and then resetting the boot order to go back to unRAID to test whether the VM was working. This had to repeated every time the fix didn't work, and I ended up having to do this a few times.

     

    I think that if I had had the flash drive mounted externally, I could simply have removed it, so that when the BIOS couldn't find it, it would boot into the next item, the Windows NVME drive. After that I could just plug in the flash drive again to boot into unRAID.

     

    Haven't tested this out because there hasn't been any reason to open up the case (another R5) to move the internally mounted flash drive).

     

    I'm sure there's a better alternative boot process involving GRUB or something similar, but I haven't looked into that.

     

     

     

    • Like 1
  2. This morning I found my server (6.12.6) had hung: couldn't access the GUI or the shares. IPMI showed an unRAID screen with a field for user name, but I couldn't type anything into the field, even using the virtual keyboard.

     

    In the end I had to reboot, so there was the dreaded unclean shutdown, and now parity-check is running.

     

    Don't think I've done anything drastic, although over the last few weeks fiddling with docker container access I switched from ipvlan back to macvlan and vice versa a couple of times, but the server has been running fine (on macvlan without any further changes) for at least a week.

     

    Hoping someone can make sense of the diagnostics and tell me what caused the problem.

    tower-diagnostics-20240224-0945.zip

  3. I like saving money as much as anyone else, but where I am, the current Pro licence is roughly the cost of an 8TB hard drive. If I want to avoid subscription/extension fees and go for a new Pro/Lifetime licence, I'm guessing it will cost less than a 16TB hard drive (I currently have four in one array, two in another).

     

    Of course unRAID isn't perfect (I absolutely hate the clickfest Alerts/Warnings/Notices system in the GUI), not all my queries here get answered and I will never understand the difference between macvlans and ipvlans, but me and unRAID have come a long way since I wrestled with PATA drives and thought a 400GB drive was huge.

     

    I was going to say I'm not a fanboi, but actually I think I am 😀

    • Upvote 1
  4. 11 hours ago, _cjd_ said:

    Firefox.

    .... It's even my browser of choice on my (android) phones/tablets... I love being able to sync tabs across devices...

     

    Specifically re Firefox on Android on a tablet: when I use FF there is no tab bar, which I find makes it almost unusable. I did try an extension, but it could display tabs only on the bottom. Am I missing a setting?

     

    I'd love to be able to use FF on the tablet so that it can sync with my PC.

     

    11 hours ago, _cjd_ said:

    I have never had issues with Unraid and Firefox, across a bunch of different systems. Maybe other bits of the system matter? W11, AMD CPU and GPU for the most common uses, but I do have a W10/intel ultrabook (10yrs old now and struggling)...

    First thing I recommend is double checking extensions when something goes wonky.

     

    I've seen occasional advice about not using FF with the unRAID GUI. Here's one I managed to dig up:

     

     

    In practice I've been using FF almost all the time with no problems, but have just kept in mind that if there's an unRAID GUI related issue it might be a FF issue.

  5. Today Firefox (latest version) decided to show black screens. Only the FF windows; Vivaldi is fine. Turns out I had to turn off hardware acceleration, so that fixes it, but why? What's changed? Certainly not my hardware. And I haven't updated FF since last night when it was working fine.

     

    But yes, the password savers/managers are great. If only FF didn't insist on positioning password options right over the dropdown box where I need to select something on the airline website.

     

    It's really ridiculous that I have to choose a browser depending on which website I want to go to. I exaggerate, of course, but only a little.

  6. On 2/9/2024 at 2:46 AM, Aran said:

    There are plenty of options if you just want to backup your files to/with unraid but if you need an AIO solution then i suggest you take a look at paid subscriptions.

     

    Did you ever look at Synology Photos? A long time ago I used the old DS Photo (?) from Synology. It wasn't a good experience, but at first glance Synology Photos looks quite nice. While I do think that Synology hardware is over-priced, if you can make good use of their software the price is much more palatable. unRAID is much more flexible of course, but as this thread shows, we could do with better apps in some areas.

  7. I'm on 6.12.6 and am trying out virtual-dsm. It seems a little different from other docker containers: it's essentially DSM running in a VM, installed as a container. I've got it set up using custom network br0, which is a macvlan, but I don't know how to get Swag/Letsencrypt set up to allow me to reverse proxy to it.

     

    For example, if the container sits at 192.168.1.100, how do I get mydomain.duckdns.org to point to that IP address? Swag doesn't have a template for virtual-dsm, so I've tried various templates, but no joy.

  8. On 2/13/2024 at 4:26 AM, Vetteman said:

    Have any users here had similar  experiences with btrfs on their Pool Devices? I have other Pool Devices on my two Unraid servers formated as btrfs and I am now a bit concerned about having this issue reoccur.

     

    I tried out btrfs on a cache pool some years back - maybe 5 years? Not sure if cache pool is the right term - basically I had two duplicate SSDs in a RAID-1 type arrangement - this was before unRAID allowed multiple cache pools, I think. I followed the official setup process, so no weird customisation involved.

     

    I ran into some problems with the filesystem and spent some time trying to fix it with help from this forum. I can't remember whether I was actually able to fix things, but whatever the outcome I do recall that my impression at the time was that it was just too risky for me to continue with btrfs. So I went back to a single cache drive on xfs and have never used btrfs since then. In fact I might have done what you did and reformatted the drives as xfs. (Unfortunately I can't find the thread now - but it's long outdated.)

     

    I do believe that btrfs has matured since then and should be better. And it does seem that lots of people use it quite happily. My understanding is that at one time if you wanted redundancy/RAID 1 type protection on any pool device (in effect duplicating the pool drive), you had to use btrfs; xfs didn't support this. Perhaps these days you can do it with zfs, but that's too complicated for me.

     

    For me, one important and sometimes overlooked feature of any data protection policy is that the user must have a high degree of confidence in the system. Whether this confidence is subjective, justified, etc. is in some ways immaterial. You want to be able to rest easy. I just couldn't trust btrfs after my experience with it, but I do accept that it's perfectly fine for others.

    • Like 1
  9. I'm finding it surprisingly difficult to settle on one browser to handle my needs, which I don't think are overly demanding. One thing I really want is vertical tabs - with current monitor aspect ratios I would much rather have my tabs using up the width rather than the height. Admittedly some of my other prejudices are largely subjective, but here's a brief summary:

     

    Chrome

    Don't entirely trust Google (and yes, my phone is an Android phone), but it's more the sneaky things they seem to try with privacy settings. The one thing where Chrome is really good is its auto-translate. Other browsers do it, but not so seamlessly.

     

    Edge

    Can't abide the constant pushing of Edge and Microsoft services.

     

    Firefox

    My current main browser. Quite nice, but doesn't play nicely with unRAID sometimes (maybe this has changed?). Also, although it doesn't offer vertical tabs natively, the Tree Style Tab extension is good. It has the unfortunate quirk of occasionally opening a tab in a new window when I click on the tab - don't know if it's the extension or Firefox or my mouse-clicking ability - so I end up having to drag the tab back to the original window. Not a big deal, but happens often enough to be mildly annoying. Firefox also has this truly frustrating habit of popping up its password suggestions right over the part where you need to see or select an item. I travel reasonably frequently and when I try to pay for my air ticket it throws up password suggestions right on top of the dropdown box where I have to choose a credit card, so I can't see any of the credit cards listed.

     

    Vivaldi

    Previously my go-to browser, largely because it has native vertical tabs. (It might be the only browser with this feature.) But over the past year or so there have been additions that seem to get in the way (like Workspaces), and I get odd behaviour. Right now, it won't launch - probably need to reboot my PC. When it was the default browser it wouldn't open links, and on some websites it won't download files. Sometimes tabs go missing in the tab bar, although they're still active.

     

    On the Vivaldi forums I always read that it must be because of extensions, but I don't think I have anything too weird: Ublock Origin, Bitwarden, Google Translate mainly. Vivaldi also has this annoying habit of resetting the address bar spacing and the search engine when it updates (no way I would have selected Bing as the default search engine.)

     

    Others

    - Opera: used it way back when it was the new kid on the block, but when I looked at it recently it seemed to have some odd marketing gumph and it didn't seem to be worth trying to work through it.

    - Safari: does it still exist for Windows?

    - DuckDuckGo: nice idea in terms of privacy, but I found it klunky and didn't pursue further.

    - Bravo: never tried

     

    So currently I use Firefox on my main PC, with Vivaldi as a fallback (and for booking plane flights and unRAID). Annoyingly I also have to use Edge because some corporate thing only seems to work with Edge. I also end up having to use Vivaldi on my tablet because Firefox Android doesn't think people need tabs. So syncing my browsing is essentially impossible. I end up sending links to myself or via Joplin.

     

    I sort of miss the (perhaps not so) good old days when it was either Internet Explorer or Netscape Navigator.

     

    I don't test out browsers frequently, so some of my points might be out of date. And I'm sure there must be ways of dealing with the various irritations, but it's rarely intuitive or easy. (For example, try adjusting the spacing on Vivaldi's address bar.)

     

    All of this makes me think that I might surrender to our Google overlords and just use Chrome on everything. Resistance is proving to be quite futile at the moment.

  10. I managed to install a container (virtual-dsm) and it seems to be running fine. Now I'd like to set up a reverse proxy to the container via Swag. There's no prebuilt nginx config file, but I'm happy to fiddle around with this.

     

    Is there anything different about a docker container installed in the "normal" unRAID way (download from Community Apps and click install) vs a container installed via docker compose manager? Particularly anything that might affect what needs to be done for a reverse proxy?

     

    (I'm not well-versed in linux, docker containers or reverse proxying.)

  11. @Cirion Would be interested to hear your experiences with Immichh if you go ahead. I tried out the docker a few months ago, and it seemed quite good, but it missed a few photos on importing. Back then and possibly still now, the author of the software warned that it was under heavy development, and I found that after an update some things were broken and some significant reinstallation was needed. Since I need something that was stable and reliable for the family to use, I didn't continue with Immichh.

     

    It does seem like a great solution, but I'm going to wait until it's a bit more settled.

  12. I do have SMART warning on 6 out of the other 9 disks, but they are all UDMA CRC Error count warnings. I suppose it sounds bad, but from what I've read, this type of error is usually an indication of a loose wiring connection and the system has had to rely on this error correction to ensure that the data being read/written is correct. (For casual readers, please don't assume this is correct - it's just my impression from reading.)

     

    Generally these error counts don't change unless I've opened up the case and replaced a hard disk or perhaps during a parity check. So I assume vibration or movement has loosened something. But after a few warnings the error count doesn't increase. I've taken a look at the various SATA connectors and can't see anything obviously wrong.

     

    So now I just ignore the errors unless the error count increases consistently. (My server runs 24x7.) Think this might have happened once or twice, but not recently. And I think I "fixed" it by jiggling SATA connectors or just swapping them.

  13. On 1/24/2024 at 4:15 AM, Holaf said:

    i'll have a look at it ...
    I dont use Kohya so I admit I didn't do a lot of tests with it 😅

     

    I'd be interested to know if anyone else has Kohya running successfully in the docker.

     

    I ended up going back to running everything natively in my Win11 VM, largely because I don't know enough to go into the docker and do all the fiddling around that the various packages always seem to require.

     

    But while I can natively run Automatic1111 and ComfyUI, native (Windows) Kohya constantly gives me problems. I've only been able to run it successfully under Pinokio.

  14. I have an 8TB disk which has reported 93 read errors during a (now paused) parity check. I have a 16TB pre-cleared disk on hand to replace it. Can I just cancel the parity check and replace the 8TB disk with the larger one? (My dual parity drives are 16TB).

     

    I think the answer is "yes", but just want to check in case I mess up something.

  15. So I did a little test: stopped docker containers and VM. Set the graphics card in the VM to the Nvidia card (no VFIO binding) and then booted up the VM.

     

    It seemed to be running but I couldn't connect via RDP. So I thought about stopping the Nvidia plug-in. At that point I thought it might be a good idea to see what the the Nvidia plug-in is meant to do, and went to the support thread. I didn't understand everything, but in the first post there was this warning:

     

    "Please be sure to never use one card for a VM and also in docker containers (your server will hard lock if it's used in a VM and then something wants to use it in a Container)."

     

    Looks like my idea is horribly risky, so I've abandoned it.

  16. 4 hours ago, Linguafoeda said:

     

    I just tried the native RDP client and its much speedier / snappier than anydesk, which is awesome! The only issue remaining is i don't know how to connect remotely with RDP when im not on the local LAN (i can't install a VPN on devices like my work PC which accesses the VM), so i will have to use the slower Anydesk for that

     

    Have you tried Guacamole? Don't know if it's fast enough for your purposes and whether it will do everything you want, but I found it OK and very easy to set up. (But in the end I went with Tailscale because I had other devices that I wanted to connect to in a consistent way.) Have never tried Parsec, so can't compare.

    • Like 1
  17. In my server I have an RTX 4070 graphics card, which is used by some of my docker containers. I also have a Win11 VM which just uses the default Virtual graphics card. The graphics card is not bound to VFIO, and I have the nVidia plug-in installed (which I understand is needed for the docker containers to use the GPU).

     

    I understand that I can't have the VM and the containers using the GPU at the same time (that would of course be ideal). As the next best alternative, I'd like to be able to switch the usage between VM and containers as needed. What I envisage is, say, starting the server with the docker containers active and able to access the GPU. Then, if I want to use the VM with GPU access, I would shut down the containers and then start up the VM. If I then want to go back to using the containers, I shut down the VM and start the containers.

     

    My thinking is that in order to be able to do this, I have to assign the GPU to the VM, but not bind the GPU to VFIO. Is there anything else I need to do? For example, would I also have to enable/disable the nVidia plug-in each time?

     

    (I know this sort of question has been asked quite a few times. I've read various threads about GPU passthrough, but most seemed to assume this also meant VFIO binding - maybe "passthrough" does, but I wasn't sure. Also, any mention of the nVidia plug-in seemed to refer to older versions.)

     

    On the risk side, assuming I can do this switching, what happens if I forget to shutdown the VM/containers and run them simultaneously? Will there just be no response or will something crash?

  18. I tried a few more things: I installed FaceFusion in a separate container, but using the same /config folder. It worked fine, with ComfyUI running as well.

     

    I tried reinstalling Kohya again, separate container, same /config, but got the same endless loop.

     

    I installed Kohya again, but this time in a different /config folder (/mnt/user/appdata/kohya instead of /mnt/user/appdata/stable-diffusion for the others). Installation went smoothly, I saw the Torch bit looking OK in the log after the nVidia toolkit was detected:

     

    23:32:46-955597 INFO     Version: v22.5.0                                       
                                                                                    
    23:32:46-959892 INFO     nVidia toolkit detected                                
    23:32:50-012332 INFO     Torch 2.1.2+cu121                                      
    23:32:50-016632 INFO     Torch backend: nVidia CUDA 12.1 cuDNN 8902             
    23:32:50-026714 INFO     Torch detected GPU: NVIDIA GeForce RTX 4070 VRAM 12009 
                             Arch (8, 9) Cores 46                                   
    23:32:50-027610 INFO     Verifying modules installation status from             
                             /config/70-kohya/kohya_ss/requirements_linux.txt...    
    23:32:50-028561 INFO     Installing package: xformers==0.0.21                   
                             bitsandbytes==0.41.1    

     

    The GUI came up fine (I didn't run anything). Then I shut down the container and restarted. This time I was back in the endless loop, with the same "Could not load torch" error as before, and no GUI. A partial log is attached.

    Kohya_log_2.txt

  19. 4 hours ago, Holaf said:

    @sonofdbn If you want to run multiples UI at the same time you have to run multiples containers.
    But those containers can point at the same folder on unraid (eg /mnt/user/appdata/stable-diffusion)

     

    So now I've installed Kohya in a separate container, but using the same folder /mnt/user/appdata/stable-diffusion for /config. As expected, I ended up with a 70-kohya sub-folder there, along with my existing 05-comfy-ui folder.

     

    On initial launch it seemed OK; the interface (assigned to port 9070; ComfyUI is on 9000) came up fine, but I didn't run anything. But when I restarted after adding some paths to the template for the outputs and model folders, it went into a loop in the log file and the web UI never came up.

     

    I thought it might be a problem with ComyUI running at the same time, so I stopped CUI and then restarted Kohya, but there was again an endless loop of messages in the log file. I couldn't find it saved anywhere, but I grabbed what I could from the log after I stopped the container. That's in the attachment.

     

    I saw the log (but keep in mind I'm not a Python person) that "library" is installing and uninstalling, and I don't know whether the hyphen makes a difference.

     

    The log also says there's no venv folder, but I do have a venv folder under 70-kohya.

     

    However, ComfyUI still runs OK. I'll try installing maybe FaceFusion or A1111 in another container and see how that goes.

    Kohya_log.txt