Jump to content

modem7

Members
  • Posts

    20
  • Joined

  • Last visited

Posts posted by modem7

  1. Hey guys, 

     

    Seemingly overnight, I seem to be having some issues with samba mounts on a few of my Ubuntu servers connected to UNRAID. 

     

    Setup is Proxmox, both UNRAID and the Ubuntu VMs are on the same hypervisor, and has been working flawlessly until tonight.

    image.png.5b61e3dfcd2371f879fe6473f071dd37.png

    image.thumb.png.d7f6d92803cace8f56580584c662cbe9.png

     

    Getting the following on console logs on one of the Ubuntu VM (similar errors on the others):

    image.thumb.png.d316761c3cb7342bcd1ad1712a2a5d83.png

     

    fstab is:

     

    LABEL=cloudimg-rootfs                  /                      ext4    discard,errors=remount-ro            0 1
    LABEL=UEFI                             /boot/efi              vfat    umask=0077                           0 1
    
    #tmpfs                                  /dev/shm/docker        tmpfs   defaults,uid=alex,gid=users,size=120G 0 0
    tmpfs                                  /dev/shm/plex          tmpfs   defaults,uid=alex,gid=docker,size=20G 0 0
    tmpfs                                  /dev/shm/backup        tmpfs   defaults,uid=alex,gid=docker,size=20G 0 0
    #tmpfs                                  /dev/shm/sab           tmpfs   defaults,uid=alex,gid=users,size=60G 0 0
    #tmpfs                                  /dev/shm/tdarr         tmpfs   defaults,uid=alex,gid=users,size=40G 0 0
    #tmpfs                                  /mnt/backup            tmpfs   defaults,uid=alex,gid=users,size=20g 0 0
    
    //192.168.50.111/docker                /mnt/docker            cifs    vers=3.11,uid=alex,gid=docker,noserverino,nobrl,hard,_netdev,mfsymlinks,iocharset=utf8,x-systemd.automount,credentials=/home/alex/.smb_credentials
    //192.168.50.111/media                 /mnt/media             cifs    vers=3.11,uid=alex,gid=docker,noserverino,nobrl,hard,_netdev,mfsymlinks,iocharset=utf8,x-systemd.automount,credentials=/home/alex/.smb_credentials
    #//192.168.50.111/plexbackup           /mnt/plexbak            cifs    vers=3.11,uid=alex,gid=users,noserverino,nobrl,hard,_netdev,mfsymlinks,iocharset=utf8,x-systemd.automount,credentials=/home/alex/.smb_credentials
    #//192.168.50.111/projects             /mnt/projects           cifs    vers=3.11,uid=alex,gid=users,noserverino,nobrl,hard,_netdev,mfsymlinks,iocharset=utf8,x-systemd.automount,credentials=/home/alex/.smb_credentials
    //192.168.50.111/oldhd                 /mnt/oldhd             cifs    vers=3.11,uid=alex,gid=users,noserverino,nobrl,hard,_netdev,mfsymlinks,iocharset=utf8,x-systemd.automount,credentials=/home/alex/.smb_credentials
    //192.168.50.111/downloads             /mnt/downloads         cifs    vers=3.11,uid=alex,gid=users,noserverino,nobrl,hard,_netdev,mfsymlinks,iocharset=utf8,x-systemd.automount,credentials=/home/alex/.smb_credentials
    //192.168.50.111/projectsbackup        /mnt/gitbackup         cifs    vers=3.11,uid=alex,gid=users,noserverino,nobrl,hard,_netdev,mfsymlinks,iocharset=utf8,x-systemd.automount,credentials=/home/alex/.smb_credentials
    //192.168.50.111/transcode             /mnt/transcode         cifs    vers=3.11,uid=alex,gid=docker,noserverino,nobrl,hard,_netdev,mfsymlinks,iocharset=utf8,x-systemd.automount,credentials=/home/alex/.smb_credentials
    //192.168.50.111/sabnzbd               /mnt/sabnzbd           cifs    vers=3.11,uid=alex,gid=docker,noserverino,nobrl,hard,_netdev,mfsymlinks,iocharset=utf8,x-systemd.automount,credentials=/home/alex/.smb_credentials
    //192.168.50.111/docker_data           /mnt/docker_data       cifs    vers=3.11,uid=alex,gid=docker,noserverino,nobrl,hard,_netdev,mfsymlinks,iocharset=utf8,x-systemd.automount,credentials=/home/alex/.smb_credentials

     

    Not quite sure where the error may be in this case, any assistance would be great. 

     

    There doesn't *seem* to be any issues with the Windows machine connected to the shares.

     

    Intermittently, the Ubuntu VM seems to show:

    ls: cannot access '/mnt/oldhd': Host is down
    ls: cannot access '/mnt/media': Host is down
     

    image.thumb.png.6cfeb69d62dd6d9db8a8a8206c5b5f42.png

    tower-diagnostics-20240410-0244.zip

  2. On 9/12/2023 at 12:32 PM, 2TC said:

     When I boot up my server I get the following error in the output of the screen

    mv: cannot stat '/usr/local/bin/mover': No such file or directory

     

    it is not really an issue, I searched the web and I found this post talking about this and the addon "move tuning plugin", which I assume is "CA Mover Tuning". The post talks about deleting the plugin. Now I do not have an issue with the server not starting, just that the entry is there.

     

    I looked at the '/usr/loval/bin/mover' which is a shell script

    #!/bin/bash
    PPPID=`ps h -o ppid= $PPID 2>/dev/null`
    P_COMMAND=`ps h -o %c $PPPID 2>/dev/null`
    /usr/local/emhttp/plugins/ca.mover.tuning/mover.php $P_COMMAND $1

     

    I looked at the file mentioned, and the mover.php file is where it is supposed to be, seems everything is working as intended, except that I get the error when booting it, surely I could just ignore it. But I rather fix it than leave it there.

     

    I'm also getting this error. 

     

    Not quite sure if I should be concerned about it or not.

  3. Hey guys, 

     

    Has anyone managed to successfully install and apply a tuned-adm profile in Unraid? Or are people mostly just using PowerTop instead?

     

    Not quite sure how to go about it as it's not a local install, so not quite sure how to install custom packages.

     

    Cheers!

  4. On 10/20/2022 at 4:13 PM, mavrrick said:

    I know this is a old thread, but wanted to put another solution in here I found for my WD drive that were not enabling cache. Here is the source for this method.

     

    Unable to activate write caching on several drives - WD Internal Drives / Desktop & Mobile Drives - WD Community

     

    The basic idea of it is to use this command first to enable the ATA command on the controller. Update /dev/sdg to your correct drive though.

     

     

     

    Then once that is submited and comes back showing 

     

    Then you can submit the hdparm command to enable write cache as stated earlier in this thread. 

     

    I know this is a necro, but thank you very much @mavrrick - this resolved my issue!

     

    Sincerely appreciated!

  5. 7 hours ago, JorgeB said:

    I moved you previous thread to the Virtualizing Unraid forum, since that's the correct place for it, going to merge this there.

    Thank you! 

     

    I deleted the old thread (or at least thought I had) as the question changed as I had figured a few things out. This thread at least focuses the question purely on Samba. 

  6. Hey guys,

     

    Got a potentially unsupported question, but one people may be able to assist with:

     

    I'm running Unraid in Proxmox as a VM, alongside another Ubuntu VM for my services etc.

     

    I've mounted the shares in Windows, but if I do a share to share transfer, for some reason they're going via the workstation rather than via the unraid server (so unraid > workstation > unraid) causing quite slow file transfers.

     

    I'd expect that a share to share transfer would be done internally on the server rather than using the workstation as the middleman.

     

    tower-diagnostics-20230419-1239.zip

  7. Things got weirder - after you posted the question, I had a check on other files, and they were absolutely fine....Just the one .env file.

    I've recreated it, and now it all seems bloody fine. -.-

    Let's consider this resolved as an ID10T issue with a dose of "huh?" - if it's just that one file, I honestly couldn't give a rat's hoohah! I should have checked before I posted - blame lack of sleep.

  8. Hey guys, 

     

    I know there's a 1000 different topics surrounding this, but yet to find a solution:

     

    Scenario: 

    New unRAID server

    Transferring files from old (Ubuntu based) server using rsync

    Created SMB shares (private)

    Set fstab to mount shares

     

    I'm currently unable to edit the current data within those shares inside Ubuntu. Windows (10) works. 

    root@Tower:/mnt/user/docker/HDA# smbstatus --resolve-uids
    
    Samba version 4.17.3
    PID     Username     Group        Machine                                   Protocol Version  Encryption           Signing
    ----------------------------------------------------------------------------------------------------------------------------------------
    28353   alex         users        192.168.0.251 (ipv4:192.168.0.251:47268)  SMB3_11           -                    partial(AES-128-CMAC)
    1617    alex         users        192.168.50.254 (ipv4:192.168.50.254:37140) SMB3_00           -                    partial(AES-128-CMAC)
    19130   alex         users        192.168.50.104 (ipv4:192.168.50.104:39458) SMB3_00           -                    partial(AES-128-CMAC)
    28354   alex         users        192.168.0.250 (ipv4:192.168.0.250:34312)  SMB3_11           -                    partial(AES-128-CMAC)
    13314   alex         users        192.168.0.100 (ipv4:192.168.0.100:33598)  SMB3_11           -                    partial(AES-128-CMAC)
    1616    alex         users        192.168.50.254 (ipv4:192.168.50.254:37142) SMB3_00           -                    partial(AES-128-CMAC)
    18964   alex         users        192.168.50.105 (ipv4:192.168.50.105:43408) SMB3_00           -                    partial(AES-128-CMAC)
    
    Service      pid     Machine       Connected at                     Encryption   Signing
    ---------------------------------------------------------------------------------------------
    IPC$         1617    192.168.50.254 Sun Apr  9 10:39:52 PM 2023 BST  -            -
    IPC$         19130   192.168.50.104 Sun Apr  9 10:08:27 PM 2023 BST  -            -
    IPC$         18964   192.168.50.105 Sun Apr  9 10:08:18 PM 2023 BST  -            -
    docker       1616    192.168.50.254 Sun Apr  9 10:39:52 PM 2023 BST  -            -
    projects     13314   192.168.0.100 Sun Apr  9 10:00:01 PM 2023 BST  -            -
    IPC$         1616    192.168.50.254 Sun Apr  9 10:39:52 PM 2023 BST  -            -
    docker       13314   192.168.0.100 Sun Apr  9 10:03:57 PM 2023 BST  -            -
    downloads    13314   192.168.0.100 Sun Apr  9 10:03:57 PM 2023 BST  -            -
    docker       19130   192.168.50.104 Sun Apr  9 10:08:27 PM 2023 BST  -            -
    proxmox      28353   192.168.0.251 Sun Apr  9 09:42:19 PM 2023 BST  -            -
    IPC$         28354   192.168.0.250 Sun Apr  9 09:42:18 PM 2023 BST  -            -
    desktopcontent 13314   192.168.0.100 Sun Apr  9 10:03:57 PM 2023 BST  -            -
    media        13314   192.168.0.100 Sun Apr  9 10:02:28 PM 2023 BST  -            -
    docker       18964   192.168.50.105 Sun Apr  9 10:08:18 PM 2023 BST  -            -
    oldhd        13314   192.168.0.100 Sun Apr  9 09:48:11 PM 2023 BST  -            -
    IPC$         28353   192.168.0.251 Sun Apr  9 09:42:19 PM 2023 BST  -            -
    proxmox      28354   192.168.0.250 Sun Apr  9 09:42:18 PM 2023 BST  -            -
    media        1617    192.168.50.254 Sun Apr  9 10:39:52 PM 2023 BST  -            -
    
    
    Locked files:
    Pid          User(ID)   DenyMode   Access      R/W        Oplock           SharePath   Name   Time
    --------------------------------------------------------------------------------------------------
    13314        alex       DENY_ALL   0x100080    RDONLY     NONE             /mnt/user/oldhd   .   Sun Apr  9 22:03:57 2023
    13314        alex       DENY_NONE  0x100081    RDONLY     NONE             /mnt/user/docker   .   Sun Apr  9 22:12:45 2023
    13314        alex       DENY_NONE  0x100081    RDONLY     NONE             /mnt/user/docker   .   Sun Apr  9 22:04:05 2023
    13314        alex       DENY_NONE  0x100081    RDONLY     NONE             /mnt/user/docker   .   Sun Apr  9 22:04:05 2023
    1616         alex       DENY_NONE  0x120089    RDONLY     LEASE(RWH)       /mnt/user/docker   .git/objects/pack/pack-b4d0ba1b6aeae7aafd9414def746bb1283cd19e2.idx   Sun Apr  9 22:40:43 2023
    13314        alex       DENY_NONE  0x100080    RDONLY     NONE             /mnt/user/projects   .   Sun Apr  9 22:02:31 2023
    1616         alex       DENY_NONE  0x120089    RDONLY     LEASE(RWH)       /mnt/user/docker   .git/objects/pack/pack-b4d0ba1b6aeae7aafd9414def746bb1283cd19e2.pack   Sun Apr  9 22:40:43 2023
    13314        alex       DENY_ALL   0x100080    RDONLY     NONE             /mnt/user/downloads   .   Sun Apr  9 22:03:57 2023
    13314        alex       DENY_ALL   0x100080    RDONLY     NONE             /mnt/user/desktopcontent   .   Sun Apr  9 22:03:56 2023

     

     

    ls -la
    total 184
    drwxr-xr-x 2 alex users      0 Apr  9 22:47  .
    drwxr-xr-x 2 alex users      0 Apr  9 22:40  ..
    -rwxr-xr-x 1 alex users   1346 Apr  7 11:51  borgmatic.restore.yml
    drwxr-xr-x 2 alex users      0 Apr  8 05:37  .cache
    -rwxr-xr-x 1 alex users  22455 Apr  7 11:51  compose.dot
    drwxr-xr-x 2 alex users      0 Apr  8 05:37 'Conf Files'
    -rwxr-xr-x 1 alex users    721 Apr  7 11:51  docker.code-workspace
    -rwxr-xr-x 1 alex users  15643 Apr  7 11:51  docker-compose-public-consumption.yml
    -rwxr-xr-x 1 alex users 109614 Apr  7 11:51  docker-compose.yml
    -rwxr-xr-x 1 alex users    628 Apr  7 11:51  Docker-viz.txt
    -rwxr-xr-x 1 alex users  15101 Apr  7 11:51  .env
    -rwxr-xr-x 1 alex users    544 Apr  7 11:51 'netdata docker nvidia.txt'
    -rwxr-xr-x 1 alex users      0 Apr  9 22:47  test.txt
    drwxr-xr-x 2 alex users      0 Apr  8 05:37  .vscode
    -rwxr-xr-x 1 alex users    148 Apr  7 11:51  yt-dlp.txt

     

    Troubleshooting steps:

    Able to see all files inside folder.

    Tried on separate Windows box. Successful

    Ran newperms /mnt/user/docker/ - No change

    Tried mounting using uid and gid - No change (//192.168.50.111/media  /mnt/media  cifs vers=3.0,uid=alex,gid=users,credentials=/home/alex/.smb_credentials)

    Tried creating new file - successful

    Tried editing new file - successful

     

     

    If I run newperms on the new file, I get nobody:users on unraid, and I'm able to edit on the Ubuntu box with no issues. 

     

    This seems to be an issue with existing files that have been rsynced, not an issue with Samba/Unraid/Ubuntu(fstab) config.

    My rsync command was: rsync -avP /mnt/disks/Z2K9R3BT/gh/TV /mnt/user/media/

     

    No idea why it'd work in Windows, but not in Linux.

     

    Unsure where to go from here! Linux permissions are definitely not my forte.

  9. 36 minutes ago, willmx said:


    If I go this route, using Unraid purely for its NAS capabilities without running anything in docker and using the Ubuntu VM for docker instead, is there any point at all in having cache pools in Unraid?

     

    I have run multiple Proxmox servers for several years and am familiar with all of the ins and outs, and I currently run a bunch of docker containers in an Ubuntu VM on two different Proxmox hosts.

     

    But I’m completely new to Unraid and attracted to its NAS functionality since I’ve found myself in a position with a bunch of mixed drives.


    So I plan on doing HBA passthrough and then sharing via SMB/NFS the Unraid shares with one or more Linux VMs in Proxmox. There’s no reason to run docker in Unraid for my use case, as I prefer my existing docker compose setup and will be setting up a K8s lab in the Linux VMs as well.

     

    I suppose I won’t need cache pools in Unraid, right?

     

    Are there any tips and tricks surrounding the NICs in the VMs? To get virtual 10GbE between them, maybe adjust the MTU as well?

     

    I will also be accessing the Unraid SMB/NFS shares from other hosts on my mixed 1/2.5/10 GbE LAN.

    The way I'll be doing it is:

     

    2-3x Cache pools. 

    1x for usenet downloads (which then gets moved by *arr to the appropriate shares which won't be cached) 

    1x for Plex DB (btrfs mirrored set to cache only) 

    1x (maybe) for scratch. 

     

    If I can get away with keeping everything on the array (+ cache) rather than some things on a VM, I will. But the reality is I'm in the same boat as yourself atm, so I'm playing with options and preparing the infrastructure design. 

  10. 1 hour ago, dodgypast said:

    I got it working pretty well.

     

    It doesn't seem like passing hardware through to an UNRAID VM, and passing those through to a VM in UNRAID is feasible however I did get my Intel iGPU passed through to UNRAID and have my plex docker in UNRAID use that for transcoding which was a huge win. That was the only real issue, every other UNRAID docker and the VMs that didn't rely on hardware pass through worked fine. Drives just worked by passing through my SATA controllers for my storage and the nvme drive my cache is on. ( Proxmox is installed on an nvme drive )

     

    It took a fair bit of trial and errror but here is the config file for my unraid VM in proxmox:

    bios: ovmf
    
    boot: order=usb0
    
    cores: 20
    
    cpu: host
    
    efidisk0: local-lvm:vm-100-disk-0,efitype=4m,pre-enrolled-keys=1,size=4M
    
    hostpci0: 0000:02:00,pcie=1
    
    hostpci3: 0000:00:02,pcie=1,x-vga=1
    
    hostpci4: 0000:00:17.0,pcie=1hostpci5: 0000:03:00.0,pcie=1
    
    machine: q35
    
    memory: 64000
    
    meta: creation-qemu=7.1.0,ctime=1677658184
    
    name: UNRAID
    
    net0: e1000=BE:10:40:4C:9C:2E,bridge=vmbr0,firewall=1
    
    numa: 0
    
    onboot: 1
    
    ostype: l26
    
    scsihw: virtio-scsi-single
    
    smbios1: uuid=d6b4046f-fef5-43bd-b70b-10aa383dd291
    
    sockets: 1
    
    usb0: host=0781:5567
    
    vmgenid: c10f6ea6-ade4-4a61-9bb8-10045a7c2329

     

    Why on earth would you try running a VM/Docker inside unraid? 

     

    Nested Virtualisation is going to bite you at some point. 

     

    If you're running unraid as a vm inside proxmox, you create vm's on proxmox, not in unraid. 

     

    Your best bet for stability in this particular scenario is to run unraid as a pure nas VM, create something like an Ubuntu VM in proxmox for your hardware passthrough and docker needs (or LXC's), passing just your HBA through to the unraid VM. 

  11. 5 minutes ago, s.Oliver said:

     

    just quickly jumped here to give a hint:

    if your goal is, to boot unraid as a VM inside of Proxmox see my last post (just a few upwards from here).

     

    there's no need anymore, to fake/virtualize the usb-stick as vm file or such things. simple create the VM without (or delete later on) a disk associated. passthrough the original usb-stick ("UNRAID" labeled) to that VM and choose this one as boot order 1 (see Options) to boot from. i've set the machine type to Q35 with UEFI for passthrough of hardware hba controllers and other stuff.

     

    works perfectly.

    Heya,

     

    Aye, I've managed to successfully virtualise (with qemu guest agent) with no issues, I was merely looking for a way to forego the USB stick as it's a single point of failure. 

     

    Would be great if there was an official vhd/iso for those who just wanted to virtualise the NAS aspect, and be able to backup/snapshot the configs as part of their standard work flows. 

     

    Cheers though! 

  12. Has anyone managed to reproduce @grumpybutfun unRAID vhd file? The original link is dead (given it's 8 years old, it's no real surprise).

     

    I'm trying to do a similar thing, but currently, unRAID is saying "Error accessing your physical USB Flash boot device", even though the virtual USB drive is writable and boots to the unRAID GUI.

     

    Steps performed:
    1. Create VHD and SCP it across to Proxmox.
    1a. VHD created as required by unraid instructions.
    2. Run the following script:

    VMNUM=1112
    VMSCSINUM=0
    VMDISKLOC=/mnt/prox/images
    DISK_STOR=Proxmox
    USBARG="args: -drive 'file=$VMDISKLOC/$VMNUM/vm-$VMNUM-disk-$VMSCSINUM.raw,if=none,id=drive-usb0,format=raw,cache=none,aio=io_uring,detect-zeroes=on' -device 'usb-storage,drive=drive-usb0,bootindex=1,removable=on'"
    cd $VMDISKLOC/$VMNUM/
    qemu-img convert -O raw UNRAID.vhd unraid.img && \
    rm UNRAID.vhd && \
    qm importdisk $VMNUM unraid.img $DISK_STOR && \
    qm set $VMNUM --scsihw virtio-scsi-pci --scsi$VMSCSINUM $DISK_STOR:$VMNUM/vm-$VMNUM-disk-$VMSCSINUM.raw && \
    sed -i -e "1i${USBARG}   ${1}" /etc/pve/qemu-server/$VMNUM.conf

     

    I've tried both:

    args: -drive 'file=/mnt/prox/images/1112/vm-1112-disk-0.raw,if=none,id=drive-usb0,format=raw,cache=none,aio=io_uring,detect-zeroes=on' -device 'usb-storage,drive=drive-usb0,bootindex=1,removable=on'

     

    and 

     

    args: -drive id=stick,if=none,format=raw,file=/mnt/prox/images/1112/unraid.img -device usb-storage,drive=stick,bootindex=1,removable=on

     

    And whilst the VM boots into UNRAID with both, it throws up a warning that it cannot write to the "disk". I have confirmed that the "disk" is writable. 

    Is img/raw the right way to go here?

  13. Hey guys,

     

    Looking to build a new NAS, but have a few questions as I'm looking to do it on a relatively cheap budget.

     

    Looking to spend ~£150 on each component hopefully at most.

     

    So far I've got the following requirements:

     

    10x HDD's minimum, onboard graphics card, minimum 8gb, probably 16-32gb ECC RAM (I understand THAT part might be over my particular budget requirements but it's something that can be split, so not too fussed about that), and mobo needs to be mATX/mITX.

     

    The current parts list I have is:

     

    Intel® Xeon® Processor E3-1265L v3

    Supermicro X10SL7-F

    Fractal Design Node 804 Case

    ECC RAM

    PSU

    SSD
    (Already have HDD's)

     

    The question I have pertains to the motherboard and CPU.

     

    Which motherboard should I be looking for, and which CPU should I pair with it? I need some form of onboard graphics for the CPU to help w/ the transcoding of video files, and a moderately low TDU as it'll be a 24/7 server.

     

    It seems the E3-1265L v3 is rather difficult to source in the UK.

     

    Any help would be greatly appreciated!

×
×
  • Create New...