Jump to content

GHunter

Members
  • Content Count

    320
  • Joined

  • Last visited

Everything posted by GHunter

  1. I'm looking to upgrade my unRaid setup from consumer level hardware to server / workstation level hardware. My main reasons for doing an upgrade are more CPU cores, more memory (I also want to use ECC memory), VM stability, and proper IOMMU grouping (I don't want to use PCIe ACS Override). My current setup is in my signature and it works well, but thanks to @limetech , I'm using my unRaid server for much more than I ever imagined 😊. I plan on using my old hardware as a backup unRaid server. My needs are as follows: Ability to run 4 video cards, 2 of which are single slot PCIe x1 cards and the 2 others are dual slot PCIe x16 cards. I also need 2 free slots for my HBA and network cards, both of which are PCIe x4. Onboard GPU or the ability to run headless. 10 or more USB connectors. ECC memory. I'm thinking of the following hardware to upgrade my server: CPU's: 2 @ Intel Xeon E5-2687W v3 which will give me 20 cores. Coolers: Need 2 CPU coolers but not sure what to get. Looking for cheap but reliable and lower noise coolers. MB: Supermicro X10DAX Memory: 64Gig ECC PSU: EVGA SuperNOVA 1300 G2 1300 Watts I currently run 4 VM's and 11 docker containers full time and want the ability to run 2 more VM's full time. 4 of the VM's will use GPU passthrough. I'd like comments or suggestions on my planned upgrade. Particularly if I can stop using PCIe ACS Override and if I can run this setup headless. I will most likely need 1 or 2 PCIe riser or ribbon cable extensions as well but not sure which ones or where to get them (I live in the USA) and I still need to choose CPU coolers. Thanks!
  2. I'm going through the process of upgrading to 8TB disks and moving data from a few small disks (2 and 3 TB disks) to empty them and then remove them from the server by doing a "New Config" on a dual parity disk protected array. When I do the "New Config" does this invalidate parity? I will of course do a parity check when I'm done regardless but I'm not sure if I'd be protected or not until I manually do a parity check. Another question. Can i pull the parity 2 disk and replace a data disk in one operation? Thanks!
  3. GHunter

    Disk consolidation - Is parity still valid?

    Ok, great! Thanks!
  4. GHunter

    [Plugin] CA Appdata Backup / Restore v2

    Posting my custom backup script for @unRaide and anyone else that wants to use it. I've been using it for months now and it works great. Note: I only use the Appdata backup function of this plugin and have set backup rotation to off as it is handled by this script. What it does: This script will backup your unRaid USB flash drive, your VM XML files, and OVMF files. Backup rotation is set to 3 days in the script and can be changed. Any dated backup folder will not be deleted if text is appended to the folder name. Example: this folder will not be deleted. 2019-01-22@02.30 Last backup of v6.6.6 before upgrade CA_Backup_Custom_Stop.sh file is attached at the bottom of this post. READ THE COMMENTS AND USE AT YOUR OWN RISK!! Comments are welcome. I'm still learning so be gentle! LOL There's always room for improvement. #!/bin/bash # CA_Backup_Custom_Stop.sh # Change the locations below to match your backup locations flashbackuplocation="/mnt/user/Backups-Gary/unRAID/Flash/" nvrambackuplocation="/mnt/user/Backups-Gary/unRAID/NVRAM/" vmxmlbackuplocation="/mnt/user/Backups-Gary/unRAID/VM_XML/" appdatabackuplocation="/mnt/user/Backups-Gary/unRAID/Appdata/" daysofbackupstokeep=3 # 1440 minutes in 1 day 7 days is 10080 (( daystominutes = daysofbackupstokeep * 1440 - 1 )) # dont change anything below here echo "..." echo "Running CA Backup Custom Stop script" echo "..." datestamp=""`date '+%F'`"@"`date '+%H'`"."`date '+%M'` dir="$flashbackuplocation"/"$datestamp" # make a subfolder to store backup files if [ ! -d $dir ] ; then echo "Making a subfolder for todays date $datestamp" # make the directory as it doesnt exist mkdir -vp $dir else echo "As $dir exists continuing." fi # save the files using rsync and mod permissions echo "Saving USB Flash drive files" rsync -a --no-o /boot/* $dir/ chmod -R 777 $dir echo "Finished backup of USB Flash drive files" # deleting backup folders older than X number of days as declared at the top echo "Deleting USB Flash Drive backups older than $daysofbackupstokeep days except those the folders that have" echo "text appended to it" # don't delete folders that have text appened to it. Useful to save older backups. Example: this folder will not be deleted 2019-01-22@02.30 Last backup of v6.6.6 before upgrade find $flashbackuplocation -type d -maxdepth 1 -mindepth 1 -mmin +$daystominutes -not -name '?????????????????*' | xargs rm -rf echo "..." sleep 2 dir="$nvrambackuplocation"/"$datestamp" # make a subfolder to store backup files if [ ! -d $dir ] ; then echo "Making a subfolder for todays date $datestamp" # make the directory as it doesnt exist mkdir -vp $dir else echo "As $dir exists continuing." fi # save the files using rsync and mod permissions echo "Saving OVMF NVRAM files" rsync -a --no-o /etc/libvirt/qemu/nvram/* $dir/ chmod -R 777 $dir echo "Finished backup of OVMF NVRAM files" # deleting backup folders older than X number of days as declared at the top echo "Deleting NVRAM backups older than $daysofbackupstokeep days except those the folders that have text" echo "appended to it" # don't delete folders that have text appened to it. Useful to save older backups. Example: this folder will not be deleted 2019-01-22@02.30 Last backup of v6.6.6 before upgrade find $nvrambackuplocation -type d -maxdepth 1 -mindepth 1 -mmin +$daystominutes -not -name '?????????????????*' | xargs rm -rf echo "..." dir="$vmxmlbackuplocation"/"$datestamp" # make a subfolder to store backup files if [ ! -d $dir ] ; then echo "Making a subfolder for todays date $datestamp" # make the directory as it doesnt exist mkdir -vp $dir else echo "As $dir exists continuing." fi # save the files using rsync and mod permissions echo "Saving VM XML files" rsync -a --no-o /etc/libvirt/qemu/*xml $dir/ chmod -R 777 $dir echo "Finished backup of VM XML files" # rename xml files to *.txt as it's easier to open with a text editor # this fuction is commented out but if you want to use it then uncomment the following 4 lines # echo "Renaming all the XML files to TXT" # cd $dir/ # rename .xml .txt *.xml # echo "Finished renaming the XML files" # deleting backup folders older than X number of days as declared at the top echo "Deleting VM XML backups older than $daysofbackupstokeep days except those the folders that have" echo "text appended to it" # don't delete folders that have text appened to it. Useful to save older backups. Example: this folder will not be deleted 2019-01-22@02.30 Last backup of v6.6.6 before upgrade find $vmxmlbackuplocation -type d -maxdepth 1 -mindepth 1 -mmin +$daystominutes -not -name '?????????????????*' | xargs rm -rf echo "..." # lets check and delete older backups from Appdata too for consistency that was performed by the plugin. Note: I disabled backup rotation of appdata folder in the plugin as it is handled by this script echo "Deleting AppData backups older than $daysofbackupstokeep days except those the folders that have" echo "text appended to it" # don't delete folders that have text appened to it. Useful to save older backups. Example: this folder will not be deleted 2019-01-22@02.30 Last backup of v6.6.6 before upgrade find $appdatabackuplocation -type d -maxdepth 1 -mindepth 1 -mmin +$daystominutes -not -name '?????????????????*' | xargs rm -rf echo "..." echo "Finished running CA Backup Custom Stop script" echo "..." exit Enjoy, Gary CA_Backup_Custom_Stop.sh
  5. GHunter

    [Plug-In] unBALANCE

    Love this plugin, Thanks for creating and maintaining it!!! I have a feature request. Can you show "Elapsed Time" like you do with "Time Remaining"? This would give me a more realistic idea on future move and copy functions. Thanks.
  6. GHunter

    [Plugin] CA Appdata Backup / Restore v2

    @unRaide My script is highly customized for my use case (it does file deletes, renaming, ignores some folders, backup rotation and, well, poorly written for general use LOL) so I'd rather not share it, however I can edit it and add some additional commenting so it would be easier to digest and you can run with it from there. I'll let you make the call though. Do you want me to post it as is or edit it a bit to just do some example backups? Gary
  7. 1. I just pinned all of my docker containers to use pair CPU 1 and HT 5 and I'm noticing that they use pin 1 but not pin 5. Are docker containers not capable of using the hyperthreaded CPU? I've got 9 of them running and they are clearly using pin 1 but not 5 according to the dashboard page CPU usage percentage. 2. Now that I have my docker containers pinned to a CPU/HT pair, how do I add the ability to use emulator pinning to CPU 0 and HT 4 to each container? 3. I thought we had the ability to have wait times when starting VM's like we do with dockers but I'm not seeing it in the webgui. Am I wrong about this feature? Thanks
  8. GHunter

    A few docker and VM questions

    Yes, I can change the order. Thanks for confirming wait times. Thanks for the info. I'm aware that isolating cores is done via the webgui but I assumed that the isolated cores setting was written to syslinux.cfg, is that not true anymore? Thanks for all the info. You guys have been a big help. Always good to know some of the inner workings of unRaid!
  9. GHunter

    A few docker and VM questions

    Yes, they are isolated in syslinux.cfg. Ok. I didn't know this. I tried this but didn't see any place to set the startup delay time. I'll check again as I might have missed it. Thanks for the help
  10. I would love this too!! It would be an excellent addition to the CPU pinning capability we have now and make things easier as I have to add this manually to my 20 or so docker containers and VMs.
  11. GHunter

    QEMU PCIe Root Port Patch

    I'd like this as well if this really does work!! This could possibly fix many of the problems some people have with GPU passthrough performance.
  12. GHunter

    [Plugin] CA Appdata Backup / Restore v2

    @unRaide I use this plugin and there is the ability to include running a "Custom Stop Script" which I use to do a few backups of additional things. It works out really well for me.
  13. FYI, The Pro version has 4 controllers, so 4 separate devices, but the non-pro version has 1 controller. The pro version is hard to find as they are no longer in production unfortunately. I've been trying to find the pro version at a decent price but not much luck. 😞
  14. GHunter

    Unraid OS version 6.7.0-rc1 available

    @Trembler That banner and a bunch of others are in this thread here:
  15. GHunter

    Unraid OS version 6.7.0-rc1 available

    I was thinking about this too. The new dashboard contains what almost appears like panels. Having the ability to drag and drop the panels where you would like them would be very cool. Better yet would be the ability to customize what gets displayed in each panel and then arrange the data and the panels however you'd like. I'm sure many of you have seen other webui's like this and have an idea of what I'm talking about. Grafana is one product that does this real well.
  16. GHunter

    Unraid OS version 6.7.0-rc1 available

    I think orange is a better choice of color over the blue. That's my 2 cents anyways. 😉
  17. GHunter

    Unraid OS version 6.7.0-rc1 available

    Upgraded from v6.6.6 with no problems. Love the new look of the Dashboard and other visual enhancements throughout the WebUI. Thanks and a job well done to all those who worked on this release and provided valuable feedback!!!
  18. GHunter

    unable to passthrough primary gpu

    You have to run them on every reboot of unRaid. You can use the User Script plugin to do it for you or run them from your go file.
  19. GHunter

    Nearly through on GPU pass-through

    This probably won't help with the error you are having but worth a try. You need to pass through the sound card that is associated with your video card. It will be identified as 01:00.1 Audio device: NVIDIA Corporation GP106 High Definition Audio Controller (rev a1)
  20. GHunter

    notes section

    I've always wanted something like this too and it has been requested before. In the mean time, as a work around I edit my "license.txt" file that is stored in the root of the flash drive. Then in the unRAID webgui, if I click on the "Tools" menu item and then click on "EULA", I can read whatever I have written in the "license.txt" file. The license file is a .md or Markdown file and can use special formatting for hyperlinks, titles, bulleted lists, etc. Here is a link with a template and some examples that are often found in a markdown file. https://gist.github.com/PurpleBooth/109311bb0361f32d87a2 Remember to keep a backup of your custom license file as it will get overwritten on any upgrades to the unRAID OS. Here is another link that shows you a live and editable markdown file that you can use as an example to create your own file. https://www.makeareadme.com/ Another option might be to install the "Custom Tab" plugin by Squid and have a link to a page you create on the flash drive. I have not tried or tested this method but I think it might work.
  21. GHunter

    How do I interact with a VM?

    Yes. I think you can see the VNC port assignments for all of your VM's on the "VMs" page in the webgui. The VNC ones may only be listed if the VM is running. Your better off using RDP for your Winodws VM's as it is much better.
  22. Running unRaid v6.6.5 for a while now and very stable on the hardware in my signature. I'm about to upgrade my BIOS and thought I'd switch from using the legacy BIOS to UEFI after I confirm my BIOS upgrade is fine (It usually is). So, what precautions or problems should I look out for. I'm thinking everything should be fine but thought I'd ask anyways. Thanks!!
  23. It went flawless. No problems. I did plenty of backups just in case. Thanks for the pointers and links guys.
  24. GHunter

    disk spinup since ~ 6.6.x

    When you power on your unraid server, there are several menu options, one of which is labeled as "Safe Mode". This allows your server to start up but without any plugins, docker containers, or virtual machines running. Choose this option and see if it resolves your spinup / spindown issues.
  25. Disk 2 started showing high reallocated sector counts so I replaced it with a new drive. A few hours into the disk 2 data rebuild, disk 3 started showing high reallocated sector counts. The rebuild process is now taking forever and I'm worried another drive might fail over the long rebuild. Is there a better way to proceed? Or should I just let it continue. Not sure what to do. Thanks! filesvr-diagnostics-20181026-0816.zip