Bladedude

Yup. Fair enough. Let me 100% validate on my end again. I'll reboot into TrueNas Scale and grab a screenshot and dmesg on boot and see if that can help.

Thanks, but help me understand: If I reboot the server, without touching the server or hardware, and only change the boot device, TrueNas Scale boots and detects the Mellanox NIC with DAC cables and receives a reserved IP. Unraid does not. Same HW, one OS brings up NIC ok, but another OS does not. Sounds to me like software.

DAC cables

Diagnostics attached. Yes, it's in ethernet mode. supermicro-diagnostics-20240303-1147.zip

Ah gotcha. It wasn't crystal clear from the docs. I did that. Files were there. Perhaps for clarity, it should say browse to the USB flash device, and complete the following steps from the flash device directory.

I don't follow

# lspci | grep Mellanox 01:00.0 Ethernet controller: Mellanox Technologies MT27520 Family [ConnectX-3 Pro] # lspci -vv -s 01:00.0 | grep "Part number" -A 3 [PN] Part number: 779793-B21 [EC] Engineering changes: B-5718 [SN] Serial number: IL271700F5 [V0] Vendor specific: PCIe 10GbE x8 6W New install of Unraid. Adaptor will not link up out of the box. I installed Mellanox Firmware Tools plug-in, and it's still not up. If I reboot into Truenas Scale (I'm wiping my existing Scale and installing Unraid), it came up from the default Truenas Scale installation.

Thanks. I tried manual install from both Mac and Windows with the errors detailed in OP. Mac USB Flash creator tool with deselected UEFI worked. Mac USB creator docs should include a link to open app from unidentified developer.

For Mac manual install, looks like it's failing in the last lines of the script: mkdir -p /tmp/UNRAID/syslinux ; cp -rp /Volumes/UNRAID/syslinux/* /tmp/UNRAID/syslinux echo -n "To continue please enter your admin " sudo /tmp/UNRAID/syslinux/make_bootable_mac.sh $TARGET

Brand new metal Sandisk 32GB USB key, used the USB Flash creator tool on Mac with no issues. UEFI may have been enabled. Server errored out with USB not bootable. On PC, tried to reformat and reinstall OS to USB via PC Flash creator tool. Hit this known Unraid issue from 2 yrs ago, with USB device (incompatible). Followed suggestion on above page to use manual install. For manual install on Windows, downloaded Unraid.zip and verified MD5. Formatted USB drive as FAT32 with name UNRAID. Ran script and received the following error: For manual install on Mac, downloaded Unraid.zip and verified MD5. Formatted USB drive as FAT32 with name UNRAID. Ran script and received the following error: $ /Users/XXX/Downloads/unRAIDServer-6.12.8-x86_64/make_bootable_mac ; exit; INFO: make_bootable_mac v1.3 INFO: The following drive appears to be the unRAID USB Flash drive: /dev/disk5 30.8GB Permit UEFI boot mode [Y/N]: n cp: /Volumes/UNRAID/syslinux/*: No such file or directory To continue please enter your admin Password: sudo: /tmp/UNRAID/syslinux/make_bootable_mac.sh: command not found logout Saving session... ...copying shared history... ...saving history...truncating history files... ...completed. Deleting expired sessions...1 completed. [Process completed] Please advise

Looking at the activation code notes at purchase: Does this mean if I wipe and reinstall Unraid, I'll need a new key for the same server? I want to test configurations for HW and apps and make sure things are setup correctly. I was intending to document as I performed the setup, and then wipe and reinstall with lessons learned (because there always are) for the final install. Should I setup and use a 30-day trial?

Based on the identical dozen spinners, I'll likely go with zfs. Is share filesystem (shfs) issue still a concern with RaidZ2? @jit-010101

Thanks for the additional comments @jit-010101 @mackid1993 and @SimonF. This is more feedback to this 1 post 30 hrs ago, than I've ever received from Truenas forums or their discord. If I didn't have a dozen identical drives, it sounds like xfs would be the way to go given the primary use case of media + smb shares. Given the identical dozen drives, zfs sounds like the best use of the existing HW. @Daniel15 I'll need to find a solution for this. I do have 1 internal USB type A port that I will use for the boot/key USB stick. This post mentions using a "USB DOM" which might work since I have 2 free internal USB headers on the mobo. @jit-010101PSU reports it's pulling 280W input at idle. 2 x E5v2 Xeons, 7 fans + 2 more in the PSU, and 12 3.5" spinners.

Thanks @Daniel15 @dopeytree and @HardwareHarry for the responses and examples of your setups. Good info on a USB stick workaround for an array @Daniel15. @dopeytree For power, I don't think the server can power down spinners, and the power is a sunk cost for me. With no drives it pulls ~200 watts, and ~325 watts with 12 3.5" spinners. This vid All about Using Multiple Cache Pools and Shares in Unraid 6.9 from SpaceInvaderOne was helpful, as well as this one Overview ZFS for Unraid (Create, Expand and Repair ZFS Pool on Unraid).. This ZFS documentation link mentions: but maybe it's a backlogged item. Use case is media server + smb shares. Given that all the drives will be spinning, zfs seems like the route to take. Maybe I'll try xfs+parity and see if the server powers down the unused drives.

Thanks for the response @JonathanM Waiting for future versions: understood. USB flash drive for array disk, I'll have to rewatch the vid and do more reading. Download and sort the media on final storage seems like the optimum route using Trash guides / hardlinking. HW available with original plans below: 12 x 10TB SAS for media in RaidZ2. Not sure whether to stick with zfs, or use a different method such as xfs + parity for future expansion. Though I could add another pool since the server has another 24 x 3.5" bays free 2 x 500GB for Truenas boot. Not sure what to use them for in Unraid 2 x 1TB NVME for apps 2 x 56GB Optane for zfs cache, slog etc I have 1 internal USB type A slot, and I've ordered a metal case 32GB USB stick for the license key I'd welcome suggestions on how to arrange/optimize this HW for Unraid.