mihcox

Members
  • Posts

    181
  • Joined

  • Last visited

Posts posted by mihcox

  1. This resolved the issue of them being seen by unraid, thanks for that.

     

    I can now ping the machines from each other, but i cannot find them in unassigned devices. Any suggestions for how to resolve this? They only see themselves in the unassigned devices list using smb.

     

    image.thumb.png.f2dcaf5b624872ebaac9c84464246c6f.png

    image.thumb.png.748680792591a182d8837328682a1f07.png

    image.png.bc238272c25c90e049c8105ac83433dd.pngimage.png.ce92f4716b16a6b38f7e843bd7e3dea7.png

  2. I just bought a couple of connect x-3 cards, MCX354A-FCBT, which report as [15b3:1003] 01:00.0 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3] in unraid, and Mellanox connect x-3 IPoIB adapter in windows.

     

    I have updated the firmwares to the latest FW Version: 2.42.5000. But i cannot seem to change them to ethernet mode. When runing mst status on windows i get  No MST devices found, and when running the mstconfig -d 62:00.0 q, i get Unsupported device

     

    Any suggestions on how to resolve this?

     

    image.png.ab0574386a26c757a64deec01059900e.png

    precision3450-diagnostics-20240203-0214.zip

    image.thumb.png.631e5b7ab413458b15b260ba15790452.png

  3. 10 hours ago, JorgeB said:

    It does confirm it's not an Unraid problem, could be an issue with the Linux in-tree driver, or a problem that the Windows driver ignores and Linux one doesn't, either way I'm afraid I don't have a good solution, other then maybe trying a different NIC if possible.

    Yes, so the difference is in the machines where it is working, i have an I217-LM intel NIC as the main connection, but in the ones where its failing its an I219-LM NIC. This means it is some sort of kernel/driver issue i guess?

     

    I had purchased an x520-DA2 because it was seemed to work easily. Is there another suggestion for cheap 10GB NICs, with 1 and 2 ports?

  4. 8 hours ago, JorgeB said:

    Could be a kernel in-tree driver problem, you can try booting a different Linux distro, ideally with a similar/same kernel.

    Same issue in ubuntu 20.04.3, what does that indicate?

     

    4 hours ago, ADvorsky said:

    Yes, it vanishes on my system as well after each reboot, but the nics are present as configured in the file. Without the file present during boot the 10gb nic is not available.

    That's why i have a copy of that file to recreating it after each reboot on array start ;)

    I tried that with mine, but when the server restarts it deletes the file. How are you generating it?

     

  5. 18 hours ago, JorgeB said:

    In this case I suspect network-rules.cfg is not being created because the other NICs are not loading a driver, so basically Unraid only sees one NIC.

    yes, thats probably why the one i was creating was getting deleted.

     

    13 hours ago, JackieWu said:

     

    Maybe switch 10G NIC PCIE slot to another. 

     Tried in both slots, x16 and x4 with the same result. Seen in the bios, and in devices, but not on the network tab.

    21 hours ago, JorgeB said:

    Both NICs are failing to initialize, so the driver is not loaded, but don't see why:

     

    Jan 18 22:59:50 Precision3450 kernel: ixgbe: probe of 0000:01:00.0 failed with error -5
    Jan 18 22:59:50 Precision3450 kernel: ixgbe: probe of 0000:01:00.1 failed with error -5

    This is unfortunately not very helpful

  6. 18 hours ago, ADvorsky said:

    I had a similar issue including the vanishing network-rules.cfg after each restart...
    (btw, for this everybody replying to a previous thread of mine insists i have something installed that removes it, which is actually not the case. i still think that its unraid itself removing the file due to reasons during startup after reading it.)
    The machine has 2 NICs, the onboard (which whyever cannot be disabled in the bios) and the 10GBit Nic

    Here is my network-rules.cfg:

    SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="e4:1d:9c:92:ce:44", ATTR{dev_id}=="0x0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth0"
    SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="22:48:5c:05:16:45", ATTR{dev_id}=="0x0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth1"
    

    It is merely to make sure the 10GBit is eth0 because Unraid has some special handling for eth0 as we all know...

    As well, I made sure its there before restarting the server (user script just writes it to /boot/config each hour ;) )

    hope this helps you as well ;)

    This did not help, after formatting it like the below, it was deleted after rebooting.

     

    SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="b0:4f:13:11:06:70", ATTR{dev_id}=="0x0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth0"
    SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="90:e2:ba:ea:71:18", ATTR{dev_id}=="0x0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth1"
    SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="90:e2:ba:ea:71:19", ATTR{dev_id}=="0x0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth2"

  7. 7 hours ago, JorgeB said:

    Both NICs are failing to initialize, so the driver is not loaded, but don't see why:

     

    Jan 18 22:59:50 Precision3450 kernel: ixgbe: probe of 0000:01:00.0 failed with error -5
    Jan 18 22:59:50 Precision3450 kernel: ixgbe: probe of 0000:01:00.1 failed with error -5

     

    Any suggestion on how to get them to initialize? I have the same 10gb nic working in another unraid server without issue

  8. I have installed 2 10gb nics, both in different unraid servers, to try and directly connect them. My older box shows the new nics in the network panel, but the precision3450 does something different. It show the devices in system devices:

    image.thumb.png.0b45d7324cf133170fb3d437483837d4.png

    But they do not show up on the network page as expected:
    image.thumb.png.ca92288eb3f041185b207d96d5809544.png

     

    Working computer same views:

    image.thumb.png.90d9d1a01867d3b2ad6411aa8e19d6ef.png

     

    image.thumb.png.ba71bdcffcc794b2dcd457f7177105af.png

  9. I found the command, but I am still seeing a downgraded rating. Any suggestions?

     

    lspci -d 1000: -vv

     

    05:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS3008 PCI-Express Fusion-MPT SAS-3 (rev 02)
            Subsystem: Broadcom / LSI SAS3008 PCI-Express Fusion-MPT SAS-3
            Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
            Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
            Latency: 0, Cache Line Size: 64 bytes
            Interrupt: pin A routed to IRQ 218
            NUMA node: 0
            IOMMU group: 52
            Region 0: I/O ports at 6000
            Region 1: Memory at dec40000 (64-bit, non-prefetchable)
            Region 3: Memory at dec00000 (64-bit, non-prefetchable)
            Expansion ROM at deb00000 [disabled]
            Capabilities: [50] Power Management version 3
                    Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
                    Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
            Capabilities: [68] Express (v2) Endpoint, MSI 00
                    DevCap: MaxPayload 4096 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
                            ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0W
                    DevCtl: CorrErr- NonFatalErr+ FatalErr+ UnsupReq-
                            RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+ FLReset-
                            MaxPayload 256 bytes, MaxReadReq 512 bytes
                    DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend+
                    LnkCap: Port #0, Speed 8GT/s, Width x8, ASPM not supported
                            ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
                    LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk+
                            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                    LnkSta: Speed 8GT/s, Width x4 (downgraded)
                            TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                    DevCap2: Completion Timeout: Range BC, TimeoutDis+ NROPrPrP- LTR-
                             10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
                             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                             FRS- TPHComp- ExtTPHComp-
                             AtomicOpsCap: 32bit- 64bit- 128bitCAS-
                    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- 10BitTagReq- OBFF Disabled,
                             AtomicOpsCtl: ReqEn-
                    LnkCap2: Supported Link Speeds: 2.5-8GT/s, Crosslink- Retimer- 2Retimers- DRS-
                    LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
                             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                             Compliance Preset/De-emphasis: -6dB de-emphasis, 0dB preshoot
                    LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+ EqualizationPhase1+
                             EqualizationPhase2+ EqualizationPhase3+ LinkEqualizationRequest-
                             Retimer- 2Retimers- CrosslinkRes: unsupported
            Capabilities: [a8] MSI: Enable- Count=1/1 Maskable+ 64bit+
                    Address: 0000000000000000  Data: 0000
                    Masking: 00000000  Pending: 00000000
            Capabilities: [c0] MSI-X: Enable+ Count=96 Masked-
                    Vector table: BAR=1 offset=0000e000
                    PBA: BAR=1 offset=0000f000
            Capabilities: [100 v2] Advanced Error Reporting
                    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                    UEMsk:  DLP+ SDES- TLP- FCP+ CmpltTO+ CmpltAbrt+ UnxCmplt+ RxOF+ MalfTLP+ ECRC+ UnsupReq+ ACSViol-
                    UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                    CEMsk:  RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ AdvNonFatalErr+
                    AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
                            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                    HeaderLog: 00000000 00000000 00000000 00000000
            Capabilities: [1e0 v1] Secondary PCI Express
                    LnkCtl3: LnkEquIntrruptEn- PerformEqu-
                    LaneErrStat: 0
            Capabilities: [1c0 v1] Power Budgeting <?>
            Capabilities: [190 v1] Dynamic Power Allocation <?>
            Capabilities: [148 v1] Alternative Routing-ID Interpretation (ARI)
                    ARICap: MFVC- ACS-, Next Function: 0
                    ARICtl: MFVC- ACS-, Function Group: 0
            Kernel driver in use: mpt3sas
            Kernel modules: mpt3sas

  10. I just installed a new 9300 HBA in my server. I had found a command that can be run from the command line that will output the link speed of the HBA to ensure its connection is not degraded. But i dont seem to be able to locate that forum. It helped me find out that my oboard SAS was running a degraded link, was hoping to ensure thats not the ase now

     

    Output looked something like this:

    # fcinfo hba-port

    HBA Port WWN: 10000000c6789451
    OS Device Name: /dev/cfg/c2
    Manufacturer: Emulex
    Model: LPe11000-S
    Firmware Version: 2.80a4 (Z3D2.80A4)
    FCode/BIOS Version: .........
    Serial Number: ...........................
    Driver Name: emlxs
    Driver Version: 2.31o (2008.10.20.14.00)
    Type: unknown
    State: offline
    Supported Speeds: 1Gb 2Gb 4Gb
    Current Speed: not established
    Node WWN: ...........................
    HBA Port WWN: 10000000c7643890
    OS Device Name: /dev/cfg/c1
    Manufacturer: Emulex
    Model: LPe11000-S
    Firmware Version: 2.80a4 (Z3D2.80A4)
    FCode/BIOS Version: .........
    Serial Number: ......................
    Driver Name: emlxs
    Driver Version: 2.31o (2008.10.20.14.00)
    Type: unknown
    State: offline
    Supported Speeds: 1Gb 2Gb 4Gb
    Current Speed: not established
    Node WWN: ..............................

  11. 2 minutes ago, JorgeB said:

    You'd need to do that manually or with a script.

    Would another solution be to keep all my "import files" or downloads on the evocachepool ONLY, then use the my regular process to move them to the movies folder structure, then let them offload to the array?

  12. Well if that's the case then what is the solution for moving files from disk to disk on the array if the folder a file is in changes and should no longer be on the disk its currently on? Seems like this would be a commonly required script.

  13. 1 hour ago, itimpi said:

    Unraid never moves files between array drives by itself, and mover will only move files between a pool and the main array.   Were you expecting something else?

    This has never been my past experience. To go further into it, im using syncthing to copy media across to my downloads folder:
    image.png.d9bdcbe2df1d1e17f387516330f1a771.png

    Files are copied to the Downloads folder which is generally on evocachepool, but when it fills up or gets a mover run it moved these files to disk20.

     

    Those files are then imported with sonarr/radarr and are now under the /media folder:
     

    image.png.d8821697a3be282fecfe64d889f6e5ee.png

    where the files are either on the evocachepool or disk 20(downloads) need to be converted to evocachepool or disk1-15 (media).

     

    This process should move any files on either the evocachepool/disk20 which were in the DOWNLOADS folder to evocachepool/disk1-15 that are now in the MEDIA folder.

     

    This process has been working without any modifications since unraid 6.7 at leasst

  14. Based on the photos below, i would expect that my Media on disk20 would be moved by the mover to disk 1-16. But when i run mover, it instant start-stops.

     

    waiting on logs to finish running with mover logging enabled.

     

     

    image.thumb.png.10727b6c7aac010f4ca200aebc3d644e.png

    image.thumb.png.80a144a6961d9a220389050ad8253263.png

    image.thumb.png.adb744984586f163a2fe645a3d59d9fb.png

    image.png.91f09716f3e66b4d99850a6cfd1dda64.png