Jump to content

Mellanox 10GbE & WOL


rajsri

Recommended Posts

Posted

Hello,

I have Supermicro Server board X10SL7-F with Mellanox 10GbE card: ConnextX-2 Lx (single port SFP). I made sure my SFP card is running latest firmware.

When I do "ethtool eth0", it says wol is disabled.

I get the following output trying to set the wol magic packet message: Cannot set new wake-on-lan settings: Operation not supported

attached are messages from ethtool commands and my BIOS config.

Appreciate help from the community. Thanks in advance.

BIOS1.PNG.6d0e4b161de39d15157e74f4f25f207a.PNG

eth_tool.PNG.93962b1e5740c00a580312fdc3b9be84.PNG

Posted

I am running unRaid 6.1.3 and "ethtool -i eth0" gave the following:

driver: mlx4_en

version: 2.2-1 (Feb 2014)

firmware-version: 2.9.1200

bus-info: 0000:05:00.0

supports-statistics: yes

supports-test: yes

supports-eeprom-access: no

supports-register-dump: no

supports-priv-flags: yes

 

Can any admin help me check if unRaid is using latest version of the driver? According to ConnectX 2 documentation and firmware release notes, my card should support WOL feature.

 

PLEASE HELP!

Posted

I dont think the Connectx2 EN supports WOL. I have them in my unraid server and in a  Win7 box. Both show WOL disabled. I only found mention of WOL support in the dual port card documentation. Maybe they are different. I also tried the 2.9.1000 and 2.9.1200 firmware and no difference. If you find out how to make it work, please post.

 

Bob

  • 3 weeks later...
Posted

I dont think the Connectx2 EN supports WOL. I have them in my unraid server and in a  Win7 box. Both show WOL disabled. I only found mention of WOL support in the dual port card documentation. Maybe they are different. I also tried the 2.9.1000 and 2.9.1200 firmware and no difference. If you find out how to make it work, please post.

 

Bob

 

I am working with Mellanox support team to check if Connectx-2 card supports WOL or not. According to their 2.9.1200 firmware release notes it supports. Will post here once I receive a response from them.

  • 3 months later...
Posted

I am working with Mellanox support team to check if Connectx-2 card supports WOL or not. According to their 2.9.1200 firmware release notes it supports. Will post here once I receive a response from them.

 

Ever found out if it works ?

  • 2 months later...
Posted

Hi guys need a little help here with my Connectx-2's in my W10 machine and Unraid 6.1.9 transfer speeds between the (2)

 

I purchased a Mikrotik CRS226-246-25+ -IN , the switch has (2) 10GB spf ports , both computers have connectx-2 cards hooked up to the 10GB spf ports and both are working fine, I can see that the MTU size on the Unraid machine is set to 1,500 which appears to be Jumbo Frames?

 

On the W10 machine looking through the adapter properties and i see multiple settings, by default the driver set this to default balanced tuning and i could only get about 110mb/s, I then picked multicast based off the description in the driver it seemed the best option and my speeds raised to 312mb/s max. 

 

Now these transfers are either with a movie of about 5gig or a linux ISO , I have also noticed at times that the speed will drop to around 50mb/s for what ever reason I am not sure,  then other times it will be steady around the 305 - 310mb/s ..... I have seen these speeds either to my OCZ 480gb SSD or to any of the SATA 3 drives.

 

Is there bottle-neck (I hope not as per i believe i have a pretty fast server) Or is this either a setting in the Unraid or on the W10 driver setting that i am missing?

 

Please let me know your thoughts!  8)

 

AJ

CONNECTX-2_ADAPTER_PROPERTIES_W10.PNG.fc332c98514b66d03773d902c69f30ba.PNG

MELLANOX_CONNECTX-2_ON_UNRAID.PNG.bc14be1a7d5e4344f64d7b3498509121.PNG

Mellanox_ETH2_ON_UNRAID.PNG.83b755031f42f8f4af898df823ddf124.PNG

SYS_INFO_UNRAID.PNG.bea0cd650e46ca1dbca8e5faed7ae1b6.PNG

Posted

I can see that the MTU size on the Unraid machine is set to 1,500 which appears to be Jumbo Frames?

 

No, an MTU of 1500 does not indicate Jumbo frames.

 

Posted

I can see that the MTU size on the Unraid machine is set to 1,500 which appears to be Jumbo Frames?

 

No, an MTU of 1500 does not indicate Jumbo frames.

 

I believe your right , I found an article at http://lime-technology.com/wiki/index.php/Improving_unRAID_Performance#Jumbo_Frames  that talks about changing it under jumbo frames

 

example # ifconfig {interface-name} mtu {size}

# ifconfig eth0 mtu 9000

 

QUESTION - based off the pictures ive attached what would be my interface name for my Mellanox (eth2)  or (FIBRE) this shows up under system devices - 0b:00.0 Ethernet controller: Mellanox Technologies MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] (rev b0)  sorry a little noobish with linux commands....

 

Also anyone have any ideas on the W10 driver setting to choose?

Posted

I can see that the MTU size on the Unraid machine is set to 1,500 which appears to be Jumbo Frames?

 

No, an MTU of 1500 does not indicate Jumbo frames.

 

I believe your right , I found an article at http://lime-technology.com/wiki/index.php/Improving_unRAID_Performance#Jumbo_Frames  that talks about changing it under jumbo frames

 

example # ifconfig {interface-name} mtu {size}

# ifconfig eth0 mtu 9000

 

QUESTION - based off the pictures ive attached what would be my interface name for my Mellanox (eth2)  or (FIBRE) this shows up under system devices - 0b:00.0 Ethernet controller: Mellanox Technologies MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] (rev b0)  sorry a little noobish with linux commands....

 

Also anyone have any ideas on the W10 driver setting to choose?

 

Before you make any changes, check first the maximum MTU size supported by your switch/router. It will drop those frames if too large.

 

Posted

I can see that the MTU size on the Unraid machine is set to 1,500 which appears to be Jumbo Frames?

 

No, an MTU of 1500 does not indicate Jumbo frames.

 

I believe your right , I found an article at http://lime-technology.com/wiki/index.php/Improving_unRAID_Performance#Jumbo_Frames  that talks about changing it under jumbo frames

 

example # ifconfig {interface-name} mtu {size}

# ifconfig eth0 mtu 9000

 

QUESTION - based off the pictures ive attached what would be my interface name for my Mellanox (eth2)  or (FIBRE) this shows up under system devices - 0b:00.0 Ethernet controller: Mellanox Technologies MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] (rev b0)  sorry a little noobish with linux commands....

 

Also anyone have any ideas on the W10 driver setting to choose?

 

Before you make any changes, check first the maximum MTU size supported by your switch/router. It will drop those frames if too large.

 

 

Ok thanks for the tip , I just found this in the manual for the switch ........ what do you think would be a good number too try 1st - maybe 65000?

 

l2mtu (integer [0..65536]; Default: ) Layer2 Maximum transmission unit. Read more>>

mtu (integer [0..65536]; Default: 1500) Layer3 Maximum transmission unit

 

 

Any idea about this ------QUESTION - based off the pictures ive attached what would be my interface name for my Mellanox (eth2)  or (FIBRE) this shows up under system devices - 0b:00.0 Ethernet controller: Mellanox Technologies MT26448 [ConnectX EN 10GigE, PCIe 2.0 5GT/s] (rev b0)  sorry a little noobish with linux commands....

Posted

name is eth2. Common jumbo frames setting is 9000. However jumbo frames can be a bugger, you have to make sure everything supports the jumbo frames value you want to use. Some old switches/routers only supported 4k, 6k or 8k. Unless you have some old hardware you probably will see a very small speed boost (if any) using jumbo frames, not worth the bother.

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...