Nic Card Help Please


Badboy

Recommended Posts

4 hours ago, Ford Prefect said:

There are tons of cases in 2U 12 bays, however most likely they will not allow for deploying an ATX-style PSU...and will only allow for 80mm fans.

If you can cope with the sound level, is something for you to decide. Finding less noisier fans of the same form factor is not a real problem, as the usual suspects like Noctua have them.

 

In this special Port configuration, yes. Edit: but only for connecting to SFP+ ports on the other side

 

There is no need...depends on your comfort zone.

I did so with my cold storage server

Also all my components in my rack are either passive or equipped / refitted with less noisier fans.

 

Well, you can to the fact of takeing additional costs.

While RJ45 Copper is commodity today, surprisingly it is not for 10G or even 40G networks.

 

The standard in 10G, in a Server is SFP+

Connections in a Rack, or short "wires" across cabinets are done with a DAC cable (https://www.fs.com/products/30856.html) ... you can get even cheaper ones from amazon.

Standard "cabling" is done by fiber optics "wire", using two transceiver modules and a fiber "patch-cable".

10GB-T modules and cards are more expensive, produce a lot of heat from their chipsets as of today and need better cabling, for length of only up to 80m for the newest technology https://www.fs.com/products/87588.html?attribute=77&id=274068 (standard 30m https://www.fs.com/products/66613.html?attribute=77&id=274067)

 

I am using 10GB-T only for creating a 10G backbone between my cabinet and existing LAN cabling in my home (still cat5e).

In my cabinet I have a https://mikrotik.com/product/CRS326-24G-2SplusRM and using a https://mikrotik.com/product/css610_8g_2s_in with a pair of these https://mikrotik.com/product/s_rj10 ... stable 10G even over 18m cat5e wires to the home-office room upstairs.

In my cabinet, for connecting servers, router (https://mikrotik.com/product/rb4011igs_rm) and switches via 10G I uses the CRS309 https://mikrotik.com/product/crs309_1g_8s_in

For driving PoE equipment I use this: https://www.digitus.info/produkte/aktive-netzwerkkomponenten/power-over-ethernet-poe/poe-injektoren/dn-95116/ and modded the fans ;-)

small, decentral switches I use are these: https://eu.dlink.com/uk/en/products/dgs-1100-pd-series-gigabit-smart-switches PoE+ powered themselves, and capable of driving a WiFi AP or Camera or else via PoE+ out as well.

 

For starting small, in your case, with already 3 devices in 10GB-T in hand, I'd recommend either a CRS309 + 3x 10GB-T modules from fs.com/Mikrotik (mind you, the CRS is passive, so deploy only every second port with a 10GB-T module to avoid overheating) or something like https://www.newegg.ca/p/0XP-0009-00283?Description=XS1930&cm_re=XS1930-_-9SIA90RDC96420-_-Product

..or sell your stuff, get a CRS305 https://mikrotik.com/product/crs305_1g_4s_in, one 10GB-T module for your ISP-Box connection and Mellanox ConnectX-3 cards https://www.ebay.ca/itm/153991705362?hash=item23da9ef312:g:DTYAAOSwsDNe~fTp with DACs for your Server and Desktop (if you don't need to use CAT/Copper cables inside your wall).

You think this work work? https://www.amazon.ca/MikroTik-CRS305-1G-4S-in/dp/B07LFKGP1L/ref=sr_1_3?crid=GRRIXQFG1AQL&dchild=1&keywords=CRS309-1G-8S%2BIN&qid=1635522255&refinements=p_85%3A5690392011&rnid=5690384011&rps=1&sprefix=crs309-1g-8s%2Bin%2Caps%2C56&sr=8-3  The only concern I have is the isp box 10g port goes directly into the MikroTik box instead of my server. I don't think there will be an issue. (I read a few people have had an issue)  I would have to get an adaptor for the main cable from the isp box, because the cable is ran down through the floor. Don't want to have to change that one. I think I seen adaptors for rj45 to SFP+. Would I have to do both ends? I think for now I will get the box, and then build my backups in my Unraid case. It is defiantly big enough. Unless I have an issue with my expander card. LOL...Plans will change. This will be a more cost effective root. I still have to buy 3 16TB drives.  You could pull your hair out trying to make your mind up sometimes.

 

Your input has been great.  Much appreciated! Maybe we gave someone else some ideas.

Link to comment
2 hours ago, Badboy said:

That's the whole point, what using a switch is for. Every host/cleint connected can communicate to all others.

 

2 hours ago, Badboy said:

I don't think there will be an issue. (I read a few people have had an issue) 

In terms of what issues exactly?

 

2 hours ago, Badboy said:

I would have to get an adaptor for the main cable from the isp box, because the cable is ran down through the floor. Don't want to have to change that one.

Yes, is this a good, full cat7 cable or "just" a patchcable marketed as CAT7 (because there are none!) ?

 

2 hours ago, Badboy said:

I think I seen adaptors for rj45 to SFP+. Would I have to do both ends?

Well, no. There are Tranceivers for SFP+ to RJ45. Like this: https://www.amazon.ca/MikroTik-RJ10-6-Speed-RJ-45-Module/dp/B07TJ1MKKV/ref=sr_1_1?crid=130JXLPHM8VFN&dchild=1&keywords=mikrotik+srj10&qid=1635533438&sprefix=s-rj10%2Caps%2C561&sr=8-1

The CRS305 has SFP+ ports for 10G. You will have to get 3 Modules, #1 for ISP, #2 for Server, #3 for Desktop when using these with RJ45.

And actually, with the CRS305 I see the risk, that this will get too hot !!! You could try and go for the CRS309 with 3 modules though.

 

 

I think you'll be better off with this one: https://www.amazon.ca/dp/B08DKSFXNW/ref=emc_b_5_i ... no modules needed to start with your current gear.

 

Edited by Ford Prefect
Link to comment
2 hours ago, Ford Prefect said:

That's the whole point, what using a switch is for. Every host/cleint connected can communicate to all others.

 

In terms of what issues exactly?

 

Yes, is this a good, full cat7 cable or "just" a patchcable marketed as CAT7 (because there are none!) ?

 

Well, no. There are Tranceivers for SFP+ to RJ45. Like this: https://www.amazon.ca/MikroTik-RJ10-6-Speed-RJ-45-Module/dp/B07TJ1MKKV/ref=sr_1_1?crid=130JXLPHM8VFN&dchild=1&keywords=mikrotik+srj10&qid=1635533438&sprefix=s-rj10%2Caps%2C561&sr=8-1

The CRS305 has SFP+ ports for 10G. You will have to get 3 Modules, #1 for ISP, #2 for Server, #3 for Desktop when using these with RJ45.

And actually, with the CRS305 I see the risk, that this will get too hot !!! You could try and go for the CRS309 with 3 modules though.

 

 

I think you'll be better off with this one: https://www.amazon.ca/dp/B08DKSFXNW/ref=emc_b_5_i ... no modules needed to start with your current gear.

 

Tbank you. That one's pricey. Lol... Still haven't given up totally on trying to get the other card to work. I think somehow I have to delete Eth0 and just use the 2 nic cards. It bugs me when I can't figure something out. 😂

Edited by Badboy
Link to comment
10 minutes ago, Badboy said:

Tbank you. That one's pricey. Lol... Still haven't given up totally on trying to get the other card to work  It bugs me when I can't figure something out. 😂

As i said before...you started your journey into 10G the wrong way....10GB-T/RJ45 is the top of the line here.

The majority of people actually get trapped into this, thinking that they just have to follow - as they feel naturally - a small upgrade from 1G, because they presumably already have all the cables ;-)

Edited by Ford Prefect
Link to comment
1 hour ago, Ford Prefect said:

As i said before...you started your journey into 10G the wrong way....10GB-T/RJ45 is the top of the line here.

The majority of people actually get trapped into this, thinking that they just have to follow - as they feel naturally - a small upgrade from 1G, because they presumably already have all the cables ;-)

I'm not disagreeing with you 😂. Still might grab that box. Probably going to have to pull the other nic card out of the server anyway . I might need the slot for the sata expansion card. Might be forced to build a backup server. Might solve some problems. 

Link to comment
I'm not disagreeing with you . Still might grab that box. Probably going to have to pull the other nic card out of the server anyway . I might need the slot for the sata expansion card. Might be forced to build a backup server. Might solve some problems. 
Remember to add the modules to the total price.
When you do, think for going for the crs309 instead of the crs305, as I suggested.
This has a more advanced switch chip and you can use some interesting features on this on L3, with it's hardware acceleration features in your future, maybe. The CRS models from mikrotik are not just simple switches, as they can ( and will, by default) boot into RouterOS, hence going full L2/L3 capabilities. But you can only use that with their smaller CPU if the switch chip alongside helps a bit with this, for getting wire speed performance on all ports.

Edit: also check the cost compared to swapping your cards for Mellanox connectX-3 model with single or dual SFP+, hence saving the need for the rj45 module here (still need one for isp-box, though). Look carefully as there are different model, even with SFP28 or QSFP+ connections but these are not Ethernet but Infiniband models and need to be converted first and prices for modules are higher.

Gesendet von meinem SM-G780G mit Tapatalk


Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.