Cabling and configuration considerations

Contributors netapp-yvonneo

Before configuring your NVIDIA SN2100 switch, review the following information:

  1. Only optical connections are supported on SN2100 switches with X1151A NIC, X1146A NIC, or onboard 100GbE ports. For example:

    1. AFF A800 on ports e0a and e0b

    2. AFF A320 on ports e0g and e0h

  2. When a QSA adapter is used to connect to the onboard Intel cluster ports on a platform, not all links come up.

    Example platforms are: FAS2750, AFF A300, and FAS8200 (all 10G) and AFF A250 (25G).

    To resolve this issue, do the following:

    1. For Intel 10G, manually set the swp1s0-3 link speed to 10000 and set auto-negotiation to off

    2. For Chelsio 25G, manually set the swp2s0-3 link speed to 25000 and set auto-negotiation to off

      Note Using 10G/25G QSA, use the non-breakout 40/100G ports. Do not insert the QSA adapter on ports that are configured for breakout.
  3. Depending on the transceiver in the switchport, you might need to set the speed on the switchport to fixed speed. If using 10G and 25G breakout ports, make sure that auto-negotiation is off and hard set the port speed on the switch. For example:

    cumulus@cumulus:mgmt:~$ net add int swp1s3 link autoneg off && net com
    --- /etc/network/interfaces     2019-11-17 00:17:13.470687027 +0000
    +++ /run/nclu/ifupdown2/interfaces.tmp  2019-11-24 00:09:19.435226258 +0000
    @@ -37,21 +37,21 @@
         alias 10G Intra-Cluster Node
         link-autoneg off
         link-speed 10000  <---- port speed set
         mstpctl-bpduguard yes
         mstpctl-portadminedge yes
         mtu 9216
    
    auto swp1s3
    iface swp1s3
         alias 10G Intra-Cluster Node
    -    link-autoneg off
    +    link-autoneg on
         link-speed 10000 <---- port speed set
         mstpctl-bpduguard yes
         mstpctl-portadminedge yes
         mtu 9216
    
    auto swp2s0
    iface swp2s0
         alias 25G Intra-Cluster Node
         link-autoneg off
         link-speed 25000 <---- port speed set