Skip to main content
Cluster and storage switches

Replace a Cisco Nexus 9336C-FX2 storage switch

Contributors netapp-jolieg

You can replace a defective Nexus 9336C-FX2 switch in a cluster network. This is a nondisruptive procedure.

What you'll need

Before installing the NX-OS software and RCFs on a Cisco Nexus 9336C-FX2 storage switch, ensure that:

  • Your system can support Cisco Nexus 9336C-FX2 storage switches.

  • You have consulted the switch compatibility table on the Cisco Ethernet Switch page for the supported ONTAP, NX-OS, and RCF versions.

  • You have referred to the appropriate software and upgrade guides available on the Cisco web site.

Cisco Nexus 3000 Series Switches:

  • You have downloaded the applicable RCFs.

  • The existing network configuration has the following characteristics:

    • The Cisco Ethernet Switches page has the latest RCF and NX-OS versions on your switches.

    • Management connectivity must exist on both switches.

  • The replacement Cisco Nexus 9336C-FX2 switch has the following characteristics:

    • Management network connectivity is functional.

    • Console access to the replacement switch is in place.

    • The appropriate RCF and NX-OS operating system image is loaded onto the switch.

    • Initial confiugration of the switch is complete.

About this task

This procedure replaces the second Nexus 9336C-FX2 storage switch S2 with the new 9336C-FX switch NS2. The two nodes are node1 and node2.

Steps to complete:

  • Confirm the switch to be replaced is S2.

  • Disconnect the cables from switch S2.

  • Reconnect the cables to switch NS2.

  • Verify all device configurations on switch NS2.

    Note There can be dependencies between command syntax in the RCF and NX-OS versions.
Steps
  1. If AutoSupport is enabled on this cluster, suppress automatic case creation by invoking an AutoSupport message:

    system node autosupport invoke -node * -type all - message MAINT=xh

    x is the duration of the maintenance window in hours.

  2. Check on the health status of the storage node ports to make sure that there is connection to storage switch S1:

    storage port show -port-type ENET

    Show example
    storage::*> storage port show -port-type ENET
                                      Speed                     VLAN
    Node           Port Type  Mode    (Gb/s) State    Status      ID
    -------------- ---- ----- ------- ------ -------- --------- ----
    node1
                   e3a  ENET  storage 100    enabled  online      30
                   e3b  ENET  storage   0    enabled  offline     30
                   e7a  ENET  storage   0    enabled  offline     30
                   e7b  ENET  storage   0    enabled  offline     30
    node2
                   e3a  ENET  storage 100    enabled  online      30
                   e3b  ENET  storage   0    enabled  offline     30
                   e7a  ENET  storage   0    enabled  offline     30
                   e7b  ENET  storage   0    enabled  offline     30
    storage::*>
  3. Verify that storage switch S1 is available:

    network device-discovery show

    Show example
    storage::*> network device-discovery show
    Node/      Local Discovered
    Protocol   Port	 Device (LLDP: ChassisID)  Interface  Platform
    --------   ----  -----------------------   ---------   ---------
    node1/cdp
               e3a   S1                        Ethernet1/1 NX9336C
               e4a   node2                     e4a         AFF-A700
               e4e   node2                     e4e         AFF-A700
    node1/lldp
               e3a   S1                        Ethernet1/1 -
               e4a   node2                     e4a         -
               e4e   node2                     e4e         -
    node2/cdp
               e3a   S1                        Ethernet1/2 NX9336C
               e4a   node1                     e4a         AFF-A700
               e4e   node1                     e4e         AFF-A700
    node2/lldp
               e3a   S1                        Ethernet1/2 -
               e4a   node1                     e4a         -
               e4e   node1                     e4e         -
    storage::*>
  4. Run the show lldp neighbors command on the working switch to confirm that you can see both nodes and all shelves:

    show lldp neighbors

    Show example
    S1# show lldp neighbors
    Capability codes:
       (R) Router, (B) Bridge, (T) Telephone, (C) DOCSIS Cable Device
       (W) WLAN Access Point, (P) Repeater, (S) Station, (O) Other
    Device ID        Local Intf   Hold-time    Capability    Port ID
    node1            Eth1/1       121          S             e3a
    node2            Eth1/2       121          S             e3a
    SHFGD2008000011  Eth1/5       121          S             e0a
    SHFGD2008000011  Eth1/6       120          S             e0a
    SHFGD2008000022  Eth1/7       120          S             e0a
    SHFGD2008000022  Eth1/8       120          S             e0a
  5. Verify the shelf ports in the storage system:

    storage shelf port show -fields remote-device,remote-port

    Show example
    storage::*> storage shelf port show -fields remote-device,remote-port
    shelf   id  remote-port   remote-device
    -----   --  -----------   -------------
    3.20    0   Ethernet1/5   S1
    3.20    1   -             -
    3.20    2   Ethernet1/6   S1
    3.20    3   -             -
    3.30    0   Ethernet1/7   S1
    3.20    1   -             -
    3.30    2   Ethernet1/8   S1
    3.20    3   -             -
    storage::*>
  6. Remove all cables attached to storage switch S2.

  7. Reconnect all cables to the replacement switch NS2.

  8. Recheck the health status of the storage node ports:

    storage port show -port-type ENET

    Show example
    storage::*> storage port show -port-type ENET
                                        Speed                     VLAN
    Node             Port Type  Mode    (Gb/s) State    Status      ID
    ---------------- ---- ----- ------- ------ -------- --------- ----
    node1
                     e3a  ENET  storage 100    enabled  online      30
                     e3b  ENET  storage   0    enabled  offline     30
                     e7a  ENET  storage   0    enabled  offline     30
                     e7b  ENET  storage   0    enabled  offline     30
    node2
                     e3a  ENET  storage 100    enabled  online      30
                     e3b  ENET  storage   0    enabled  offline     30
                     e7a  ENET  storage   0    enabled  offline     30
                     e7b  ENET  storage   0    enabled  offline     30
    storage::*>
  9. Verify that both switches are available:

    network device-discovery show

    Show example
    storage::*> network device-discovery show
    Node/     Local Discovered
    Protocol  Port  Device (LLDP: ChassisID)  Interface	  Platform
    --------  ----  -----------------------   ---------   ---------
    node1/cdp
              e3a  S1                         Ethernet1/1 NX9336C
              e4a  node2                      e4a         AFF-A700
              e4e  node2                      e4e         AFF-A700
              e7b   NS2                       Ethernet1/1 NX9336C
    node1/lldp
              e3a  S1                         Ethernet1/1 -
              e4a  node2                      e4a         -
              e4e  node2                      e4e         -
              e7b  NS2                        Ethernet1/1 -
    node2/cdp
              e3a  S1                         Ethernet1/2 NX9336C
              e4a  node1                      e4a         AFF-A700
              e4e  node1                      e4e         AFF-A700
              e7b  NS2                        Ethernet1/2 NX9336C
    node2/lldp
              e3a  S1                         Ethernet1/2 -
              e4a  node1                      e4a         -
              e4e  node1                      e4e         -
              e7b  NS2                        Ethernet1/2 -
    storage::*>
  10. Verify the shelf ports in the storage system:

    storage shelf port show -fields remote-device,remote-port

    Show example
    storage::*> storage shelf port show -fields remote-device,remote-port
    shelf   id    remote-port     remote-device
    -----   --    -----------     -------------
    3.20    0     Ethernet1/5     S1
    3.20    1     Ethernet1/5     NS2
    3.20    2     Ethernet1/6     S1
    3.20    3     Ethernet1/6     NS2
    3.30    0     Ethernet1/7     S1
    3.20    1     Ethernet1/7     NS2
    3.30    2     Ethernet1/8     S1
    3.20    3     Ethernet1/8     NS2
    storage::*>
  11. If you suppressed automatic case creation, re-enable it by invoking an AutoSupport message:

    system node autosupport invoke -node * -type all -message MAINT=END