Replace a Cisco Nexus 9336C-FX2 storage switch
You can replace a defective Nexus 9336C-FX2 switch in a cluster network. This is a nondisruptive procedure.
Before installing the NX-OS software and RCFs on a Cisco Nexus 9336C-FX2 storage switch, ensure that:
-
Your system can support Cisco Nexus 9336C-FX2 storage switches.
-
You have consulted the switch compatibility table on the Cisco Ethernet Switch page for the supported ONTAP, NX-OS, and RCF versions.
-
You have referred to the appropriate software and upgrade guides available on the Cisco web site.
Cisco Nexus 3000 Series Switches:
-
You have downloaded the applicable RCFs.
-
The existing network configuration has the following characteristics:
-
The Cisco Ethernet Switches page has the latest RCF and NX-OS versions on your switches.
-
Management connectivity must exist on both switches.
-
-
The replacement Cisco Nexus 9336C-FX2 switch has the following characteristics:
-
Management network connectivity is functional.
-
Console access to the replacement switch is in place.
-
The appropriate RCF and NX-OS operating system image is loaded onto the switch.
-
Initial confiugration of the switch is complete.
-
This procedure replaces the second Nexus 9336C-FX2 storage switch S2 with the new 9336C-FX switch NS2. The two nodes are node1 and node2.
Steps to complete:
-
Confirm the switch to be replaced is S2.
-
Disconnect the cables from switch S2.
-
Reconnect the cables to switch NS2.
-
Verify all device configurations on switch NS2.
There can be dependencies between command syntax in the RCF and NX-OS versions.
-
If AutoSupport is enabled on this cluster, suppress automatic case creation by invoking an AutoSupport message:
system node autosupport invoke -node * -type all - message MAINT=xh
x is the duration of the maintenance window in hours.
-
Check on the health status of the storage node ports to make sure that there is connection to storage switch S1:
storage port show -port-type ENET
Show example
storage::*> storage port show -port-type ENET Speed VLAN Node Port Type Mode (Gb/s) State Status ID -------------- ---- ----- ------- ------ -------- --------- ---- node1 e3a ENET storage 100 enabled online 30 e3b ENET storage 0 enabled offline 30 e7a ENET storage 0 enabled offline 30 e7b ENET storage 0 enabled offline 30 node2 e3a ENET storage 100 enabled online 30 e3b ENET storage 0 enabled offline 30 e7a ENET storage 0 enabled offline 30 e7b ENET storage 0 enabled offline 30 storage::*>
-
Verify that storage switch S1 is available:
network device-discovery show
Show example
storage::*> network device-discovery show Node/ Local Discovered Protocol Port Device (LLDP: ChassisID) Interface Platform -------- ---- ----------------------- --------- --------- node1/cdp e3a S1 Ethernet1/1 NX9336C e4a node2 e4a AFF-A700 e4e node2 e4e AFF-A700 node1/lldp e3a S1 Ethernet1/1 - e4a node2 e4a - e4e node2 e4e - node2/cdp e3a S1 Ethernet1/2 NX9336C e4a node1 e4a AFF-A700 e4e node1 e4e AFF-A700 node2/lldp e3a S1 Ethernet1/2 - e4a node1 e4a - e4e node1 e4e - storage::*>
-
Run the show
lldp neighbors
command on the working switch to confirm that you can see both nodes and all shelves:show lldp neighbors
Show example
S1# show lldp neighbors Capability codes: (R) Router, (B) Bridge, (T) Telephone, (C) DOCSIS Cable Device (W) WLAN Access Point, (P) Repeater, (S) Station, (O) Other Device ID Local Intf Hold-time Capability Port ID node1 Eth1/1 121 S e3a node2 Eth1/2 121 S e3a SHFGD2008000011 Eth1/5 121 S e0a SHFGD2008000011 Eth1/6 120 S e0a SHFGD2008000022 Eth1/7 120 S e0a SHFGD2008000022 Eth1/8 120 S e0a
-
Verify the shelf ports in the storage system:
storage shelf port show -fields remote-device,remote-port
Show example
storage::*> storage shelf port show -fields remote-device,remote-port shelf id remote-port remote-device ----- -- ----------- ------------- 3.20 0 Ethernet1/5 S1 3.20 1 - - 3.20 2 Ethernet1/6 S1 3.20 3 - - 3.30 0 Ethernet1/7 S1 3.20 1 - - 3.30 2 Ethernet1/8 S1 3.20 3 - - storage::*>
-
Remove all cables attached to storage switch S2.
-
Reconnect all cables to the replacement switch NS2.
-
Recheck the health status of the storage node ports:
storage port show -port-type ENET
Show example
storage::*> storage port show -port-type ENET Speed VLAN Node Port Type Mode (Gb/s) State Status ID ---------------- ---- ----- ------- ------ -------- --------- ---- node1 e3a ENET storage 100 enabled online 30 e3b ENET storage 0 enabled offline 30 e7a ENET storage 0 enabled offline 30 e7b ENET storage 0 enabled offline 30 node2 e3a ENET storage 100 enabled online 30 e3b ENET storage 0 enabled offline 30 e7a ENET storage 0 enabled offline 30 e7b ENET storage 0 enabled offline 30 storage::*>
-
Verify that both switches are available:
network device-discovery show
Show example
storage::*> network device-discovery show Node/ Local Discovered Protocol Port Device (LLDP: ChassisID) Interface Platform -------- ---- ----------------------- --------- --------- node1/cdp e3a S1 Ethernet1/1 NX9336C e4a node2 e4a AFF-A700 e4e node2 e4e AFF-A700 e7b NS2 Ethernet1/1 NX9336C node1/lldp e3a S1 Ethernet1/1 - e4a node2 e4a - e4e node2 e4e - e7b NS2 Ethernet1/1 - node2/cdp e3a S1 Ethernet1/2 NX9336C e4a node1 e4a AFF-A700 e4e node1 e4e AFF-A700 e7b NS2 Ethernet1/2 NX9336C node2/lldp e3a S1 Ethernet1/2 - e4a node1 e4a - e4e node1 e4e - e7b NS2 Ethernet1/2 - storage::*>
-
Verify the shelf ports in the storage system:
storage shelf port show -fields remote-device,remote-port
Show example
storage::*> storage shelf port show -fields remote-device,remote-port shelf id remote-port remote-device ----- -- ----------- ------------- 3.20 0 Ethernet1/5 S1 3.20 1 Ethernet1/5 NS2 3.20 2 Ethernet1/6 S1 3.20 3 Ethernet1/6 NS2 3.30 0 Ethernet1/7 S1 3.20 1 Ethernet1/7 NS2 3.30 2 Ethernet1/8 S1 3.20 3 Ethernet1/8 NS2 storage::*>
-
If you suppressed automatic case creation, re-enable it by invoking an AutoSupport message:
system node autosupport invoke -node * -type all -message MAINT=END