Upgrade your Reference Configuration File (RCF)
Suggest changes
PDFs
You upgrade your RCF version when you have an existing version of the RCF file installed on your operational switches.
Make sure you have the following:
-
A current backup of the switch configuration.
-
A fully functioning cluster (no errors in the logs or similar issues).
-
The current RCF.
-
If you are updating your RCF version, you need a boot configuration in the RCF that reflects the desired boot images.
If you need to change the boot configuration to reflect the current boot images, you must do so before reapplying the RCF so that the correct version is instantiated on future reboots.
|
No operational inter-switch link (ISL) is needed during this procedure. This is by design because RCF version changes can affect ISL connectivity temporarily. To ensure non-disruptive cluster operations, the following procedure migrates all of the cluster LIFs to the operational partner switch while performing the steps on the target switch. |
|
Before installing a new switch software version and RCFs, you must erase the switch settings and perform basic configuration. You must be connected to the switch using the serial console or have preserved basic configuration information prior to erasing the switch settings. |
Step 1: Prepare for the upgrade
-
If AutoSupport is enabled on this cluster, suppress automatic case creation by invoking an AutoSupport message:
system node autosupport invoke -node * -type all -message MAINT=xhwhere x is the duration of the maintenance window in hours.
-
Change the privilege level to advanced, entering y when prompted to continue:
set -privilege advancedThe advanced prompt (*>) appears.
-
Display the ports on each node that are connected to the switches:
network device-discovery showShow example
cluster1::*> network device-discovery show Node/ Local Discovered Protocol Port Device (LLDP: ChassisID) Interface Platform ----------- ------ ------------------------- ---------------- ---------------- node1-01/cdp e10a cs1(FLMXXXXXXXX) Ethernet1/16/3 N9K-C9332D-GX2B e10b cs2(FDOXXXXXXXX) Ethernet1/16/3 N9K-C9332D-GX2B e11a cs1(FLMXXXXXXXX) Ethernet1/16/4 N9K-C9332D-GX2B e11b cs2(FDOXXXXXXXX) Ethernet1/16/4 N9K-C9332D-GX2B e1a cs1(FLMXXXXXXXX) Ethernet1/16/1 N9K-C9332D-GX2B e1b cs2(FDOXXXXXXXX) Ethernet1/16/1 N9K-C9332D-GX2B . . . e7a cs1(FLMXXXXXXXX) Ethernet1/16/2 N9K-C9332D-GX2B e7b cs2(FDOXXXXXXXX) Ethernet1/16/2 N9K-C9332D-GX2B node1-01/lldp e10a cs1 (c8:60:8f:xx:xx:xx) Ethernet1/16/3 - e10b cs2 (04:e3:87:xx:xx:xx) Ethernet1/16/3 - e11a cs1 (c8:60:8f:xx:xx:xx) Ethernet1/16/4 - e11b cs2 (04:e3:87:xx:xx:xx) Ethernet1/16/4 - e1a cs1 (c8:60:8f:xx:xx:xx) Ethernet1/16/1 - e1b cs2 (04:e3:87:xx:xx:xx) Ethernet1/16/1 - . . . e7a cs1 (c8:60:8f:xx:xx:xx) Ethernet1/16/2 - e7b cs2 (04:e3:87:xx:xx:xx) Ethernet1/16/2 - -
Check the administrative and operational status of each port.
-
Cluster ports
-
Verify that all the cluster ports are up with a healthy status:
network port show -ipspace ClusterShow example
cluster1::*> network port show -ipspace Cluster Node: node1-01 Ignore Speed(Mbps) Health Health Port IPspace Broadcast Domain Link MTU Admin/Oper Status Status --------- ------------ ---------------- ---- ---- ----------- -------- ------ e7a Cluster Cluster up 9000 auto/100000 healthy false e7b Cluster Cluster up 9000 auto/100000 healthy false Node: node1-02 Ignore Speed(Mbps) Health Health Port IPspace Broadcast Domain Link MTU Admin/Oper Status Status --------- ------------ ---------------- ---- ---- ----------- -------- ------ e7a Cluster Cluster up 9000 auto/100000 healthy false e7b Cluster Cluster up 9000 auto/100000 healthy false Node: node1-03 Ignore Speed(Mbps) Health Health Port IPspace Broadcast Domain Link MTU Admin/Oper Status Status --------- ------------ ---------------- ---- ---- ----------- -------- ------ e7a Cluster Cluster up 9000 auto/10000 healthy false e7b Cluster Cluster up 9000 auto/10000 healthy false Node: node1-04 Ignore Speed(Mbps) Health Health Port IPspace Broadcast Domain Link MTU Admin/Oper Status Status --------- ------------ ---------------- ---- ---- ----------- -------- ------ e7a Cluster Cluster up 9000 auto/10000 healthy false e7b Cluster Cluster up 9000 auto/10000 healthy false -
Verify that all the cluster interfaces (LIFs) are on the home port:
network interface show -role clusterShow example
cluster1::*> network interface show -role cluster Logical Status Network Current Current Is Vserver Interface Admin/Oper Address/Mask Node Port Home ----------- ------------------ ---------- ----------------- ------------ ------- ---- Cluster node1-01_clus1 up/up 169.254.3.4/23 node1-01 e7a true node1-01_clus2 up/up 169.254.3.5/23 node1-01 e7b true node1-02_clus1 up/up 169.254.3.8/23 node1-02 e7a true node1-02_clus2 up/up 169.254.3.9/23 node1-02 e7b true node1-03_clus1 up/up 169.254.1.3/23 node1-03 e7a true node1-03_clus2 up/up 169.254.1.1/23 node1-03 e7b true node1-04_clus1 up/up 169.254.1.6/23 node1-04 e7a true node1-04_clus2 up/up 169.254.1.7/23 node1-04 e7b true 8 entries were displayed. -
Verify that the cluster displays information for both switches:
system cluster-switch show -is-monitoring-enabled-operational trueShow example
cluster1::*> system cluster-switch show -is-monitoring-enabled-operational true Switch Type Address Model --------------------------- ------------------ ---------------- --------------- cs2(FDOXXXXXXXX) cluster-network 10.228.137.233 N9K-C9332D-GX2B Serial Number: FDOXXXXXXXX Is Monitored: true Reason: None Software Version: Cisco Nexus Operating System (NX-OS) Software, Version 10.4(2) Version Source: CDP/ISDP cs2(FLMXXXXXXXX) cluster-network 10.228.137.234 N9K-C9332D-GX2B Serial Number: FLMXXXXXXXX Is Monitored: true Reason: None Software Version: Cisco Nexus Operating System (NX-OS) Software, Version 10.4(2) Version Source: CDP/ISDP 2 entries were displayed.
-
-
HA ports
-
Verify that all the HA ports are up with a healthy status:
ha interconnect status show -node <node-name>Show example
cluster1::*> ha interconnect status show -node node1-01 (system ha interconnect status show) Node: node1-01 Link 0 Status: up Link 1 Status: up Is Link 0 Active: true Is Link 1 Active: true IC RDMA Connection: up Slot: 0 Debug Firmware: no Interconnect Port 0 : Port Name: e1a-17 MTU: 4096 Link Information: ACTIVE Interconnect Port 1 : Port Name: e1b-18 MTU: 4096 Link Information: ACTIVE cluster1::*> ha interconnect status show -node node1-01 (system ha interconnect status show) Node: node1-01 Link 0 Status: up Link 1 Status: up Is Link 0 Active: true Is Link 1 Active: true IC RDMA Connection: up Slot: 0 Debug Firmware: no Interconnect Port 0 : Port Name: e1a-17 MTU: 4096 Link Information: ACTIVE Interconnect Port 1 : Port Name: e1b-18 MTU: 4096 Link Information: ACTIVE . . .
-
-
Storage ports
-
Verify that all the storage ports are up with a healthy status:
storage port show -port-type ENETShow example
cluster1::*> storage port show -port-type ENET Speed Node Port Type Mode (Gb/s) State Status ------------------ ---- ----- ------- ------ -------- ----------- node1-01 e10a ENET - 100 enabled online e10b ENET - 100 enabled online e11a ENET - 100 enabled online e11b ENET - 100 enabled online node1-02 e10a ENET - 100 enabled online e10b ENET - 100 enabled online e11a ENET - 100 enabled online e11b ENET - 100 enabled online node1-03 e10a ENET - 100 enabled online e10b ENET - 100 enabled online e11a ENET - 100 enabled online node1-04 e10a ENET - 100 enabled online e10b ENET - 100 enabled online e11a ENET - 100 enabled online e11b ENET - 100 enabled online 16 entries were displayed.
-
-
Storage shelf ports
-
Verify that all the storage shelf ports are up with a healthy status:
storage shelf port showShow example
cluster1::*> storage shelf port show Shelf ID Module State Internal? ----- -- ------ ------------ --------- 1.1 0 A connected false 1 A connected false 2 A connected false 3 A connected false 4 A connected false 5 A connected false 6 A connected false 7 A connected false 8 B connected false 9 B connected false 10 B connected false 11 B connected false 12 B connected false 13 B connected false 14 B connected false 15 B connected false 16 entries were displayed. -
Verify that all the storage shelf ports are up with a healthy status:
storage shelf port show -fields remote-device,remote-port,connector-stateShow example
cluster1::*> storage shelf port show -fields remote-device,remote-port,connector-state shelf id connector-state remote-port remote-device ----- -- --------------- -------------- ----------------- 1.1 0 connected Ethernet1/17/1 CX9332D-cs1 1.1 1 connected Ethernet1/15/1 CX9364D-cs1 1.1 2 connected Ethernet1/17/2 CX9332D-cs1 1.1 3 connected Ethernet1/15/2 CX9364D-cs1 1.1 4 connected Ethernet1/17/3 CX9332D-cs1 1.1 5 connected Ethernet1/15/3 CX9364D-cs1 1.1 6 connected Ethernet1/17/4 CX9332D-cs1 1.1 7 connected Ethernet1/15/4 CX9364D-cs1 1.1 8 connected Ethernet1/19/1 CX9332D-cs1 1.1 9 connected Ethernet1/17/1 CX9364D-cs1 1.1 10 connected Ethernet1/19/2 CX9332D-cs1 1.1 11 connected Ethernet1/17/2 CX9364D-cs1 1.1 12 connected Ethernet1/19/3 CX9332D-cs1 1.1 13 connected Ethernet1/17/3 CX9364D-cs1 1.1 14 connected Ethernet1/19/4 CX9332D-cs1 1.1 15 connected Ethernet1/17/4 CX9364D-cs1 16 entries were displayed.
-
-
-
Disable auto-revert on the cluster LIFs.
network interface modify -vserver Cluster -lif * -auto-revert false
Step 2: Configure ports
-
On switch cs1, shut down the ports connected to all the ports of the nodes.
cs1# config cs1(config)# interface e1/1/1-4,e1/2/1-4,e1/3/1-4,e1/4/1-4,e1/5/1-4,e1/6/1-4,e1/7/1-4,e1/8/1-4 cs1(config-if-range)# shutdown cs1(config)# interface e1/9/1-4,e1/10/1-4,e1/11/1-4,e1/12/1-4,e1/13/1-4,e1/14/1-4,e1/15/1-4,e1/16/1-4 cs1(config-if-range)# shutdown cs1(config)# interface e1/17/1-4,e1/18/1-4,e1/19/1-4,e1/20/1-4,e1/21/1-4,e1/22/1-44,e1/23/1-4 cs1(config-if-range)# shutdown cs1(config)# interface e1/24/1-,e1/25/1-4,e1/26/1-4,e1/27/1-4,e1/28/1-4,e1/29/1-4,e1/30/1-44 cs1(config-if-range)# shutdown cs1(config-if-range)# exit cs1(config)# exit
Make sure to shutdown all connected ports to avoid any network connection issues. See the Knowledge Base article Node out of quorum when migrating cluster LIF during switch OS upgrade for further details. -
Verify that the cluster LIFs have failed over to the ports hosted on switch cs1. This might take a few seconds.
network interface show -role clusterShow example
cluster1::*> network interface show -role cluster Logical Status Network Current Current Is Vserver Interface Admin/Oper Address/Mask Node Port Home ----------- --------------- ---------- ------------------ ----------- ------- ---- Cluster node1-01_clus1 up/up 169.254.36.44/16 node1-01 e7a true node1-01_clus2 up/up 169.254.7.5/16 node1-01 e7b true node1-02_clus1 up/up 169.254.197.206/16 node1-02 e7a true node1-02_clus2 up/up 169.254.195.186/16 node1-02 e7b true node1-03_clus1 up/up 169.254.192.49/16 node1-03 e7a true node1-03_clus2 up/up 169.254.182.76/16 node1-03 e7b true node1-04_clus1 up/up 169.254.59.49/16 node1-04 e7a true node1-04_clus2 up/up 169.254.62.244/16 node1-04 e7b true 8 entries were displayed. -
Verify that the cluster is healthy:
cluster showShow example
cluster1::*> cluster show Node Health Eligibility Epsilon ----------------- ------- ------------ ------- node1-01 true true false node1-02 true true false node1-03 true true true node1-04 true true false 4 entries were displayed.
-
If you have not already done so, save a copy of the current switch configuration by copying the output of the following command to a text file:
show running-config-
Record any custom additions between the current
running-configand the RCF file in use (such as an SNMP configuration for your organization). -
For NX-OS 10.2 and later, use the
show diff running-configcommand to compare with the saved RCF file in the bootflash. Otherwise, use a third part diff/compare tool.
-
-
Save basic configuration details to the
write_erase.cfgfile on the bootflash.
Make sure to configure the following:
-
Username and password
-
Management IP address
-
Default gateway
-
Switch name
cs1# show run | i "username admin password" > bootflash:write_erase.cfgcs1# show run | section "vrf context management" >> bootflash:write_erase.cfgcs1# show run | section "interface mgmt0" >> bootflash:write_erase.cfgcs1# show run | section "switchname" >> bootflash:write_erase.cfgcs1# echo "hardware access-list tcam region ing-racl 1024" >> bootflash:write_erase.cfgcs1# echo "hardware access-list tcam region egr-racl 1024" >> bootflash:write_erase.cfgcs1# echo "hardware access-list tcam region ing-l2-qos 1536" >> bootflash:write_erase.cfgSee the Knowledge Base article How to clear configuration on a Cisco interconnect switch while retaining remote connectivity for further details.
-
-
Verify that the
write_erase.cfgfile is populated as expected:show file bootflash:write_erase.cfg -
Issue the
write erasecommand to erase the current saved configuration:cs1# write eraseWarning: This command will erase the startup-configuration.Do you wish to proceed anyway? (y/n) [n] y -
Copy the previously saved basic configuration into the startup configuration.
cs1# copy bootflash:write_erase.cfg startup-config -
Reboot the switch:
cs1# reloadThis command will reboot the system. (y/n)? [n] y -
After the management IP address is reachable again, log in to the switch through SSH.
You may need to update host file entries related to the SSH keys.
-
Copy the RCF to the bootflash of switch cs1 using one of the following transfer protocols: FTP, TFTP, SFTP, or SCP.
For more information on Cisco commands, see the appropriate guide in the Cisco Nexus 9000 Series NX-OS Command Reference guides.
Show example
This example shows TFTP being used to copy an RCF to the bootflash on switch cs1:
cs1# copy tftp: bootflash: vrf management Enter source filename: NX9332D-GX2B-RCF-v10.0-Shared.txt Enter hostname for the tftp server: 172.22.201.50 Trying to connect to tftp server......Connection to Server Established. TFTP get operation was successful Copy complete, now saving to disk (please wait)...
-
Apply the RCF previously downloaded to the bootflash.
For more information on Cisco commands, see the appropriate guide in the Cisco Nexus 9000 Series NX-OS Command Reference guides.
This example shows the RCF file
NX9332D-GX2B-RCF-v10.0-Shared.txtbeing installed on switch cs1:cs1# copy NX9332D-GX2B-RCF-v10.0-Shared.txt running-config echo-commands
Make sure to thoroughly read the Installation notes, Important Notes, and banner sections of your RCF. You must read and follow these instructions to ensure the proper configuration and operation of the switch.
-
Verify that the RCF file is the correct newer version:
show running-configWhen you check the output to verify you have the correct RCF, make sure that the following information is correct:
-
The RCF banner
-
The node and port settings
-
Customizations
The output varies according to your site configuration. Check the port settings and refer to the release notes for any changes specific to the RCF that you have installed.
-
-
Reapply any previous customizations to the switch configuration.
-
After you verify the RCF versions, custom additions, and switch settings are correct, copy the
running-configfile to thestartup-configfile.For more information on Cisco commands, see the appropriate guide in the Cisco Nexus 9000 Series NX-OS Command Reference guides.
cs1# copy running-config startup-config[] 100% Copy complete -
Reboot switch cs1. You can ignore the “cluster switch health monitor” alerts and “cluster ports down” events reported on the nodes while the switch reboots.
cs1# reloadThis command will reboot the system. (y/n)? [n] y -
Verify the health of all the ports on the cluster.
-
Cluster ports
-
Verify that cluster ports are up and healthy across all nodes in the cluster:
network port show -ipspace clusterShow example
cluster1::*> network port show -ipspace Cluster Node: node1 Ignore Speed(Mbps) Health Health Port IPspace Broadcast Domain Link MTU Admin/Oper Status Status --------- ------------ ---------------- ---- ---- ----------- -------- ------ e7a Cluster Cluster up 9000 auto/10000 healthy false e7b Cluster Cluster up 9000 auto/10000 healthy false Node: node1-02 Ignore Speed(Mbps) Health Health Port IPspace Broadcast Domain Link MTU Admin/Oper Status Status --------- ------------ ---------------- ---- ---- ----------- -------- ------ e7a Cluster Cluster up 9000 auto/10000 healthy false e7b Cluster Cluster up 9000 auto/10000 healthy false Node: node1-03 Ignore Speed(Mbps) Health Health Port IPspace Broadcast Domain Link MTU Admin/Oper Status Status --------- ------------ ---------------- ---- ---- ----------- -------- ------ e7a Cluster Cluster up 9000 auto/100000 healthy false e7b Cluster Cluster up 9000 auto/100000 healthy false Node: node1-04 Ignore Speed(Mbps) Health Health Port IPspace Broadcast Domain Link MTU Admin/Oper Status Status --------- ------------ ---------------- ---- ---- ----------- -------- ------ e7a Cluster Cluster up 9000 auto/100000 healthy false e7b Cluster Cluster up 9000 auto/100000 healthy false 8 entries were displayed. -
Verify the switch health from the cluster.
network device-discovery show -protocol cdpsystem cluster-switch show -is-monitoring-enabled-operational trueShow example
cluster1::*> network device-discovery show -protocol cdp Node/ Local Discovered Protocol Port Device (LLDP: ChassisID) Interface Platform ----------- ------ ------------------------- ---------------- ---------------- node1-01/cdp e10a cs1(FLMXXXXXXXX) Ethernet1/16/3 N9K-C9332D-GX2B e10b cs2(FDOXXXXXXXX) Ethernet1/16/3 N9K-C9332D-GX2B e11a cs1(FLMXXXXXXXX) Ethernet1/16/4 N9K-C9332D-GX2B e11b cs2(FDOXXXXXXXX) Ethernet1/16/4 N9K-C9332D-GX2B e1a cs1(FLMXXXXXXXX) Ethernet1/16/1 N9K-C9332D-GX2B e1b cs2(FDOXXXXXXXX) Ethernet1/16/1 N9K-C9332D-GX2B . . . e7a cs1(FLMXXXXXXXX) Ethernet1/16/2 N9K-C9332D-GX2B e7b cs2(FDOXXXXXXXX) Ethernet1/16/2 N9K-C9332D-GX2B cluster1::*> system cluster-switch show -is-monitoring-enabled-operational true Switch Type Address Model --------------------------- ------------------ ---------------- --------------- cs2(FDOXXXXXXXX) cluster-network 10.228.137.233 N9K-C9332D-GX2B Serial Number: FDOXXXXXXXX Is Monitored: true Reason: None Software Version: Cisco Nexus Operating System (NX-OS) Software, Version 10.4(2) Version Source: CDP/ISDP cs1(FLMXXXXXXXX) cluster-network 10.228.137.234 N9K-C9332D-GX2B Serial Number: FLMXXXXXXXX Is Monitored: true Reason: None Software Version: Cisco Nexus Operating System (NX-OS) Software, Version 10.4(2) Version Source: CDP/ISDP 2 entries were displayed.
-
-
HA ports
-
Verify that all the HA ports are up with a healthy status:
ha interconnect status show -node <node-name>Show example
cluster1::*> ha interconnect status show -node node1-01 (system ha interconnect status show) Node: node1-01 Link 0 Status: up Link 1 Status: up Is Link 0 Active: true Is Link 1 Active: true IC RDMA Connection: up Slot: 0 Debug Firmware: no Interconnect Port 0 : Port Name: e1a-17 MTU: 4096 Link Information: ACTIVE Interconnect Port 1 : Port Name: e1b-18 MTU: 4096 Link Information: ACTIVE cluster1::*> ha interconnect status show -node node1-02 (system ha interconnect status show) Node: node1-02 Link 0 Status: up Link 1 Status: up Is Link 0 Active: true Is Link 1 Active: true IC RDMA Connection: up Slot: 0 Debug Firmware: no Interconnect Port 0 : Port Name: e1a-17 MTU: 4096 Link Information: ACTIVE Interconnect Port 1 : Port Name: e1b-18 MTU: 4096 Link Information: ACTIVE . . .
-
-
Storage ports
-
Verify that all the storage ports are up with a healthy status:
storage port show -port-type ENETShow example
cluster1::*> storage port show -port-type ENET Speed Node Port Type Mode (Gb/s) State Status ------------------ ---- ----- ------- ------ -------- ----------- node1-01 e10a ENET - 100 enabled online e10b ENET - 100 enabled online e11a ENET - 100 enabled online e11b ENET - 100 enabled online node1-02 e10a ENET - 100 enabled online e10b ENET - 100 enabled online e11a ENET - 100 enabled online e11b ENET - 100 enabled online node1-03 e10a ENET - 100 enabled online e10b ENET - 100 enabled online e11a ENET - 100 enabled online node1-04 e10a ENET - 100 enabled online e10b ENET - 100 enabled online e11a ENET - 100 enabled online e11b ENET - 100 enabled online 16 entries were displayed.
-
-
Storage shelf ports
-
Verify that all the storage shelf ports are up with a healthy status:
storage shelf port showShow example
cluster1::*> storage shelf port show Shelf ID Module State Internal? ----- -- ------ ------------ --------- 1.1 0 A connected false 1 A connected false 2 A connected false 3 A connected false 4 A connected false 5 A connected false 6 A connected false 7 A connected false 8 B connected false 9 B connected false 10 B connected false 11 B connected false 12 B connected false 13 B connected false 14 B connected false 15 B connected false 16 entries were displayed. -
Verify the connection status of all the storage shelf ports:
storage shelf port show -fields remote-device,remote-port,connector-stateShow example
cluster1::*> storage shelf port show -fields remote-device,remote-port,connector-state shelf id connector-state remote-port remote-device ----- -- --------------- -------------- ----------------- 1.1 0 connected Ethernet1/17/1 CX9332D-cs1 1.1 1 connected Ethernet1/15/1 CX9364D-cs1 1.1 2 connected Ethernet1/17/2 CX9332D-cs1 1.1 3 connected Ethernet1/15/2 CX9364D-cs1 1.1 4 connected Ethernet1/17/3 CX9332D-cs1 1.1 5 connected Ethernet1/15/3 CX9364D-cs1 1.1 6 connected Ethernet1/17/4 CX9332D-cs1 1.1 7 connected Ethernet1/15/4 CX9364D-cs1 1.1 8 connected Ethernet1/19/1 CX9332D-cs1 1.1 9 connected Ethernet1/17/1 CX9364D-cs1 1.1 10 connected Ethernet1/19/2 CX9332D-cs1 1.1 11 connected Ethernet1/17/2 CX9364D-cs1 1.1 12 connected Ethernet1/19/3 CX9332D-cs1 1.1 13 connected Ethernet1/17/3 CX9364D-cs1 1.1 14 connected Ethernet1/19/4 CX9332D-cs1 1.1 15 connected Ethernet1/17/4 CX9364D-cs1 16 entries were displayed.
-
-
-
Verify that the cluster is healthy:
cluster showShow example
cluster1::*> cluster show Node Health Eligibility Epsilon ----------------- -------- ------------- ------- node1-01 true true false node1-02 true true false node1-03 true true true node1-04 true true false 4 entries were displayed.
-
Repeat steps 4 to 17 on switch cs2.
-
Enable auto-revert on the cluster LIFs.
network interface modify -vserver Cluster -lif * -auto-revert true
Step 3: Verify the cluster network configuration and cluster health
-
Verify that the switch ports connected to the cluster ports are up.
show interface briefShow example
cs1# show interface brief | grep up . . Eth1/9/3 1 eth trunk up none 100G(D) -- Eth1/9/4 1 eth trunk up none 100G(D) -- Eth1/15/1 1 eth trunk up none 100G(D) -- Eth1/15/2 1 eth trunk up none 100G(D) -- Eth1/15/3 1 eth trunk up none 100G(D) -- Eth1/15/4 1 eth trunk up none 100G(D) -- Eth1/16/1 1 eth trunk up none 100G(D) -- Eth1/16/2 1 eth trunk up none 100G(D) -- Eth1/16/3 1 eth trunk up none 100G(D) -- Eth1/16/4 1 eth trunk up none 100G(D) -- Eth1/17/1 1 eth trunk up none 100G(D) -- Eth1/17/2 1 eth trunk up none 100G(D) -- Eth1/17/3 1 eth trunk up none 100G(D) -- Eth1/17/4 1 eth trunk up none 100G(D) -- . . .
-
Verify that the expected nodes are still connected:
show cdp neighborsShow example
cs1# show cdp neighbors Capability Codes: R - Router, T - Trans-Bridge, B - Source-Route-Bridge S - Switch, H - Host, I - IGMP, r - Repeater, V - VoIP-Phone, D - Remotely-Managed-Device, s - Supports-STP-Dispute Device-ID Local Intrfce Hldtme Capability Platform Port ID cs2(FDOXXXXXXXX) Eth1/31 179 R S I s N9K-C9364D-GX2A Eth1/63 cs2(FDOXXXXXXXX) Eth1/32 179 R S I s N9K-C9364D-GX2A Eth1/64 node1-01 Eth1/4/1 123 H AFX-1K e1a node1-01 Eth1/4/2 123 H AFX-1K e7a node1-01 Eth1/4/3 123 H AFX-1K e10a node1-01 Eth1/4/4 123 H AFX-1K e11a node1-02 Eth1/9/1 138 H AFX-1K e1a node1-02 Eth1/9/2 138 H AFX-1K e7a node1-02 Eth1/9/3 138 H AFX-1K e10a node1-02 Eth1/9/4 138 H AFX-1K e11a node1-03 Eth1/15/1 138 H AFX-1K e1a node1-03 Eth1/15/2 138 H AFX-1K e7a node1-03 Eth1/15/3 138 H AFX-1K e10a node1-03 Eth1/15/4 138 H AFX-1K e11a node1-04 Eth1/16/1 173 H AFX-1K e1a node1-04 Eth1/16/2 173 H AFX-1K e7a node1-04 Eth1/16/3 173 H AFX-1K e10a node1-04 Eth1/16/4 173 H AFX-1K e11a Total entries displayed: 18 -
Verify that the cluster nodes are in their correct cluster VLANs using the following commands:
show vlan briefshow interface trunkShow example
cs1# show vlan brief VLAN Name Status Ports ---- -------------------------------- --------- ------------------------------- 1 default active Po1, Po999, Eth1/31, Eth1/32 Eth1/33, Eth1/34, Eth1/1/1 Eth1/1/2, Eth1/1/3, Eth1/1/4 Eth1/2/1, Eth1/2/2, Eth1/2/3 Eth1/2/4, Eth1/3/1, Eth1/3/2 Eth1/3/3, Eth1/3/4, Eth1/4/1 Eth1/4/2, Eth1/4/3, Eth1/4/4 Eth1/5/1, Eth1/5/2, Eth1/5/3 Eth1/5/4, Eth1/6/1, Eth1/6/2 Eth1/6/3, Eth1/6/4, Eth1/7/1 Eth1/7/2, Eth1/7/3, Eth1/7/4 Eth1/8/1, Eth1/8/2, Eth1/8/3 Eth1/8/4, Eth1/9/1, Eth1/9/2 Eth1/9/3, Eth1/9/4, Eth1/10/1 Eth1/10/2, Eth1/10/3, Eth1/10/4 Eth1/11/1, Eth1/11/2, Eth1/11/3 Eth1/11/4, Eth1/12/1, Eth1/12/2 Eth1/12/3, Eth1/12/4, Eth1/13/1 Eth1/13/2, Eth1/13/3, Eth1/13/4 Eth1/14/1, Eth1/14/2, Eth1/14/3 Eth1/14/4, Eth1/15/1, Eth1/15/2 Eth1/15/3, Eth1/15/4, Eth1/16/1 Eth1/16/2, Eth1/16/3, Eth1/16/4 Eth1/17/1, Eth1/17/2, Eth1/17/3 Eth1/17/4, Eth1/18/1, Eth1/18/2 Eth1/18/3, Eth1/18/4, Eth1/19/1 Eth1/19/2, Eth1/19/3, Eth1/19/4 Eth1/20/1, Eth1/20/2, Eth1/20/3 Eth1/20/4, Eth1/21/1, Eth1/21/2 Eth1/21/3, Eth1/21/4, Eth1/22/1 Eth1/22/2, Eth1/22/3, Eth1/22/4 Eth1/23/1, Eth1/23/2, Eth1/23/3 Eth1/23/4, Eth1/24/1, Eth1/24/2 Eth1/24/3, Eth1/24/4, Eth1/25/1 Eth1/25/2, Eth1/25/3, Eth1/25/4 Eth1/26/1, Eth1/26/2, Eth1/26/3 Eth1/26/4, Eth1/27/1, Eth1/27/2 Eth1/27/3, Eth1/27/4, Eth1/28/1 Eth1/28/2, Eth1/28/3, Eth1/28/4 Eth1/29/1, Eth1/29/2, Eth1/29/3 Eth1/29/4, Eth1/30/1, Eth1/30/2 Eth1/30/3, Eth1/30/4 17 VLAN0017 active Eth1/1/1, Eth1/1/2, Eth1/1/3 Eth1/1/4, Eth1/2/1, Eth1/2/2 Eth1/2/3, Eth1/2/4, Eth1/3/1 Eth1/3/2, Eth1/3/3, Eth1/3/4 Eth1/4/1, Eth1/4/2, Eth1/4/3 Eth1/4/4, Eth1/5/1, Eth1/5/2 Eth1/5/3, Eth1/5/4, Eth1/6/1 Eth1/6/2, Eth1/6/3, Eth1/6/4 Eth1/7/1, Eth1/7/2, Eth1/7/3 Eth1/7/4, Eth1/8/1, Eth1/8/2 Eth1/8/3, Eth1/8/4, Eth1/9/1 Eth1/9/2, Eth1/9/3, Eth1/9/4 Eth1/10/1, Eth1/10/2, Eth1/10/3 Eth1/10/4, Eth1/11/1, Eth1/11/2 Eth1/11/3, Eth1/11/4, Eth1/12/1 Eth1/12/2, Eth1/12/3, Eth1/12/4 Eth1/13/1, Eth1/13/2, Eth1/13/3 Eth1/13/4, Eth1/14/1, Eth1/14/2 Eth1/14/3, Eth1/14/4, Eth1/15/1 Eth1/15/2, Eth1/15/3, Eth1/15/4 Eth1/16/1, Eth1/16/2, Eth1/16/3 Eth1/16/4, Eth1/17/1, Eth1/17/2 Eth1/17/3, Eth1/17/4, Eth1/18/1 Eth1/18/2, Eth1/18/3, Eth1/18/4 Eth1/19/1, Eth1/19/2, Eth1/19/3 Eth1/19/4, Eth1/20/1, Eth1/20/2 Eth1/20/3, Eth1/20/4, Eth1/21/1 Eth1/21/2, Eth1/21/3, Eth1/21/4 Eth1/22/1, Eth1/22/2, Eth1/22/3 Eth1/22/4, Eth1/23/1, Eth1/23/2 Eth1/23/3, Eth1/23/4, Eth1/24/1 Eth1/24/2, Eth1/24/3, Eth1/24/4 Eth1/25/1, Eth1/25/2, Eth1/25/3 Eth1/25/4, Eth1/26/1, Eth1/26/2 Eth1/26/3, Eth1/26/4, Eth1/27/1 Eth1/27/2, Eth1/27/3, Eth1/27/4 Eth1/28/1, Eth1/28/2, Eth1/28/3 Eth1/28/4, Eth1/29/1, Eth1/29/2 Eth1/29/3, Eth1/29/4, Eth1/30/1 Eth1/30/2, Eth1/30/3, Eth1/30/4 18 VLAN0018 active Eth1/1/1, Eth1/1/2, Eth1/1/3 Eth1/1/4, Eth1/2/1, Eth1/2/2 Eth1/2/3, Eth1/2/4, Eth1/3/1 Eth1/3/2, Eth1/3/3, Eth1/3/4 Eth1/4/1, Eth1/4/2, Eth1/4/3 Eth1/4/4, Eth1/5/1, Eth1/5/2 Eth1/5/3, Eth1/5/4, Eth1/6/1 Eth1/6/2, Eth1/6/3, Eth1/6/4 Eth1/7/1, Eth1/7/2, Eth1/7/3 Eth1/7/4, Eth1/8/1, Eth1/8/2 Eth1/8/3, Eth1/8/4, Eth1/9/1 Eth1/9/2, Eth1/9/3, Eth1/9/4 Eth1/10/1, Eth1/10/2, Eth1/10/3 Eth1/10/4, Eth1/11/1, Eth1/11/2 Eth1/11/3, Eth1/11/4, Eth1/12/1 Eth1/12/2, Eth1/12/3, Eth1/12/4 Eth1/13/1, Eth1/13/2, Eth1/13/3 Eth1/13/4, Eth1/14/1, Eth1/14/2 Eth1/14/3, Eth1/14/4, Eth1/15/1 Eth1/15/2, Eth1/15/3, Eth1/15/4 Eth1/16/1, Eth1/16/2, Eth1/16/3 Eth1/16/4, Eth1/17/1, Eth1/17/2 Eth1/17/3, Eth1/17/4, Eth1/18/1 Eth1/18/2, Eth1/18/3, Eth1/18/4 Eth1/19/1, Eth1/19/2, Eth1/19/3 Eth1/19/4, Eth1/20/1, Eth1/20/2 Eth1/20/3, Eth1/20/4, Eth1/21/1 Eth1/21/2, Eth1/21/3, Eth1/21/4 Eth1/22/1, Eth1/22/2, Eth1/22/3 Eth1/22/4, Eth1/23/1, Eth1/23/2 Eth1/23/3, Eth1/23/4, Eth1/24/1 Eth1/24/2, Eth1/24/3, Eth1/24/4 Eth1/25/1, Eth1/25/2, Eth1/25/3 Eth1/25/4, Eth1/26/1, Eth1/26/2 Eth1/26/3, Eth1/26/4, Eth1/27/1 Eth1/27/2, Eth1/27/3, Eth1/27/4 Eth1/28/1, Eth1/28/2, Eth1/28/3 Eth1/28/4, Eth1/29/1, Eth1/29/2 Eth1/29/3, Eth1/29/4, Eth1/30/1 Eth1/30/2, Eth1/30/3, Eth1/30/4 30 VLAN0030 active Eth1/1/1, Eth1/1/2, Eth1/1/3 Eth1/1/4, Eth1/2/1, Eth1/2/2 Eth1/2/3, Eth1/2/4, Eth1/3/1 Eth1/3/2, Eth1/3/3, Eth1/3/4 Eth1/4/1, Eth1/4/2, Eth1/4/3 Eth1/4/4, Eth1/5/1, Eth1/5/2 Eth1/5/3, Eth1/5/4, Eth1/6/1 Eth1/6/2, Eth1/6/3, Eth1/6/4 Eth1/7/1, Eth1/7/2, Eth1/7/3 Eth1/7/4, Eth1/8/1, Eth1/8/2 Eth1/8/3, Eth1/8/4, Eth1/9/1 Eth1/9/2, Eth1/9/3, Eth1/9/4 Eth1/10/1, Eth1/10/2, Eth1/10/3 Eth1/10/4, Eth1/11/1, Eth1/11/2 Eth1/11/3, Eth1/11/4, Eth1/12/1 Eth1/12/2, Eth1/12/3, Eth1/12/4 Eth1/13/1, Eth1/13/2, Eth1/13/3 Eth1/13/4, Eth1/14/1, Eth1/14/2 Eth1/14/3, Eth1/14/4, Eth1/15/1 Eth1/15/2, Eth1/15/3, Eth1/15/4 Eth1/16/1, Eth1/16/2, Eth1/16/3 Eth1/16/4, Eth1/17/1, Eth1/17/2 Eth1/17/3, Eth1/17/4, Eth1/18/1 Eth1/18/2, Eth1/18/3, Eth1/18/4 Eth1/19/1, Eth1/19/2, Eth1/19/3 Eth1/19/4, Eth1/20/1, Eth1/20/2 Eth1/20/3, Eth1/20/4, Eth1/21/1 Eth1/21/2, Eth1/21/3, Eth1/21/4 Eth1/22/1, Eth1/22/2, Eth1/22/3 Eth1/22/4, Eth1/23/1, Eth1/23/2 Eth1/23/3, Eth1/23/4, Eth1/24/1 Eth1/24/2, Eth1/24/3, Eth1/24/4 Eth1/25/1, Eth1/25/2, Eth1/25/3 Eth1/25/4, Eth1/26/1, Eth1/26/2 Eth1/26/3, Eth1/26/4, Eth1/27/1 Eth1/27/2, Eth1/27/3, Eth1/27/4 Eth1/28/1, Eth1/28/2, Eth1/28/3 Eth1/28/4, Eth1/29/1, Eth1/29/2 Eth1/29/3, Eth1/29/4, Eth1/30/1 Eth1/30/2, Eth1/30/3, Eth1/30/4 40 VLAN0040 active Eth1/1/1, Eth1/1/2, Eth1/1/3 Eth1/1/4, Eth1/2/1, Eth1/2/2 Eth1/2/3, Eth1/2/4, Eth1/3/1 Eth1/3/2, Eth1/3/3, Eth1/3/4 Eth1/4/1, Eth1/4/2, Eth1/4/3 Eth1/4/4, Eth1/5/1, Eth1/5/2 Eth1/5/3, Eth1/5/4, Eth1/6/1 Eth1/6/2, Eth1/6/3, Eth1/6/4 Eth1/7/1, Eth1/7/2, Eth1/7/3 Eth1/7/4, Eth1/8/1, Eth1/8/2 Eth1/8/3, Eth1/8/4, Eth1/9/1 Eth1/9/2, Eth1/9/3, Eth1/9/4 Eth1/10/1, Eth1/10/2, Eth1/10/3 Eth1/10/4, Eth1/11/1, Eth1/11/2 Eth1/11/3, Eth1/11/4, Eth1/12/1 Eth1/12/2, Eth1/12/3, Eth1/12/4 Eth1/13/1, Eth1/13/2, Eth1/13/3 Eth1/13/4, Eth1/14/1, Eth1/14/2 Eth1/14/3, Eth1/14/4, Eth1/15/1 Eth1/15/2, Eth1/15/3, Eth1/15/4 Eth1/16/1, Eth1/16/2, Eth1/16/3 Eth1/16/4, Eth1/17/1, Eth1/17/2 Eth1/17/3, Eth1/17/4, Eth1/18/1 Eth1/18/2, Eth1/18/3, Eth1/18/4 Eth1/19/1, Eth1/19/2, Eth1/19/3 Eth1/19/4, Eth1/20/1, Eth1/20/2 Eth1/20/3, Eth1/20/4, Eth1/21/1 Eth1/21/2, Eth1/21/3, Eth1/21/4 Eth1/22/1, Eth1/22/2, Eth1/22/3 Eth1/22/4, Eth1/23/1, Eth1/23/2 Eth1/23/3, Eth1/23/4, Eth1/24/1 Eth1/24/2, Eth1/24/3, Eth1/24/4 Eth1/25/1, Eth1/25/2, Eth1/25/3 Eth1/25/4, Eth1/26/1, Eth1/26/2 Eth1/26/3, Eth1/26/4, Eth1/27/1 Eth1/27/2, Eth1/27/3, Eth1/27/4 Eth1/28/1, Eth1/28/2, Eth1/28/3 Eth1/28/4, Eth1/29/1, Eth1/29/2 Eth1/29/3, Eth1/29/4, Eth1/30/1 Eth1/30/2, Eth1/30/3, Eth1/30/4 cs1# show interface trunk -------------------------------------------------------------------------------- Port Native Status Port Vlan Channel -------------------------------------------------------------------------------- Eth1/1/1 1 trunking -- Eth1/1/2 1 trunking -- Eth1/1/3 1 trunking -- Eth1/1/4 1 trunking -- Eth1/2/1 1 trunking -- Eth1/2/2 1 trunking -- Eth1/2/3 1 trunking -- Eth1/2/4 1 trunking -- . . . Eth1/30/1 none Eth1/30/2 none Eth1/30/3 none Eth1/30/4 none Eth1/31 none Eth1/32 none Po1 1
For specific port and VLAN usage details, refer to the banner and important notes section in your RCF. -
Verify that the ISL between cs1 and cs2 is functional:
show port-channel summaryShow example
cs1# show port-channel summary Flags: D - Down P - Up in port-channel (members) I - Individual H - Hot-standby (LACP only) s - Suspended r - Module-removed b - BFD Session Wait S - Switched R - Routed U - Up (port-channel) p - Up in delay-lacp mode (member) M - Not in use. Min-links not met -------------------------------------------------------------------------------- Group Port- Type Protocol Member Ports Channel -------------------------------------------------------------------------------- 1 Po1(SU) Eth LACP Eth1/31(P) Eth1/32(P) 999 Po999(SD) Eth NONE -- cs1# -
Verify that the cluster LIFs have reverted to their home port:
network interface show -role clusterShow example
cluster1::*> network interface show -role cluster Logical Status Network Current Current Is Vserver Interface Admin/Oper Address/Mask Node Port Home ----------- --------------- ---------- ------------------ ----------- ------- ---- Cluster node1-01_clus1 up/up 169.254.36.44/16 node1-01 e7a true node1-01_clus2 up/up 169.254.7.5/16 node1-01 e7b true node1-02_clus1 up/up 169.254.197.206/16 node1-02 e7a true node1-02_clus2 up/up 169.254.195.186/16 node1-02 e7b true node1-03_clus1 up/up 169.254.192.49/16 node1-03 e7a true node1-03_clus2 up/up 169.254.182.76/16 node1-03 e7b true node1-04_clus1 up/up 169.254.59.49/16 node1-04 e7a true node1-04_clus2 up/up 169.254.62.244/16 node1-04 e7b true 8 entries were displayed.If any cluster LIFs have not returned to their home ports, revert them manually from the local node:
network interface revert -vserver vserver_name -lif <lif-name> -
Verify that the cluster is healthy:
cluster showShow example
cluster1::*> cluster show Node Health Eligibility Epsilon ----------------- ------- ------------- ------- node1-01 true true false node1-02 true true false node1-03 true true true node1-04 true true false 4 entries were displayed.
-
Verify the connectivity of the remote cluster interfaces:
-
You can use the
network interface check cluster-connectivity showcommand to display the details of an accessibility check for cluster connectivity:network interface check cluster-connectivity showShow example
cluster1::*> network interface check cluster-connectivity show Source Destination Packet Node Date LIF LIF Loss ------ -------------------------- ---------------- --------------- ----------- node1-01 6/4/2025 03:13:33 -04:00 node1-01_clus2 node1-02_clus1 none 6/4/2025 03:13:34 -04:00 node1-01_clus2 node1-02_clus1 none node1-02 6/4/2025 03:13:33 -04:00 node1-02_clus2 node1-01_clus1 none 6/4/2025 03:13:34 -04:00 node1-02_clus2 node1-01_clus2 none . . . -
Alternatively, you can use the
cluster ping-cluster -node <node-name>command to check the connectivity:cluster ping-cluster -node <node-name>Show example
cluster1::*> cluster ping-cluster -node local Host is node1-04 Getting addresses from network interface table... Cluster node1-01_clus1 169.254.36.44 node1-01 e7a Cluster node1-01_clus2 169.254.7.5 node1-01 e7b Cluster node1-02_clus1 169.254.197.206 node1-02 e7a Cluster node1-02_clus2 169.254.195.186 node1-02 e7b Cluster node1-03_clus1 169.254.192.49 node1-03 e7a Cluster node1-03_clus2 169.254.182.76 node1-03 e7b Cluster node1-04_clus1 169.254.59.49 node1-04 e7a Cluster node1-04_clus2 169.254.62.244 node1-04 e7b Local = 169.254.59.49 169.254.62.244 Remote = 169.254.36.44 169.254.7.5 169.254.197.206 169.254.195.186 169.254.192.49 169.254.182.76 Cluster Vserver Id = 4294967293 Ping status: ............ Basic connectivity succeeds on 12 path(s) Basic connectivity fails on 0 path(s) ................................................ Detected 9000 byte MTU on 12 path(s): Local 169.254.59.49 to Remote 169.254.182.76 Local 169.254.59.49 to Remote 169.254.192.49 Local 169.254.59.49 to Remote 169.254.195.186 Local 169.254.59.49 to Remote 169.254.197.206 Local 169.254.59.49 to Remote 169.254.36.44 Local 169.254.59.49 to Remote 169.254.7.5 Local 169.254.62.244 to Remote 169.254.182.76 Local 169.254.62.244 to Remote 169.254.192.49 Local 169.254.62.244 to Remote 169.254.195.186 Local 169.254.62.244 to Remote 169.254.197.206 Local 169.254.62.244 to Remote 169.254.36.44 Local 169.254.62.244 to Remote 169.254.7.5 Larger than PMTU communication succeeds on 12 path(s) RPC status: 6 paths up, 0 paths down (tcp check) 6 paths up, 0 paths down (udp check)
-
After you've upgraded your RCF, you verify the SSH configuration.