Skip to main content
简体中文版经机器翻译而成,仅供参考。如与英语版出现任何冲突,应以英语版为准。

升级 RCF 版本 - Cisco Nexus 9364D-GX2A

贡献者 netapp-lisa netapp-yvonneo

您可以升级 Cisco Nexus 9364D-GX2A 交换机上的参考配置文件 (RCF) 版本,以支持新硬件、新 ONTAP 版本,或与 AFX 1K 或 AFX 2K 系统配置中的新 NX-OS 版本保持一致。

备注 请勿将 RCF 版本升级或降级到不受支持的版本。
开始之前
  • 您必须已阅读"安装或升级 RCF 概述"页面。

  • 确保您有交换机配置的当前备份。

  • 确认您的群集已完全正常运行,这意味着日志中没有任何错误或类似问题。

  • 您必须具有当前的 RCF 版本。

  • 您需要在 RCF 中进行引导配置,以反映所需的引导映像。

    如果需要更改启动配置以反映当前的启动映像,则必须在重新应用 RCF 之前进行更改,以便在以后的重启中实例化正确的版本。

关于此任务
  • 为了确保集群操作不中断,此过程要求您在目标交换机上执行步骤时,将所有集群 LIF 迁移到运行中的配对交换机。

  • 在此过程中,无需运行中的交换机间链路 (ISL)。这是设计使然,因为 RCF 版本更改可能会暂时影响 ISL 连接。

  • 由于此过程需要使用 ONTAP 命令和 Cisco Nexus 9000 系列交换机命令,因此这些步骤会指示您使用哪个 CLI 来输入命令。

  • 本流程中的示例使用以下开关和节点命名规则:

    • 这两个Cisco交换机的名称分别是 cs1 和 cs2。

    • 节点名称为node1-01、node1-02、node1-03和node1-04。

    • 集群 LIF 名称为:

      • node1-01 的 node1-01_clus1 和 node1-01_clus2

      • node1-02 的 node1-02_clus1 和 node1-02_clus2

      • node1-03 的 node1-03_clus1 和 node1-03_clus2

      • node1-04 的 node1-04_clus1 和 node1-04_clus2

    • 这 `cluster1::*>`prompt 指示集群名称。

  • 本程序中显示的示例适用于运行 RCF 10.0 的交换机的 AFX 1K 系统。如果您有 AFX 2K 系统,则输入和输出可能会有所不同。

第一步:准备升级

使用 ONTAP CLI 执行以下步骤,根据需要禁止自动创建案例、检查端口上的管理和操作状态,并在集群 LIF 上禁用自动还原,从而为 RCF 升级做好准备。

  1. 如果此集群上启用了AutoSupport ,则通过调用AutoSupport消息来抑制自动创建案例:

    system node autosupport invoke -node * -type all -message MAINT=<number of hours down>h
  2. 将权限级别更改为高级,并在提示继续时输入 y

    set -privilege advanced

    出现高级提示符(*>)。

  3. 显示每个节点上连接到交换机的集群端口:

    network device-discovery show
    显示示例
    cluster1::*> network device-discovery show
    
    Node/       Local  Discovered
    Protocol    Port   Device (LLDP: ChassisID)  Interface         Platform
    ----------- ------ ------------------------- ----------------  --------
    node1-01/cdp
                e10a   cs1(FLMXXXXXXXX)         Ethernet1/16/3    N9K-C9364D-GX2A
                e10b   cs1(FDOXXXXXXXX)         Ethernet1/13/3    N9K-C9364D-GX2A
                e11a   cs1(FLMXXXXXXXX)         Ethernet1/16/4    N9K-C9364D-GX2A
                e11b   cs1(FDOXXXXXXXX)         Ethernet1/13/4    N9K-C9364D-GX2A
                e1a    cs1(FLMXXXXXXXX)         Ethernet1/16/1    N9K-C9364D-GX2A
                e1b    cs1(FDOXXXXXXXX)         Ethernet1/13/1    N9K-C9364D-GX2A
                .
                .
                .
                e7a    cs1(FLMXXXXXXXX)         Ethernet1/16/2    N9K-C9364D-GX2A
                e7b    cs1(FDOXXXXXXXX)         Ethernet1/13/2    N9K-C9364D-GX2A
    node1-01/lldp
                e10a   cs1 (c8:60:8f:xx:xx:xx)   Ethernet1/16/3    -
                e10b   cs2 (04:e3:87:xx:xx:xx)   Ethernet1/16/3    -
                e11a   cs1 (c8:60:8f:xx:xx:xx)   Ethernet1/16/4    -
                e11b   cs2 (04:e3:87:xx:xx:xx)   Ethernet1/16/4    -
                e1a    cs1 (c8:60:8f:xx:xx:xx)   Ethernet1/16/1    -
                e1b    cs2 (04:e3:87:xx:xx:xx)   Ethernet1/16/1    -
                .
                .
                .
                e7a    cs1 (c8:60:8f:xx:xx:xx)   Ethernet1/16/2    -
                e7b    cs2 (04:e3:87:xx:xx:xx)   Ethernet1/16/2    -
    .
    .
    .
  4. 检查各港口的行政及营运状况。

    1. 集群端口

      1. 确认集群所有端口均已启动且状态正常:

        network port show -ipspace Cluster
        显示示例
        cluster1::*> network port show -ipspace Cluster
        
        Node: node1-01
                                                                               Ignore
                                                          Speed(Mbps) Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
        --------- ------------ ---------------- ---- ---- ----------- -------- ------
        e7a       Cluster      Cluster          up   9000  auto/100000 healthy false
        e7b       Cluster      Cluster          up   9000  auto/100000 healthy false
        
        Node:node1-02
                                                                               Ignore
                                                          Speed(Mbps) Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
        --------- ------------ ---------------- ---- ---- ----------- -------- ------
        e7a       Cluster      Cluster          up   9000  auto/100000 healthy false
        e7b       Cluster      Cluster          up   9000  auto/100000 healthy false
        
        Node: node1-03
        
                                                                            Ignore
                                                          Speed(Mbps) Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
        --------- ------------ ---------------- ---- ---- ----------- -------- ------
        e7a       Cluster      Cluster          up   9000  auto/10000 healthy  false
        e7b       Cluster      Cluster          up   9000  auto/10000 healthy  false
        
        Node: node1-04
                                                                               Ignore
                                                          Speed(Mbps) Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
        --------- ------------ ---------------- ---- ---- ----------- -------- ------
        e7a       Cluster      Cluster          up   9000  auto/10000 healthy  false
        e7b       Cluster      Cluster          up   9000  auto/10000 healthy  false
        cluster1::*>
      2. 确认所有集群接口(LIF)都位于主端口上:

        network interface show -role cluster
        显示示例
        cluster1::*> network interface show -role cluster
                    Logical          Status      Network           Current      Current Is
        Vserver     Interface        Admin/Oper  Address/Mask      Node         Port    Home
        ----------- ---------------- ----------- ----------------- ------------ ------- ----
        Cluster
                    node1-01_clus1   up/up       169.254.3.4/23    node1-01     e7a     true
                    node1-01_clus2   up/up       169.254.3.5/23    node1-01     e7b     true
                    node1-02_clus1   up/up       169.254.3.8/23    node1-02     e7a     true
                    node1-02_clus2   up/up       169.254.3.9/23    node1-02     e7b     true
                    node1-03_clus1   up/up       169.254.1.3/23    node1-03     e7a     true
                    node1-03_clus2   up/up       169.254.1.1/23    node1-03     e7b     true
                    node1-04_clus1   up/up       169.254.1.6/23    node1-04     e7a     true
                    node1-04_clus2   up/up       169.254.1.7/23    node1-04     e7b     true
        8 entries were displayed.
      3. 验证集群是否显示两个交换机的信息:

        system cluster-switch show -is-monitoring-enabled-operational true
        显示示例
        cluster1::*> system cluster-switch show -is-monitoring-enabled-operational true
        Switch                      Type               Address          Model
        --------------------------- ------------------ ---------------- -----
        cs1(FDOXXXXXXXX)            cluster-network    10.228.137.233   N9K-C9364D-GX2A
             Serial Number: FDOXXXXXXXX
              Is Monitored: true
                    Reason: None
          Software Version: Cisco Nexus Operating System (NX-OS) Software, Version
                            10.4(2)
            Version Source: CDP/ISDP
        
        cs2(FLMXXXXXXXX)            cluster-network    10.228.137.234   N9K-C9364D-GX2A
             Serial Number: FLMXXXXXXXX
              Is Monitored: true
                    Reason: None
          Software Version: Cisco Nexus Operating System (NX-OS) Software, Version
                            10.4(2)
            Version Source: CDP/ISDP
    2. HA 端口

      1. 验证所有 HA 端口是否处于正常运行状态:

        ha interconnect status show -node <node-name>
        显示示例
        cluster1::*> ha interconnect status show -node node1-01
          (system ha interconnect status show)
        
                               Node: node1-01
                      Link 0 Status: up
                      Link 1 Status: up
                   Is Link 0 Active: true
                   Is Link 1 Active: true
                 IC RDMA Connection: up
                               Slot: 0
                     Debug Firmware: no
        
        
        Interconnect Port 0 :
                          Port Name: e1a-17
                                MTU: 4096
                   Link Information: ACTIVE
        
        
        Interconnect Port 1 :
                          Port Name: e1b-18
                                MTU: 4096
                   Link Information: ACTIVE
        
        cluster1::*> ha interconnect status show -node node1-01
          (system ha interconnect status show)
        
                               Node: node1-01
                      Link 0 Status: up
                      Link 1 Status: up
                   Is Link 0 Active: true
                   Is Link 1 Active: true
                 IC RDMA Connection: up
                               Slot: 0
                     Debug Firmware: no
        
        
        Interconnect Port 0 :
                          Port Name: e1a-17
                                MTU: 4096
                   Link Information: ACTIVE
        
        
        Interconnect Port 1 :
                          Port Name: e1b-18
                                MTU: 4096
                   Link Information: ACTIVE
        .
        .
        .
    3. 存储端口

      1. 验证所有存储端口均处于正常状态:

        storage port show -port-type ENET
        显示示例
        cluster1::*> storage port show -port-type ENET
        
        
                                              Speed
        Node               Port Type  Mode    (Gb/s) State    Status
        ------------------ ---- ----- ------- ------ -------- -----------
        node1-01
                           e10a ENET  -          100 enabled  online
                           e10b ENET  -          100 enabled  online
                           e11a ENET  -          100 enabled  online
                           e11b ENET  -          100 enabled  online
        node1-02
                           e10a ENET  -          100 enabled  online
                           e10b ENET  -          100 enabled  online
                           e11a ENET  -          100 enabled  online
                           e11b ENET  -          100 enabled  online
        node1-03
                           e10a ENET  -          100 enabled  online
                           e10b ENET  -          100 enabled  online
                           e11a ENET  -          100 enabled  online
        node1-04
                           e10a ENET  -          100 enabled  online
                           e10b ENET  -          100 enabled  online
                           e11a ENET  -          100 enabled  online
                           e11b ENET  -          100 enabled  online
        16 entries were displayed.
    4. 存储架端口

      1. 验证所有存储架端口是否处于正常状态:

        storage shelf port show
        显示示例
        cluster1::*> storage shelf port show
        
        Shelf ID Module State        Internal?
        ----- -- ------ ------------ ---------
        1.1
               0 A      connected    false
               1 A      connected    false
               2 A      connected    false
               3 A      connected    false
               4 A      connected    false
               5 A      connected    false
               6 A      connected    false
               7 A      connected    false
               8 B      connected    false
               9 B      connected    false
              10 B      connected    false
              11 B      connected    false
              12 B      connected    false
              13 B      connected    false
              14 B      connected    false
              15 B      connected    false
        
        16 entries were displayed.
      2. 验证所有存储架端口是否处于正常状态:

        storage shelf port show -fields remote-device,remote-port,connector-state
        显示示例
        cluster1::*> storage shelf port show -fields remote-device,remote-port,connector-state
        
        shelf id connector-state remote-port    remote-device
        ----- -- --------------- -------------- -----------------
        1.1   0  connected       Ethernet1/17/1 CX9332D-cs1
        1.1   1  connected       Ethernet1/15/1 CX9364D-cs1
        1.1   2  connected       Ethernet1/17/2 CX9332D-cs1
        1.1   3  connected       Ethernet1/15/2 CX9364D-cs1
        1.1   4  connected       Ethernet1/17/3 CX9332D-cs1
        1.1   5  connected       Ethernet1/15/3 CX9364D-cs1
        1.1   6  connected       Ethernet1/17/4 CX9332D-cs1
        1.1   7  connected       Ethernet1/15/4 CX9364D-cs1
        1.1   8  connected       Ethernet1/19/1 CX9332D-cs1
        1.1   9  connected       Ethernet1/17/1 CX9364D-cs1
        1.1   10 connected       Ethernet1/19/2 CX9332D-cs1
        1.1   11 connected       Ethernet1/17/2 CX9364D-cs1
        1.1   12 connected       Ethernet1/19/3 CX9332D-cs1
        1.1   13 connected       Ethernet1/17/3 CX9364D-cs1
        1.1   14 connected       Ethernet1/19/4 CX9332D-cs1
        1.1   15 connected       Ethernet1/17/4 CX9364D-cs1
        
        16 entries were displayed.
  5. 禁用集群 LIF 上的自动还原。在目标交换机上执行此过程时,集群 LIF 将故障转移到伙伴集群交换机并保留在那里:

    network interface modify -vserver Cluster -lif * -auto-revert false

步骤 2:升级 RCF

您可以使用交换机 CLI 和 ONTAP CLI(如以下步骤所示)进行 RCF 升级。升级第一个交换机(cs1)上的 RCF,然后对第二个交换机(cs2)重复这些步骤。

  1. 使用交换机 CLI,在交换机 cs1 上关闭连接到节点所有端口的端口。

    注意 请确保关闭*所有*连接的端口,以避免任何网络连接问题。有关详细信息,请参见知识库文章 "在切换操作系统升级期间迁移集群 LIF 时,节点脱离仲裁。"
    cs1# config
    cs1(config)# interface e1/1/1-4,e1/2/1-4,e1/3/1-4,e1/4/1-4,e1/5/1-4,e1/6/1-4,e1/7/1-4,e1/8/1-4
    cs1(config-if-range)# shutdown
    cs1(config)# interface e1/9/1-4,e1/10/1-4,e1/11/1-4,e1/12/1-4,e1/13/1-4,e1/14/1-4,e1/15/1-4,e1/16/1-4
    cs1(config-if-range)# shutdown
    cs1(config)# interface e1/17/1-4,e1/18/1-4,e1/19/1-4,e1/20/1-4,e1/21/1-4,e1/22/1-4,e1/23/1-4,e1/24/1-4
    cs1(config-if-range)# shutdown
    cs1(config)# interface e1/25/1-4,e1/26/1-4,e1/27/1-4,e1/28/1-4,e1/29/1-4,e1/30/1-4,e1/31/1-4,e1/32/1-4
    cs1(config-if-range)# shutdown
    cs1(config)# interface e1/33/1-4,e1/34/1-4,e1/35/1-4,e1/36/1-4,e1/37/1-4,e1/38/1-4,e1/39/1-4,e1/40/1-4
    cs1(config-if-range)# shutdown
    cs1(config)# interface e1/41/1-4,e1/42/1-4,e1/43/1-4,e1/44/1-4,e1/35/1-4,e1/46/1-4,e1/47/1-4,e1/48/1-4
    cs1(config-if-range)# shutdown
    cs1(config)# interface e1/49/1-4,e1/50/1-4,e1/51/1-4,e1/52/1-4,e1/53/1-4,e1/54/1-4,e1/55/1-4,e1/56/1-4
    cs1(config-if-range)# shutdown
    cs1(config)# interface e1/57/1-4,e1/58/1-4,e1/59/1-4,e1/60/1-4,e1/61/1-4,e1/62/1-4
    cs1(config-if-range)# shutdown
    cs1(config-if-range)# exit
    cs1(config)# exit
  2. 使用 ONTAP CLI,验证集群 LIF 是否已故障切换到交换机 cs1 上托管的端口。这可能需要几秒钟。

    network interface show -role cluster
    显示示例
    cluster1::*> network interface show -role cluster
                Logical           Status     Network            Current       Current Is
    Vserver     Interface         Admin/Oper Address/Mask       Node          Port    Home
    ----------- ----------------- ---------- ------------------ ------------- ------- ----
    Cluster
                node1-01_clus1    up/up      169.254.36.44/16   node1-01      e7a     true
                node1-01_clus2    up/up      169.254.7.5/16     node1-01      e7b     true
                node1-02_clus1    up/up      169.254.197.206/16 node1-02      e7a     true
                node1-02_clus2    up/up      169.254.195.186/16 node1-02      e7b     true
                node1-03_clus1    up/up      169.254.192.49/16  node1-03      e7a     true
                node1-03_clus2    up/up      169.254.182.76/16  node1-03      e7b     true
                node1-04_clus1    up/up      169.254.59.49/16   node1-04      e7a     true
                node1-04_clus2    up/up      169.254.62.244/16  node1-04      e7b     true
    8 entries were displayed.
  3. 使用 ONTAP CLI,验证集群是否正常:

    cluster show
    显示示例
    cluster1::*> cluster show
    Node              Health  Eligibility   Epsilon
    ----------------- ------- ------------  -------
    node1-01          true    true          false
    node1-02          true    true          false
    node1-03          true    true          true
    node1-04          true    true          false
    4 entries were displayed.
  4. 如果尚未执行此操作,请使用交换机 CLI,通过将以下命令的输出复制到文本文件来保存当前交换机配置的副本:

    show running-config

    1. 使用 `show diff running-config`命令与引导闪存中保存的 RCF 文件进行比较。否则,请使用第三方差异/比较工具。

  5. 保存基本配置详细信息 `write_erase.cfg`启动闪存上的文件。

    备注

    确保配置以下内容:

    • 用户名和密码

    • 管理 IP 地址

    • 默认网关

    • 交换机名称

    注意

    如果 write_erase.cfg`文件已存在,请将其重命名为 `write_erase_old.cfg,如下所示:

    cs1# move bootflash:write_erase.cfg write_erase_old.cfg

    cs1# show run | i "username admin password" > bootflash:write_erase.cfg

    cs1# show run | section "vrf context management" >> bootflash:write_erase.cfg

    cs1# show run | section "interface mgmt0" >> bootflash:write_erase.cfg

    cs1# show run | section "switchname" >> bootflash:write_erase.cfg

    cs1# echo "hardware access-list tcam region ing-racl 1024" >> bootflash:write_erase.cfg

    cs1# echo "hardware access-list tcam region egr-racl 1024" >> bootflash:write_erase.cfg

    cs1# echo "hardware access-list tcam region ing-l2-qos 1536" >> bootflash:write_erase.cfg

    有关更多详细信息,请参见知识库文章 "如何在保持远程连接的情况下清除Cisco互连交换机上的配置"

  6. 使用交换机 CLI,验证 `write_erase.cfg`文件是否按预期填充:

    show file bootflash:write_erase.cfg

  7. 使用交换机命令行界面,清除当前保存的配置:

    write erase

    Warning: This command will erase the startup-configuration.

    Do you wish to proceed anyway? (y/n) [n] y

  8. 使用交换机 CLI,将先前保存的基本配置复制到启动配置中:

    copy bootflash:write_erase.cfg startup-config

  9. 使用交换机命令行界面重启交换机:

    reload

    This command will reboot the system. (y/n)? [n] y

  10. 管理 IP 地址恢复正常后,通过 SSH 登录交换机。

    您可能需要更新与 SSH 密钥相关的 hosts 文件条目。

  11. 使用交换机 CLI,使用以下传输协议之一将 RCF 复制到交换机 cs1 的引导闪存:FTP、TFTP、SFTP 或 SCP。

    有关 Cisco 命令的更多信息,请参见 "Cisco Nexus 9000 系列 NX-OS 命令参考" 中的相应指南。

    copy <protocol>: bootflash: vrf management

    显示示例

    此示例展示了如何使用 TFTP 将 RCF 文件复制到交换机 cs1 的启动闪存中:

    cs1# copy tftp: bootflash: vrf management
    Enter source filename: NX9364D-GX2A-RCF-v10.0-Shared.txt
    Enter hostname for the tftp server: 172.22.201.50
    Trying to connect to tftp server......Connection to Server Established.
    TFTP get operation was successful
    Copy complete, now saving to disk (please wait)...
  12. 使用交换机 CLI,将先前下载的 RCF 应用于引导闪存。

    有关 Cisco 命令的更多信息,请参见 "Cisco Nexus 9000 系列 NX-OS 命令参考" 中的相应指南。

    此示例展示了 RCF 文件 `NX9364D-GX2A-RCF-v10.0-Shared.txt`正在交换机 cs1 上安装:

    cs1# copy NX9364D-GX2A-RCF-v10.0-Shared.txt running-config echo-commands
    注意

    请务必仔细阅读 RCF 的*安装说明*、*重要说明*和*横幅*部分。

    您必须阅读并遵循这些说明,以确保交换机配置和操作正确。

  13. 使用交换机 CLI,验证 RCF 文件是否为正确的较新版本:

    show running-config

    检查输出结果以验证是否拥有正确的 RCF 时,请确保以下信息正确:

    • RCF横幅

    • 节点和端口设置

    • 定制

      输出结果会根据您的网站配置而有所不同。检查端口设置,并参考发行说明,了解您安装的 RCF 版本是否有任何特定更改。

  14. 将之前对交换机配置所做的任何自定义设置重新应用。

    如果您的交换机运行的是 RCF 10.1 或更高版本,则可以根据需要 "更改端口速度配置"

  15. 使用交换机 CLI,验证 RCF 版本、自定义添加和交换机设置是否正确后,将 running-config 文件复制到 startup-config 文件。

    有关 Cisco 命令的更多信息,请参见 "Cisco Nexus 9000 系列 NX-OS 命令参考" 中的相应指南。

    copy running-config startup-config

    [] 100% Copy complete

  16. 使用交换机 CLI 重新启动交换机 cs1。您可以在交换机重新启动时忽略节点上报告的 “cluster switch health monitor” 警报和 “cluster ports down” 事件。

    reload

    This command will reboot the system. (y/n)? [n] y

  17. 使用 ONTAP CLI,验证集群上所有端口的运行状况:

    1. 集群端口

      1. 确认集群中所有节点的集群端口均已启动且运行状况良好:

        network port show -ipspace Cluster
        显示示例
        cluster1::*> network port show -ipspace Cluster
        
        Node: node1-01
                                                                               Ignore
                                                          Speed(Mbps) Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
        --------- ------------ ---------------- ---- ---- ----------- -------- ------
        e7a       Cluster      Cluster          up   9000  auto/10000 healthy  false
        e7b       Cluster      Cluster          up   9000  auto/10000 healthy  false
        
        Node: node1-02
                                                                               Ignore
                                                          Speed(Mbps) Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
        --------- ------------ ---------------- ---- ---- ----------- -------- ------
        e7a       Cluster      Cluster          up   9000  auto/10000 healthy  false
        e7b       Cluster      Cluster          up   9000  auto/10000 healthy  false
        
        Node: node1-03
                                                                               Ignore
                                                          Speed(Mbps) Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
        --------- ------------ ---------------- ---- ---- ----------- -------- ------
        e7a       Cluster      Cluster          up   9000  auto/100000 healthy false
        e7b       Cluster      Cluster          up   9000  auto/100000 healthy false
        
        Node: node1-04
                                                                               Ignore
                                                          Speed(Mbps) Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
        --------- ------------ ---------------- ---- ---- ----------- -------- ------
        e7a       Cluster      Cluster          up   9000  auto/100000 healthy false
        e7b       Cluster      Cluster          up   9000  auto/100000 healthy false
        8 entries were displayed.
      2. 从集群中验证交换机的运行状况。

        network device-discovery show -protocol cdp
        system cluster-switch show -is-monitoring-enabled-operational true
        显示示例
        cluster1::*> network device-discovery show -protocol cdp
        Node/       Local  Discovered
        Protocol    Port   Device (LLDP: ChassisID)  Interface         Platform
        ----------- ------ ------------------------- ----------------- --------
        node1-01/cdp
                    e10a   cs1(FLMXXXXXXXX)          Ethernet1/16/3    N9K-C9364D-GX2A
                    e10b   cs2(FDOXXXXXXXX)          Ethernet1/13/3    N9K-C9364D-GX2A
                    e11a   cs1(FLMXXXXXXXX)          Ethernet1/16/4    N9K-C9364D-GX2A
                    e11b   cs2(FDOXXXXXXXX)          Ethernet1/13/4    N9K-C9364D-GX2A
                    e1a    cs1(FLMXXXXXXXX)          Ethernet1/16/1    N9K-C9364D-GX2A
                    e1b    cs2(FLMXXXXXXXX)          Ethernet1/13/1    N9K-C9364D-GX2A
                    .
                    .
                    .
                    e7a    cs1(FLMXXXXXXXX)          Ethernet1/16/2    N9K-C9364D-GX2A
                    e7b    cs2(FDOXXXXXXXX)          Ethernet1/13/2    N9K-C9364D-GX2A
        node1-02/cdp
        .
        .
        .
        
        cluster1::*> system cluster-switch show -is-monitoring-enabled-operational true
        Switch                      Type               Address          Model
        --------------------------- ------------------ ---------------- -----
        cs2(FDOXXXXXXXX)            cluster-network    10.228.137.233   N9K-C9364D-GX2A
             Serial Number: FDOXXXXXXXX
              Is Monitored: true
                    Reason: None
          Software Version: Cisco Nexus Operating System (NX-OS) Software, Version
                            10.4(2)
            Version Source: CDP/ISDP
        
        cs1(FLMXXXXXXXX)            cluster-network    10.228.137.234   N9K-C9364D-GX2A
             Serial Number: FLMXXXXXXXX
              Is Monitored: true
                    Reason: None
          Software Version: Cisco Nexus Operating System (NX-OS) Software, Version
                            10.4(2)
            Version Source: CDP/ISDP
        
        2 entries were displayed.
    2. HA 端口

      1. 验证所有 HA 端口是否处于正常运行状态:

        ha interconnect status show -node <node-name>
        显示示例
        cluster1::*> ha interconnect status show -node node1-01
          (system ha interconnect status show)
        
                               Node: node1-01
                      Link 0 Status: up
                      Link 1 Status: up
                   Is Link 0 Active: true
                   Is Link 1 Active: true
                 IC RDMA Connection: up
                               Slot: 0
                     Debug Firmware: no
        
        
        Interconnect Port 0 :
                          Port Name: e1a-17
                                MTU: 4096
                   Link Information: ACTIVE
        
        
        Interconnect Port 1 :
                          Port Name: e1b-18
                                MTU: 4096
                   Link Information: ACTIVE
        
        cluster1::*> ha interconnect status show -node node1-02
          (system ha interconnect status show)
        
                               Node: node1-02
                      Link 0 Status: up
                      Link 1 Status: up
                   Is Link 0 Active: true
                   Is Link 1 Active: true
                 IC RDMA Connection: up
                               Slot: 0
                     Debug Firmware: no
        
        
        Interconnect Port 0 :
                          Port Name: e1a-17
                                MTU: 4096
                   Link Information: ACTIVE
        
        
        Interconnect Port 1 :
                          Port Name: e1b-18
                                MTU: 4096
                   Link Information: ACTIVE
        .
        .
        .
    3. 存储端口

      1. 验证所有存储端口均处于正常状态:

        storage port show -port-type ENET
        显示示例
        cluster1::*> storage port show -port-type ENET
        
        
                                              Speed
        Node               Port Type  Mode    (Gb/s) State    Status
        ------------------ ---- ----- ------- ------ -------- -----------
        node1-01
                           e10a ENET  -          100 enabled  online
                           e10b ENET  -          100 enabled  online
                           e11a ENET  -          100 enabled  online
                           e11b ENET  -          100 enabled  online
        node1-02
                           e10a ENET  -          100 enabled  online
                           e10b ENET  -          100 enabled  online
                           e11a ENET  -          100 enabled  online
                           e11b ENET  -          100 enabled  online
        node1-03
                           e10a ENET  -          100 enabled  online
                           e10b ENET  -          100 enabled  online
                           e11a ENET  -          100 enabled  online
        node1-04
                           e10a ENET  -          100 enabled  online
                           e10b ENET  -          100 enabled  online
                           e11a ENET  -          100 enabled  online
                           e11b ENET  -          100 enabled  online
        16 entries were displayed.
    4. 存储架端口

      1. 验证所有存储架端口是否处于正常状态:

        storage shelf port show
        显示示例
        cluster1::*> storage shelf port show
        
        Shelf ID Module State        Internal?
        ----- -- ------ ------------ ---------
        1.1
               0 A      connected    false
               1 A      connected    false
               2 A      connected    false
               3 A      connected    false
               4 A      connected    false
               5 A      connected    false
               6 A      connected    false
               7 A      connected    false
               8 B      connected    false
               9 B      connected    false
              10 B      connected    false
              11 B      connected    false
              12 B      connected    false
              13 B      connected    false
              14 B      connected    false
              15 B      connected    false
        
        16 entries were displayed.
      2. 验证所有存储架端口的连接状态:

        storage shelf port show -fields remote-device,remote-port,connector-state
        显示示例
        cluster1::*> storage shelf port show -fields remote-device,remote-port,connector-state
        
        shelf id connector-state remote-port    remote-device
        ----- -- --------------- -------------- -----------------
        1.1   0  connected       Ethernet1/17/1 CX9332D-cs1
        1.1   1  connected       Ethernet1/15/1 CX9364D-cs1
        1.1   2  connected       Ethernet1/17/2 CX9332D-cs1
        1.1   3  connected       Ethernet1/15/2 CX9364D-cs1
        1.1   4  connected       Ethernet1/17/3 CX9332D-cs1
        1.1   5  connected       Ethernet1/15/3 CX9364D-cs1
        1.1   6  connected       Ethernet1/17/4 CX9332D-cs1
        1.1   7  connected       Ethernet1/15/4 CX9364D-cs1
        1.1   8  connected       Ethernet1/19/1 CX9332D-cs1
        1.1   9  connected       Ethernet1/17/1 CX9364D-cs1
        1.1   10 connected       Ethernet1/19/2 CX9332D-cs1
        1.1   11 connected       Ethernet1/17/2 CX9364D-cs1
        1.1   12 connected       Ethernet1/19/3 CX9332D-cs1
        1.1   13 connected       Ethernet1/17/3 CX9364D-cs1
        1.1   14 connected       Ethernet1/19/4 CX9332D-cs1
        1.1   15 connected       Ethernet1/17/4 CX9364D-cs1
        
        16 entries were displayed.
  18. 使用 ONTAP CLI,验证集群是否正常:

    cluster show
    显示示例
    cluster1::*> cluster show
    Node              Health   Eligibility   Epsilon
    ----------------- -------- ------------- -------
    node1-01          true     true          false
    node1-02          true     true          false
    node1-03          true     true          true
    node1-04          true     true          false
    4 entries were displayed.
  19. 在交换机 cs2 上重复步骤 4 至 18。

  20. 使用 ONTAP CLI,在集群 LIF 上启用自动还原。

    network interface modify -vserver Cluster -lif * -auto-revert true

步骤 3:验证集群网络配置和集群健康状况

在两台交换机上升级 RCF 后,验证集群网络配置和集群运行状况。

  1. 使用交换机 CLI,验证连接到集群端口的交换机端口是否处于 up 状态。

    show interface brief

    显示示例
    cs1# show interface brief | grep up
    .
    .
    Eth1/9/3        1       eth  trunk  up      none                     100G(D) --
    Eth1/9/4        1       eth  trunk  up      none                     100G(D) --
    Eth1/15/1       1       eth  trunk  up      none                     100G(D) --
    Eth1/15/2       1       eth  trunk  up      none                     100G(D) --
    Eth1/15/3       1       eth  trunk  up      none                     100G(D) --
    Eth1/15/4       1       eth  trunk  up      none                     100G(D) --
    Eth1/16/1       1       eth  trunk  up      none                     100G(D) --
    Eth1/16/2       1       eth  trunk  up      none                     100G(D) --
    Eth1/16/3       1       eth  trunk  up      none                     100G(D) --
    Eth1/16/4       1       eth  trunk  up      none                     100G(D) --
    Eth1/17/1       1       eth  trunk  up      none                     100G(D) --
    Eth1/17/2       1       eth  trunk  up      none                     100G(D) --
    Eth1/17/3       1       eth  trunk  up      none                     100G(D) --
    Eth1/17/4       1       eth  trunk  up      none                     100G(D) --
    .
    .
    .
  2. 使用交换机 CLI,验证预期节点是否仍然连接:

    show cdp neighbors

    显示示例
    cs1# show cdp neighbors
    
    Capability Codes: R - Router, T - Trans-Bridge, B - Source-Route-Bridge
                      S - Switch, H - Host, I - IGMP, r - Repeater,
                      V - VoIP-Phone, D - Remotely-Managed-Device,
                      s - Supports-STP-Dispute
    
    Device-ID          Local Intrfce  Hldtme Capability  Platform      Port ID
    cs2(FDOXXXXXXXX)    Eth1/63        179    R S I s   N9K-C9332D-GX2B   Eth1/31
    cs2(FDOXXXXXXXX)    Eth1/64        179    R S I s   N9K-C9332D-GX2B   Eth1/32
    node1-01            Eth1/4/1       123    H         AFX-1K            e1a
    node1-01            Eth1/4/2       123    H         AFX-1K            e7a
    node1-01            Eth1/4/3       123    H         AFX-1K            e10a
    node1-01            Eth1/4/4       123    H         AFX-1K            e11a
    node1-02            Eth1/9/1       138    H         AFX-1K            e1a
    node1-02            Eth1/9/2       138    H         AFX-1K            e7a
    node1-02            Eth1/9/3       138    H         AFX-1K            e10a
    node1-02            Eth1/9/4       138    H         AFX-1K            e11a
    node1-03            Eth1/15/1      138    H         AFX-1K            e1a
    node1-03            Eth1/15/2      138    H         AFX-1K            e7a
    node1-03            Eth1/15/3      138    H         AFX-1K            e10a
    node1-03            Eth1/15/4      138    H         AFX-1K            e11a
    node1-04            Eth1/16/1      173    H         AFX-1K            e1a
    node1-04            Eth1/16/2      173    H         AFX-1K            e7a
    node1-04            Eth1/16/3      173    H         AFX-1K            e10a
    node1-04            Eth1/16/4      173    H         AFX-1K            e11a
    
    Total entries displayed: 18
  3. 使用交换机 CLI,使用以下命令验证集群节点是否位于其正确的集群 VLAN 中:

    show vlan brief

    show interface trunk

    显示示例
    cs1# show vlan brief
    
    VLAN Name                             Status    Ports
    ---- -------------------------------- --------- -------------------------------
    1    default                          active    Po1, Po999, Eth1/63, Eth1/64
                                                    Eth1/65, Eth1/66, Eth1/1/1
                                                    Eth1/1/2, Eth1/1/3, Eth1/1/4
    .
    .
    .
                                                    Eth1/61/2, Eth1/61/3, Eth1/61/4
                                                    Eth1/62/1, Eth1/62/2, Eth1/62/3
                                                    Eth1/62/4
    17   VLAN0017                         active    Eth1/1/1, Eth1/1/2, Eth1/1/3
                                                    Eth1/1/4, Eth1/2/1, Eth1/2/2
    .
    .
    .
                                                    Eth1/61/1, Eth1/61/2, Eth1/61/3
                                                    Eth1/61/4, Eth1/62/1, Eth1/62/2
                                                    Eth1/62/3, Eth1/62/4
    18   VLAN0018                         active    Eth1/1/1, Eth1/1/2, Eth1/1/3
                                                    Eth1/1/4, Eth1/2/1, Eth1/2/2
    .
    .
    .
                                                    Eth1/61/1, Eth1/61/2, Eth1/61/3
                                                    Eth1/61/4, Eth1/62/1, Eth1/62/2
                                                    Eth1/62/3, Eth1/62/4
    30   VLAN0030                         active    Eth1/1/1, Eth1/1/2, Eth1/1/3
                                                    Eth1/1/4, Eth1/2/1, Eth1/2/2
    .
    .
    .
                                                    Eth1/61/1, Eth1/61/2, Eth1/61/3
                                                    Eth1/61/4, Eth1/62/1, Eth1/62/2
                                                    Eth1/62/3, Eth1/62/4
    40   VLAN0040                         active    Eth1/1/1, Eth1/1/2, Eth1/1/3
                                                    Eth1/1/4, Eth1/2/1, Eth1/2/2
    .
    .
    .
                                                    Eth1/61/1, Eth1/61/2, Eth1/61/3
                                                    Eth1/61/4, Eth1/62/1, Eth1/62/2
                                                    Eth1/62/3, Eth1/62/4
    
    cs1# show interface trunk
    
    -----------------------------------------------------
    Port          Native  Status        Port
                  Vlan                  Channel
    -----------------------------------------------------
    Eth1/1/1      1       trunking      --
    Eth1/1/2      1       trunking      --
    Eth1/1/3      1       trunking      --
    Eth1/1/4      1       trunking      --
    Eth1/2/1      1       trunking      --
    Eth1/2/2      1       trunking      --
    Eth1/2/3      1       trunking      --
    Eth1/2/4      1       trunking      --
    .
    .
    .
    Eth1/62/2     none
    Eth1/62/3     none
    Eth1/62/4     none
    Eth1/63       none
    Eth1/64       none
    Po1           1
    备注 有关具体端口和 VLAN 使用详情,请参阅 RCF 中的横幅和重要说明部分。
  4. 使用交换机 CLI 验证 cs1 和 cs2 之间的 ISL 是否正常工作:

    show port-channel summary

    显示示例
    cs1# show port-channel summary
    Flags:  D - Down        P - Up in port-channel (members)
            I - Individual  H - Hot-standby (LACP only)
            s - Suspended   r - Module-removed
            b - BFD Session Wait
            S - Switched    R - Routed
            U - Up (port-channel)
            p - Up in delay-lacp mode (member)
            M - Not in use. Min-links not met
    --------------------------------------------------------------------------------
    Group Port-       Type     Protocol  Member Ports      Channel
    --------------------------------------------------------------------------------
    1     Po1(SU)     Eth      LACP      Eth1/63(P)   Eth1/64(P)
    999   Po999(SD)   Eth      NONE      --
    cs1#
  5. 使用 ONTAP CLI,验证集群 LIF 是否已恢复到其主端口:

    network interface show -role cluster
    显示示例
    cluster1::*> network interface show -role cluster
                Logical            Status     Network            Current      Current Is
    Vserver     Interface          Admin/Oper Address/Mask       Node         Port    Home
    ----------- ------------------ ---------- ------------------ ------------ ------- ----
    Cluster
                node1-01_clus1     up/up      169.254.36.44/16   node1-01     e7a     true
                node1-01_clus2     up/up      169.254.7.5/16     node1-01     e7b     true
                node1-02_clus1     up/up      169.254.197.206/16 node1-02     e7a     true
                node1-02_clus2     up/up      169.254.195.186/16 node1-02     e7b     true
                node1-03_clus1     up/up      169.254.192.49/16  node1-03     e7a     true
                node1-03_clus2     up/up      169.254.182.76/16  node1-03     e7b     true
                node1-04_clus1     up/up      169.254.59.49/16   node1-04     e7a     true
                node1-04_clus2     up/up      169.254.62.244/16  node1-04     e7b     true
    
    8 entries were displayed.

    如果任何集群 LIF 尚未返回到其源端口,请从本地节点手动将其还原:

    network interface revert -vserver vserver_name -lif <lif-name>
  6. 使用 ONTAP CLI,验证集群是否正常:

    cluster show
    显示示例
    cluster1::*> cluster show
    Node              Health  Eligibility   Epsilon
    ----------------- ------- ------------- -------
    node1-01          true    true          false
    node1-02          true    true          false
    node1-03          true    true          true
    node1-04          true    true          false
    
    4 entries were displayed.
  7. 使用 ONTAP CLI,验证远程集群接口的连通性:

    • 您可以使用以下命令显示集群连接的可访问性检查的详细信息:

      network interface check cluster-connectivity show
      显示示例
      cluster1::*> network interface check cluster-connectivity show
      
                                        Source           Destination     Packet
      Node   Date                       LIF              LIF             Loss
      ------ -------------------------- ---------------- --------------- -----------
      node1-01
             6/4/2025 03:13:33 -04:00   node1-01_clus2  node1-02_clus1   none
             6/4/2025 03:13:34 -04:00   node1-01_clus2  node1-02_clus1   none
      
      
      node1-02
             6/4/2025 03:13:33 -04:00   node1-02_clus2  node1-01_clus1   none
             6/4/2025 03:13:34 -04:00   node1-02_clus2  node1-01_clus2   none
      .
      .
      .
    • 或者,您可以使用以下命令来检查连接:

      cluster ping-cluster -node <node-name>
      显示示例
      cluster1::*> cluster ping-cluster -node local
      Host is node1-04
      Getting addresses from network interface table...
      Cluster node1-01_clus1 169.254.36.44 node1-01 e7a
      Cluster node1-01_clus2 169.254.7.5   node1-01 e7b
      Cluster node1-02_clus1 169.254.197.206 node1-02 e7a
      Cluster node1-02_clus2 169.254.195.186 node1-02 e7b
      Cluster node1-03_clus1 169.254.192.49 node1-03 e7a
      Cluster node1-03_clus2 169.254.182.76 node1-03 e7b
      Cluster node1-04_clus1 169.254.59.49 node1-04 e7a
      Cluster node1-04_clus2 169.254.62.244 node1-04 e7b
      Local = 169.254.59.49 169.254.62.244
      Remote = 169.254.36.44 169.254.7.5 169.254.197.206 169.254.195.186 169.254.192.49 169.254.182.76
      Cluster Vserver Id = 4294967293
      Ping status:
      ............
      Basic connectivity succeeds on 12 path(s)
      Basic connectivity fails on 0 path(s)
      ................................................
      Detected 9000 byte MTU on 12 path(s):
          Local 169.254.59.49 to Remote 169.254.182.76
          Local 169.254.59.49 to Remote 169.254.192.49
          Local 169.254.59.49 to Remote 169.254.195.186
          Local 169.254.59.49 to Remote 169.254.197.206
          Local 169.254.59.49 to Remote 169.254.36.44
          Local 169.254.59.49 to Remote 169.254.7.5
          Local 169.254.62.244 to Remote 169.254.182.76
          Local 169.254.62.244 to Remote 169.254.192.49
          Local 169.254.62.244 to Remote 169.254.195.186
          Local 169.254.62.244 to Remote 169.254.197.206
          Local 169.254.62.244 to Remote 169.254.36.44
          Local 169.254.62.244 to Remote 169.254.7.5
      Larger than PMTU communication succeeds on 12 path(s)
      RPC status:
      6 paths up, 0 paths down (tcp check)
      6 paths up, 0 paths down (udp check)
下一步是什么?

升级交换机上的 RCF 后,您"验证日志收集的 SSH"