Skip to main content
简体中文版经机器翻译而成,仅供参考。如与英语版出现任何冲突,应以英语版为准。

升级 NX-OS - Cisco Nexus 9808

贡献者 netapp-yvonneo

您可以升级 Cisco Nexus 9808 交换机上的 NX-OS,以支持 AFX 2K 系统上的新硬件或新 ONTAP 版本。

备注 NetApp 建议您首先完成任何 ONTAP 软件升级,然后为您的交换机执行软件升级。
开始之前
  • 确保您有交换机配置的当前备份。

  • 确认您的群集已完全正常运行,这意味着日志中没有任何错误或类似问题。

关于此任务
  • 如果需要,您可以参见 "Cisco Nexus 9000 系列 NX-OS 软件升级和降级指南" 以获取更多信息。

  • AFX 系统上运行的 ONTAP 版本决定了交换机支持的 NX-OS 版本。

    • 对于运行 ONTAP 9.19.1GA 或更高版本的 AFX 2K 系统中的交换机,支持 NX-OS 10.6 及更高版本。

      有关受支持的 NX-OS 版本的当前列表,请参见"NetApp Cisco 以太网交换机"页面。

    备注 请勿将 NX-OS 版本升级或降级到不受支持的版本。
  • 由于此过程需要使用 ONTAP 命令和 Cisco Nexus 9000 系列交换机命令,因此这些步骤会指示您使用哪个 CLI 来输入命令。

  • 本流程中的示例使用以下开关和节点命名规则:

    • 这两个Cisco交换机的名称分别是 cs1 和 cs2。

    • 节点名称为node1-01、node1-02、node1-03和node1-04。

    • 集群 LIF 名称为:

      • node1-01 的 node1-01_clus1 和 node1-01_clus2

      • node1-02 的 node1-02_clus1 和 node1-02_clus2

      • node1-03 的 node1-03_clus1 和 node1-03_clus2

      • node1-04 的 node1-04_clus1 和 node1-04_clus2

    • 这 `cluster1::*>`prompt 指示集群名称。

步骤 1:准备升级 NX-OS

通过确保每个交换机都有管理网络连接、下载 NX-OS 版本、检查集群上的端口状态以及禁用集群 LIF 上的自动恢复来准备升级 NX-OS。

步骤
  1. 将每台交换机连接到管理网络。

  2. 使用交换机 CLI,验证与托管 NX-OS 的服务器的连接。

    ping <IP address>

    显示示例

    此示例验证交换机可以访问 IP 地址为 172.19.2.1 的服务器:

    cs1# ping 172.19.2.1
    Pinging 172.19.2.1 with 0 bytes of data:
    
    Reply From 172.19.2.1: icmp_seq = 0. time= 5910 usec.
  3. "Cisco软件下载"页面将正确版本的 NX-OS 下载到交换机。

  4. 使用 ONTAP CLI,显示连接到集群交换机的每个节点上的集群端口:

    network device-discovery show
    显示示例
    cluster1::*> network device-discovery show
    
    Node/       Local  Discovered
    Protocol    Port   Device (LLDP: ChassisID)  Interface         Platform
    ----------- ------ ------------------------- ----------------  ----------------
    node1-01/cdp
                e10a   cs1(FOXXXXXXXXX)          Ethernet1/5       N9K-C9808
                e10b   cs2(FDOXXXXXXXX)          Ethernet1/14      N9K-C9808
                e8a    cs1(FOXXXXXXXXX)          Ethernet1/7       N9K-C9808
                e8b    cs2(FDOXXXXXXXX)          Ethernet1/16      N9K-C9808
                e2a    cs1(FOXXXXXXXXX)          Ethernet1/3       N9K-C9808
                e2b    cs2(FOXXXXXXXXX)          Ethernet1/12      N9K-C9808
    node1-01/lldp
                e10a   cs1 (ec:bb:78:9e:c7:e8)   Ethernet1/5       -
                e10b   cs2 (ec:bb:78:9e:c8:0c)   Ethernet1/14      -
                e8a    cs1 (ec:bb:78:9e:c7:f0)   Ethernet1/7       -
                e8b    cs2 (ec:bb:78:9e:c8:14)   Ethernet1/16      -
                e2a    cs1 (ec:bb:78:9e:c7:d8)   Ethernet1/1       -
                e2b    cs2 (ec:bb:78:9e:c7:fc)   Ethernet1/10      -
                e1a    cs1 (ec:bb:78:9e:c7:e0)   Ethernet1/3       -
                e1b    cs2 (ec:bb:78:9e:c8:04)   Ethernet1/12      -
    node1-02/cdp
                e10a   cs1(FOXXXXXXXXX)          Ethernet1/6       N9K-C9808
                e10b   cs2(FDOXXXXXXXX)          Ethernet1/15      N9K-C9808
                e8a    cs1(FOXXXXXXXXX)          Ethernet1/8       N9K-C9808
                e8b    cs2(FDOXXXXXXXX)          Ethernet1/17      N9K-C9808
                e2a    cs1(FOXXXXXXXXX)          Ethernet1/2       N9K-C9808
                e2b    cs2(FDOXXXXXXXX)          Ethernet1/13      N9K-C9808
    node1-02/lldp
                e10a   cs1 (ec:bb:78:9e:c7:ec)   Ethernet1/6       -
                e10b   cs2 (ec:bb:78:9e:c8:10)   Ethernet1/15      -
                e8a    cs1 (ec:bb:78:9e:c7:f4)   Ethernet1/8       -
                e8b    cs2 (ec:bb:78:9e:c8:18)   Ethernet1/17      -
                e1a    cs1 (ec:bb:78:9e:c7:dc)   Ethernet1/2       -
                e1b    cs2 (ec:bb:78:9e:c8:00)   Ethernet1/11      -
                e2a    cs1 (ec:bb:78:9e:c7:e4)   Ethernet1/4       -
                e2b    cs2 (ec:bb:78:9e:c8:08)   Ethernet1/13      -
  5. 使用 ONTAP CLI,检查每个端口的管理和操作状态:

    1. 集群端口

      1. 确认集群所有端口均已启动且状态正常:

        network port show -ipspace Cluster
        显示示例
        cluster1::*> network port show -ipspace Cluster
        
        Node: node1-01
                                                                                Ignore
                                                          Speed(Mbps)  Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper   Status   Status
        --------- ------------ ---------------- ---- ---- ------------ -------- ------
        e2a       Cluster      Cluster          up   9000  auto/400000 healthy false
        e2b       Cluster      Cluster          up   9000  auto/400000 healthy false
        
        Node: node1-02
                                                                                Ignore
                                                          Speed(Mbps)  Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper   Status   Status
        --------- ------------ ---------------- ---- ---- ------------ -------- ------
        e2a       Cluster      Cluster          up   9000  auto/400000 healthy false
        e2b       Cluster      Cluster          up   9000  auto/400000 healthy false
        
        Node: node1-03
        
                                                                               Ignore
                                                          Speed(Mbps)  Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper   Status   Status
        --------- ------------ ---------------- ---- ---- ------------ -------- ------
        e2a       Cluster      Cluster          up   9000  auto/400000 healthy  false
        e2b       Cluster      Cluster          up   9000  auto/400000 healthy  false
        
        Node: node1-04
                                                                                Ignore
                                                          Speed(Mbps)  Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper   Status   Status
        --------- ------------ ---------------- ---- ---- ------------ -------- ------
        e2a       Cluster      Cluster          up   9000  auto/400000 healthy  false
        e2b       Cluster      Cluster          up   9000  auto/400000 healthy  false
      2. 确认所有集群接口(LIF)都位于主端口上:

        network interface show -role cluster
        显示示例
        cluster1::*> network interface show -role cluster
        
                    Logical         Status     Network            Current   Current Is
        Vserver     Interface       Admin/Oper Address/Mask       Node      Port    Home
        ----------- --------------- ---------- ------------------ --------- ------- ----
        Cluster
                    node1-01_clus1  up/up      169.254.36.44/16   node1-01  e2a     true
                    node1-01_clus2  up/up      169.254.7.5/16     node1-01  e2b     true
                    node1-02_clus1  up/up      169.254.197.206/16 node1-02  e2a     true
                    node1-02_clus2  up/up      169.254.195.186/16 node1-02  e2b     true
                    node1-03_clus1  up/up      169.254.192.49/16  node1-03  e2a     true
                    node1-03_clus2  up/up      169.254.182.76/16  node1-03  e2b     true
                    node1-04_clus1  up/up      169.254.59.49/16   node1-04  e2a     true
                    node1-04_clus2  up/up      169.254.62.244/16  node1-04  e2b     true
      3. 确认集群显示两个集群交换机的信息:

        system cluster-switch show -is-monitoring-enabled-operational true
        显示示例
        cluster1::*> system cluster-switch show -is-monitoring-enabled-operational true
        
        Switch                      Type               Address          Model
        --------------------------- ------------------ ---------------- ---------
        cs2(FDOXXXXXXXX)            cluster-network    10.228.137.233   N9K-C9808
             Serial Number: FDOXXXXXXXX
              Is Monitored: true
                    Reason: None
          Software Version: Cisco Nexus Operating System (NX-OS) Software, Version
                            10.5(3)(F)
            Version Source: CDP/ISDP
        
        
        cs1(FOXXXXXXXXX)             cluster-network   10.228.137.253   N9K-C9808
             Serial Number: FOXXXXXXXXX
              Is Monitored: true
                    Reason: None
          Software Version: Cisco Nexus Operating System (NX-OS) Software, Version
                            10.5(3)(F)
            Version Source: CDP/ISDP
    2. HA 端口

      1. 验证所有 HA 端口是否处于正常运行状态:

        ha interconnect status show -node <node-name>
        显示示例
        cluster1::*> ha interconnect status show -node node1-01
          (system ha interconnect status show)
        
                               Node: node1-01
                      Link 0 Status: up
                      Link 1 Status: up
                   Is Link 0 Active: true
                   Is Link 1 Active: true
                 IC RDMA Connection: up
                               Slot: 0
                     Debug Firmware: no
        
        
        Interconnect Port 0 :
                          Port Name: e1a-17
                                MTU: 4096
                   Link Information: ACTIVE
        
        
        Interconnect Port 1 :
                          Port Name: e1b-18
                                MTU: 4096
                   Link Information: ACTIVE
        
        cluster1::*> ha interconnect status show -node node1-02
          (system ha interconnect status show)
        
                               Node: node1-02
                      Link 0 Status: up
                      Link 1 Status: up
                   Is Link 0 Active: true
                   Is Link 1 Active: true
                 IC RDMA Connection: up
                               Slot: 0
                     Debug Firmware: no
        
        
        Interconnect Port 0 :
                          Port Name: e1a-17
                                MTU: 4096
                   Link Information: ACTIVE
        
        
        Interconnect Port 1 :
                          Port Name: e1b-18
                                MTU: 4096
                   Link Information: ACTIVE
        .
        .
        .
      2. 验证所有 HA 端口配置正确且互连类型为 RoCE:

        ha interconnect config show
        显示示例
        cluster1::*> ha interconnect config show
          (system ha interconnect config show)
                               Node: node1-01
                  Interconnect Type: RoCE
                    Local System ID: 542023071
                  Partner System ID: 542022984
               Connection Initiator: local
                          Interface: external
        
        
        Port    IP Address         Flags
        ------  -----------------  -----------
        e1a-17  169.254.17.111     0x0
        e1b-18  169.254.18.242     0x0
        
        
        
                               Node: node1-02
                  Interconnect Type: RoCE
                    Local System ID: 542022984
                  Partner System ID: 542023071
               Connection Initiator: partner
                          Interface: external
        
        
        Port    IP Address         Flags
        ------  -----------------  -----------
        e1a-17  169.254.17.208     0x0
        e1b-18  169.254.18.169     0x0
        .
        .
        .
    3. 存储端口

      1. 验证所有存储端口均处于正常状态:

        storage port show -port-type ENET
        显示示例
        cluster1::*> storage port show -port-type ENET
        
        
                                              Speed
        Node               Port Type  Mode    (Gb/s) State    Status
        ------------------ ---- ----- ------- ------ -------- -----------
        node1-01
                           e10a ENET  -          400 enabled  online
                           e10b ENET  -            0 enabled  offline
                           e8a ENET   -          400 enabled  online
                           e8b ENET   -            0 enabled  offline
        node1-02
                           e10a ENET  -          400 enabled  online
                           e10b ENET  -            0 enabled  offline
                           e8a ENET   -          400 enabled  online
                           e8b ENET   -            0 enabled  offline
        node1-03
                           e10a ENET  -          400 enabled  online
                           e10b ENET  -            0 enabled  offline
                           e8a ENET   -          400 enabled  online
                           e8b ENET   -            0 enabled  offline
        node1-04
                           e10a ENET  -          400 enabled  online
                           e10b ENET  -            0 enabled  offline
                           e8a ENET   -          400 enabled  online
                           e8b ENET   -            0 enabled  offline
    4. 存储架端口

      1. 验证所有存储架端口是否处于正常状态:

        storage shelf port show
        显示示例
        cluster1::*> storage shelf port show
        
        Shelf ID Module State        Internal?
        ----- -- ------ ------------ ---------
        1.1
               0 A      connected    false
               1 A      connected    false
               2 A      connected    false
               3 A      connected    false
               4 A      connected    false
               5 A      connected    false
               6 A      connected    false
               7 A      connected    false
               8 B      connected    false
               9 B      connected    false
              10 B      connected    false
              11 B      connected    false
              12 B      connected    false
              13 B      connected    false
              14 B      connected    false
              15 B      connected    false
      2. 验证所有存储架端口的连接状态:

        storage shelf port show -fields remote-device,remote-port,connector-state
        显示示例
        cluster1::*> storage shelf port show -fields remote-device,remote-port,connector-state
        
        shelf id connector-state remote-port    remote-device
        ----- -- --------------- -------------- -----------------
        1.1   0  connected       Ethernet1/17/1 cs1(FOXXXXXXXXX)
        1.1   1  connected       Ethernet1/15/1 cs2(FDOXXXXXXXX)
        1.1   2  connected       Ethernet1/17/2 cs1(FOXXXXXXXXX)
        1.1   3  connected       Ethernet1/15/2 cs2(FDOXXXXXXXX)
        1.1   4  connected       Ethernet1/17/3 cs1(FOXXXXXXXXX)
        1.1   5  connected       Ethernet1/15/3 cs2(FDOXXXXXXXX)
        1.1   6  connected       Ethernet1/17/4 cs1(FOXXXXXXXXX)
        1.1   7  connected       Ethernet1/15/4 cs2(FDOXXXXXXXX)
        1.1   8  connected       Ethernet1/19/1 cs1(FOXXXXXXXXX)
        1.1   9  connected       Ethernet1/17/1 cs2(FDOXXXXXXXX)
        1.1   10 connected       Ethernet1/19/2 cs1(FOXXXXXXXXX)
        1.1   11 connected       Ethernet1/17/2 cs2(FDOXXXXXXXX)
        1.1   12 connected       Ethernet1/19/3 cs1(FOXXXXXXXXX)
        1.1   13 connected       Ethernet1/17/3 cs2(FDOXXXXXXXX)
        1.1   14 connected       Ethernet1/19/4 cs1(FOXXXXXXXXX)
        1.1   15 connected       Ethernet1/17/4 cs2(FDOXXXXXXXX)
  6. 使用 ONTAP CLI,在集群 LIF 上禁用自动还原。集群 LIF 将故障转移到伙伴集群交换机,并在您对目标交换机执行此过程时保持在该交换机上:

    network interface modify -vserver Cluster -lif * -auto-revert false

步骤 2:安装 NX-OS

在第一台交换机(cs1)上安装 NX-OS,方法是安装并验证新版本的 NX-OS 和 EPLD,验证集群上所有端口的运行状况,然后在第二台交换机(cs2)上重复这些步骤。

  1. 使用交换机 CLI 将 NX-OS 和 EPLD 映像复制到交换机。

    copy <protocol>: bootflash: vrf management

    显示示例

    示例使用 sftp。

    cs1# copy sftp: bootflash: vrf management
    Enter source filename: /code/nxos64-s1.10.6.3.F.bin
    Enter hostname for the sftp server: 172.19.2.1
    Enter username: user1
    
    Outbound-ReKey for 172.19.2.1:22
    Inbound-ReKey for 172.19.2.1:22
    user1@172.19.2.1's password:
    sftp> progress
      Progress meter enabled
    sftp> get code/nxos64-s1.10.6.3.F.bin /bootflash/nxos64-s1.10.6.3.F.bin
    /code/nxos64-s1.10.6.3.F.bin  100% 1261MB   9.3MB/s   02:15
    sftp> exit
    Copy complete, now saving to disk (please wait)...
    Copy complete.
  2. 使用交换机 CLI,验证 NX-OS 的运行版本:

    show version

    显示示例
    cs1# show version
    Cisco Nexus Operating System (NX-OS) Software
    TAC support: http://www.cisco.com/tac
    Copyright (C) 2002-2025, Cisco and/or its affiliates.
    All rights reserved.
    The copyrights to certain works contained in this software are
    owned by other third parties and used and distributed under their own
    licenses, such as open source.  This software is provided "as is," and unless
    otherwise stated, there is no warranty, express or implied, including but not
    limited to warranties of merchantability and fitness for a particular purpose.
    Certain components of this software are licensed under
    the GNU General Public License (GPL) version 2.0 or
    GNU General Public License (GPL) version 3.0  or the GNU
    Lesser General Public License (LGPL) Version 2.1 or
    Lesser General Public License (LGPL) Version 2.0.
    A copy of each such license is available at
    http://www.opensource.org/licenses/gpl-2.0.php and
    http://opensource.org/licenses/gpl-3.0.html and
    http://www.opensource.org/licenses/lgpl-2.1.php and
    http://www.gnu.org/licenses/old-licenses/library.txt.
    
    
    Software
      BIOS: version 01.14
      NXOS: version 10.5(3)(F) [Feature Release]
      Host NXOS: version 10.5(3)(F)
      BIOS compile time:  11/25/2024
      NXOS image file is: bootflash:///nxos64-s1.10.5.3.F.bin
      NXOS compile time:  11/30/2023 12:00:00 [12/14/2023 05:25:50]
      NXOS boot mode: LXC
    
    
    Hardware
      cisco Nexus9000 C9808 Chassis
      Intel(R) Xeon(R) CPU D-1633N @ 2.50GHz with 32802156 kB of memory.
      Processor Board ID FLMXXXXXXXX
      Device name: cs1
      bootflash:  115802886 kB
    
    
    Kernel uptime is 5 day(s), 2 hour(s), 13 minute(s), 21 second(s)
    
    
    Last reset at 3580 usecs after Thu Jun  5 15:55:08 2025
      Reason: Reset Requested by CLI command reload
      System version: 10.4(1)
      Service:
    
    
    plugin
      Core Plugin, Ethernet Plugin
    
    
    Active Package(s):
    
    cs1#
  3. 使用交换机 CLI 安装 NX-OS 和 EPLD 映像。

    安装镜像文件后,每次交换机重启时都会加载该文件。

    install all nxos bootflash:nxos.<version number>.bin

    显示示例

    示例使用 NX-OS 版本 10.6(3)(F)。

    cs1# install all nxos bootflash:/nxos64-s1.10.6.3.F.bin
    
    Installer will perform compatibility check first. Please wait.
    Installer is forced disruptive
    
    Verifying image bootflash:/nxos64-s1.10.6.3.F.bin for boot variable "nxos".
    [] 100% -- SUCCESS
    
    Verifying image type.
    [] 100% -- SUCCESS
    
    Preparing "nxos" version info using image bootflash://nxos64-s1.10.6.3.F.bin.
    [] 100% -- SUCCESS
    
    Preparing "bios" version info using image bootflash:/nxos64-s1.10.6.3.F.bin.
    [] 100% -- SUCCESS
    
    Performing module support checks.
    [] 100% -- SUCCESS
    
    Notifying services about system upgrade.
    [] 100% -- SUCCESS
    
    
    Compatibility check is done:
    Module  Bootable  Impact          Install-type  Reason
    ------  --------  --------------- ------------  ---------
      1     yes       Disruptive      Reset         Default upgrade is not hitless
    
    
    
    Images will be upgraded according to following table:
    
    Module   Image    Running-Version(pri:alt)                 New-Version         Upg-Required
    ------- --------- ---------------------------------------- ------------------- ------------
      1      nxos     10.5(3)(F)                               10.6(3)(F)          Yes
      1      bios     xx.xx.:xx.xx                             xxx                 No
    
    
    Switch will be reloaded for disruptive upgrade.
    
    Do you want to continue with the installation (y/n)? [n] y
    
    Install is in progress, please wait.
    
    Performing runtime checks.
    [] 100% -- SUCCESS
    
    Setting boot variables.
    [] 100% -- SUCCESS
    
    Performing configuration copy.
    [] 100% -- SUCCESS
    
    Module 1: Refreshing compact flash and upgrading bios/loader/bootrom.
    Warning: please do not remove or power off the module at this time.
    [] 100% -- SUCCESS
    
    Finishing the upgrade, switch will reboot in 10 seconds.
  4. 使用交换机 CLI,在交换机重新启动后验证新版本的 NX-OS:

    show version

    显示示例
    cs1# show version
    Cisco Nexus Operating System (NX-OS) Software
    TAC support: http://www.cisco.com/tac
    Copyright (C) 2002-2025, Cisco and/or its affiliates.
    All rights reserved.
    The copyrights to certain works contained in this software are
    owned by other third parties and used and distributed under their own
    licenses, such as open source.  This software is provided "as is," and unless
    otherwise stated, there is no warranty, express or implied, including but not
    limited to warranties of merchantability and fitness for a particular purpose.
    Certain components of this software are licensed under
    the GNU General Public License (GPL) version 2.0 or
    GNU General Public License (GPL) version 3.0  or the GNU
    Lesser General Public License (LGPL) Version 2.1 or
    Lesser General Public License (LGPL) Version 2.0.
    A copy of each such license is available at
    http://www.opensource.org/licenses/gpl-2.0.php and
    http://opensource.org/licenses/gpl-3.0.html and
    http://www.opensource.org/licenses/lgpl-2.1.php and
    http://www.gnu.org/licenses/old-licenses/library.txt.
    
    
    Software
      BIOS: version 01.14
      NXOS: version 10.6(3)(F) [Feature Release]
      Host NXOS: version 10.6(3)(F)
      BIOS compile time:  11/25/2024
      NXOS image file is: bootflash:///nxos64-s1.10.6.3.F.bin
      NXOS compile time:  05/30/2026 12:00:00 [06/14/2026 05:25:50]
      NXOS boot mode: LXC
    
    
    Hardware
      cisco Nexus9000 C9808 Chassis
      Intel(R) Xeon(R) CPU D-1633N @ 2.50GHz with 32802156 kB of memory.
      Processor Board ID FLMXXXXXXXX
      Device name: cs1
      bootflash:  115802886 kB
    
    
    Kernel uptime is 5 day(s), 2 hour(s), 13 minute(s), 21 second(s)
    
    
    Last reset at 3580 usecs after Thu Jun  5 15:55:08 2025
      Reason: Reset Requested by CLI command reload
      System version: 10.4(2)
      Service:
    
    
    plugin
      Core Plugin, Ethernet Plugin
    
    
    Active Package(s):
    
    cs1#
  5. 使用交换机 CLI,验证新版本的 EPLD 是否已成功加载:

    show install epld status

    显示示例

    该示例使用 EPLD 版本 10.6(3)(F)。

    cs1# show install epld status
    
    1) Module 2 upgraded on Mon May  4 09:17:08 2026 (631239  us)
    EPLD Install Image: EPLD image file 10.6.3.F. built on Fri Apr 24 19:49:50 2026
    
    Status: EPLD Upgrade was Successful
    
    EPLD                             Curr Ver       Old Ver
    -------------------------------------------------------
    MI FPGA                         0x10014         0x1000b
    IO FPGA                         0x10033         0x10006
    
    2) Module 27 upgraded on Wed Apr  1 15:03:13 2026 (193093  us)
    EPLD Install Image: EPLD image file 10.6.3.F. built on Mon Mar 16 03:28:47 2026
    
    Status: EPLD Upgrade was Successful
    
    EPLD                            Curr Ver        Old Ver
    -------------------------------------------------------
    IO FPGA                         0x1002d         0x10020
    
    3) Module 28 upgraded on Wed Apr  1 14:59:53 2026 (843907  us)
    EPLD Install Image: EPLD image file 10.6.3.F. built on Mon Mar 16 03:28:47 2026
    
    Status: EPLD Upgrade was Successful
    
    EPLD                            Curr Ver        Old Ver
    -------------------------------------------------------
    IO FPGA                         0x1002d         0x10020
    
    4) Module 27 upgraded on Fri Mar 27 21:55:55 2026 (132290  us)
    EPLD Install Image: EPLD image file 10.6.2.F. built on Fri Dec 12 11:15:18 2025
    
    Status: EPLD Upgrade was Successful
    
    EPLD                            Curr Ver        Old Ver
    -------------------------------------------------------
    FM-19 FPGA                      0x10006         0x10000
    FM-20 FPGA                      0x10006         0x10000
    FM-21 FPGA                      0x10006         0x10000
    FM-22 FPGA                      0x10006         0x10000
    FM-23 FPGA                      0x10006         0x10000
    FM-24 FPGA                      0x10006         0x10000
    FM-25 FPGA                      0x10006         0x10000
    FM-26 FPGA                      0x10006         0x10000
    
    5) Module 27 upgraded on Fri Mar 27 21:50:16 2026 (  4899  us)
    EPLD Install Image: EPLD image file 10.6.2.F. built on Fri Dec 12 11:15:18 2025
    
    Status: EPLD Upgrade was Successful
    
    EPLD                            Curr Ver        Old Ver
    -------------------------------------------------------
    FM-19 FPGA                      0x10006         0x10000
    FM-20 FPGA                      0x10006         0x10000
    FM-21 FPGA                      0x10006         0x10000
    FM-22 FPGA                      0x10006         0x10000
    FM-23 FPGA                      0x10006         0x10000
    FM-24 FPGA                      0x10006         0x10000
    FM-25 FPGA                      0x10006         0x10000
    FM-26 FPGA                      0x10006         0x10000
    
    6) Module 27 upgraded on Fri Mar 27 21:44:36 2026 (775397  us)
    EPLD Install Image: EPLD image file 10.6.2.F. built on Fri Dec 12 11:15:18 2025
    
    Status: EPLD Upgrade was Successful
    
    EPLD                            Curr Ver        Old Ver
    -------------------------------------------------------
    FM-19 FPGA                      0x10006         0x10000
    FM-20 FPGA                      0x10006         0x10000
    FM-21 FPGA                      0x10006         0x10000
    FM-22 FPGA                      0x10006         0x10000
    FM-23 FPGA                      0x10006         0x10000
    FM-24 FPGA                      0x10006         0x10000
    FM-25 FPGA                      0x10006         0x10000
    FM-26 FPGA                      0x10006         0x10000
    
    7) Module 27 upgraded on Fri Mar 27 21:38:58 2026 (330582  us)
    EPLD Install Image: EPLD image file 10.6.2.F. built on Fri Dec 12 11:15:18 2025
    
    Status: EPLD Upgrade was Successful
    
    EPLD                            Curr Ver        Old Ver
    -------------------------------------------------------
    FM-19 FPGA                      0x10006         0x10000
    FM-20 FPGA                      0x10006         0x10000
    FM-21 FPGA                      0x10006         0x10000
    FM-22 FPGA                      0x10006         0x10000
    FM-23 FPGA                      0x10006         0x10000
    FM-24 FPGA                      0x10006         0x10000
    FM-25 FPGA                      0x10006         0x10000
    FM-26 FPGA                      0x10006         0x10000
    
    8) Module 27 upgraded on Fri Mar 27 21:33:19 2026 (112679  us)
    EPLD Install Image: EPLD image file 10.6.2.F. built on Fri Dec 12 11:15:18 2025
    
    Status: EPLD Upgrade was Successful
    
    EPLD                            Curr Ver        Old Ver
    -------------------------------------------------------
    FM-19 FPGA                      0x10006         0x10000
    FM-20 FPGA                      0x10006         0x10000
    FM-21 FPGA                      0x10006         0x10000
    FM-22 FPGA                      0x10006         0x10000
    FM-23 FPGA                      0x10006         0x10000
    FM-24 FPGA                      0x10006         0x10000
    FM-25 FPGA                      0x10006         0x10000
    FM-26 FPGA                      0x10006         0x10000
    
    9) Module 27 upgraded on Fri Mar 27 21:27:41 2026 (957182  us)
    EPLD Install Image: EPLD image file 10.6.2.F. built on Fri Dec 12 11:15:18 2025
    
    Status: EPLD Upgrade was Successful
    
    EPLD                            Curr Ver        Old Ver
    -------------------------------------------------------
    FM-19 FPGA                      0x10006         0x10000
    FM-20 FPGA                      0x10006         0x10000
    FM-21 FPGA                      0x10006         0x10000
    FM-22 FPGA                      0x10006         0x10000
    FM-23 FPGA                      0x10006         0x10000
    FM-24 FPGA                      0x10006         0x10000
    FM-25 FPGA                      0x10006         0x10000
    FM-26 FPGA                      0x10006         0x10000
    
    10) Module 27 upgraded on Fri Mar 27 21:22:03 2026 ( 90303  us)
    EPLD Install Image: EPLD image file 10.6.2.F. built on Fri Dec 12 11:15:18 2025
    
    Status: EPLD Upgrade was Successful
    
    EPLD                            Curr Ver        Old Ver
    -------------------------------------------------------
    FM-19 FPGA                      0x10006         0x10000
    FM-20 FPGA                      0x10006         0x10000
    FM-21 FPGA                      0x10006         0x10000
    FM-22 FPGA                      0x10006         0x10000
    FM-23 FPGA                      0x10006         0x10000
    FM-24 FPGA                      0x10006         0x10000
    FM-25 FPGA                      0x10006         0x10000
    FM-26 FPGA                      0x10006         0x10000
    
    11) Module 1 upgraded on Fri Mar 27 21:16:24 2026 (240369  us)
    EPLD Install Image: EPLD image file 10.6.2.F. built on Fri Dec 12 11:15:18 2025
    
    Status: EPLD Upgrade was Successful
    
    EPLD                            Curr Ver        Old Ver
    -------------------------------------------------------
    MI FPGA                         0x10014         0x1000b
    IO FPGA                         0x10033         0x10006
  6. 使用 ONTAP CLI,验证集群上所有端口的运行状况。

    1. 集群端口

      1. 确认集群中所有节点的集群端口均已启动且运行状况良好:

        network port show -ipspace Cluster
        显示示例
        cluster1::*> network port show -ipspace Cluster
        
        Node: node1-01
                                                                                Ignore
                                                          Speed(Mbps)  Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper   Status   Status
        --------- ------------ ---------------- ---- ---- ------------ -------- ------
        e2a       Cluster      Cluster          up   9000  auto/400000 healthy  false
        e2b       Cluster      Cluster          up   9000  auto/400000 healthy  false
        
        Node: node1-02
                                                                                Ignore
                                                          Speed(Mbps)  Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper   Status   Status
        --------- ------------ ---------------- ---- ---- ------------ -------- ------
        e2a       Cluster      Cluster          up   9000  auto/400000 healthy  false
        e2b       Cluster      Cluster          up   9000  auto/400000 healthy  false
        
        Node: node1-03
                                                                                 Ignore
                                                          Speed(Mbps)   Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper    Status   Status
        --------- ------------ ---------------- ---- ---- ------------- -------- ------
        e2a       Cluster      Cluster          up   9000  auto/400000 healthy  false
        e2b       Cluster      Cluster          up   9000  auto/400000 healthy  false
        
        Node: node1-04
                                                                                Ignore
                                                          Speed(Mbps)  Health   Health
        Port      IPspace      Broadcast Domain Link MTU  Admin/Oper   Status   Status
        --------- ------------ ---------------- ---- ---- ------------ -------- ------
        e2a       Cluster      Cluster          up   9000  auto/400000 healthy  false
        e2b       Cluster      Cluster          up   9000  auto/400000 healthy  false
      2. 从集群验证交换机运行状况:

        network device-discovery show -protocol cdp
        system cluster-switch show -is-monitoring-enabled-operational true
        显示示例
        cluster1::*> network device-discovery show -protocol cdp
        
        Node/       Local  Discovered
        Protocol    Port   Device (LLDP: ChassisID)  Interface         Platform
        ----------- ------ ------------------------- ----------------  ----------------
        node1-01/cdp
                    e10a   cs1(FOXXXXXXXXX)          Ethernet1/5       N9K-C9808
                    e10b   cs2(FDOXXXXXXXX)          Ethernet1/14      N9K-C9808
                    e8a    cs1(FOXXXXXXXXX)          Ethernet1/7       N9K-C9808
                    e8b    cs2(FDOXXXXXXXX)          Ethernet1/16      N9K-C9808
                    e2a    cs1(FOXXXXXXXXX)          Ethernet1/3       N9K-C9808
                    e2b    cs2(FOXXXXXXXXX)          Ethernet1/12      N9K-C9808
        .
        .
        .
        node1-02/cdp
                    e10a   cs1(FOXXXXXXXXX)          Ethernet1/6       N9K-C9808
                    e10b   cs2(FDOXXXXXXXX)          Ethernet1/15      N9K-C9808
                    e8a    cs1(FOXXXXXXXXX)          Ethernet1/8       N9K-C9808
                    e8b    cs2(FDOXXXXXXXX)          Ethernet1/17      N9K-C9808
                    e2a    cs1(FOXXXXXXXXX)          Ethernet1/2       N9K-C9808
                    e2b    cs2(FDOXXXXXXXX)          Ethernet1/13      N9K-C9808
        .
        .
        .
        cluster1::*> system cluster-switch show -is-monitoring-enabled-operational true
        Switch                      Type               Address          Model
        --------------------------- ------------------ ---------------- ---------------
        cs1(FOXXXXXXXXX)            cluster-network    10.228.137.233   N9K-C9808
             Serial Number: FOXXXXXXXXX
              Is Monitored: true
                    Reason: None
          Software Version: Cisco Nexus Operating System (NX-OS) Software, Version
                            10.6(3)(F)
            Version Source: CDP/ISDP
        
        
        cs2(FDOXXXXXXXX)             cluster-network   10.228.137.253   N9K-C9808
             Serial Number: FDOXXXXXXXX
              Is Monitored: true
                    Reason: None
          Software Version: Cisco Nexus Operating System (NX-OS) Software, Version
                            10.6(3)(F)
            Version Source: CDP/ISDP
    2. HA 端口

      1. 验证所有 HA 端口是否处于正常运行状态:

        ha interconnect status show -node <node-name>
        显示示例
        cluster1::*> ha interconnect status show -node node1-01
          (system ha interconnect status show)
        
                               Node: node1-01
                      Link 0 Status: up
                      Link 1 Status: up
                   Is Link 0 Active: true
                   Is Link 1 Active: true
                 IC RDMA Connection: up
                               Slot: 0
                     Debug Firmware: no
        
        
        Interconnect Port 0 :
                          Port Name: e1a-17
                                MTU: 4096
                   Link Information: ACTIVE
        
        
        Interconnect Port 1 :
                          Port Name: e1b-18
                                MTU: 4096
                   Link Information: ACTIVE
        
        cluster1::*> ha interconnect status show -node node1-02
          (system ha interconnect status show)
        
                               Node: node1-02
                      Link 0 Status: up
                      Link 1 Status: up
                   Is Link 0 Active: true
                   Is Link 1 Active: true
                 IC RDMA Connection: up
                               Slot: 0
                     Debug Firmware: no
        
        
        Interconnect Port 0 :
                          Port Name: e1a-17
                                MTU: 4096
                   Link Information: ACTIVE
        
        
        Interconnect Port 1 :
                          Port Name: e1b-18
                                MTU: 4096
                   Link Information: ACTIVE
        .
        .
        .
      2. 验证所有 HA 端口配置正确且互连类型为 RoCE:

        ha interconnect config show
        显示示例
        cluster1::*> ha interconnect config show
          (system ha interconnect config show)
                               Node: node1-01
                  Interconnect Type: RoCE
                    Local System ID: 542023071
                  Partner System ID: 542022984
               Connection Initiator: local
                          Interface: external
        
        
        Port    IP Address         Flags
        ------  -----------------  -----------
        e1a-17  169.254.17.111     0x0
        e1b-18  169.254.18.242     0x0
        
        
        
                               Node: node1-02
                  Interconnect Type: RoCE
                    Local System ID: 542022984
                  Partner System ID: 542023071
               Connection Initiator: partner
                          Interface: external
        
        
        Port    IP Address         Flags
        ------  -----------------  -----------
        e1a-17  169.254.17.208     0x0
        e1b-18  169.254.18.169     0x0
        .
        .
        .
    3. 存储端口

      1. 验证所有存储端口均处于正常状态:

        storage port show -port-type ENET
        显示示例
        cluster1::*> storage port show -port-type ENET
        
        
                                              Speed
        Node               Port Type  Mode    (Gb/s) State    Status
        ------------------ ---- ----- ------- ------ -------- -----------
        node1-01
                           e10a ENET  -          400 enabled  online
                           e10b ENET  -            0 enabled  offline
                           e8a ENET   -          400 enabled  online
                           e8b ENET   -            0 enabled  offline
        node1-02
                           e10a ENET  -          400 enabled  online
                           e10b ENET  -            0 enabled  offline
                           e8a ENET   -          400 enabled  online
                           e8b ENET   -            0 enabled  offline
        node1-03
                           e10a ENET  -          400 enabled  online
                           e10b ENET  -            0 enabled  offline
                           e8a ENET   -          400 enabled  online
                           e8b ENET   -            0 enabled  offline
        node1-04
                           e10a ENET  -          400 enabled  online
                           e10b ENET  -            0 enabled  offline
                           e8a ENET   -          400 enabled  online
                           e8b ENET   -            0 enabled  offline
    4. 存储架端口

      1. 验证所有存储架端口是否处于正常状态:

        storage shelf port show
        显示示例
        cluster1::*> storage shelf port show
        
        Shelf ID Module State        Internal?
        ----- -- ------ ------------ ---------
        1.1
               0 A      connected    false
               1 A      connected    false
               2 A      connected    false
               3 A      connected    false
               4 A      connected    false
               5 A      connected    false
               6 A      connected    false
               7 A      connected    false
               8 B      connected    false
               9 B      connected    false
              10 B      connected    false
              11 B      connected    false
              12 B      connected    false
              13 B      connected    false
              14 B      connected    false
              15 B      connected    false
        
        16 entries were displayed.
      2. 验证所有存储架端口的连接状态:

        storage shelf port show -fields remote-device,remote-port,connector-state
        显示示例
        cluster1::*> storage shelf port show -fields remote-device,remote-port,connector-state
        
        shelf id connector-state remote-port    remote-device
        ----- -- --------------- -------------- -----------------
        1.1   0  connected       Ethernet1/17/1 cs1(FOXXXXXXXXX)
        1.1   1  connected       Ethernet1/15/1 cs2(FDOXXXXXXXX)
        1.1   2  connected       Ethernet1/17/2 cs1(FOXXXXXXXXX)
        1.1   3  connected       Ethernet1/15/2 cs2(FDOXXXXXXXX)
        1.1   4  connected       Ethernet1/17/3 cs1(FOXXXXXXXXX)
        1.1   5  connected       Ethernet1/15/3 cs2(FDOXXXXXXXX)
        1.1   6  connected       Ethernet1/17/4 cs1(FOXXXXXXXXX)
        1.1   7  connected       Ethernet1/15/4 cs2(FDOXXXXXXXX)
        1.1   8  connected       Ethernet1/19/1 cs1(FOXXXXXXXXX)
        1.1   9  connected       Ethernet1/17/1 cs2(FDOXXXXXXXX)
        1.1   10 connected       Ethernet1/19/2 cs1(FOXXXXXXXXX)
        1.1   11 connected       Ethernet1/17/2 cs2(FDOXXXXXXXX)
        1.1   12 connected       Ethernet1/19/3 cs1(FOXXXXXXXXX)
        1.1   13 connected       Ethernet1/17/3 cs2(FDOXXXXXXXX)
        1.1   14 connected       Ethernet1/19/4 cs1(FOXXXXXXXXX)
        1.1   15 connected       Ethernet1/17/4 cs2(FDOXXXXXXXX)
        
        16 entries were displayed.
  7. 使用 ONTAP CLI,验证集群是否正常:

    cluster show
    显示示例
    cluster1::*> cluster show
    
    
    Node                 Health  Eligibility   Epsilon
    -------------------- ------- ------------  ------------
    node1-01             true    true          false
    node1-02             true    true          false
    node1-03             true    true          false
    node1-04             true    true          true
  8. 重复上述步骤,在交换机 cs2 上安装 NX-OS 和 EPLD 映像。

步骤 3:完成 NX-OS 升级

使用 ONTAP CLI,通过在集群 LIF 上重新启用自动还原并验证集群 LIF 已还原到其主端口来完成 NX-OS 升级。

  1. 在集群 LIF 上重新启用自动还原。

    network interface modify -vserver Cluster -lif * -auto-revert true
  2. 确认集群 LIF 已恢复到其原端口:

    network interface show -role cluster
    显示示例
    cluster1::*> network interface show -role cluster
    
                Logical         Status     Network            Current     Current Is
    Vserver     Interface       Admin/Oper Address/Mask       Node        Port    Home
    ----------- --------------- ---------- ------------------ ----------- ------- ----
    Cluster
                node1-01_clus1  up/up      169.254.36.44/16   node1-01    e2a     true
                node1-01_clus2  up/up      169.254.7.5/16     node1-01    e2b     true
                node1-02_clus1  up/up      169.254.197.206/16 node1-02    e2a     true
                node1-02_clus2  up/up      169.254.195.186/16 node1-02    e2b     true
                node1-03_clus1  up/up      169.254.192.49/16  node1-03    e2a     true
                node1-03_clus2  up/up      169.254.182.76/16  node1-03    e2b     true
                node1-04_clus1  up/up      169.254.59.49/16   node1-04    e2a     true
                node1-04_clus2  up/up      169.254.62.244/16  node1-04    e2b     true

    如果任何集群 LIF 尚未返回到其源端口,请从本地节点手动将其还原:

    network interface revert -vserver Cluster -lif <lif-name>
下一步是什么?

升级交换机上的 NX-OS 后,请从 "安装或升级 RCF 概述" 开始升级 RCF。