简体中文版经机器翻译而成,仅供参考。如与英语版出现任何冲突,应以英语版为准。

安装参考配置文件( RCF )

首次设置 Nexus 9336C-FX2 交换机后,您可以安装 RCF 。您也可以使用此操作步骤升级 RCF 版本。

此操作步骤中的示例使用以下交换机和节点命名:

  • 两个 Cisco 交换机的名称分别为 CS1 和 CS2 。

  • 节点名称包括 cluster1-01 , cluster1-02 , cluster1-03 和 cluster1-04 。

  • 集群 LIF 名称包括 cluster1-01_clus1 , cluster1-01_clus2 , cluster1-02_clus1 , cluster1-02_clus2 , cluster1-03_clus1 , cluster1-03_clus2 , cluster1-04_clus1 和 cluster1-04_clus2 。

  • cluster1 ::: * > 提示符指示集群的名称。

注 操作步骤要求同时使用 ONTAP 命令和 Cisco Nexus 9000 系列交换机命令;除非另有说明,否则使用 ONTAP 命令。
步骤
  1. 显示连接到集群交换机的每个节点上的集群端口: network device-discovery show

    cluster1::*> network device-discovery show
    Node/       Local  Discovered
    Protocol    Port   Device (LLDP: ChassisID)  Interface         Platform
    ----------- ------ ------------------------- ----------------  --------
    cluster1-01/cdp
                e0a    cs1                       Ethernet1/7       N9K-C9336C
                e0d    cs2                       Ethernet1/7       N9K-C9336C
    cluster1-02/cdp
                e0a    cs1                       Ethernet1/8       N9K-C9336C
                e0d    cs2                       Ethernet1/8       N9K-C9336C
    cluster1-03/cdp
                e0a    cs1                       Ethernet1/1/1     N9K-C9336C
                e0b    cs2                       Ethernet1/1/1     N9K-C9336C
    cluster1-04/cdp
                e0a    cs1                       Ethernet1/1/2     N9K-C9336C
                e0b    cs2                       Ethernet1/1/2     N9K-C9336C
    cluster1::*>
  2. 检查每个集群端口的管理和运行状态。

    1. 确认所有集群端口均已启动且状态正常: network port show – role cluster

      cluster1::*> network port show -role cluster
      
      Node: cluster1-01
                                                                             Ignore
                                                        Speed(Mbps) Health   Health
      Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
      --------- ------------ ---------------- ---- ---- ----------- -------- ------
      e0a       Cluster      Cluster          up   9000  auto/100000 healthy false
      e0d       Cluster      Cluster          up   9000  auto/100000 healthy false
      
      Node: cluster1-02
                                                                             Ignore
                                                        Speed(Mbps) Health   Health
      Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
      --------- ------------ ---------------- ---- ---- ----------- -------- ------
      e0a       Cluster      Cluster          up   9000  auto/100000 healthy false
      e0d       Cluster      Cluster          up   9000  auto/100000 healthy false
      8 entries were displayed.
      
      Node: cluster1-03
      
         Ignore
                                                        Speed(Mbps) Health   Health
      Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
      --------- ------------ ---------------- ---- ---- ----------- -------- ------
      e0a       Cluster      Cluster          up   9000  auto/10000 healthy  false
      e0b       Cluster      Cluster          up   9000  auto/10000 healthy  false
      
      Node: cluster1-04
                                                                             Ignore
                                                        Speed(Mbps) Health   Health
      Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
      --------- ------------ ---------------- ---- ---- ----------- -------- ------
      e0a       Cluster      Cluster          up   9000  auto/10000 healthy  false
      e0b       Cluster      Cluster          up   9000  auto/10000 healthy  false
      cluster1::*>
    2. 确认所有集群接口( LIF )均位于主端口上: network interface show -role cluster

      cluster1::*> network interface show -role cluster
                  Logical            Status     Network           Current      Current Is
      Vserver     Interface          Admin/Oper Address/Mask      Node         Port    Home
      ----------- ------------------ ---------- ----------------- ------------ ------- ----
      Cluster
                  cluster1-01_clus1  up/up     169.254.3.4/23     cluster1-01  e0a     true
                  cluster1-01_clus2  up/up     169.254.3.5/23     cluster1-01  e0d     true
                  cluster1-02_clus1  up/up     169.254.3.8/23     cluster1-02  e0a     true
                  cluster1-02_clus2  up/up     169.254.3.9/23     cluster1-02  e0d     true
                  cluster1-03_clus1  up/up     169.254.1.3/23     cluster1-03  e0a     true
                  cluster1-03_clus2  up/up     169.254.1.1/23     cluster1-03  e0b     true
                  cluster1-04_clus1  up/up     169.254.1.6/23     cluster1-04  e0a     true
                  cluster1-04_clus2  up/up     169.254.1.7/23     cluster1-04  e0b     true
      8 entries were displayed.
      cluster1::*>
    3. 验证集群是否同时显示两个集群交换机的信息: ssystem cluster-switch show -is-monitoring-enableed-Operational true

      cluster1::*> system cluster-switch show -is-monitoring-enabled-operational true
      Switch                      Type               Address          Model
      --------------------------- ------------------ ---------------- -----
      cs1                         cluster-network    10.233.205.90    N9K-C9336C
           Serial Number: FOCXXXXXXGD
            Is Monitored: true
                  Reason: None
        Software Version: Cisco Nexus Operating System (NX-OS) Software, Version
                          9.3(5)
          Version Source: CDP
      
      cs2                         cluster-network    10.233.205.91    N9K-C9336C
           Serial Number: FOCXXXXXXGS
            Is Monitored: true
                  Reason: None
        Software Version: Cisco Nexus Operating System (NX-OS) Software, Version
                          9.3(5)
          Version Source: CDP
      cluster1::*>
  3. 在集群 LIF 上禁用自动还原。

    cluster1::*> network interface modify -vserver Cluster -lif \* -auto-revert false
  4. 在集群交换机 CS2 上,关闭连接到节点集群端口的端口。

    cs2(config)# interface eth1/1/1-2,eth1/7-8
    cs2(config-if-range)# shutdown
  5. 验证集群 LIF 是否已迁移到集群交换机 CS1 上托管的端口。这可能需要几秒钟时间: network interface show -role cluster

    cluster1::*> network interface show -role cluster
                Logical           Status     Network            Current       Current Is
    Vserver     Interface         Admin/Oper Address/Mask       Node          Port    Home
    ----------- ----------------- ---------- ------------------ ------------- ------- ----
    Cluster
                cluster1-01_clus1 up/up      169.254.3.4/23     cluster1-01   e0a     true
                cluster1-01_clus2 up/up      169.254.3.5/23     cluster1-01   e0a     false
                cluster1-02_clus1 up/up      169.254.3.8/23     cluster1-02   e0a     true
                cluster1-02_clus2 up/up      169.254.3.9/23     cluster1-02   e0a     false
                cluster1-03_clus1 up/up      169.254.1.3/23     cluster1-03   e0a     true
                cluster1-03_clus2 up/up      169.254.1.1/23     cluster1-03   e0a     false
                cluster1-04_clus1 up/up      169.254.1.6/23     cluster1-04   e0a     true
                cluster1-04_clus2 up/up      169.254.1.7/23     cluster1-04   e0a     false
    8 entries were displayed.
    cluster1::*>
  6. 验证集群是否运行正常: cluster show

    cluster1::*> cluster show
    Node                 Health  Eligibility   Epsilon
    -------------------- ------- ------------  -------
    cluster1-01          true    true          false
    cluster1-02          true    true          false
    cluster1-03          true    true          true
    cluster1-04          true    true          false
    4 entries were displayed.
    cluster1::*>
  7. 清理交换机 CS2 上的配置并执行基本设置。

    注意 更新或应用新 RCF 时,必须擦除交换机设置并执行基本配置。您必须使用串行控制台连接到交换机,才能擦除交换机设置。
    1. 清理配置。此步骤需要与交换机建立控制台连接。

      cs2# write erase
      Warning: This command will erase the startup-configuration.
      Do you wish to proceed anyway? (y/n)  [n] y
      cs2# reload
      This command will reboot the system. (y/n)?  [n] y
      cs2#
    2. 对交换机执行基本设置。

  8. 使用以下传输协议之一将 RCF 复制到交换机 CS2 的启动闪存: FTP , TFTP , SFTP 或 SCP 。有关 Cisco 命令的详细信息,请参见中的相应指南 "《 Cisco Nexus 9000 系列 NX-OS 命令参考》" 指南。

    此示例显示了使用 TFTP 将 RCF 复制到交换机 CS2 上的 bootflash 。

    cs2# copy tftp: bootflash: vrf management
    Enter source filename: Nexus_9336C_RCF_v1.6-Cluster-HA-Breakout.txt
    Enter hostname for the tftp server: 172.22.201.50
    Trying to connect to tftp server......Connection to Server Established.
    TFTP get operation was successful
    Copy complete, now saving to disk (please wait)...
  9. 将先前下载的 RCF 应用于 bootflash 。

    有关 Cisco 命令的详细信息,请参见中的相应指南 "《 Cisco Nexus 9000 系列 NX-OS 命令参考》" 指南。

    此示例显示了正在交换机 CS2 上安装的 RCF 文件 Nexus 9336C_RCF_v1.6-Cluster-HA-Breakout 。 txt

    cs2# copy Nexus_9336C_RCF_v1.6-Cluster-HA-Breakout.txt running-config echo-commands
  10. 检查 show banner motd 命令的横幅输出。您必须阅读并遵循这些说明,以确保交换机的配置和操作正确。

    cs2# show banner motd
    
    ******************************************************************************
    * NetApp Reference Configuration File (RCF)
    *
    * Switch   : Nexus N9K-C9336C-FX2
    * Filename : Nexus_9336C_RCF_v1.6-Cluster-HA-Breakout.txt
    * Date     : 10-23-2020
    * Version  : v1.6
    *
    * Port Usage:
    * Ports  1- 3: Breakout mode (4x10G) Intra-Cluster Ports, int e1/1/1-4, e1/2/1-4
    , e1/3/1-4
    * Ports  4- 6: Breakout mode (4x25G) Intra-Cluster/HA Ports, int e1/4/1-4, e1/5/
    1-4, e1/6/1-4
    * Ports  7-34: 40/100GbE Intra-Cluster/HA Ports, int e1/7-34
    * Ports 35-36: Intra-Cluster ISL Ports, int e1/35-36
    *
    * Dynamic breakout commands:
    * 10G: interface breakout module 1 port <range> map 10g-4x
    * 25G: interface breakout module 1 port <range> map 25g-4x
    *
    * Undo breakout commands and return interfaces to 40/100G configuration in confi
    g mode:
    * no interface breakout module 1 port <range> map 10g-4x
    * no interface breakout module 1 port <range> map 25g-4x
    * interface Ethernet <interfaces taken out of breakout mode>
    * inherit port-profile 40-100G
    * priority-flow-control mode auto
    * service-policy input HA
    * exit
    *
    ******************************************************************************
  11. 验证 RCF 文件是否为正确的更新版本: show running-config

    在检查输出以确认您的 RCF 正确无误时,请确保以下信息正确无误:

    • RCF 横幅

    • 节点和端口设置

    • 自定义输出因站点配置而异。检查端口设置,并参阅发行说明,了解您安装的 RCF 的任何特定更改。

  12. 验证 RCF 版本和交换机设置是否正确后,将 running-config 文件复制到 startup-config 文件。

    有关 Cisco 命令的详细信息,请参见中的相应指南 "《 Cisco Nexus 9000 系列 NX-OS 命令参考》" 指南。

    cs2# copy running-config startup-config [########################################] 100% Copy complete
  13. 重新启动交换机 CS2 。在交换机重新启动时,您可以忽略节点上报告的 "`cluster ports down` " 事件。

    cs2# reload
    This command will reboot the system. (y/n)?  [n] y
  14. 验证集群上集群端口的运行状况。

    1. 验证集群中所有节点上的 e0d 端口是否均已启动且运行正常: network port show -role cluster

      cluster1::*> network port show -role cluster
      
      Node: cluster1-01
                                                                             Ignore
                                                        Speed(Mbps) Health   Health
      Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
      --------- ------------ ---------------- ---- ---- ----------- -------- ------
      e0a       Cluster      Cluster          up   9000  auto/10000 healthy  false
      e0b       Cluster      Cluster          up   9000  auto/10000 healthy  false
      
      Node: cluster1-02
                                                                             Ignore
                                                        Speed(Mbps) Health   Health
      Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
      --------- ------------ ---------------- ---- ---- ----------- -------- ------
      e0a       Cluster      Cluster          up   9000  auto/10000 healthy  false
      e0b       Cluster      Cluster          up   9000  auto/10000 healthy  false
      
      Node: cluster1-03
                                                                             Ignore
                                                        Speed(Mbps) Health   Health
      Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
      --------- ------------ ---------------- ---- ---- ----------- -------- ------
      e0a       Cluster      Cluster          up   9000  auto/100000 healthy false
      e0d       Cluster      Cluster          up   9000  auto/100000 healthy false
      
      Node: cluster1-04
                                                                             Ignore
                                                        Speed(Mbps) Health   Health
      Port      IPspace      Broadcast Domain Link MTU  Admin/Oper  Status   Status
      --------- ------------ ---------------- ---- ---- ----------- -------- ------
      e0a       Cluster      Cluster          up   9000  auto/100000 healthy false
      e0d       Cluster      Cluster          up   9000  auto/100000 healthy false
      8 entries were displayed.
    2. 从集群验证交换机运行状况(此操作可能不会显示交换机 CS2 ,因为 LIF 不驻留在 e0d 上)。

      cluster1::*> network device-discovery show -protocol cdp
      Node/       Local  Discovered
      Protocol    Port   Device (LLDP: ChassisID)  Interface         Platform
      ----------- ------ ------------------------- ----------------- --------
      cluster1-01/cdp
                  e0a    cs1                       Ethernet1/7       N9K-C9336C
                  e0d    cs2                       Ethernet1/7       N9K-C9336C
      cluster01-2/cdp
                  e0a    cs1                       Ethernet1/8       N9K-C9336C
                  e0d    cs2                       Ethernet1/8       N9K-C9336C
      cluster01-3/cdp
                  e0a    cs1                       Ethernet1/1/1     N9K-C9336C
                  e0b    cs2                       Ethernet1/1/1     N9K-C9336C
      cluster1-04/cdp
                  e0a    cs1                       Ethernet1/1/2     N9K-C9336C
                  e0b    cs2                       Ethernet1/1/2     N9K-C9336C
      
      cluster1::*> system cluster-switch show -is-monitoring-enabled-operational true
      Switch                      Type               Address          Model
      --------------------------- ------------------ ---------------- -----
      cs1                         cluster-network    10.233.205.90    NX9-C9336C
           Serial Number: FOCXXXXXXGD
            Is Monitored: true
                  Reason: None
        Software Version: Cisco Nexus Operating System (NX-OS) Software, Version
                          9.3(5)
          Version Source: CDP
      
      cs2                         cluster-network    10.233.205.91    NX9-C9336C
           Serial Number: FOCXXXXXXGS
            Is Monitored: true
                  Reason: None
        Software Version: Cisco Nexus Operating System (NX-OS) Software, Version
                          9.3(5)
          Version Source: CDP
      
      2 entries were displayed.
      注 根据先前加载在 CS1 交换机控制台上的 RCF 版本,您可能会在该交换机控制台上看到以下输出。
    2020 Nov 17 16:07:18 cs1 %$ VDC-1 %$ %STP-2-UNBLOCK_CONSIST_PORT: Unblocking port port-channel1 on VLAN0092. Port consistency restored.
    2020 Nov 17 16:07:23 cs1 %$ VDC-1 %$ %STP-2-BLOCK_PVID_PEER: Blocking port-channel1 on VLAN0001. Inconsistent peer vlan.
    2020 Nov 17 16:07:23 cs1 %$ VDC-1 %$ %STP-2-BLOCK_PVID_LOCAL: Blocking port-channel1 on VLAN0092. Inconsistent local vlan.
  15. 在集群交换机 CS1 上,关闭连接到节点集群端口的端口。

    以下示例使用步骤 1 中的接口示例输出:

    cs1(config)# interface eth1/1/1-2,eth1/7-8
    cs1(config-if-range)# shutdown
  16. 验证集群 LIF 是否已迁移到交换机 CS2 上托管的端口。这可能需要几秒钟的时间。network interface show -role cluster

    cluster1::*> network interface show -role cluster
                Logical            Status     Network            Current             Current Is
    Vserver     Interface          Admin/Oper Address/Mask       Node                Port    Home
    ----------- ------------------ ---------- ------------------ ------------------- ------- ----
    Cluster
                cluster1-01_clus1  up/up      169.254.3.4/23     cluster1-01         e0d     false
                cluster1-01_clus2  up/up      169.254.3.5/23     cluster1-01         e0d     true
                cluster1-02_clus1  up/up      169.254.3.8/23     cluster1-02         e0d     false
                cluster1-02_clus2  up/up      169.254.3.9/23     cluster1-02         e0d     true
                cluster1-03_clus1  up/up      169.254.1.3/23     cluster1-03         e0b     false
                cluster1-03_clus2  up/up      169.254.1.1/23     cluster1-03         e0b     true
                cluster1-04_clus1  up/up      169.254.1.6/23     cluster1-04         e0b     false
                cluster1-04_clus2  up/up      169.254.1.7/23     cluster1-04         e0b     true
    8 entries were displayed.
    cluster1::*>
  17. 验证集群是否运行正常: cluster show

    cluster1::*> cluster show
    Node                 Health   Eligibility   Epsilon
    -------------------- -------- ------------- -------
    cluster1-01          true     true          false
    cluster1-02          true     true          false
    cluster1-03          true     true          true
    cluster1-04          true     true          false
    4 entries were displayed.
    cluster1::*>
  18. 对交换机 CS1 重复步骤 7 至 14 。

  19. 在集群 LIF 上启用自动还原。

    cluster1::*> network interface modify -vserver Cluster -lif \* -auto-revert True
  20. 重新启动交换机 CS1 。执行此操作可触发集群 LIF 还原到其主端口。在交换机重新启动时,您可以忽略节点上报告的 "`cluster ports down` " 事件。

    cs1# reload
    This command will reboot the system. (y/n)?  [n] y
  21. 验证连接到集群端口的交换机端口是否已启动。

    cs1# show interface brief \| grep up
    .
    .
    Eth1/1/1      1       eth  access up      none                    10G(D) --
    Eth1/1/2      1       eth  access up      none                    10G(D) --
    Eth1/7        1       eth  trunk  up      none                   100G(D) --
    Eth1/8        1       eth  trunk  up      none                   100G(D) --
    .
    .
  22. 验证 CS1 和 CS2 之间的 ISL 是否正常运行:s如何执行端口通道摘要

    cs1# show port-channel summary
    Flags:  D - Down        P - Up in port-channel (members)
            I - Individual  H - Hot-standby (LACP only)
            s - Suspended   r - Module-removed
            b - BFD Session Wait
            S - Switched    R - Routed
            U - Up (port-channel)
            p - Up in delay-lacp mode (member)
            M - Not in use. Min-links not met
    --------------------------------------------------------------------------------
    Group Port-       Type     Protocol  Member Ports      Channel
    --------------------------------------------------------------------------------
    1     Po1(SU)     Eth      LACP      Eth1/35(P)        Eth1/36(P)
    cs1#
  23. 验证集群 LIF 是否已还原到其主端口: network interface show -role cluster

    cluster1::*> network interface show -role cluster
                Logical            Status     Network            Current             Current Is
    Vserver     Interface          Admin/Oper Address/Mask       Node                Port    Home
    ----------- ------------------ ---------- ------------------ ------------------- ------- ----
    Cluster
                cluster1-01_clus1  up/up      169.254.3.4/23     cluster1-01         e0d     true
                cluster1-01_clus2  up/up      169.254.3.5/23     cluster1-01         e0d     true
                cluster1-02_clus1  up/up      169.254.3.8/23     cluster1-02         e0d     true
                cluster1-02_clus2  up/up      169.254.3.9/23     cluster1-02         e0d     true
                cluster1-03_clus1  up/up      169.254.1.3/23     cluster1-03         e0b     true
                cluster1-03_clus2  up/up      169.254.1.1/23     cluster1-03         e0b     true
                cluster1-04_clus1  up/up      169.254.1.6/23     cluster1-04         e0b     true
                cluster1-04_clus2  up/up      169.254.1.7/23     cluster1-04         e0b     true
    8 entries were displayed.
    cluster1::*>
  24. 验证集群是否运行正常: cluster show

    cluster1::*> cluster show
    Node                 Health  Eligibility   Epsilon
    -------------------- ------- ------------- -------
    cluster1-01          true    true          false
    cluster1-02          true    true          false
    cluster1-03          true    true          true
    cluster1-04          true    true          false
    4 entries were displayed.
    cluster1::*>
  25. 对远程集群接口执行 Ping 操作以验证连接: cluster ping-cluster -node local

    cluster1::*> cluster ping-cluster -node local
    Host is cluster1-03
    Getting addresses from network interface table...
    Cluster cluster1-03_clus1 169.254.1.3 cluster1-03 e0a
    Cluster cluster1-03_clus2 169.254.1.1 cluster1-03 e0b
    Cluster cluster1-04_clus1 169.254.1.6 cluster1-04 e0a
    Cluster cluster1-04_clus2 169.254.1.7 cluster1-04 e0b
    Cluster cluster1-01_clus1 169.254.3.4 cluster1-01 e0a
    Cluster cluster1-01_clus2 169.254.3.5 cluster1-01 e0d
    Cluster cluster1-02_clus1 169.254.3.8 cluster1-02 e0a
    Cluster cluster1-02_clus2 169.254.3.9 cluster1-02 e0d
    Local = 169.254.1.3 169.254.1.1
    Remote = 169.254.1.6 169.254.1.7 169.254.3.4 169.254.3.5 169.254.3.8 169.254.3.9
    Cluster Vserver Id = 4294967293
    Ping status:
    ............
    Basic connectivity succeeds on 12 path(s)
    Basic connectivity fails on 0 path(s)
    ................................................
    Detected 9000 byte MTU on 12 path(s):
        Local 169.254.1.3 to Remote 169.254.1.6
        Local 169.254.1.3 to Remote 169.254.1.7
        Local 169.254.1.3 to Remote 169.254.3.4
        Local 169.254.1.3 to Remote 169.254.3.5
        Local 169.254.1.3 to Remote 169.254.3.8
        Local 169.254.1.3 to Remote 169.254.3.9
        Local 169.254.1.1 to Remote 169.254.1.6
        Local 169.254.1.1 to Remote 169.254.1.7
        Local 169.254.1.1 to Remote 169.254.3.4
        Local 169.254.1.1 to Remote 169.254.3.5
        Local 169.254.1.1 to Remote 169.254.3.8
        Local 169.254.1.1 to Remote 169.254.3.9
    Larger than PMTU communication succeeds on 12 path(s)
    RPC status:
    6 paths up, 0 paths down (tcp check)
    6 paths up, 0 paths down (udp check)