Upgrade controllers

Map network ports using ONTAP 9.8 or later

Contributors netapp-pcarriga netapp-aoife netapp-martyh

To enable node3 and node4 to communicate with each other in the cluster and with the network after the upgrade, you must confirm that the physical ports are correctly configured with the settings for the intended use, such as cluster, data, and so on.

Before you begin

These steps apply to systems running ONTAP 9.8 or later. If you are running ONTAP 9.7 or earlier, you must use the procedure in Map network ports using ONTAP 9.7 or earlier.

About this task

You must perform these steps on node3 and node4.

Note The following command examples refer to "node1" because at this stage in the procedure the replacement nodes "node3" and "node4" are actually named "node1" and "node2".
  1. If your system is running ONTAP 9.7 or earlier, STOP. You must use the procedure in Map network ports using ONTAP 9.7 or earlier.

  2. Locate the port and LIF configuration information for node1 and node2 that you recorded in Prepare for upgrade when moving storage, Step 3.

  3. Locate the information for ports, broadcast domains, and IPspaces that you recorded in Prepare for upgrade when moving storage, Step 3.

  4. Make the following changes:

    1. Boot and log in to node3 and node4 if you have not already done so.

    2. Modify ports that will be part of Cluster broadcast domain:

      network port modify -node node_name -port port_name -mtu 9000 -ipspace Cluster

      This example adds Cluster port e1b on "node1":

      network port modify -node node1 -port e1b -ipspace Cluster -mtu 9000

    3. Migrate the cluster LIFs to the new ports, once for each LIF:

      network interface migrate -vserver vserver_name -lif lif_name -source-node node1 -destination-node node1 -destination-port port_name

      When all cluster LIFs are migrated and cluster communication is established, the cluster should come into quorum.

    4. Modify the home port of the Cluster LIFs:

      network interface modify -vserver Cluster -lif lif_name –home-port port_name

    5. Remove the old ports from the Cluster broadcast domain:

      network port broadcast-domain remove-ports -ipspace Cluster -broadcast-domain Cluster -ports node1:port

    6. Display the health state of node3 and node4:

      cluster show -node node1 -fields health

    7. Each cluster LIF must be listening on port 7700. Verify that the cluster LIFs are listening on port 7700:

      ::> network connections listening show -vserver Cluster

      Port 7700 listening on cluster ports is the expected outcome as shown in the following example for a two-node cluster:

      Cluster::> network connections listening show -vserver Cluster
      Vserver Name     Interface Name:Local Port     Protocol/Service
      ---------------- ----------------------------  -------------------
      Node: NodeA
      Cluster          NodeA_clus1:7700               TCP/ctlopcp
      Cluster          NodeA_clus2:7700               TCP/ctlopcp
      Node: NodeB
      Cluster          NodeB_clus1:7700               TCP/ctlopcp
      Cluster          NodeB_clus2:7700               TCP/ctlopcp
      4 entries were displayed.
    8. If necessary, for each cluster LIF that is not listening on port 7700, set the administrative status of the LIF to down and then up:

      ::> net int modify -vserver Cluster -lif cluster-lif -status-admin down; net int modify -vserver Cluster -lif cluster-lif -status-admin up

      Repeat substep (g) to verify that the cluster LIF is now listening on port 7700.

  5. Modify the broadcast domain memberships of physical ports hosting data LIFs. You can do this manually, as shown in Map network ports using ONTAP 9.7 or earlier, Step7. The recommended approach is to use the enhanced network reachability scan and repair procedure introduced in ONTAP 9.8, as shown in the following Step 5, substeps (a) to (g).

    1. List the reachability status of all ports:

      network port reachability show

    2. Repair the reachability of the physical ports, followed by VLAN ports, by running the following command on each port, one port at a time:

      reachability repair -node node_name -port port_name

      A warning like the following is expected. Review and enter y or n as appropriate:

      Warning: Repairing port "node_name:port" may cause it to move into a
      different broadcast domain, which can cause LIFs to be re-homed away
      from the port. Are you sure you want to continue? {y|n}:
    3. To enable ONTAP to complete the repair, wait for about a minute after running the reachability repair command on the last port.

    4. List all broadcast domains on the cluster:

      network port broadcast-domain show

    5. As the reachability repair is performed, ONTAP attempts to place the ports in the correct broadcast domains. However, if a port’s reachability cannot be determined and does not correspond to any of the existing broadcast domains, ONTAP will create new broadcast domains for these ports. As required, you can delete the newly created broadcast domains if all their member ports will become member ports of the interface groups. Delete broadcast domains:

      broadcast-domain delete -broadcast-domain broadcast_domain

    6. Review the interface group configuration, and as required, add or delete member ports. Add member ports to interface group ports:

      ifgrp add-port -node node_name -ifgrp ifgrp_port -port port_name

      Remove member ports from interface group ports:

      ifgrp remove-port -node node_name -ifgrp ifgrp_port -port port_name

    7. Delete and re-create VLAN ports as needed. Delete VLAN ports:

      vlan delete -node node_name -vlan-name vlan_port

      Create VLAN ports:

      vlan create -node node_name -vlan-name vlan_port

      Note Depending on the complexity of the networking configuration of the system being upgraded, you might be required to repeat Step 5, substeps (a) to (g) ountil all ports are placed correctly where needed.
  6. If there are no VLANs configured on the system, go to Step 7. If there are VLANs configured, restore displaced VLANs that were previously configured on ports that no longer exist or were configured on ports that were moved to another broadcast domain.

    1. Display the displaced VLANs:

      cluster controller-replacement network displaced-vlans show

    2. Restore the displaced VLANs to the desired destination port:

      displaced-vlans restore -node node_name -port port_name -destination-port destination_port

    3. Verify that all displaced VLANs have been restored:

      cluster controller-replacement network displaced-vlans show

    4. VLANs are automatically placed into the appropriate broadcast domains about a minute after they are created. Verify that the restored VLANs have been placed into the appropriate broadcast domains:

      network port reachability show

  7. Beginning with ONTAP 9.8, ONTAP will automatically modify the home ports of LIFs if the ports are moved between broadcast domains during the network port reachability repair procedure. If a LIF’s home port was moved to another node, or is unassigned, that LIF will be presented as a displaced LIF. Restore the home ports of displaced LIFs whose home ports either no longer exist or were relocated to another node.

    1. Display the LIFs whose home ports might have moved to another node or no longer exist:

      displaced-interface show

    2. Restore the home port of each LIF:

      displaced-interface restore -vserver vserver_name -lif-name lif_name

    3. Verify that all LIF home ports have been restored:

      displaced-interface show

      When all ports are correctly configured and added to the correct broadcast domains, the network port reachability show command should report the reachability status as ok for all connected ports, and the status as no-reachability for ports with no physical connectivity. If any ports are reporting a status other than these two, repair the reachability as outlined in Step 5.

  8. Verify that all LIFs are administratively up on ports belonging to the correct broadcast domains.

    1. Check for any LIFs that are administratively down:

      network interface show -vserver vserver_name -status-admin down

    2. Check for any LIFs that are operationally down: network interface show -vserver vserver_name -status-oper down

    3. Modify any LIFs that need to be modified to have a different home port:

      network interface modify -vserver vserver_name -lif lif -home-port home_port

      Note For iSCSI LIFs, modification of the home port requires the LIF to be administratively down.
    4. Revert LIFs that are not home to their respective home ports:

      network interface revert *

You have completed mapping the physical ports. To complete the upgrade, go to Perform final upgrade steps in ONTAP 9.8 or later.