Mapping network ports using ONTAP 9.8

To enable node3 and node4 to communicate with each other in the cluster and with the network after the upgrade, you must ensure the physical ports are correctly configured with the settings for the intended use, such as cluster, data, and so on.

Before you begin

These steps apply to systems running ONTAP 9.8. If you are running ONTAP 9.7 or earlier, you must use the procedure in Mapping network ports using ONTAP 9.7 or earlier.

About this task

You must perform these steps on node3 and node4.
Note: The following command examples refer to "node1" because at this stage in the procedure the replacement nodes "node3" and "node4" are actually named "node1" and "node2".

Procedure

  1. If your system is running ONTAP 9.7 or earlier, STOP. You must use the procedure in Mapping network ports using ONTAP 9.7 or earlier.
  2. Locate the port and LIF configuration information for node1 and node2 that you recorded in Step 3.
  3. Locate the information for ports, broadcast domains, and IPspaces that you recorded in Step 3.
  4. Make the following changes:
    1. Boot and log in to node3 and node4 if you have not already done so.
    2. Modify ports that will be part of Cluster broadcast domain: network port modify -node node_name -port port_name -mtu 9000 -ipspace Cluster
      This example adds Cluster port e1b on node1:

      network port modify -node node1 -port e1b -ipspace Cluster -mtu 9000

    3. Migrate the cluster LIFs to the new ports, once for each LIF:

      network interface migrate -vserver vserver_name -lif lif_name -source-node node1 -destination-node node1 -destination-port port_name

      When all cluster LIFs are migrated and cluster communication is established, the cluster should come into quorum.
    4. Modify the home port of the Cluster LIFs:
      network interface modify -vserver Cluster -lif lif_name –home-port port_name
    5. Remove the old ports from the Cluster broadcast domain: network port broadcast-domain remove-ports -ipspace Cluster -broadcast-domain Cluster -ports node1:port
    6. Display the health state of node3 and node4: cluster show -node node1 -fields health
  5. Modify the broadcast domain memberships of physical ports hosting data LIFs. You can do this manually, as shown in Step7 of Mapping network ports using ONTAP 9.7 or earlier. The recommended approach is to use the enhanced network reachability scan and repair procedure introduced in ONTAP 9.8, as shown in substeps (a) to (g) of Step 5.
    1. List the reachability status of all ports: network port reachability show
    2. Repair the reachability of the physical ports, followed by VLAN ports, by running the following command on each port, one port at a time: reachability repair -node node_name -port port_name
      A warning like the following is expected. Review and enter y or n as appropriate:
      Warning: Repairing port "node_name:port" may cause it to move into a 
      different broadcast domain, which can cause LIFs to be re-homed away 
      from the port. Are you sure you want to continue? {y|n}:
    3. To allow ONTAP to complete the repair, wait for about a minute after running the reachability repair command on the last port.
    4. List all broadcast domains on the cluster:broadcast-domain show
    5. As the reachability repair is performed, ONTAP attempts to place the ports in the correct broadcast domains. However, if a port’s reachability cannot be determined and does not correspond to any of the existing broadcast domains, ONTAP will create new broadcast domains for these ports. As required, you can delete the newly created broadcast domains if all their member ports will become member ports of the interface groups. Delete broadcast domains: broadcast-domain delete -broadcast-domain broadcast_domain
    6. Review the interface group configuration, and as required, add or delete member ports. Add member ports to interface group ports: ifgrp add-port -node node_name -ifgrp ifgrp_port -port port_nameRemove member ports from interface group ports:ifgrp remove-port -node node_name -ifgrp ifgrp_port -port port_name
    7. Delete and re-create VLAN ports as needed. Delete VLAN ports:vlan delete -node node_name -vlan-name vlan_portCreate VLAN ports: vlan create -node node_name -vlan-name vlan_port
      Note: Depending on the complexity of the networking configuration of the system being upgraded, you might be required to repeat substeps (a) to (g) of Step 5 until all ports are placed correctly where needed.
  6. If there are no VLANs configured on the system, go to Step 7. If there are VLANs configured, restore displaced VLANs that were previously configured on ports that no longer exist or were configured on ports that were moved to another broadcast domain.
    1. Display the displaced VLANs:displaced-vlans show
    2. Restore the displaced VLANs to the desired destination port:displaced-vlans restore -node node_name -port port_name -destination-port destination_port
    3. Verify that all displaced VLANs have been restored:displaced-vlans show
    4. VLANs are automatically placed into the appropriate broadcast domains about a minute after they are created. Verify that the restored VLANs have been placed into the appropriate broadcast domains: network port reachability show
  7. Starting from ONTAP 9.8, ONTAP will automatically modify the home ports of LIFs if the ports are moved between broadcast domains during the network port reachability repair procedure. If a LIF’s home port was moved to another node, or is unassigned, that LIF will be presented as a displaced LIF. Restore the home ports of displaced LIFs whose home ports either no longer exist or were relocated to another node.
    1. Display the LIFs whose home ports might have moved to another node or no longer exist:displaced-interface show
    2. Restore the home port of each LIF:displaced-interface restore -vserver vserver_name -lif-name lif_name
    3. Verify that all LIF home ports have been restored:displaced-interface show

    When all ports are correctly configured and added to the correct broadcast domains, the network port reachability show command should report the reachability status as ok for all connected ports, and the status as no-reachability for ports with no physical connectivity. If any ports are reporting a status other than these two, repair the reachability as outlined in Step 5.

  8. Verify that all LIFs are administratively up on ports belonging to the correct broadcast domains.
    1. Check for any LIFs that are administratively down:network interface show -vserver vserver_name -status-admin down
    2. Check for any LIFs that are operationally down:network interface show -vserver vserver_name -status-oper down
    3. Modify any LIFs that need to be modified to have a different home port: network interface modify -vserver vserver_name -lif lif -home-port home_port
      Note: For iSCSI LIFs, modification of the home port requires the LIF to be administratively down.
    4. Revert LIFs that are not home to their respective home ports:network interface revert *

After you finish

You have completed mapping the physical ports. To complete the upgrade, go to Performing final upgrade steps in ONTAP 9.8.