Skip to main content
Install and maintain

Prepare for a hot-add - NS224 shelves

Contributors netapp-lisa netapp-jsnyder
PDFs

Complete the preparation tasks applicable to your HA pair before hot-adding an NS224 shelf.

When you are done with the applicable preparation tasks, go to Install a shelf for a hot-add.

Install RoCE-capable PCIe cards or I/O modules

If your platform model supports the use of RoCE-capable PCIe cards or I/O modules, your HA pair must have enough available RoCE-capable Ethernet ports to support the number of shelves you are hot-adding.

Steps

  1. For each shelf you are hot-adding, verify that there are two RoCE-capable ports on each controller.

    These ports can be on board the controllers, on RoCE-capable PCIe cards, a combination of both, or on RoCE-capable I/O modules, as supported by your platform model.

  2. If your HA pair does not have enough available RoCE-capable ports, install the additional PCIe cards or I/O modules into the correct controller slots, as supported by your platform model.

    1. Identify the correct controller slots for your platform model. See NetApp Hardware Universe.

    2. See your platform model's documentation for PCIe card or I/O module installation instructions.

Configure RoCE-capable ports for storage use

If your HA pair has non-dedicated RoCE-capable Ethernet ports that you are using to hot-add an NS224 shelf, you must configure the ports for storage use (not networking use).

Before you begin

  • Make sure you installed any additional RoCE-capable PCIe cards or I/O modules in each controller.

About this task

  • For some platform models, when a RoCE-capable PCIe card or I/O module is installed in a supported slot on a controller, the ports automatically default to storage use (instead of networking); however, it is recommended that you complete the following procedure to verify the RoCE-capable ports are configured for storage use.

  • If you determine that the non-dedicated RoCE-capable ports in your HA pair are not configured for storage use, it is a nondisruptive procedure to configure them.

    Depending on the version of ONTAP your HA pair is running, you might need to reboot the controllers:

    • If your HA pair is running a version of ONTAP 9.6, you need to reboot the controllers, one at a time.

    • If your HA pair is running ONTAP 9.7 or later, you do not need to reboot the controllers, unless one or both controllers are in maintenance mode. This procedure assumes that neither controller is in maintenance mode.

  • If in the future you need to change ports from storage use to networking use, enter the command, storage port modify -node node_name -port port_name -mode network.

Steps

  1. Log in to the cluster using SSH or the serial console port.

  2. Enter the following command to verify if the non-dedicated ports in the HA pair are configured for storage use:

    storage port show

    • If your HA pair is running ONTAP 9.8 or later, the non-dedicated ports display storage in the Mode column.

    • If your HA pair is running ONTAP 9.7 or 9.6, the non-dedicated ports, which display false in the Is Dedicated? column, also display enabled in the State column.

      Note

      When non-dedicated ports are not configured for storage use, the command output displays the following:

      • If your HA pair is running ONTAP 9.8 or later, the non-dedicated ports display network in the Mode column.

      • If your HA pair is running ONTAP 9.7 or 9.6, the non-dedicated ports, which display false in the Is Dedicated?` column, also display disabled in the State column.

  3. If the non-dedicated ports are configured for storage use, you are done with this procedure.

    Otherwise, you need to configure the ports by completing steps 4 through 7.

  4. Configure the non-dedicated ports for storage use, on one of the controllers:

    You must repeat the applicable command for each port you are configuring.

    If your HA pair is running…​ Use this command…​

    ONTAP 9.8 or later

    storage port modify -node node_name -port port_name -mode storage

    ONTAP 9.7 or 9.6

    storage port enable -node node_name -port port_name

  5. If your HA pair is running ONTAP 9.6, reboot the controller so that the port changes take effect: system node reboot -node node_name -reason reason_for_the_reboot.

    Otherwise, go to the next step.

    Note The reboot can take up to 15 minutes.

  6. Repeat the steps for the second controller:

    If your HA pair is running…​ Then…​

    ONTAP 9.7 or later

    1. Repeat step 4.

    2. Go to step 7.

    ONTAP 9.6

    1. Repeat steps 4 and 5.

      Note The first controller must have already completed its reboot.

    2. Go to step 7.

  7. Verify that the non-dedicated ports on both controllers are configured for storage use: storage port show

    • If your HA pair is running ONTAP 9.8 or later, the non-dedicated ports display storage in the Mode column.

    • If your HA pair is running ONTAP 9.7 or 9.6, the non-dedicated ports, which display false in the Is Dedicated? column, also display enabled in the State column.

Recable existing shelves

Before hot-adding additional shelves, depending on your platform model, you might need to recable an existing shelf (after you have installed the additional RoCE-capable PCIe cards or I/O modules) across two sets of ports in different slots for resiliency against slot failure.

Before you begin

  • Make sure you installed any additional RoCE-capable PCIe cards or I/O modules in each controller.

  • Make sure that the non-dedicated ports on the RoCE-capable PCIe cards or I/O modules you installed are configured for storage use.

About this task

  • Recabling port connections is a nondisruptive procedure when your shelf has multipath-HA connectivity.

  • You move one cable at a time to always maintain connectivity to the shelf during this procedure.

    Note Moving a cable does not require any wait time between unplugging the cable from one port and plugging it into another port.

  • If needed, refer to the shelf cabling illustrations for your platform model in Overview of cabling for a hot-add.

Steps

  1. Recable the existing shelf's connections across two sets of RoCE-capable ports in different slots, as applicable to your platform model.

AFF A1K

Do one of the following if you are hot-adding a second shelf or a fourth shelf.

Note If you have an AFF A1K HA pair and you are hot-adding a third shelf and installing a third or fourth RoCE-capable I/O module in each controller, the third shelf is cabled to only the third or third and fourth I/O modules. You do not need to recable any existing shelves.

  • If you are hot-adding a second shelf, recable the first shelf across the RoCE-capable I/O modules in slot 11 and slot 10 on each controller.

    The substeps assume the existing shelf is cabled to a RoCE-capable I/O module in slot 11 on each controller.

    1. On controller A, move the cable from slot 11 port b (e11b) to slot 10 port b (e10b).

    2. Repeat the same cable move on controller B.

  • If you are hot-adding a fourth shelf, recable the third shelf across the RoCE-capable I/O modules in slot 9 and slot 8 on each controller.

    The substeps assume the third shelf is cabled to a RoCE-capable I/O module in slot 9 on each controller.

    1. On controller A, move the cable from slot 9 port b (e9b) to slot 8 port b (e8b).

    2. Repeat the same cable move on controller B.

AFF A70 or AFF A90

If you are hot-adding a second shelf, recable the first shelf across the RoCE-capable I/O modules in slot 11 and slot 8 on each controller.

The substeps assume the existing shelf is cabled to a RoCE-capable I/O module in slot 11 on each controller.

  1. On controller A, move the cable from slot 11 port b (e11b) to slot 8 port b (e8b).

  2. Repeat the same cable move on controller B.

AFF A800 or AFF C800

If you are hot-adding a second shelf, recable the first shelf across the two sets of RoCE-capable ports in slot 5 and slot 3 on each controller.

The substeps assume the existing shelf is cabled to RoCE-capable PCIe cards in slot 5 on each controller.

  1. On controller A, move the cable from slot 5 port b (e5b) to slot 3 port b (e3b).

  2. Repeat the same cable move on controller B.

AFF A700

If you are hot-adding a second shelf, recable the first shelf across the two sets of RoCE-capable ports in slot 3 and slot 7 on each controller.

The substeps assume the existing shelf is cabled to RoCE-capable I/O modules in slot 3 on each controller.

  1. On controller A, move the cable from slot 3 port b (e3b) to slot 7 port b (e7b).

  2. Repeat the same cable move on controller B.

AFF A400 or AFF C400

If you are hot-adding a second shelf, depending on your platform model, do one of the following:

  • On the AFF A400:

    Recable the first shelf across the two sets of RoCE-capable ports, onboard e0c/e0d and in slot 5, on each controller.

    The substeps assume the existing shelf is cabled to RoCE-capable onboard ports e0c/e0d on each controller.

    1. On controller A, move the cable from port e0d to slot 5 Port b (e5b).

    2. Repeat the same cable move on controller B.

  • On the AFF C400:

    Recable the first shelf across the two sets of RoCE-capable ports in slot 4 and slot 5, on each controller.

    The substeps assume the existing shelf is cabled to RoCE-capable ports in slot 4 on each controller.

    1. On controller A, move the cable from slot 4 port a (e4a) to slot 5 port b (e5b).

    2. Repeat the same cable move on controller B.

  1. Verify that the recabled shelf is cabled correctly using Active IQ Config Advisor.

    If any cabling errors are generated, follow the corrective actions provided.

Disable automatic drive assignment

If you are manually assigning drive ownership for the NS224 shelf you are hot-adding, then you need to disable automatic drive assignment if it is enabled.

If you are unsure whether you should manually assign drive ownership, or want to understand the automatic assignment of drive ownership policies for your storage system, go to About automatic assignment of disk ownership.

Steps

  1. Verify whether automatic drive assignment is enabled: storage disk option show

    You can enter the command on either node.

    If automatic drive assignment is enabled, the output shows on in the Auto Assign column (for each node).

  2. If automatic drive assignment is enabled, disable it: storage disk option modify -node node_name -autoassign off

    You must disable automatic drive assignment on both nodes.