Replace E2800 host interface card (HIC)

Contributors netapp-jsnyder NetAppZacharyWambold netapp-jolieg

You can replace a host interface card (HIC) that has failed.

About this task

When you replace a HIC, you place the controller offline, remove the controller canister, install the new HIC, replace the controller canister, and then bring the controller online.

Before you begin
  • Review Requirements for E2800 HIC replacement.

  • You must schedule a downtime maintenance window for this procedure. The power must be off when you install HICs, so you cannot access data on the storage array until you have successfully completed this procedure. (In a duplex configuration, this is because both controllers must have the same HIC configuration when they are powered on.)

  • Make sure that no volumes are in use or that you have a multipath driver installed on all hosts using these volumes.

What you’ll need
  • One or two HICs, based on whether you have one or two controllers in your storage array. The HICs must be compatible with your controllers. If two controllers are present, each controller must have identical HICs.

  • Labels to identify each cable that is connected to the controller canister.

  • An ESD wristband, or you have taken other antistatic precautions.

  • A #1 Phillips screwdriver.

  • A management station with a browser that can access SANtricity System Manager for the controller. (To open the System Manager interface, point the browser to the controller’s domain name or IP address.)

Step 1: Place controller offline

The steps to place a controller offline depend on whether you have one controller (simplex) or two controllers (duplex). Go to the appropriate instructions for:

Duplex: Place controller offline

If you have a duplex configuration, follow this step to place the controller offline so you can safely remove the failed HIC.

Note Perform this task only if your storage array has two controllers (duplex configuration).
Steps
  1. From the Details area of the Recovery Guru, determine which of the controller canisters has the failed HIC.

  2. Back up the storage array’s configuration database using SANtricity System Manager.

    If a problem occurs during this procedure, you can use the saved file to restore your configuration. The system will save the current state of the RAID configuration database, which includes all data for volume groups and disk pools on the controller.

    • From System Manager:

      1. Select Support  Support Center  Diagnostics.

      2. Select Collect Configuration Data.

      3. Click Collect.

        The file is saved in the Downloads folder for your browser with the name, configurationData-<arrayName>-<dateTime>.7z.

    • Alternatively, you can back up the configuration database by using the following CLI command:

      save storageArray dbmDatabase sourceLocation=onboard contentType=all file="filename";

  3. Collect support data for your storage array using SANtricity System Manager.

    If a problem occurs during this procedure, you can use the saved file to troubleshoot the issue. The system will save inventory, status, and performance data about your storage array in a single file.

    1. Select Support  Support Center  Diagnostics.

    2. Select Collect Support Data.

    3. Click Collect.

      The file is saved in the Downloads folder for your browser with the name, support-data.7z.

  4. If the controller is not already offline, take it offline now using SANtricity System Manager.

    • From SANtricity System Manager:

      1. Select Hardware.

      2. If the graphic shows the drives, select Show back of shelf to show the controllers.

      3. Select the controller that you want to place offline.

      4. From the context menu, select Place offline, and confirm that you want to perform the operation.

        Note If you are accessing SANtricity System Manager using the controller you are attempting to take offline, a SANtricity System Manager Unavailable message is displayed. Select Connect to an alternate network connection to automatically access SANtricity System Manager using the other controller.
    • Alternatively, you can take the controllers offline by using the following CLI commands:

      For controller A: set controller [a] availability=offline

      For controller B: set controller [b] availability=offline

  5. Wait for SANtricity System Manager to update the controller’s status to offline.

Caution Do not begin any other operations until after the status has been updated.

Simplex: Power down the controller shelf

If you have a simplex configuration, power down the controller shelf so you can safely remove the failed HIC.

Note Perform this task only if your storage array has one controller (simplex configuration).
Steps
  1. From SANtricity System Manager, review the details in the Recovery Guru to confirm that you have a failed HIC and to ensure no other items must be addressed before you can remove and replace the HIC.

  2. Back up the storage array’s configuration database using SANtricity System Manager.

    If a problem occurs during this procedure, you can use the saved file to restore your configuration. The system will save the current state of the RAID configuration database, which includes all data for volume groups and disk pools on the controller.

    • From System Manager:

      1. Select Support  Support Center  Diagnostics.

      2. Select Collect Configuration Data.

      3. Click Collect.

        The file is saved in the Downloads folder for your browser with the name, configurationData-<arrayName>-<dateTime>.7z.

    • Alternatively, you can back up the configuration database by using the following CLI command:

      save storageArray dbmDatabase sourceLocation=onboard contentType=all file="filename";

  3. Collect support data for your storage array using SANtricity System Manager.

    If a problem occurs during this procedure, you can use the saved file to troubleshoot the issue. The system will save inventory, status, and performance data about your storage array in a single file.

    1. Select Support  Support Center  Diagnostics.

    2. Select Collect Support Data.

    3. Click Collect.

      The file is saved in the Downloads folder for your browser with the name, support-data.7z.

  4. Ensure that no I/O operations are occurring between the storage array and all connected hosts. For example, you can perform these steps:

    • Stop all processes that involve the LUNs mapped from the storage to the hosts.

    • Ensure that no applications are writing data to any LUNs mapped from the storage to the hosts.

    • Unmount all file systems associated with volumes on the array.

      Note The exact steps to stop host I/O operations depend on the host operating system and the configuration, which are beyond the scope of these instructions. If you are not sure how to stop host I/O operations in your environment, consider shutting down the host.
      Caution Possible data loss — If you continue this procedure while I/O operations are occurring, you might lose data.
  5. Wait for any data in cache memory to be written to the drives.

    The green Cache Active LED on the back of the controller is on when cached data needs to be written to the drives. You must wait for this LED to turn off.

  6. From the home page of SANtricity System Manager, select View Operations in Progress.

  7. Confirm that all operations have completed before continuing with the next step.

  8. Turn off both power switches on the controller shelf.

  9. Wait for all LEDs on the controller shelf to turn off.

Step 2: Remove controller canister

Remove the controller canister so you can add the new host interface card (HIC).

Steps
  1. Label each cable that is attached to the controller canister.

  2. Disconnect all the cables from the controller canister.

    Caution To prevent degraded performance, do not twist, fold, pinch, or step on the cables.
  3. Confirm that the Cache Active LED on the back of the controller is off.

    The green Cache Active LED on the back of the controller is on when cached data needs to be written to the drives. You must wait for this LED to turn off before removing the controller canister.

    28 dwg 2800 controller attn led maint e2800

    (1) Cache Active LED

  4. Squeeze the latch on the cam handle until it releases, and then open the cam handle to the right to release the controller canister from the shelf.

    The following figure is an example of an E2812 controller shelf, E2824 controller shelf, or EF280 flash array:

    28 dwg e2824 remove controller canister maint e2800

    (1) Controller canister

    (2) Cam handle

    The following figure is an example of an E2860 controller shelf:

    28 dwg e2860 add controller canister maint e2800

    (1) Controller canister

    (2) Cam handle

  5. Using two hands and the cam handle, slide the controller canister out of the shelf.

    Caution Always use two hands to support the weight of a controller canister.

    If you are removing the controller canister from an E2812 controller shelf, E2824 controller shelf or EF280 flash array, a flap swings into place to block the empty bay, helping to maintain air flow and cooling.

  6. Turn the controller canister over, so that the removable cover faces up.

  7. Place the controller canister on a flat, static-free surface.

Step 3: Install a HIC

Install a HIC to replace the failed one with a new HIC.

Caution Possible loss of data access — Never install a HIC in an E2800 controller canister if that HIC was designed for another E-Series controller. In addition, if you have a duplex configuration, both controllers and both HICs must be identical. The presence of incompatible or mismatched HICs will cause the controllers to lock down when you apply power.
Steps
  1. Unpack the new HIC and the new HIC faceplate.

  2. Press the button on the cover of the controller canister, and slide the cover off.

  3. Confirm that the green LED inside the controller (by the DIMMs) is off.

    If this green LED is on, the controller is still using battery power. You must wait for this LED to go off before removing any components.

    28 dwg e2800 internal cache active led maint e2800

    (1) Internal Cache Active LED

    (2) Battery

  4. Using a #1 Phillips screwdriver, remove the four screws that attach the blank faceplate to the controller canister, and remove the faceplate.

  5. Align the three thumbscrews on the HIC with the corresponding holes on the controller, and align the connector on the bottom of the HIC with the HIC interface connector on the controller card.

    Be careful not to scratch or bump the components on the bottom of the HIC or on the top of the controller card.

  6. Carefully lower the HIC into place, and seat the HIC connector by pressing gently on the HIC.

    Caution Possible equipment damage — Be very careful not to pinch the gold ribbon connector for the controller LEDs between the HIC and the thumbscrews.
    28 dwg e2800 hic thumbscrews maint e2800

    (1) Host interface card

    (2) Thumbscrews

  7. Hand-tighten the HIC thumbscrews.

    Do not use a screwdriver, or you might over-tighten the screws.

  8. Using a #1 Phillips screwdriver, attach the new HIC faceplate to the controller canister with the four screws you removed previously.

    28 dwg e2800 hic faceplace screws maint e2800

Step 4: Reinstall controller canister

After installing the HIC, reinstall the controller canister into the controller shelf.

Steps
  1. Turn the controller canister over, so that the removable cover faces down.

  2. With the cam handle in the open position, slide the controller canister all the way into the controller shelf.

    The following figure is an example of an E2824 controller shelf or EF280 flash array:

    28 dwg e2824 remove controller canister maint e2800

    (1) Controller canister

    (2) Cam handle

    The following figure is an example of an E2860 controller shelf:

    28 dwg e2860 add controller canister maint e2800

    (1) Controller canister

    (2) Cam handle

  3. Move the cam handle to the left to lock the controller canister in place.

  4. Reconnect all the cables you removed.

    Note Do not connect data cables to the new HIC ports at this time.
  5. (Optional) If you are adding HICs to a duplex configuration, repeat all steps to remove the second controller canister, install the second HIC, and reinstall the second controller canister.

Step 5: Place controller online

The steps to place a controller online depend on whether you have one controller (simplex) or two controllers (duplex).

Duplex: Place controller online

For a duplex configuration, bring the controller online, collect support data, and resume operations.

Note Perform this task only if your storage array has two controllers.
Steps
  1. As the controller boots, check the controller LEDs and the seven-segment display.

    Note The figure shows an example controller canister. Your controller might have a different number and a different type of host ports.

    When communication with the other controller is reestablished:

    • The seven-segment display shows the repeating sequence OS, OL, blank to indicate that the controller is offline.

    • The amber Attention LED remains lit.

    • The Host Link LEDs might be on, blinking, or off, depending on the host interface. 28 dwg attn led 7s display maint e2800

      (1) Attention LED (amber)

      (2) Seven-segment display

      (3) Host Link LEDs

  2. Bring the controller online using SANtricity System Manager.

    • From SANtricity System Manager:

      1. Select Hardware.

      2. If the graphic shows the drives, select Show back of shelf.

      3. Select the controller you want to place online.

      4. Select Place Online from the context menu, and confirm that you want to perform the operation.

        The system places the controller online.

    • Alternatively, you can use the following CLI commands:

      For controller A: set controller [a] availability=online;

      For controller B: set controller [b] availability=online;

  3. Check the codes on the controller’s seven-segment display as it comes back online. If the display shows one of the following repeating sequences, immediately remove the controller.

    • OE, L0, blank (mismatched controllers)

    • OE, L6, blank (unsupported HIC)

      Caution Possible loss of data access — If the controller you just installed shows one of these codes, and the other controller is reset for any reason, the second controller could also lock down.
  4. When the controller is back online, confirm that its status is Optimal, and check the controller shelf’s Attention LEDs.

    If the status is not Optimal or if any of the Attention LEDs are on, confirm that all cables are correctly seated, and check that the HIC and the controller canister are installed correctly. If necessary, remove and reinstall the controller canister and the HIC.

    Note If you cannot resolve the problem, contact technical support.
  5. Collect support data for your storage array using SANtricity System Manager.

    1. Select Support  Support Center  Diagnostics.

    2. Select Collect Support Data.

    3. Click Collect.

      The file is saved in the Downloads folder for your browser with the name, support-data.7z.

  6. Return the failed part to NetApp, as described in the RMA instructions shipped with the kit.

    Contact technical support at NetApp Support, 888-463-8277 (North America), 00-800-44-638277 (Europe), or +800-800-80-800 (Asia/Pacific) if you need the RMA number.

Simplex: Power up the controller shelf

For a simplex configuration, apply power to the controller shelf, collect support data, and resume operations.

Note Perform this task only if your storage array has one controller.
Steps
  1. Turn on the two power switches at the back of the controller shelf.

    • Do not turn off the power switches during the power-on process, which typically takes 90 seconds or less to complete.

    • The fans in each shelf are very loud when they first start up. The loud noise during start-up is normal.

  2. As the controller boots, check the controller LEDs and seven-segment display.

    • The seven-segment display shows the repeating sequence OS, Sd, blank to indicate that the controller is performing Start-of-day (SOD) processing. After a controller has successfully booted up, its seven-segment display should show the tray ID.

    • The amber Attention LED on the controller turns on and then turns off, unless there is an error.

    • The green Host Link LEDs turn on.

      Note The figure shows an example controller canister. Your controller might have a different number and a different type of host ports.
      28 dwg attn led 7s display maint e2800

      (1) Attention LED (amber)

      (2) Seven-segment display

      (3) Host Link LEDs

  3. Confirm that the controller’s status is Optimal, and check the controller shelf’s Attention LEDs.

    If the status is not Optimal or if any of the Attention LEDs are on, confirm that all cables are correctly seated, and check that the HIC and the controller canister are installed correctly. If necessary, remove and reinstall the controller canister and the HIC.

    Note If you cannot resolve the problem, contact technical support.
  4. Collect support data for your storage array using SANtricity System Manager.

    1. Select Support  Support Center  Diagnostics.

    2. Select Collect Support Data.

    3. Click Collect.

      The file is saved in the Downloads folder for your browser with the name, support-data.7z.

  5. Return the failed part to NetApp, as described in the RMA instructions shipped with the kit.

    Contact technical support at NetApp Support, 888-463-8277 (North America), 00-800-44-638277 (Europe), or +800-800-80-800 (Asia/Pacific) if you need the RMA number.

What’s next?

Your HIC replacement is complete. You can resume normal operations.