Skip to main content
E-Series Systems

Replace HIC in E4000

Contributors netapp-ivanad
PDFs

Follow this procedure to replace a failed host interface card (HIC) in an E4000 array.

About this task

When you replace a failed HIC, you must power off the storage array (simplex) or place affected controller offline (duplex), replace the HIC, and reapply power (simplex) or bring controller online (duplex).

Before you begin

  • If you have a simplex configuration, schedule a downtime maintenance window for this procedure. You cannot access data on the storage array until you have successfully completed this procedure.

  • Make sure you have the following:

    • HICs that are compatible with your controller(s).

    • An ESD wristband, or you have taken other antistatic precautions.

    • A flat, static free work area.

    • Labels to identify each cable that is connected to the controller canister.

    • A #1 Phillips screwdriver.

    • A management station with a browser that can access SANtricity System Manager for the controller. (To open the System Manager interface, point the browser to the controller's domain name or IP address.)

      Caution Possible loss of data access — Never install a HIC in an E4000 controller canister if that HIC was designed for another E-Series controller. In addition, both controllers and both HICs must be identical in a duplex configuration. The presence of incompatible or mismatched HICs causes the controllers to lock down when you apply power.

Step 1: Prepare to replace HIC

Power down the controller shelf (simplex) or place the affected controller offline (duplex) so you can safely replace the HICs.

Power down the controller shelf (simplex)
Steps

  1. If possible, make a note of which version of SANtricity OS software is currently installed on the controller. Open SANtricity System Manager and select Support › Upgrade Center › View Software and Firmware Inventory.

  2. If the Drive Security feature is enabled, be sure a saved key exists and that you know the pass phrase required to install it.

    Caution Possible loss of data access — If all drives in the storage array are security enabled, the new controller will not be able to access the storage array until you unlock the secured drives using the Enterprise Management Window in SANtricity Storage Manager.

    To save the key (might not be possible, depending on the state of the controller):

    1. From SANtricity System Manager, select Settings › System.

    2. Under Security key management, select Back Up Key.

    3. In the Define a pass phrase/Re-enter pass phrase fields, enter and confirm a pass phrase for this backup copy.

    4. Click Backup.

    5. Record your key information in a secure location, and then click Close.

  3. Back up the storage array's configuration database using SANtricity System Manager.

    If a problem occurs when you remove a controller, you can use the saved file to restore your configuration. The system will save the current state of the RAID configuration database, which includes all data for volume groups and disk pools on the controller.

    • From System Manager:

      1. Select Support › Support Center › Diagnostics.

      2. Select Collect Configuration Data.

      3. Click Collect.

        The file is saved in the Downloads folder for your browser with the name, configurationData-<arrayName>-<dateTime>.7z.

    • Alternatively, you can back up the configuration database by using the following CLI command:

      save storageArray dbmDatabase sourceLocation=onboard contentType=all file="filename";

  4. Collect support data for your storage array using SANtricity System Manager.

    If a problem occurs when you remove a controller, you can use the saved file to troubleshoot the issue. The system will save inventory, status, and performance data about your storage array in a single file.

    1. Select Support › Support Center › Diagnostics.

    2. Select Collect Support Data.

    3. Click Collect.

      The file is saved in the Downloads folder for your browser with the name, support-data.7z.

  5. Ensure that no I/O operations are occurring between the storage array and all connected hosts. For example, you can perform these steps:

    • Stop all processes that involve the LUNs mapped from the storage to the hosts.

    • Ensure that no applications are writing data to any LUNs mapped from the storage to the hosts.

    • Unmount all file systems associated with volumes on the array.

      Note The exact steps to stop host I/O operations depend on the host operating system and the configuration, which are beyond the scope of these instructions. If you are not sure how to stop host I/O operations in your environment, consider shutting down the host.
      Caution Possible data loss — If you continue this procedure while I/O operations are occurring, you might lose data.

  6. Wait for any data in cache memory to be written to the drives.

    The green Cache Active LED on the back of the controller is on when cached data needs to be written to the drives. You must wait for this LED to turn off.

  7. From the home page of SANtricity System Manager, select View Operations in Progress.

  8. Confirm that all operations have completed before continuing with the next step.

  9. Turn off both power switches on the controller shelf.

  10. Wait for all LEDs on the controller shelf to turn off.

  11. Select Recheck from the Recovery Guru, and confirm that the OK to remove field in the Details area displays Yes, indicating that it is safe to remove this component. Data on the storage array will not be accessible until you replace the controller canister.

Place controller offline (duplex)
Steps

  1. Unpack the new controller canister, and set it on a flat, static-free surface.

    Save the packing materials to use when shipping the failed controller canister.

  2. Locate the MAC address and FRU part number labels on the back of the controller canister.

  3. From SANtricity System Manager, locate the replacement part number for the controller canister you are replacing.

    When a controller has a fault and needs to be replaced, the replacement part number is displayed in the Details area of the Recovery Guru. If you need to find this number manually, follow these steps:

    1. Select Hardware.

    2. Locate the controller shelf, which is marked with the controller icon.

    3. Click the controller icon.

    4. Select the controller, and click Next.

    5. On the Base tab, make a note of the Replacement Part Number for the controller.

  4. Confirm that the replacement part number for the failed controller is the same as the FRU part number for the replacement controller.

    Caution Possible loss of data access — If the two part numbers are not the same, do not attempt this procedure. The presence of mismatched controllers will cause the new controller to lock down when you bring it online.

  5. Back up the storage array's configuration database using SANtricity System Manager.

    If a problem occurs when you remove a controller, you can use the saved file to restore your configuration. The system will save the current state of the RAID configuration database, which includes all data for volume groups and disk pools on the controller.

    • From System Manager:

      1. Select Support › Support Center › Diagnostics.

      2. Select Collect Configuration Data.

      3. Click Collect.

        The file is saved in the Downloads folder for your browser with the name, configurationData-<arrayName>-<dateTime>.7z.

    • Alternatively, you can back up the configuration database by using the following CLI command:

      save storageArray dbmDatabase sourceLocation=onboard contentType=all file="filename";

  6. If the controller is not already offline, take it offline now using SANtricity System Manager.

    • From SANtricity System Manager:

      1. Select Hardware.

      2. If the graphic shows the drives, select Show back of shelf to show the controllers.

      3. Select the controller that you want to place offline.

      4. From the context menu, select Place offline, and confirm that you want to perform the operation.

        Note If you are accessing SANtricity System Manager using the controller you are attempting to take offline, a SANtricity System Manager Unavailable message is displayed. Select Connect to an alternate network connection to automatically access SANtricity System Manager using the other controller.

    • Alternatively, you can take the controllers offline by using the following CLI commands:

      For controller A: set controller [a] availability=offline

      For controller B: set controller [b] availability=offline

  7. Wait for SANtricity System Manager to update the controller's status to offline.

    Caution Do not begin any other operations until after the status has been updated.

  8. Select Recheck from the Recovery Guru, and confirm that the OK to remove field in the Details area displays Yes, indicating that it is safe to remove this component.

Step 2: Remove controller canister

Remove the controller canister from the system and then remove the controller canister cover.

Steps

  1. If you are not already grounded, properly ground yourself.

  2. Loosen the hook and loop strap binding the cables to the cable management device, and then unplug the system cables and SFPs (if needed) from the controller canister, keeping track of where the cables were connected.

    Leave the cables in the cable management device so that when you reinstall the cable management device, the cables are organized.

  3. Remove and set aside the cable management devices from the left and right sides of the controller canister.

  4. Squeeze the latch on the cam handle until it releases, open the cam handle fully to release the controller canister from the midplane, and then, using two hands, pull the controller canister out of the chassis.

  5. Turn the controller canister over and place it on a flat, stable surface.

  6. Open the cover by pressing the blue buttons on the sides of the controller canister to release the cover, and then rotate the cover up and off of the controller canister.

    Open controller canister cover.

Step 3: Replace the HIC

Replace the HIC.

Steps

  1. If you are not already grounded, properly ground yourself.

  2. Remove the HIC:

    Remove HIC and faceplate.

    1. Remove the HIC faceplate by sliding it straight out from the controller module.

    2. Loosen the thumbscrews on the HIC and lift it straight up.

  3. Reinstall the HIC:

    1. Align the socket on the replacement HIC plug with the socket on the motherboard, and then gently seat the card squarely into the socket.

    2. Tighten the three thumbscrews on the HIC.

    3. Reinstall the HIC faceplate.

  4. Reinstall the controller module cover and lock it into place.

Step 4: Reinstall controller canister

Reinstall the controller canister into the chassis.

Steps

  1. If you are not already grounded, properly ground yourself.

  2. If you have not already done so, replace the cover on the controller canister.

  3. Turn the controller canister over and align the end with the opening in the chassis.

  4. Gently push the controller canister halfway into the system. Align the end of the controller canister with the opening in the chassis, and then gently push the controller canister halfway into the system.

    Note Do not completely insert the controller canister in the chassis until instructed to do so.

  5. Recable the system, as needed.

    If you removed the media converters (QSFPs or SFPs), remember to reinstall them if you are using fiber optic cables.

  6. Complete the reinstallation of the controller canister:

    1. With the cam handle in the open position, firmly push the controller canister in until it meets the midplane and is fully seated, and then close the cam handle to the locked position.

      Note Do not use excessive force when sliding the controller canister into the chassis to avoid damaging the connectors.

      If you have a duplex configuration, the controller will begin to boot as soon as it is seated in the chassis.

    2. If you have not already done so, reinstall the cable management device.

    3. Bind the cables to the cable management device with the hook and loop strap.

Step 5: Complete HIC replacement

Power up the controller (simplex) or place the controller online (duplex), collect support data, and resume operations.

Power up controller (simplex)
Steps

  1. Turn on the two power switches at the back of the controller shelf.

    • Do not turn off the power switches during the power-on process, which typically takes 90 seconds or less to complete.

    • The fans in each shelf are very loud when they first start up. The loud noise during start-up is normal.

  2. When the controller is back online, check the controller shelf's Attention LEDs.

    If the status is not Optimal or if any of the Attention LEDs are on, confirm that all cables are correctly seated, and check that the battery and the controller canister are installed correctly. If necessary, remove and reinstall the controller canister and the battery.

    Note If you cannot resolve the problem, contact technical support. If needed, collect support data for your storage array using SANtricity System Manager.

  3. Collect support data for your storage array using SANtricity System Manager.

    1. Select Support › Support Center › Diagnostics.

    2. Select Collect Support Data.

    3. Click Collect.

      The file is saved in the Downloads folder for your browser with the name, support-data.7z.

Place controller online (duplex)
Steps

  1. Bring the controller online using SANtricity System Manager.

    • From SANtricity System Manager:

      1. Select Hardware.

      2. If the graphic shows the drives, select Show back of shelf.

      3. Select the controller you want to place online.

      4. Select Place Online from the context menu, and confirm that you want to perform the operation.

        The system places the controller online.

    • Alternatively, you can bring the controller back online by using the following CLI commands:

      For controller A: set controller [a] availability=online;

      For controller B: set controller [b] availability=online;

  2. When the controller is back online, check the controller shelf's Attention LEDs.

    If the status is not Optimal or if any of the Attention LEDs are on, confirm that all cables are correctly seated, and check that the battery and the controller canister are installed correctly. If necessary, remove and reinstall the controller canister and the battery.

    Note If you cannot resolve the problem, contact technical support. If needed, collect support data for your storage array using SANtricity System Manager.

  3. Verify that all volumes have been returned to the preferred owner.

    1. Select Storage › Volumes. From the All Volumes page, verify that volumes are distributed to their preferred owners. Select More › Change ownership to view volume owners.

    2. If volumes are all owned by preferred owner continue to step 5.

    3. If none of the volumes are returned, you must manually return the volumes. Go to More › Redistribute volumes.

    4. If only some of the volumes are returned to their preferred owners after auto-distribution or manual distribution, you must check the Recovery Guru for host connectivity issues.

    5. If there is no Recovery Guru present or if after following the recovery guru steps the volumes are still not returned to their preferred owners, contact support.

  4. Collect support data for your storage array using SANtricity System Manager.

    1. Select Support › Support Center › Diagnostics.

    2. Select Collect Support Data.

    3. Click Collect.

      The file is saved in the Downloads folder for your browser with the name, support-data.7z.

What's next?

Your host interface card replacement is complete. You can resume normal operations.