Skip to main content
Install and maintain

Replace a PCIe card - AFF A800

Contributors dougthomp Copilot
PDFs

Replace or add an I/O module in your AFF A800 system when the module fails, requires an upgrade to support higher performance, or additional features. The replacement process involves shutting down the controller, replacing the failed I/O module, rebooting the controller, and returning the failed part to NetApp.

Before you begin

  • You must have the NetApp new or replacement part available.

  • Make sure all other components in the storage system are functioning properly; if not, contact technical support.

  • You can use this procedure with all versions of ONTAP supported by your system.

  • All other components in the system must be functioning properly; if not, you must contact technical support.

Step 1: Shut down the impaired controller

Shut down or take over the impaired controller.

To shut down the impaired controller, you must determine the status of the controller and, if necessary, take over the controller so that the healthy controller continues to serve data from the impaired controller storage.

About this task

  • If you have a SAN system, you must have checked event messages (cluster kernel-service show) for the impaired controller SCSI blade. The cluster kernel-service show command (from priv advanced mode) displays the node name, quorum status of that node, availability status of that node, and operational status of that node.

    Each SCSI-blade process should be in quorum with the other nodes in the cluster. Any issues must be resolved before you proceed with the replacement.

  • If you have a cluster with more than two nodes, it must be in quorum. If the cluster is not in quorum or a healthy controller shows false for eligibility and health, you must correct the issue before shutting down the impaired controller; see Synchronize a node with the cluster.

Steps

  1. If AutoSupport is enabled, suppress automatic case creation by invoking an AutoSupport message:

    system node autosupport invoke -node * -type all -message MAINT=<# of hours>h

    The following AutoSupport message suppresses automatic case creation for two hours:

    cluster1:> system node autosupport invoke -node * -type all -message MAINT=2h

  2. Disable automatic giveback:

    1. Enter the following command from the console of the healthy controller:

      storage failover modify -node impaired_node_name -auto-giveback false

    2. Enter y when you see the prompt Do you want to disable auto-giveback?

  3. Take the impaired controller to the LOADER prompt:

    If the impaired controller is displaying…​ Then…​

    The LOADER prompt

    Go to the next step.

    Waiting for giveback…​

    Press Ctrl-C, and then respond y when prompted.

    System prompt or password prompt

    Take over or halt the impaired controller from the healthy controller:

    storage failover takeover -ofnode impaired_node_name -halt true

    The -halt true parameter brings you to the LOADER prompt.

Step 2: Remove the controller module

You must remove the controller module from the chassis when you replace the controller module or replace a component inside the controller module.

Steps

  1. If you are not already grounded, properly ground yourself.

  2. Ensure that all drives in the chassis are firmly seated against the midplane by using your thumbs to push each drive until you feel a positive stop.

    Video - Confirm drive seating
    Seat the drives

  3. Check the controller drives based on the system status:

    1. On the healthy controller, check if any active RAID group is in a degraded state, failed state, or both:

      storage aggregate show -raidstatus !*normal*

      • If the command returns There are no entries matching your query. continue to go to the next sub-step to check for missing drives.

      • If the command returns any other results, collect the AutoSupport data from both controllers and contact NetApp Support for further assistance.

        system node autosupport invoke -node * -type all -message '<message_name>'

    2. Check for missing drive issues for both the file system or spare drives:

      event log show -severity * -node * -message-name *disk.missing*

      • If the command returns There are no entries matching your query. continue to go to the next step.

      • If the command returns any other results, collect the AutoSupport data from both controllers and contact NetApp Support for further assistance.

        system node autosupport invoke -node * -type all -message '<message_name>'

  4. Remove the power cable retainers, then unplug the cables from the power supplies.

  5. Loosen the hook and loop strap on the cable management device. Unplug the system cables and SFP/QSFP modules (if needed) from the controller module. Note each cable's location.

    Leave the cables in the cable management device so that when you reinstall the cable management device, the cables are organized.

  6. Remove the cable management device from the controller module and set it aside.

  7. Press down on both of the locking latches, and then rotate both latches downward at the same time.

    The controller module moves slightly out of the chassis.

    Removing the controller module

    Callout number 1

    Locking latch

    Callout number 2

    Locking pin

  8. Slide the controller module out of the chassis and place it on a stable, flat surface.

    Support the bottom of the controller module while sliding it out of the chassis.

Step 3: Replace the PCIe card

Replace a PCIe card by removing the cabling and any QSFPs and SFPs from the ports on the PCIe cards in the target riser, removing the riser from the controller module, removing and replacing the PCIe card, reinstalling the riser and any QSFPs and SFPs onto the ports, and recable the ports.

Steps

  1. Determine if the card you are replacing is from Riser 1 or if it is from Riser 2 or 3.

    • If you are replacing the 100GbE PCIe card in Riser 1, use Steps 2 - 3 and Steps 6 - 7.

    • If you are replacing a PCIe card from Riser 2 or 3, use Steps 4 through 7.

  2. Remove Riser 1 from the controller module:

    1. Remove the QSFP modules that might be in the PCIe card.

    2. Rotate the riser locking latch on the left side of the riser up and toward the fan modules.

      The riser raises up slightly from the controller module.

    3. Lift the riser up, shift it toward the fans so that the sheet metal lip on the riser clears the edge of the controller module, lift the riser out of the controller module, and then place it on a stable, flat surface.

      Replace PCI card in riser 1

      Callout number 1

      Air duct

      Callout number 2

      Riser locking latch

      Callout number 3

      Card locking bracket

      Callout number 4

      Riser 1 (left riser) with 100GbE PCIe card in slot 1.

  3. Remove the PCIe card from Riser 1:

    1. Turn the riser so that you can access the PCIe card.

    2. Press the locking bracket on the side of the PCIe riser, and then rotate it to the open position.

    3. Remove the PCIe card from the riser.

  4. Remove the PCIe riser from the controller module:

    1. Remove any SFP or QSFP modules that might be in the PCIe cards.

    2. Rotate the riser locking latch on the left side of the riser up and toward the fan modules.

      The riser raises up slightly from the controller module.

    3. Lift the riser up, shift it toward the fans so that the sheet metal lip on the riser clears the edge of the controller module, lift the riser out of the controller module, and then place it on a stable, flat surface.

      Replace PCI cards 2 through 5 in middle and right risers

      Callout number 1

      Air duct

      Callout number 2

      Riser 2 (middle riser) or 3 (right riser) locking latch

      Callout number 3

      Card locking bracket

      Callout number 4

      Side panel on riser 2 or 3

      Callout number 5

      PCIe cards in riser 2 or 3

  5. Remove the PCIe card from the riser:

    1. Turn the riser so that you can access the PCIe cards.

    2. Press the locking bracket on the side of the PCIe riser, and then rotate it to the open position.

    3. Swing the side panel off the riser.

    4. Remove the PCIe card from the riser.

  6. Install the PCIe card into the same slot in the riser:

    1. Align the card with the card socket in the riser, and then slide it squarely into the socket in the riser.

      Note Make sure that the card is completely and squarely seated into the riser socket.

    2. For Riser 2 or 3, close the side panel.

    3. Swing the locking latch into place until it clicks into the locked position.

  7. Install the riser into the controller module:

    1. Align the lip of the riser with the underside of the controller module sheet metal.

    2. Guide the riser along the pins in the controller module, and then lower the riser into the controller module.

    3. Swing the locking latch down and click it into the locked position.

      When locked, the locking latch is flush with the top of the riser and the riser sits squarely in the controller module.

    4. Reinsert any SFP modules that were removed from the PCIe cards.

Step 4: Reinstall the controller module

Reinstall the controller module and reboot it.

Steps

  1. Align the end of the controller module with the opening in the chassis, and then gently push the controller module halfway into the system.

    Note Do not completely insert the controller module in the chassis until instructed to do so.

  2. Recable the system, as needed.

    If you removed the media converters (QSFPs or SFPs), remember to reinstall them if you are using fiber optic cables.

  3. Complete the reinstallation of the controller module:

    1. Firmly push the controller module into the chassis until it meets the midplane and is fully seated.

      The locking latches rise when the controller module is fully seated.

      Note Do not use excessive force when sliding the controller module into the chassis to avoid damaging the connectors.

    2. Rotate the locking latches upward, tilting them so that they clear the locking pins, and then lower them into the locked position.

    3. Plug the power cords into the power supplies, reinstall the power cable locking collar, and then connect the power supplies to the power source.

      The controller module begins to boot as soon as power is restored. Be prepared to interrupt the boot process.

    4. If you have not already done so, reinstall the cable management device.

  4. Return the impaired controller to normal operation by giving back its storage:

    storage failover giveback -ofnode impaired_node_name.

  5. If automatic giveback was disabled, reenable it:

    storage failover modify -node local -auto-giveback true.

  6. If AutoSupport is enabled, restore/unsuppress automatic case creation:

    system node autosupport invoke -node * -type all -message MAINT=END.

Step 5: Return the failed part to NetApp

Return the failed part to NetApp, as described in the RMA instructions shipped with the kit. See the Part Return and Replacements page for further information.