Cabling disk shelves with IOM12 modules for a hot-add

You cable the SAS connections—shelf-to-shelf and controller-to-stack—as applicable for hot-added disk shelves so they have connectivity to the system.

Before you begin

You must have met the requirements in the "Requirements for a hot-adding disk shelves with IOM12 modules" section and installed, powered on, and set shelf IDs for each disk shelf as instructed in the "Installing disk shelves with IOM12 modules for a hot-add" section.

About this task

Steps

  1. If you want to manually assign disk ownership for the disk shelves you are hot-adding, you need to disable disk ownership automatic assignment if it is enabled; otherwise, go to the next step.
    You need to manually assign disk ownership if disks in the stack are owned by both controllers in an HA pair.

    You disable disk ownership automatic assignment before cabling the hot-added disk shelves and then later, in step 7, you reenable it after cabling the hot-added disk shelves.

    1. Verify if disk ownership automatic assignment is enabled:storage disk option show
      If you have an HA pair, you can enter the command at the console of either controller.
      If disk ownership automatic assignment is enabled, the output shows "on" (for each controller) in the "Auto Assign" column.
    2. If disk ownership automatic assignment is enabled, you need to disable it:storage disk option modify -node node_name -autoassign off
      You need to disable disk ownership automatic assignment on both controllers in an HA pair.
  2. If you are hot-adding a stack of disk shelves directly to a controller, complete the following substeps; otherwise, go to step 3.
    1. If the stack you are hot-adding has more than one disk shelf, cable the shelf-to-shelf connections; otherwise, go to substep b.
      If... Then...
      You are cabling a stack with multipath HA, multipath, single-path HA, or single-path connectivity to the controllers Cable the shelf-to-shelf connections as "standard" connectivity (using IOM ports 3 and 1):
      1. Beginning with the logical first shelf in the stack, connect IOM A port 3 to the next shelf's IOM A port 1 until each IOM A in the stack is connected.
      2. Repeat substep i for IOM B.
      You are cabling a stack with quad-path HA or quad-path connectivity to the controllers Cable the shelf-to-shelf connections as "double-wide" connectivity:

      You cable the standard connectivity using IOM ports 3 and 1 and then the double-wide connectivity using IOM ports 4 and 2.

      1. Beginning with the logical first shelf in the stack, connect IOM A port 3 to the next shelf's IOM A port 1 until each IOM A in the stack is connected.
      2. Beginning with the logical first shelf in the stack, connect IOM A port 4 to the next shelf's IOM A port 2 until each IOM A in the stack is connected.
      3. Repeat substeps i and ii for IOM B.
    2. Check the controller-to-stack cabling worksheets and cabling examples sections to see whether a completed worksheet exists for your configuration.
    3. If there is a completed worksheet for your configuration, cable the controller-to-stack connections using the completed worksheet; otherwise, go to the next substep.
    4. If there is no completed worksheet for your configuration, fill out a worksheet template, and then cable the controller-to-stack connections using the completed worksheet.
      Worksheet templates can be found towards the back of this guide.
    5. Verify that all cables are securely fastened.
  3. If you are hot-adding one or more disk shelves to an end—the logical first or last disk shelf—of an existing stack, complete the applicable substeps for your configuration; otherwise, go to the next step.
    If you are... Then...
    Hot-adding a disk shelf to an end of a stack that has multipath HA, multipath, quad-path HA, or quad-path connectivity to the controllers
    1. Disconnect any cables from IOM A of the disk shelf at the end of the stack that are connected to any controllers; otherwise, go to substep e.

      Leave the other end of these cables connected to the controllers, or replace cables with longer cables if needed.

    2. Cable the shelf-to-shelf connection(s) between IOM A of the disk shelf at the end of the stack and IOM A of the disk shelf you are hot-adding.
    3. Reconnect any cables that you removed in substep a to the same port(s) on IOM A of the disk shelf you are hot-adding; otherwise, go to the next substep.
    4. Verify that all cables are securely fastened.
    5. Repeat substeps a through d for IOM B; otherwise, go to Step 4.
    Hot-adding a disk shelf to an end of the stack in a FAS2600 series single-path HA or single-path configuration

    These instructions are for hot-adding to the end of the stack that does not have controller-to-stack connections.

    1. Cable the shelf-to-shelf connection between IOM A of the disk shelf in the stack and IOM A of the disk shelf you are hot-adding.
    2. Verify that the cable is securely fastened.
    3. Repeat applicable substeps for IOM B.
  4. If you hot-added a disk shelf with mini-SAS HD SAS optical cables to a stack of disk shelves connected with SAS copper cables, replace the SAS copper cables; otherwise, go to the next step.
    The stack must meet the requirements stated in the "Requirements for hot-adding disk shelves with IOM12 modules" section of this procedure.
  5. Download and run Config Advisor to verify that your SAS connections are cabled correctly.
    If any SAS cabling errors are generated, follow the corrective actions provided.
  6. Verify SAS connectivity for each hot-added disk shelf: storage shelf show -shelf shelf_name -connectivity
    You must run this command for each disk shelf you hot-added.

    For example, the following output shows hot-added disk shelf 2.5 is connected to initiator ports 1a and 0d (port pair 1a/0d) on each controller (in a FAS8080 multipath HA configuration with one quad-port SAS HBA):

    cluster1::> storage shelf show -shelf 2.5 -connectivity 
                                                                          
               Shelf Name: 2.5
                 Stack ID: 2
                 Shelf ID: 5
                Shelf UID: 40:0a:09:70:02:2a:2b
            Serial Number: 101033373
              Module Type: IOM12
                    Model: DS224C
             Shelf Vendor: NETAPP
               Disk Count: 24
          Connection Type: SAS
              Shelf State: Online
                   Status: Normal
    
    Paths:
    
    Controller     Initiator   Initiator Side Switch    Port Target Side Switch Port   Target Port   TPGN
    ------------   ---------   ----------------------   ----------------------------   -----------   ------
    stor-8080-1    1a           -                        -                              -             -
    stor-8080-1    0d           -                        -                              -             -
    stor-8080-2    1a           -                        -                              -             -
    stor-8080-2    0d           -                        -                              -             -
    
    Errors:
    ------
    -
  7. If you disabled disk ownership automatic assignment in Step 1, manually assign disk ownership, and then reenable disk ownership automatic assignment if needed:
    1. Display all unowned disks:storage disk show -container-type unassigned
    2. Assign each disk:storage disk assign -disk disk_name -owner owner_name
      You can use the wildcard character to assign more than one disk at once.
    3. Reenable disk ownership automatic assignment if needed:storage disk option modify -node node_name -autoassign on
      You need to reenable disk ownership automatic assignment on both controllers in an HA pair.
  8. If your configuration is running in-band ACP, verify that in-band ACP was automatically enabled on hot-added disk shelves: storage shelf acp show
    In the output, "in-band" is listed as "active" for each node.