Hot-adding a stack of SAS disk shelves to an existing pair of FibreBridge 7500N bridges

Contributors netapp-ivanad netapp-martyh Download PDF of this page

You can hot-add a stack of SAS disk shelves to an existing pair of FibreBridge 7500N bridges that have available ports.

This procedure is written with the assumption that you are using the recommended bridge management interfaces: the ATTO ExpressNAV GUI and the ATTO QuickNAV utility.

You can use the ATTO ExpressNAV GUI to configure and manage a bridge, and to update the bridge firmware. You can use the ATTO QuickNAV utility to configure the bridge Ethernet management 1 port.

You can use other management interfaces, if required. These options include using a serial port or Telnet to configure and manage a bridge and to configure the Ethernet management 1 port, and using FTP to update the bridge firmware. If you choose any of these management interfaces, you must meet the applicable requirements in Other bridge management interfaces.

Important If you insert a SAS cable into the wrong port, when you remove the cable from a SAS port, you must wait at least 120 seconds before plugging the cable into a different SAS port. If you fail to do so, the system will not recognize that the cable has been moved to another port.
Steps
  1. Properly ground yourself.

  2. From the console of either controller, verify that your system has disk autoassignment enabled:

    storage disk option show

    The Auto Assign column indicates whether disk autoassignment is enabled.

    Node        BKg. FW. Upd.  Auto Copy   Auto Assign  Auto Assign Policy
    ----------  -------------  ----------  -----------  ------------------
    node_A_1             on           on           on           default
    node_A_2             on           on           on           default
    2 entries were displayed.
  3. Disable the switch ports for the new stack.

  4. Update the FibreBridge firmware on each bridge.

    If the new bridge is the same type as the partner bridge upgrade to the same firmware as the partner bridge. If the new bridge is a different type to the partner bridge, upgrade to the latest firmware supported by the bridge and version of ONTAP. See the section "Updating firmware on a FibreBridge bridge" in the MetroCluster Maintenance Guide.

  5. On each bridge in the pair, enable the SAS port that will connect to the new stack:

    SASPortEnable port-letter

    The same SAS port (B, C, or D) must be used on both bridges.

  6. Save the configuration and reboot each bridge:

    SaveConfiguration Restart

  7. Cable the disk shelves to the bridges:

    1. Daisy-chain the disk shelves in each stack.

      The Installation and Service Guide for your disk shelf model provides detailed information about daisy-chaining disk shelves.

    2. For each stack of disk shelves, cable IOM A of the first shelf to SAS port A on FibreBridge A, and then cable IOM B of the last shelf to SAS port A on FibreBridge B

      Each bridge has one path to its stack of disk shelves; bridge A connects to the A-side of the stack through the first shelf, and bridge B connects to the B-side of the stack through the last shelf.

      Note The bridge SAS port B is disabled.
  8. Verify that each bridge can detect all of the disk drives and disk shelves to which the bridge is connected.

    If you are using the…​ Then…​

    ATTO ExpressNAV GUI

    1. In a supported web browser, enter the IP address of a bridge in the browser box.

      You are brought to the ATTO FibreBridge home page, which has a link.

    2. Click the link, and then enter your user name and the password that you designated when you configured the bridge.

      The ATTO FibreBridge status page appears with a menu to the left.

    3. Click Advanced in the menu.

    4. View the connected devices:

      sastargets

    5. Click Submit.

    Serial port connection

    View the connected devices:

    sastargets

    The output shows the devices (disks and disk shelves) to which the bridge is connected. The output lines are sequentially numbered so that you can quickly count the devices.

    Note If the text response truncated appears at the beginning of the output, you can use Telnet to connect to the bridge, and then view all of the output by using the sastargets command.

    The following output shows that 10 disks are connected:

    Tgt VendorID ProductID        Type        SerialNumber
      0 NETAPP   X410_S15K6288A15 DISK        3QP1CLE300009940UHJV
      1 NETAPP   X410_S15K6288A15 DISK        3QP1ELF600009940V1BV
      2 NETAPP   X410_S15K6288A15 DISK        3QP1G3EW00009940U2M0
      3 NETAPP   X410_S15K6288A15 DISK        3QP1EWMP00009940U1X5
      4 NETAPP   X410_S15K6288A15 DISK        3QP1FZLE00009940G8YU
      5 NETAPP   X410_S15K6288A15 DISK        3QP1FZLF00009940TZKZ
      6 NETAPP   X410_S15K6288A15 DISK        3QP1CEB400009939MGXL
      7 NETAPP   X410_S15K6288A15 DISK        3QP1G7A900009939FNTT
      8 NETAPP   X410_S15K6288A15 DISK        3QP1FY0T00009940G8PA
      9 NETAPP   X410_S15K6288A15 DISK        3QP1FXW600009940VERQ
  9. Verify that the command output shows that the bridge is connected to all of the appropriate disks and disk shelves in the stack.

    If the output is…​ Then…​

    Correct

    Repeat the previous step for each remaining bridge.

    Not correct

    1. Check for loose SAS cables or correct the SAS cabling by repeating the step to cable the disk shelves to the bridges.

    2. Repeat the previous step for each remaining bridge.

  10. Cable each bridge to the local FC switches, using the cabling shown in the table for your configuration, switch model, and FC-to-SAS bridge model:

    Note

    The Brocade and Cisco switches use different port numbering, as shown in the following tables

    • On Brocade switches, the first port is numbered “0”.

    • On Cisco switches, the first port is numbered “1”.

    Configurations using FibreBridge 7500N or 7600N using both FC ports (FC1 and FC2)

    DR GROUP 1

    Brocade 6505

    Brocade 6510, Brocade DCX 8510-8

    Brocade 6520

    Brocade G620, Brocade G620-1, Brocade G630, Brocade G630-1

    Brocade G720

    Component

    Port

    Switch 1

    Switch 2

    Switch 1

    Switch 2

    Switch 1

    Switch 2

    Switch 1

    Switch 2

    Switch 1

    Switch 2

    Stack 1

    bridge_x_1a

    FC1

    8

    8

    8

    8

    10

    FC2

    -

    8

    -

    8

    -

    8

    -

    8

    -

    10

    bridge_x_1B

    FC1

    9

    -

    9

    -

    9

    -

    9

    -

    11

    -

    FC2

    -

    9

    -

    9

    -

    9

    -

    9

    -

    11

    Stack 2

    bridge_x_2a

    FC1

    10

    -

    10

    -

    10

    -

    10

    -

    14

    -

    FC2

    -

    10

    -

    10

    -

    10

    -

    10

    -

    14

    bridge_x_2B

    FC1

    11

    -

    11

    -

    11

    -

    11

    -

    17

    -

    FC2

    -

    11

    -

    11

    -

    11

    -

    11

    -

    17

    Stack 3

    bridge_x_3a

    FC1

    12

    -

    12

    -

    12

    -

    12

    -

    18

    -

    FC2

    -

    12

    -

    12

    -

    12

    -

    12

    -

    18

    bridge_x_3B

    FC1

    13

    -

    13

    -

    13

    -

    13

    -

    19

    -

    FC2

    -

    13

    -

    13

    -

    13

    -

    13

    -

    19

    Stack y

    bridge_x_ya

    FC1

    14

    -

    14

    -

    14

    -

    14

    -

    20

    -

    FC2

    -

    14

    -

    14

    -

    14

    -

    14

    -

    20

    bridge_x_yb

    FC1

    15

    -

    15

    -

    15

    -

    15

    -

    21

    -

    FC2

    15

    15

    15

    -

    15

    -

    21

    Note Additional bridges can be cabled to ports 16, 17, 20 and 21 in G620, G630, G620-1, and G630-1 switches.
    Configurations using FibreBridge 7500N or 7600N using both FC ports (FC1 and FC2)

    DR GROUP 2

    Brocade G620, Brocade G620-1, Brocade G630, Brocade G630-1

    Brocade 6510, Brocade DCX 8510-8

    Brocade 6520

    Brocade G720

    Component

    Port

    Switch 1

    Switch 2

    Switch 1

    Switch 2

    Switch 1

    Switch 2

    Switch 1

    switch 2

    Stack 1

    bridge_x_51a

    FC1

    26

    -

    32

    -

    56

    -

    32

    -

    FC2

    -

    26

    -

    32

    -

    56

    -

    32

    bridge_x_51b

    FC1

    27

    -

    33

    -

    57

    -

    33

    -

    FC2

    -

    27

    -

    33

    -

    57

    -

    33

    Stack 2

    bridge_x_52a

    FC1

    30

    -

    34

    -

    58

    -

    34

    -

    FC2

    -

    30

    -

    34

    -

    58

    -

    34

    bridge_x_52b

    FC1

    31

    -

    35

    -

    59

    -

    35

    -

    FC2

    -

    31

    -

    35

    -

    59

    -

    35

    Stack 3

    bridge_x_53a

    FC1

    32

    -

    36

    -

    60

    -

    36

    -

    FC2

    -

    32

    -

    36

    -

    60

    -

    36

    bridge_x_53b

    FC1

    33

    -

    37

    -

    61

    -

    37

    -

    FC2

    -

    33

    -

    37

    -

    61

    -

    37

    Stack y

    bridge_x_5ya

    FC1

    34

    -

    38

    -

    62

    -

    38

    -

    FC2

    -

    34

    -

    38

    -

    62

    -

    38

    bridge_x_5yb

    FC1

    35

    -

    39

    -

    63

    -

    39

    -

    FC2

    -

    35

    -

    39

    -

    63

    -

    39

    Note Additional bridges can be cabled to ports 36 - 39 in G620, G630, G620-1, and G-630-1 switches.
    Configurations using FibreBridge 6500N bridges or FibreBridge 7500N or 7600N using one FC port (FC1 or FC2) only

    DR GROUP 1

    Brocade 6505

    Brocade 6510, Brocade DCX 8510-8

    Brocade 6520

    Brocade G620, brocade G620-1, Brocade G630, Brocade G630-1

    Brocade G720

    Component

    Port

    Switch 1

    Switch 2

    Switch 1

    Switch 2

    Switch 1

    Switch 2

    Switch 1

    Switch 2

    Switch 1

    Switch 2

    Stack 1

    bridge_x_1a

    8

    8

    8

    8

    10

    bridge_x_1b

    -

    8

    -

    8

    -

    8

    -

    8

    -

    10

    Stack 2

    bridge_x_2a

    9

    -

    9

    -

    9

    -

    9

    -

    11

    -

    bridge_x_2b

    -

    9

    -

    9

    -

    9

    -

    9

    -

    11

    Stack 3

    bridge_x_3a

    10

    -

    10

    -

    10

    -

    10

    -

    14

    -

    bridge_x_4b

    -

    10

    -

    10

    -

    10

    -

    10

    -

    14

    Stack y

    bridge_x_ya

    11

    -

    11

    -

    11

    -

    11

    -

    15

    -

    bridge_x_yb

    -

    11

    -

    11

    -

    11

    -

    11

    -

    15

    Note Additional bridges can be cabled to ports 12 - 17, 20 and 21 in G620, G630, G620-1, and G630-1 switches. Additional bridges can be cabled to ports 16 - 17, 20 and 21 G720 switches.
    Configurations using FibreBridge 6500N bridges or FibreBridge 7500N or 7600N using one FC port (FC1 or FC2) only

    DR GROUP 2

    Brocade G720

    Brocade G620, Brocade G620-1, Brocade G630, Brocade G630-1

    Brocade 6510, Brocade DCX 8510-8

    Brocade 6520

    Stack 1

    bridge_x_51a

    32

    -

    26

    -

    32

    -

    56

    -

    bridge_x_51b

    -

    32

    -

    26

    -

    32

    -

    56

    Stack 2

    bridge_x_52a

    33

    -

    27

    -

    33

    -

    57

    -

    bridge_x_52b

    -

    33

    -

    27

    -

    33

    -

    57

    Stack 3

    bridge_x_53a

    34

    -

    30

    -

    34

    -

    58

    -

    bridge_x_54b

    -

    34

    -

    30

    -

    34

    -

    58

    Stack y

    bridge_x_ya

    35

    -

    31

    -

    35

    -

    59

    -

    bridge_x_yb

    -

    35

    -

    31

    -

    35

    -

    59

    Note Additional bridges can be cabled to ports 32 - 39 in G620, G630, G620-1, and G630-1 switches. Additional bridges can be cabled to ports 36 - 39 in G720 switches.
  11. Update the disk drive firmware to the most current version from the system console:

    disk_fw_update

    You must run this command on both controllers.

  12. Update the disk shelf firmware to the most current version by using the instructions for the downloaded firmware.

    You can run the commands in the procedure from the system console of either controller.

  13. If your system does not have disk autoassignment enabled, assign disk drive ownership.

    Note If you are splitting the ownership of a single stack of disk shelves among multiple controllers, you must disable disk autoassignment (storage disk option modify -autoassign off * from both nodes in the cluster) before assigning disk ownership; otherwise, when you assign any single disk drive, the remaining disk drives might be automatically assigned to the same controller and pool.
    Note You must not add disk drives to aggregates or volumes until after the disk drive firmware and disk shelf firmware have been updated and the verification steps in this task have been completed.
  14. Enable the switch ports for the new stack.

  15. Verify the operation of the MetroCluster configuration in ONTAP:

    1. Check whether the system is multipathed:

      node run -node node-name sysconfig -a

    2. Check for any health alerts on both clusters:

      system health alert show

    3. Confirm the MetroCluster configuration and that the operational mode is normal:

      metrocluster show

    4. Perform a MetroCluster check:

      metrocluster check run

    5. Display the results of the MetroCluster check:

      metrocluster check show

    6. Check for any health alerts on the switches (if present):

      storage switch show

    7. Run Config Advisor.

    8. After running Config Advisor, review the tool’s output and follow the recommendations in the output to address any issues discovered.

  16. If applicable, repeat this procedure for the partner site.