Skip to main content
NetApp Cloud Tiering

Tier data from on-premises ONTAP clusters to Azure Blob storage in NetApp Cloud Tiering

Contributors amgrissino
PDFs

Free space on your on-premises ONTAP clusters by tiering inactive data to Azure Blob storage.
Free space on your on-premises ONTAP clusters by tiering inactive data to Azure Blob storage.

Quick start

Get started quickly by following these steps, or scroll down to the remaining sections for full details.

One Prepare to tier data to Azure Blob storage

You need the following:

  • A source on-premises ONTAP cluster that's running ONTAP 9.4 or later that you have added to the NetApp Console, and an HTTPS connection to Azure Blob storage. Learn how to discover a cluster.

  • A Console agent installed in an Azure VNet or on your premises.

  • Networking for an agent that enables an outbound HTTPS connection to the ONTAP cluster in your data center, to Azure storage, and to the Cloud Tiering service.

Two Set up tiering

In the NetApp Console, select an on-premises ONTAP system, select Enable for the Tiering service, and follow the prompts to tier data to Azure Blob storage.

Three Set up licensing

After your free trial ends, pay for Cloud Tiering through a pay-as-you-go subscription, an ONTAP Cloud Tiering BYOL license, or a combination of both:

Requirements

Verify support for your ONTAP cluster, set up your networking, and prepare your object storage.

The following image shows each component and the connections that you need to prepare between them:

An architecture image that shows the Cloud Tiering service with a connection to the Console agent in your cloud provider, the agent with a connection to your ONTAP cluster, and a connection between the ONTAP cluster and object storage in your cloud provider. Active data resides on the ONTAP cluster, while inactive data resides in object storage.

Note Communication between the Console agent and Blob storage is for object storage setup only. The agent can reside on your premises, instead of in the cloud.

Prepare your ONTAP clusters

Your ONTAP clusters must meet the following requirements when tiering data to Azure Blob storage.

Supported ONTAP platforms

  • When using ONTAP 9.8 and later: You can tier data from AFF systems, or FAS systems with all-SSD aggregates or all-HDD aggregates.

  • When using ONTAP 9.7 and earlier: You can tier data from AFF systems, or FAS systems with all-SSD aggregates.

Supported ONTAP version

ONTAP 9.4 or later

Cluster networking requirements

  • The ONTAP cluster initiates an HTTPS connection over port 443 to Azure Blob storage.

    ONTAP reads and writes data to and from object storage. The object storage never initiates, it just responds.

    Although ExpressRoute provides better performance and lower data transfer charges, it's not required between the ONTAP cluster and Azure Blob storage. But doing so is the recommended best practice.

  • An inbound connection is required from the agent, which can reside in an Azure VNet or on your premises.

    A connection between the cluster and the Cloud Tiering service is not required.

  • An intercluster LIF is required on each ONTAP node that hosts the volumes you want to tier. The LIF must be associated with the IPspace that ONTAP should use to connect to object storage.

    When you set up data tiering, Cloud Tiering prompts you for the IPspace to use. You should choose the IPspace that each LIF is associated with. That might be the "Default" IPspace or a custom IPspace that you created. Learn more about LIFs and IPspaces.

Supported volumes and aggregates

The total number of volumes that Cloud Tiering can tier might be less than the number of volumes on your ONTAP system. That's because volumes can't be tiered from some aggregates. Refer to the ONTAP documentation for functionality or features not supported by FabricPool.

Note Cloud Tiering supports FlexGroup volumes, starting with ONTAP 9.5. Setup works the same as any other volume.

Discover an ONTAP cluster

You need to add an on-premises ONTAP system to the NetApp Console before you can start tiering cold data.

Learn how to discover a cluster.

Create or switch agents

An agent is required to tier data to the cloud. When tiering data to Azure Blob storage, you can use an agent that's in an Azure VNet or in your premises. You'll either need to create a new agent make sure that the currently selected agent resides in Azure or on-premises.

Verify that you have the necessary agent permissions

If you created the Console agent using version 3.9.25 or greater, then you're all set. The custom role that provides the permissions that an agent needs to manage resources and processes within your Azure network will be set up by default. See the required custom role permissions and the specific permissions required for Cloud Tiering.

If you created the agent using an earlier version, then you'll need to edit the permission list for the Azure account to add any missing permissions.

Prepare networking for the Console agent

Ensure that the Console agent has the required networking connections. The agent can be installed on-premises or in Azure.

Steps

  1. Ensure that the network where the agent is installed enables the following connections:

    • An HTTPS connection over port 443 to the Cloud Tiering service and to your Azure Blob object storage (see the list of endpoints)

    • An HTTPS connection over port 443 to your ONTAP cluster management LIF

  2. If needed, enable a VNet service endpoint to Azure storage.

    A VNet service endpoint to Azure storage is recommended if you have an ExpressRoute or VPN connection from your ONTAP cluster to the VNet and you want communication between the agent and Blob storage to stay in your virtual private network.

Prepare Azure Blob storage

When you set up tiering, you need to identify the resource group you want to use, and the storage account and Azure container that belong to the resource group. A storage account enables Cloud Tiering to authenticate and access the Blob container used for data tiering.

Cloud Tiering supports tiering to any storage account in any region that can be accessed via the agent.

Cloud Tiering supports only the General Purpose v2 and Premium Block Blob types of storage accounts.

Note If you are planning to configure Cloud Tiering to use a lower cost access tier where your tiered data will transition to after a certain number of days, you must not select any lifecycle rules when setting up the container in your Azure account. Cloud Tiering manages the lifecycle transitions.

Tier inactive data from your first cluster to Azure Blob storage

After you prepare your Azure environment, start tiering inactive data from your first cluster.

What you'll need

An on-premises ONTAP system to the NetApp Console.

Steps

  1. Select the on-premises ONTAP system.

  2. Click Enable for the Tiering service from the right panel.

    If the Azure Blob tiering destination exists as a system on the Systems page, you can drag the cluster onto the Azure Blob system to initiate the setup wizard.

    A screenshot that shows the Enable option that appears on the right side of the screen after you select an on-premises ONTAP system.

  3. Define Object Storage Name: Enter a name for this object storage. It must be unique from any other object storage you may be using with aggregates on this cluster.

  4. Select Provider: Select Microsoft Azure and select Continue.

  5. Select Provider: Select Microsoft Azure and select Continue.

  6. Complete the steps on the Create Object Storage pages:

    1. Resource Group: Select a resource group where an existing container is managed, or where you'd like to create a new container for tiered data, and select Continue.

    2. Resource Group: Select a resource group where an existing container is managed, or where you'd like to create a new container for tiered data, and select Continue.

      When using an on-premises agent, you must enter the Azure Subscription that provides access to the resource group.

    3. Azure Container: Select the radio button to either add a new Blob container to a storage account or to use an existing container. Then select the storage account and choose the existing container, or enter the name for the new container. Then select Continue.

    4. Azure Container: Select the radio button to either add a new Blob container to a storage account or to use an existing container. Then select the storage account and choose the existing container, or enter the name for the new container. Then select Continue.

      The storage accounts and containers that appear in this step belong to the resource group that you selected in the previous step.

    5. Access Tier Lifecycle: Cloud Tiering manages the lifecycle transitions of your tiered data. Data starts in the Hot class, but you can create a rule to apply the Cool class to the data after a certain number of days.

      Select the access tier that you want to transition the tiered data to and the number of days before the data is assigned to that tier, and select Continue. For example, the screenshot below shows that tiered data is assigned to the Cool class from the Hot class after 45 days in object storage.

      If you choose Keep data in this access tier, then the data remains in the Hot access tier and no rules are applied. See supported access tiers.

      A screenshot showing how to select another access tier where that is assigned to your data after a certain number of days.

      Note that the lifecycle rule is applied to all blob containers in the selected storage account.

    6. Cluster Network: Select the IPspace that ONTAP should use to connect to object storage, and select Continue.

      Selecting the correct IPspace ensures that Cloud Tiering can set up a connection from ONTAP to your cloud provider's object storage.

      You can also set the network bandwidth available to upload inactive data to object storage by defining the "Maximum transfer rate". Select the Limited radio button and enter the maximum bandwidth that can be used, or select Unlimited to indicate that there is no limit.

  7. On the Tier Volumes page, select the volumes that you want to configure tiering for and launch the Tiering Policy page:

    • To select all volumes, check the box in the title row () and select Configure volumes.

    • To select multiple volumes, check the box for each volume () and select Configure volumes.

    • To select a single volume, select the row (or edit pencil icon icon) for the volume.

      A screenshot that shows how to select a single volume

  8. In the Tiering Policy dialog, select a tiering policy, optionally adjust the cooling days for the selected volumes, and select Apply.

    Learn more about volume tiering policies and cooling days.

    A screenshot that shows the configurable tiering policy settings.

Result

You've successfully set up data tiering from volumes on the cluster to Azure Blob object storage.

What's next?

Be sure to subscribe to the Cloud Tiering service.

You can review information about the active and inactive data on the cluster. Learn more about managing your tiering settings.

You can also create additional object storage in cases where you may want to tier data from certain aggregates on a cluster to different object stores. Or if you plan to use FabricPool Mirroring where your tiered data is replicated to an additional object store. Learn more about managing object stores.