Skip to main content
Cloud Manager 3.8
A newer release of this product is available.

Tiering data from on-premises ONTAP clusters to Google Cloud Storage

Contributors netapp-bcammett

Free space on your on-prem ONTAP clusters by tiering data to Google Cloud Storage. Data tiering is powered by NetApp's Cloud Tiering service.

Quick start

Get started quickly by following these steps or scroll down to the remaining sections for full details.

number 1 Prepare to tier data to Google Cloud Storage

You need the following:

  • An AFF or FAS system with all-SSD aggregates that's running ONTAP 9.6 or later and has an HTTPS connection to Google Cloud Storage.

  • A service account that has the predefined Storage Admin role and storage access keys.

  • A Connector installed in a Google Cloud Platform VPC.

  • Networking for the Connector that enables an outbound HTTPS connection to the ONTAP cluster in your data center, to Google Cloud Storage, and to the Cloud Tiering service.

number2 Set up tiering

In Cloud Manager, select an on-prem working environment, click Setup Tiering and follow the prompts to tier data to Google Cloud Storage.

number 3 Set up licensing

After your free trial ends, pay for Cloud Tiering through a pay-as-you-go subscription, an ONTAP tiering license, or a combination of both:

Requirements

Verify support for your ONTAP cluster, set up your networking, and prepare your object storage.

The following image shows each component and the connections that you need to prepare between them:

An architecture image that shows the Cloud Tiering service with a connection to the Service Connector in your cloud provider, the Service Connector with a connection to your ONTAP cluster, and a connection between the ONTAP cluster and object storage in your cloud provider. Active data resides on the ONTAP cluster, while inactive data resides in object storage.

Note Communication between the Connector and Google Cloud Storage is for object storage setup only.

Preparing your ONTAP clusters

Your ONTAP clusters must meet the following requirements when tiering data to Google Cloud Storage.

Supported ONTAP platforms

Cloud Tiering supports AFF systems and all-SSD aggregates on FAS systems.

Supported ONTAP versions

ONTAP 9.6 or later

Cluster networking requirements

  • The ONTAP cluster initiates an HTTPS connection over port 443 to Google Cloud Storage.

    ONTAP reads and writes data to and from object storage. The object storage never initiates, it just responds.

    Although a Google Cloud Interconnect provides better performance and lower data transfer charges, it's not required between the ONTAP cluster and Google Cloud Storage. Because performance is significantly better when using Google Cloud Interconnect, doing so is the recommended best practice.

  • An inbound connection is required from the NetApp Service Connector, which resides in an Google Cloud Platform VPC.

    A connection between the cluster and the Cloud Tiering service is not required.

  • An intercluster LIF is required on each ONTAP node that hosts tiered volumes. The LIF must be associated with the IPspace that ONTAP should use to connect to object storage.

    IPspaces enable network traffic segregation, allowing for separation of client traffic for privacy and security. Learn more about IPspaces.

    When you set up data tiering, Cloud Tiering prompts you for the IPspace to use. You should choose the IPspace that each LIF is associated with. That might be the "Default" IPspace or a custom IPspace that you created.

Supported volumes and aggregates

The total number of volumes that Cloud Tiering can tier might be less than the number of volumes on your ONTAP system. That's because volumes can't be tiered from some aggregates. For example, you can't tier data from SnapLock volumes or from MetroCluster configurations. Refer to ONTAP documentation for functionality or features not supported by FabricPool.

Note Cloud Tiering supports FlexGroup volumes. Setup works the same as any other volume.

Creating or switching Connectors

A Connector is required to tier data to the cloud. When tiering data to Google Cloud Storage, a Connector must be available in a Google Cloud Platform VPC. You'll either need to create a new Connector or make sure that the currently selected Connector resides in GCP.

Preparing networking for the Connector

Ensure that the Connector has the required networking connections.

Steps

  1. Ensure that the VPC where the Connector is installed enables the following connections:

    • An outbound internet connection to the Cloud Tiering service over port 443 (HTTPS)

    • An HTTPS connection over port 443 to Google Cloud Storage

    • An HTTPS connection over port 443 to your ONTAP clusters

  2. Optional: Enable Private Google Access on the subnet where you plan to deploy the Service Connector.

    Private Google Access is recommended if you have a direct connection from your ONTAP cluster to the VPC and you want communication between the Connector and Google Cloud Storage to stay in your virtual private network. Note that Private Google Access works with VM instances that have only internal (private) IP addresses (no external IP addresses).

Preparing Google Cloud Storage for data tiering

When you set up tiering, you need to provide storage access keys for a service account that has Storage Admin permissions. A service account enables Cloud Tiering to authenticate and access Cloud Storage buckets used for data tiering. The keys are required so that Google Cloud Storage knows who is making the request.

Steps

  1. Create a service account that has the predefined Storage Admin role.

  2. Go to GCP Storage Settings and create access keys for the service account:

    1. Select a project, and click Interoperability. If you haven’t already done so, click Enable interoperability access.

    2. Under Access keys for service accounts, click Create a key for a service account, select the service account that you just created, and click Create Key.

      You'll need to enter the keys in Cloud Tiering later when you set up tiering.

Tiering inactive data from your first cluster to Google Cloud Storage

After you prepare your Google Cloud environment, start tiering inactive data from your first cluster.

What you'll need
Steps

  1. Select an on-prem cluster.

  2. Click Setup Tiering.

    A screenshot that shows the Setup Tiering option that appears on the right side of the screen after you select an on-prem ONTAP working environment.

    You're now on the Tiering dashboard.

  3. Click Set up Tiering next to the cluster.

  4. Complete the steps on the Tiering Setup page:

    1. Bucket: Add a new Google Cloud Storage bucket or select an existing bucket and click Continue.

    2. Storage Class: Select the storage class that you want to use for the tiered data and click Continue.

    3. Credentials: Enter the storage access key and secret key for a service account that has the Storage Admin role.

    4. Cluster Network: Select the IPspace that ONTAP should use to connect to object storage and click Continue.

      Selecting the correct IPspace ensures that Cloud Tiering can set up a connection from ONTAP to your cloud provider's object storage.

  5. Click Continue to select the volumes that you want to tier.

  6. On the Tier Volumes page, set up tiering for each volume. Click the A screenshot of the edit icon that appears at the end of each row in the table for tiering volumes icon, select a tiering policy, optionally adjust the cooling days, and click Apply.

    Learn more about volume tiering policies.

    A screenshot that shows volumes selected in the Select Source Volumes page.

Result

You've successfully set up data tiering from volumes on the cluster to Google Cloud object storage.

What's next?

Be sure to subscribe from the Cloud Tiering service.

You can also add additional clusters or review information about the active and inactive data on the cluster. For details, see Managing data tiering from your clusters.