Manage data tiering for your clusters in NetApp Cloud Tiering
Now that you've set up data tiering from your on-premises ONTAP clusters, you can tier data from additional volumes, change a volume's tiering policy, discover additional clusters, and more by using NetApp Cloud Tiering.
Review tiering info for a cluster
Check the data in the cloud tier, on disks, or the amount of hot and cold data on the cluster's disks. Or, you might want to see the amount of hot and cold data on the cluster's disks. Cloud Tiering provides this information for each cluster.
-
From the left navigation menu, select Mobility > Cloud Tiering.
-
From the Clusters page, select the menu icon
for a cluster and select Cluster info.
-
Review details about the cluster.
Here's an example:
Note that the display is different for Cloud Volumes ONTAP systems. While Cloud Volumes ONTAP volumes can have data tiered to the cloud, they do not use the Cloud Tiering service. Learn how to tier inactive data from Cloud Volumes ONTAP systems to low-cost object storage.
You can also view tiering information for a cluster from Active IQ Digital Advisor (also known as Digital Advisor) if you're familiar with this NetApp product. Select Cloud Recommendations from the left navigation pane.
Tier data from additional volumes
Set up data tiering for additional volumes at any time—for example, after creating a new volume.
|
You don't need to configure the object storage because it was already configured when you initially set up tiering for the cluster. ONTAP tiers inactive data from any additional volumes to the same object store. |
-
From the left navigation menu, select Mobility > Cloud Tiering.
-
From the Clusters page, select Tier volumes for the cluster.
-
On the Tier Volumes page, select the volumes that you want to configure tiering for and launch the Tiering Policy page:
-
To select all volumes, check the box in the title row (
) and select Configure volumes.
-
To select multiple volumes, check the box for each volume (
) and select Configure volumes.
-
To select a single volume, select the row (or
icon) for the volume.
-
-
In the Tiering Policy dialog, select a tiering policy, optionally adjust the cooling days for the selected volumes, and select Apply.
-
In the Tiering Policy dialog, select a tiering policy, optionally adjust the cooling days for the selected volumes, and select Apply.
ONTAP starts tiering the selected volumes' data to the cloud.
Change a volume's tiering policy
Changing the tiering policy for a volume changes how ONTAP tiers cold data to object storage. The change starts from the moment that you change the policy. It changes only the subsequent tiering behavior for the volume—it does not retroactively move data to the cloud tier.
-
From the left navigation menu, select Mobility > CloudTiering.
-
From the Clusters page, select Tier volumes for the cluster.
-
From the Clusters page, select Tier volumes for the cluster.
-
Click the row for a volume, select a tiering policy, optionally adjust the cooling days, and select Apply.
-
Click the row for a volume, select a tiering policy, optionally adjust the cooling days, and select Apply.
|
If you see options to "Retrieve Tiered Data", see Migrate data from the cloud tier back to the performance tier for details. |
ONTAP changes the tiering policy and begins tiering data based on the new policy.
Change the network bandwidth available to upload inactive data to object storage
When you activate Cloud Tiering for a cluster, by default, ONTAP can use an unlimited amount of bandwidth to transfer the inactive data from volumes in system to object storage. If tiering traffic affects user workloads, throttle the network bandwidth used during the transfer. You can choose a value between 1 and 10,000 Mbps as the maximum transfer rate.
-
From the left navigation menu, select Mobility > Tiering.
-
From the Clusters page, select the menu icon
for a cluster and select Maximum transfer rate.
-
From the Clusters page, select the menu icon
for a cluster and select Maximum transfer rate.
-
In the Maximum transfer rate page, select the Limited radio button and enter the maximum bandwidth that can be used, or select Unlimited to indicate that there is no limit. Then select Apply.
-
In the Maximum transfer rate page, select the Limited radio button and enter the maximum bandwidth that can be used, or select Unlimited to indicate that there is no limit. Then select Apply.
This setting does not affect the bandwidth allocated to any other clusters that are tiering data.
Download a tiering report for your volumes
Download a report of the Tier Volumes page so you can review the tiering status of all the volumes on the clusters you are managing. Just select the button. Cloud Tiering generates a .CSV file that you can review and send to other groups as needed. The .CSV file includes up to 10,000 rows of data.
Migrate data from the cloud tier back to the performance tier
Tiered data that is accessed from the cloud may be "re-heated" and moved back to the performance tier. However, if you want to proactively promote data to the performance tier from the cloud tier, you can do this in the Tiering Policy dialog. This capability is available when using ONTAP 9.8 and greater.
You can do this if you want to stop using tiering on a volume, or if you decide to keep all user data on the performance tier, but keep Snapshot copies on the cloud tier.
There are two options:
Option | Description | Affect on Tiering Policy |
---|---|---|
Bring back all data |
Retrieves all volume data and Snapshot copies tiered in the cloud and promotes them to the performance tier. |
Tiering policy is changed to "No policy". |
Bring back active file system |
Retrieves only active file system data tiered in the cloud and promotes it to the performance tier (Snapshot copies remain in the cloud). |
Tiering policy is changed to "Cold snapshots". |
|
You may be charged by your cloud provider based on that amount of data transferred off the cloud. |
Ensure the performance tier has enough space for data moved back from the cloud.
-
From the left navigation menu, select Mobility > Cloud Tiering.
-
From the Clusters page, select Tier volumes for the cluster.
-
From the Clusters page, select Tier volumes for the cluster.
-
Click the
icon for the volume, choose the retrieval option you want to use, and select Apply.
-
Click the
icon for the volume, choose the retrieval option you want to use, and select Apply.
The tiering policy is changed and the tiered data starts to be migrated back to the performance tier. Depending on the amount of data in the cloud, the transfer process could take some time.
Manage tiering settings on aggregates
Each aggregate in your on-premises ONTAP systems has two settings that you can adjust: the tiering fullness threshold and whether inactive data reporting is enabled.
Each aggregate in your on-premises ONTAP systems has two settings that you can adjust: the tiering fullness threshold and whether inactive data reporting is enabled.
- Tiering fullness threshold
-
Setting the threshold to a lower number reduces the amount of data required to be stored on the performance tier before tiering takes place. This might be useful for large aggregates that contain little active data.
Setting the threshold to a higher number increases the amount of data required to be stored on the performance tier before tiering takes place. This might be useful for solutions designed to tier only when aggregates are near maximum capacity.
- Inactive data reporting
-
Inactive data reporting (IDR) uses a 31-day cooling period to determine which data is considered inactive. The amount of cold data that is tiered is dependent on the tiering policies set on volumes. This amount might be different than the amount of cold data detected by IDR using a 31-day cooling period.
It's best to keep IDR enabled because it helps to identify your inactive data and savings opportunities. IDR must remain enabled if data tiering is enabled on an aggregate.
-
From the Clusters page, select Advanced setup for the selected cluster.
-
From the Clusters page, select Advanced setup for the selected cluster.
-
From the Advanced Setup page, select the menu icon for the aggregate and select Modify Aggregate.
-
From the Advanced Setup page, select the menu icon for the aggregate and select Modify Aggregate.
-
In the dialog that is displayed, modify the fullness threshold and choose whether to enable or disable inactive data reporting.
-
Click Apply.
Fix operational health
If failures occur, Cloud Tiering displays a "Failed" operational health status on the Cluster Dashboard. The health reflects the status of the ONTAP system and the NetApp Console.
-
Identify any clusters that have an operational health of "Failed."
-
Hover over the informational "i" icon see the failure reason.
-
Correct the issue:
-
Verify that the ONTAP cluster is operational and that it has an inbound and outbound connection to your object storage provider.
-
Verify that the Console has outbound connections to the Cloud Tiering service, to the object store, and to the ONTAP clusters that it discovers.
-
Discover additional clusters from Cloud Tiering
You can add your undiscovered on-premises ONTAP clusters to the Console from the Tiering Cluster page so that you can enable tiering for the cluster.
Note that buttons also appear on the Tiering On-Prem dashboard page for you to discover additional clusters.
-
From Cloud Tiering, select the Clusters tab.
-
To see any undiscovered clusters, select Show undiscovered clusters.
-
To see any undiscovered clusters, select Show undiscovered clusters.
If your NSS credentials are saved in the Console, the clusters in your account are displayed in the list.
If your NSS credentials are not saved, you are first prompted to add your credentials before you can see the undiscovered clusters.
-
Click Discover Cluster for the cluster that you want to manage through the Console and implement data tiering.
-
In the Cluster Details page, enter the password for the admin user account and select Discover.
-
In the Cluster Details page, enter the password for the admin user account and select Discover.
Note that the cluster management IP address is populated based on information from your NSS account.
-
In the Details & Credentials page the cluster name is added as the System Name, so select Go.
The Console discovers the cluster and adds it to the Systems page using the cluster name as the system name.
You can enable the Tiering service or other services for this cluster in the right panel.
Search for a cluster across all Console agents
If you are using multiple agents to manage all the storage in your environment, some clusters on which you want to implement tiering may be in another agent. If you are not sure which agent is managing a certain cluster, you can search across all agents using Cloud Tiering.
-
In the Cloud Tiering menu bar, select the action menu and select Search for cluster in all agents.
-
In the displayed Search dialog, enter the name of the cluster and select Search.
Cloud Tiering displays the name of the agent if it is able to find the cluster.