Skip to main content
Cloud Manager 3.7
A newer release of this product is available.

Syncing data to Amazon S3

Contributors netapp-bcammett
PDFs

You can sync data from ONTAP volumes to an Amazon S3 bucket by integrating a working environment with NetApp Cloud Sync. You can then use the synced data as a secondary copy or for data processing using AWS services like EMR and Redshift.

How the sync to S3 feature works

You can integrate a working environment with the Cloud Sync service at any time. When you integrate a working environment, the Cloud Sync service syncs data from the selected volumes to a single S3 bucket. The integration works with Cloud Volumes ONTAP working environments, as well as ONTAP clusters that are on-premises or part of a NetApp Private Storage (NPS) configuration.

To sync the data, the service launches a data broker instance in your VPC. Cloud Sync uses one data broker per working environment to sync data from volumes to an S3 bucket. After the initial sync, the service syncs any changed data once per day at midnight.

Screen shot: Shows a conceptual image of volumes from a working environment being synced to an S3 bucket by a data broker.

If you want to perform advanced Cloud Sync actions, go directly to the Cloud Sync service. From there, you can perform actions such as syncing from S3 to an NFS server, choosing different S3 buckets for volumes, and modifying schedules.

14-day free trial

If you are a new Cloud Sync user, your first 14 days are free. After the free trial ends, you must pay for each sync relationship at an hourly rate or by purchasing licenses. Each volume that you sync to an S3 bucket is considered a sync relationship. You can set up both payment options directly from Cloud Sync in the License Settings page.

How to get help

Use the following options for any support related to the Cloud Manager sync to S3 feature or for Cloud Sync in general:

  • General product feedback: ng-cloudsync-contact@netapp.com

  • Technical Support options:

    • NetApp Cloud Sync Communities

    • In-product chat (lower-right corner of Cloud Manager)

Integrating a working environment with the Cloud Sync service

If you want to sync volumes to Amazon S3 directly from Cloud Manager, then you must integrate the working environment with the Cloud Sync service.

Steps

  1. Open a working environment and click Sync to S3.

  2. Click Sync and follow the prompts to sync your data to S3.

Note You cannot sync data protection volumes to S3. The volumes must be writable.

Managing volume sync relationships

After you integrate a working environment with the Cloud Sync service, you can sync additional volumes, stop syncing a volume, and remove the integration with Cloud Sync.

Steps

  1. On the Working Environments page, double-click the working environment on which you want to manage sync relationships.

  2. If you want to enable or disable sync to S3 for a volume, select the volume and then click Sync to S3 or Delete Sync Relationship.

  3. If you want to delete all sync relationships for a working environment, click the Sync to S3 tab and then click Delete Sync.

    This action does not delete synced data from the S3 bucket. If the data broker is not being used in any other sync relationships, then the Cloud Sync service deletes the data broker.