Learn about Cloud Compliance
Cloud Compliance is a data privacy and compliance service for Cloud Manager that scans your volumes, Amazon S3 buckets, and databases to identify the personal and sensitive data that resides in those files. Using Artificial Intelligence (AI) driven technology, Cloud Compliance helps organizations understand data context and identify sensitive data.
Features
Cloud Compliance provides several tools that can help you with your compliance efforts. You can use Cloud Compliance to:
-
Identify Personal Identifiable Information (PII)
-
Identify a wide scope of sensitive information as required by GDPR, CCPA, PCI, and HIPAA privacy regulations
-
Respond to Data Subject Access Requests (DSAR)
Supported working environments and data sources
Cloud Compliance can scan data from the following types of data sources:
-
Cloud Volumes ONTAP in AWS
-
Cloud Volumes ONTAP in Azure
-
Azure NetApp Files
-
Amazon S3
-
Databases that reside anywhere (there is no requirement that the database resides in a working environment)
Note: For Azure NetApp Files, Cloud Compliance can scan any volumes that are in the same region as Cloud Manager.
Cost
-
The cost to use Cloud Compliance depends on the amount of data that you're scanning. As of October 7th, 2020, the first 1 TB of data that Cloud Compliance scans in a Cloud Manager workspace is free. This includes data from Cloud Volumes ONTAP volumes, Azure NetApp Files volumes, Amazon S3 buckets, and database schemas. A subscription to the AWS or Azure Marketplace is required to continue scanning data after that point. See pricing for details.
-
Installing Cloud Compliance requires deploying a cloud instance, which results in charges from the cloud provider where it is deployed. See the the type of instance that is deployed for each cloud provider
-
Cloud Compliance requires that you have deployed a Connector. In many cases you already have a Connector because of other storage and services you are using in Cloud Manager. The Connector instance results in charges from the cloud provider where it is deployed. See the type of instance that is deployed for each cloud provider.
Data transfer costs
Data transfer costs depend on your setup. If the Cloud Compliance instance and data source are in the same Availability Zone and region, then there are no data transfer costs. But if the data source, such as a Cloud Volumes ONTAP cluster or S3 Bucket, is in a different Availability Zone or region, then you'll be charged by your cloud provider for data transfer costs. See these links for more details:
How Cloud Compliance works
At a high-level, Cloud Compliance works like this:
-
You deploy an instance of Cloud Compliance in Cloud Manager.
-
You enable it on one or more working environments, or on your databases.
-
Cloud Compliance scans the data using an AI learning process.
-
In Cloud Manager, you click Compliance and use the provided dashboard and reporting tools to help in your compliance efforts.
The Cloud Compliance instance
When you enable Cloud Compliance, Cloud Manager deploys a Cloud Compliance instance in the same subnet as the Connector. Learn more about Connectors.
If the Connector is installed on-prem, it deploys the Cloud Compliance instance in same VPC or VNet as the first Cloud Volumes ONTAP system in the request. |
Note the following about the instance:
-
In Azure, Cloud Compliance runs on a Standard_D16s_v3 VM with a 512 GB disk.
-
In AWS, Cloud Compliance runs on an m5.4xlarge instance with a 500 GB GP2 disk.
In regions where m5.4xlarge isn't available, Cloud Compliance runs on an m4.4xlarge instance instead.
Changing or resizing the instance/VM type isn't supported. You need to use the size that's provided. -
The instance is named CloudCompliance with a generated hash (UUID) concatenated to it. For example: CloudCompliance-16bb6564-38ad-4080-9a92-36f5fd2f71c7
-
Only one Cloud Compliance instance is deployed per Connector.
-
Upgrades of Cloud Compliance software is automated—you don't need to worry about it.
The instance should remain running at all times because Cloud Compliance continuously scans the data. |
How scans work
After you enable Cloud Compliance and select the volumes, buckets, or database schemas you want to scan, it immediately starts scanning the data to identify personal and sensitive data. It maps your organizational data, categorizes each file, and identifies and extracts entities and predefined patterns in the data. The result of the scan is an index of personal information, sensitive personal information, and data categories.
Cloud Compliance connects to the data like any other client by mounting NFS and CIFS volumes. NFS volumes are automatically accessed as read-only, while you need to provide Active Directory credentials to scan CIFS volumes.
After the initial scan, Cloud Compliance continuously scans each volume to detect incremental changes (this is why it's important to keep the instance running).
You can enable and disable scans at the volume level, at the bucket level, and at the database schema level.
Information that Cloud Compliance indexes
Cloud Compliance collects, indexes, and assigns categories to unstructured data (files). The data that Cloud Compliance indexes includes the following:
- Standard metadata
-
Cloud Compliance collects standard metadata about files: the file type, its size, creation and modification dates, and so on.
- Personal data
-
Personally identifiable information such as email addresses, identification numbers, or credit card numbers. Learn more about personal data.
- Sensitive personal data
-
Special types of sensitive information, such as health data, ethnic origin, or political opinions, as defined by GDPR and other privacy regulations. Learn more about sensitive personal data.
- Categories
-
Cloud Compliance takes the data that it scanned and divides it into different types of categories. Categories are topics based on AI analysis of the content and metadata of each file. Learn more about categories.
- Name entity recognition
-
Cloud Compliance uses AI to extract natural persons’ names from documents. Learn about responding to Data Subject Access Requests.
Networking overview
Cloud Manager deploys the Cloud Compliance instance with a security group that enables inbound HTTP connections from the Connector instance.
When using Cloud Manager in SaaS mode, the connection to Cloud Manager is served over HTTPS, and the private data sent between your browser and the Cloud Compliance instance are secured with end-to-end encryption, which means NetApp and third parties can’t read it.
If you need to use the local user interface instead of the SaaS user interface for any reason, you can still access the local UI.
Outbound rules are completely open. Internet access is needed to install and upgrade the Cloud Compliance software and to send usage metrics.
If you have strict networking requirements, learn about the endpoints that Cloud Compliance contacts.
User access to compliance information
The role each user has been assigned provides different capabilities within Cloud Manager and within Cloud Compliance:
-
Account Admins can manage compliance settings and view compliance information for all working environments.
-
Workspace Admins can manage compliance settings and view compliance information only for systems that they have permissions to access. If a Workspace Admin can't access a working environment in Cloud Manager, then they can't see any compliance information for the working environment in the Compliance tab.
-
Users with the Cloud Compliance Viewer role can only view compliance information and generate reports for systems that they have permission to access. These users cannot enable/disable scanning of volumes, buckets, or database schemas.