What platform services are

StorageGRID Webscale platform services can help you implement a hybrid cloud strategy.

If the use of platform services is allowed for your tenant account, you can configure the following services for any S3 bucket:

Because the target location for platform services is typically external to your StorageGRID Webscale deployment, platform services give you the power and flexibility that comes from using external storage resources, notification services, and search or analysis services for your data.

Any combination of platform services can be configured for a single S3 bucket. For example, you could configure both the CloudMirror service and notifications on a StorageGRID Webscale S3 bucket so that you can mirror specific objects to the AWS Simple Storage Service, while sending a notification about each such object to a third party monitoring application to help you track your AWS expenses.

Attention: The use of platform services must be enabled for each tenant account by a StorageGRID Webscale administrator using the Grid Manager or the Grid Management API. Tenant accounts that were created in versions of StorageGRID Webscale earlier than 11.0 have platform services disabled by default. Contact your grid administrator for more information.

How platform services are configured

Platform services communicate with external endpoints that you configure using the Tenant Manager or Tenant Management API. Each endpoint represents an external destination, such as a StorageGRID Webscale S3 bucket, an Amazon Web Services bucket, a Simple Notification Service topic, or an Elasticsearch cluster hosted locally or on AWS.

After you create an endpoint, you can enable a platform service for a bucket by adding XML configuration to the bucket. The XML configuration identifies the objects that the bucket should act on, the action that the bucket should take, and the endpoint that the bucket should use for the service.

You must add separate XML configurations for each platform service that you want to configure. For example:
  1. If you want all objects whose keys start with /images to be replicated to an AWS S3 bucket, you must add a replication configuration to the source bucket.
  2. If you also want to send notifications when these objects are stored to the bucket, you must add a notifications configuration.
  3. Finally, if you want to index the metadata for these objects, you must add the metadata notification configuration that is used to implement search integration.

The format for the configuration XML is governed by the S3 REST APIs used to implement StorageGRID Webscale platform services:

Platform service S3 REST API
CloudMirror replication
  • GET Bucket replication
  • PUT Bucket replication
Notifications
  • GET Bucket notification
  • PUT Bucket notification
Search integration
  • GET Bucket metadata notification configuration
  • PUT Bucket metadata notification configuration

These operations are custom to StorageGRID Webscale.

See the instructions for implementing S3 client applications for details on how StorageGRID Webscale implements these APIs.