Grid nodes and services

The basic building block of a StorageGRID system is the grid node. Nodes contain services, which are software modules that provide a set of capabilities to a grid node.

The StorageGRID system uses four types of grid nodes:
  • Admin Nodes provide management services such as system configuration, monitoring, and logging. When you sign in to the Grid Manager, you are connecting to an Admin Node. Each grid must have one primary Admin Node and might have additional non-primary Admin Nodes for redundancy. You can connect to any Admin Node, and each Admin Node displays a similar view of the StorageGRID system. However, maintenance procedures must be performed using the primary Admin Node.

    Admin Nodes can also be used to load balance S3 and Swift client traffic.

  • Storage Nodes manage and store object data and metadata. Each StorageGRID system must have at least three Storage Nodes. If you have multiple sites, each site within your StorageGRID system must also have three Storage Nodes.
  • Gateway Nodes (optional) provide a load-balancing interface that client applications can use to connect to StorageGRID. A load balancer seamlessly directs clients to an optimal Storage Node, so that the failure of nodes or even an entire site is transparent. You can use a combination of Gateway Nodes and Admin Nodes for load balancing, or you can implement a third-party HTTP load balancer.
  • Archive Nodes (optional) provide an interface through which object data can be archived to tape.

Software-based nodes

Software-based grid nodes can be deployed in the following ways:
  • As virtual machines (VMs) in VMware vSphere Web Client
  • Within Docker containers on Linux hosts. The following operating systems are supported:
    • Red Hat Enterprise Linux
    • CentOS
    • Ubuntu
    • Debian

Use the NetApp Interoperability Matrix Tool to get a list of supported versions.

StorageGRID appliance nodes

StorageGRID hardware appliances are specially designed for use in a StorageGRID system. Some appliances can be used as Storage Nodes. Other appliances can be used as Admin Nodes or Gateway Nodes. You can combine appliance nodes with software-based nodes or deploy fully engineered, all-appliance grids that have no dependencies on external hypervisors, storage, or compute hardware.

Four types of StorageGRID appliances are available:
  • The SG100 and SG1000 services appliances are 1-rack-unit (1U) servers that can each operate as the primary Admin Node, a non-primary Admin Node, or a Gateway Node. Both appliances can operate as Gateway Nodes and Admin Nodes (primary and non-primary) at the same time.
  • The SG6000 storage appliance operates as a Storage Node and combines the 1U SG6000-CN compute controller with a 2U or 4U storage controller shelf. The SG6000 is available in two models:
    • SGF6024: Combines the SG6000-CN compute controller with a 2U storage controller shelf that includes 24 solid state drives (SSDs) and redundant storage controllers.
    • SG6060: Combines the SG6000-CN compute controller with a 4U enclosure that includes 58 NL-SAS drives, 2 SSDs, and redundant storage controllers. Each SG6060 appliance supports one or two 60-drive expansion shelves, providing up to 178 drives dedicated to object storage.
  • The SG5700 storage appliance is an integrated storage and computing platform that operates as a Storage Node. The SG5700 is available in two models:
    • SG5712: a 2U enclosure that includes 12 NL-SAS drives and integrated storage and compute controllers.
    • SG5760: a 4U enclosure that includes 60 NL-SAS drives and integrated storage and compute controllers.
  • The SG5600 storage appliance is an integrated storage and computing platform that operates as a Storage Node. The SG5600 is available in two models:
    • SG5612: a 2U enclosure that includes 12 NL-SAS drives and integrated storage and compute controllers.
    • SG5660: a 4U enclosure that includes 60 NL-SAS drives and integrated storage and compute controllers.

See the NetApp Hardware Universe for complete specifications.

Primary services for Admin Nodes

The following table shows the primary services for Admin Nodes; however, this table does not list all node services.

Service Key function
Audit Management System (AMS) Tracks system activity.
Configuration Management Node (CMN) Manages system-wide configuration. Primary Admin Node only.
Management Application Program Interface (mgmt-api) Processes requests from the Grid Management API and the Tenant Management API.
High Availability Manages high availability virtual IP addresses for groups of Admin Nodes and Gateway Nodes.
Note: This service is also found on Gateway Nodes.
Load Balancer Provides load balancing of S3 and Swift traffic from clients to Storage Nodes.
Note: This service is also found on Gateway Nodes.
Network Management System (NMS) Provides functionality for the Grid Manager.
Prometheus Collects and stores metrics.
Server Status Monitor (SSM) Monitors the operating system and underlying hardware.

Primary services for Storage Nodes

The following table shows the primary services for Storage Nodes; however, this table does not list all node services.

Note: Some services, such as the ADC service and the RSM service, typically exist only on three Storage Nodes at each site.
Service Key function
Account (acct) Manages tenant accounts.
Administrative Domain Controller (ADC) Maintains topology and grid-wide configuration.
Cassandra Stores and protects object metadata.
Cassandra Reaper Performs automatic repairs of object metadata.
Chunk Manages erasure-coded data and parity fragments.
Data Mover (dmv) Moves data to Cloud Storage Pools.
Distributed Data Store (DDS) Monitors object metadata storage.
Identity (idnt) Federates user identities from LDAP and Active Directory.
Local Distribution Router (LDR) Processes object storage protocol requests and manages object data on disk.
Replicated State Machine (RSM) Ensures that S3 platform service requests are sent to their respective endpoints.
Server Status Monitor (SSM) Monitors the operating system and underlying hardware.

Primary services for Gateway Nodes

The following table shows the primary services for Gateway Nodes; however, this table does not list all node services.

Service Key function
Connection Load Balancer (CLB) Provides Layers 3 and 4 load balancing of S3 and Swift traffic from clients to Storage Nodes. Legacy load balancing mechanism.
Note: The CLB service is deprecated.
High Availability Manages high availability virtual IP addresses for groups of Admin Nodes and Gateway Nodes.
Note: This service is also found on Admin Nodes.
Load Balancer Provides Layer 7 load balancing of S3 and Swift traffic from clients to Storage Nodes. This is the recommended load balancing mechanism.
Note: This service is also found on Admin Nodes.
Server Status Monitor (SSM) Monitors the operating system and underlying hardware.

Primary services for Archive Nodes

The following table shows the primary services for Archive Nodes; however, this table does not list all node services.

Service Key function
Archive (ARC) Communicates with a Tivoli Storage Manager (TSM) external tape storage system.
Server Status Monitor (SSM) Monitors the operating system and underlying hardware.