How StorageGRID groups alerts in email notifications

To prevent an excessive number of email notifications from being sent when alerts are triggered, StorageGRID attempts to group multiple alerts in the same notification.

Refer to the following table for examples of how StorageGRID groups multiple alerts in email notifications.

Behavior Example
Each alert notification applies only to alerts that have the same name. If two alerts with different names are triggered at the same time, two email notifications are sent.
  • Alert A is triggered on two nodes at the same time. Only one notification is sent.
  • Alert A is triggered on node 1, and Alert B is triggered on node 2 at the same time. Two notifications are sent—one for each alert.
For a specific alert on a specific node, if the thresholds are reached for more than one severity, a notification is sent only for the most severe alert.
  • Alert A is triggered and the minor, major, and critical alert thresholds are reached. One notification is sent for the critical alert.
The first time an alert is triggered, StorageGRID waits 2 minutes before sending a notification. If other alerts with the same name are triggered during that time, StorageGRID groups all of the alerts in the initial notification.
  1. Alert A is triggered on node 1 at 08:00. No notification is sent.
  2. Alert A is triggered on node 2 at 08:01. No notification is sent.
  3. At 08:02, a notification is sent to report both instances of the alert.
If an another alert with the same name is triggered, StorageGRID waits 10 minutes before sending a new notification. The new notification reports all active alerts (current alerts that have not been silenced), even if they were reported previously.
  1. Alert A is triggered on node 1 at 08:00. A notification is sent at 08:02.
  2. Alert A is triggered on node 2 at 08:05. A second notification is sent at 08:15 (10 minutes later). Both nodes are reported.
If there are multiple current alerts with the same name and one of those alerts is resolved, a new notification is not sent if the alert reoccurs on the node for which the alert was resolved.
  1. Alert A is triggered for node 1. A notification is sent.
  2. Alert A is triggered for node 2. A second notification is sent.
  3. Alert A is resolved for node 2, but it remains active for node 1.
  4. Alert A is triggered again for node 2. No new notification is sent because the alert is still active for node 1.
StorageGRID continues to send email notifications once every 7 days until all instances of the alert are resolved or the alert rule is silenced.
  1. Alert A is triggered for node 1 on March 8. A notification is sent.
  2. Alert A is not resolved or silenced. Additional notifications are sent on March 15, March 22, March 29, and so on.