Skip to main content

Monitor infrastructure with Cloud Insights, Prometheus, or Fluentd connections

Contributors netapp-dbagwell
PDFs

You can configure several optional settings to enhance your Astra Control Center experience. To monitor and gain insight into your complete infrastructure, create a connection to NetApp Cloud Insights, configure Prometheus, or add a Fluentd connection.

If the network where you're running Astra Control Center requires a proxy for connecting to the Internet (to upload support bundles to NetApp Support Site or establish a connection to Cloud Insights), you should configure a proxy server in Astra Control Center.

Add a proxy server for connections to Cloud Insights or to NetApp Support Site

If the network where you're running Astra Control Center requires a proxy for connecting to the Internet (to upload support bundles to NetApp Support Site or establish a connection to Cloud Insights), you should configure a proxy server in Astra Control Center.

Important Astra Control Center does not validate the details you enter for your proxy server. Ensure that you enter correct values.
Steps

  1. Log in to Astra Control Center using an account with admin/owner privilege.

  2. Select Account > Connections.

  3. Select Connect from the drop-down list to add a proxy server.

    This image shows the Connect option to enable proxy connection.

  4. Enter the proxy server name or IP address and the proxy port number.

  5. If your proxy server requires authentication, select the check box, and enter the username and password.

  6. Select Connect.

Result

If the proxy information you entered was saved, the HTTP Proxy section of the Account > Connections page indicates that it is connected, and displays the server name.

This image shows that the proxy server successfully connected.

Edit proxy server settings

You can edit the proxy server settings.

Steps

  1. Log in to Astra Control Center using an account with admin/owner privilege.

  2. Select Account > Connections.

  3. Select Edit from the drop-down list to edit the connection.

  4. Edit the server details and authentication information.

  5. Select Save.

Disable proxy server connection

You can disable the proxy server connection. You will be warned before you disable that potential disruption to other connections might occur.

Steps

  1. Log in to Astra Control Center using an account with admin/owner privilege.

  2. Select Account > Connections.

  3. Select Disconnect from the drop-down list to disable the connection.

  4. In the dialog box that opens, confirm the operation.

Connect to Cloud Insights

To monitor and gain insight into your complete infrastructure, connect NetApp Cloud Insights with your Astra Control Center instance. Cloud Insights is included in your Astra Control Center license.

Cloud Insights should be accessible from the network that Astra Control Center uses, or indirectly via a proxy server.

When Astra Control Center is connected to Cloud Insights, an Acquisition Unit pod gets created. This pod collects data from the storage backends that are managed by Astra Control Center and pushes it to Cloud Insights. This pod requires 8 GB RAM and 2 CPU cores.

Note When Astra Control Center is paired with Cloud Insights, you should not use the Modify Deployment option in Cloud Insights. 
Note After you enable the Cloud Insights connection, you can view throughput information on the Backends page as well as connect to Cloud Insights after selecting a storage backend. You can also find the information on the Dashboard in the Cluster section and connect to Cloud Insights from there.
Before you begin

  • An Astra Control Center account with admin/owner privileges.

  • A valid Astra Control Center license.

  • A proxy server if the network where you're running Astra Control Center requires a proxy for connecting to the Internet.

Tip If you are new to Cloud Insights, familiarize yourself with the features and capabilities. Refer to Cloud Insights documentation.
Steps

  1. Log in to Astra Control Center using an account with admin/owner privilege.

  2. Select Account > Connections.

  3. Select Connect where it shows Disconnected in the drop-down list to add the connection.

    This image shows the Connect option from the drop-down list to enable Cloud Insights connection.

  4. Enter the Cloud Insights API tokens and the tenant URL. The tenant URL has the following format, as an example:

    https://<environment-name>.c01.cloudinsights.netapp.com/

    You get the tenant URL when you get the Cloud Insights license. If you do not have the tenant URL, see the Cloud Insights documentation.

    1. To get the API token, log in to your Cloud Insights tenant URL.

    2. In Cloud Insights, generate both a Read/Write and a Read only API Access token by clicking Admin > API Access.

      This image shows the Cloud Insights API token generation page.

    3. Copy the Read only key. You will need to paste it into the Astra Control Center window for enabling the Cloud Insights connection. For the Read API Access Token key permissions, select: Assets, Alerts, Acquisition Unit, and Data Collection.

    4. Copy the Read/Write key. You will need to paste it into the Astra Control Center Connect Cloud Insights window. For the Read/Write API Access Token key permissions, select: Data Ingestion, Log Ingestion, Acquisition Unit, and Data Collection.

      Note We recommend that you generate a Read only key and a Read/Write key, and not use the same key for both purposes. By default, the token expiry period is set to one year. We recommend that you keep the default selection to give the token the maximum duration before it expires. If your token expires, the telemetry will stop.

    5. Paste the keys that you copied from Cloud Insights into Astra Control Center.

  5. Select Connect.

Important After you select Connect, the status of the connection changes to Pending in the Cloud Insights section of the Account > Connections page. It can a few minutes for the connection to be enabled and the status to change to Connected.
Note To go back and forth easily between the Astra Control Center and Cloud Insights UIs, ensure that you are logged into both.

View data in Cloud Insights

If the connection was successful, the Cloud Insights section of the Account > Connections page indicates that it is connected, and displays the tenant URL. You can visit Cloud Insights to see data being successfully received and displayed.

This image shows the Cloud Insights connection enabled in the Astra Control Center UI.

If the connection failed for some reason, the status shows Failed. You can find the reason for failure under Notifications at the top-right side of the UI.

This image shows the error message when Cloud Insights connection fails.

You can also find the same information under Account > Notifications.

From Astra Control Center, you can view throughput information on the Backends page as well as connect to Cloud Insights from here after selecting a storage backend.
This image shows the throughput information on the Backends page in Astra Control Center.

To go directly to Cloud Insights, select the Cloud Insights icon next to the metrics image.

You can also find the information on the Dashboard.

This image shows the Cloud Insights icon on the Dashboard.

Important After enabling the Cloud Insights connection, if you remove the backends that you added in Astra Control Center, the backends stop reporting to Cloud Insights.

Edit Cloud Insights connection

You can edit the Cloud Insights connection.

Note You can only edit the API keys. To change the Cloud Insights tenant URL, we recommended that you disconnect the Cloud Insights connection, and connect with the new URL.
Steps

  1. Log in to Astra Control Center using an account with admin/owner privilege.

  2. Select Account > Connections.

  3. Select Edit from the drop-down list to edit the connection.

  4. Edit the Cloud Insights connection settings.

  5. Select Save.

Disable Cloud Insights connection

You can disable the Cloud Insights connection for a Kubernetes cluster managed by Astra Control Center. Disabling the Cloud Insights connection does not delete the telemetry data already uploaded to Cloud Insights.

Steps

  1. Log in to Astra Control Center using an account with admin/owner privilege.

  2. Select Account > Connections.

  3. Select Disconnect from the drop-down list to disable the connection.

  4. In the dialog box that opens, confirm the operation.
    After you confirm the operation, on the Account > Connections page, the Cloud Insights status changes to Pending. It take a few minutes for the status to change to Disconnected.

Connect to Prometheus

You can monitor Astra Control Center data with Prometheus. You can configure Prometheus to gather metrics from the Kubernetes cluster metrics endpoint, and you can use Prometheus also to visualize the metrics data.

For details about using Prometheus, refer to their documentation at Getting started with Prometheus.

What you'll need

Make sure that you have downloaded and installed the Prometheus package on the Astra Control Center cluster or a different cluster that can communicate with the Astra Control Center cluster.

Follow the instructions in the official documentation to Install Prometheus.

Prometheus needs to be able to communicate with the Astra Control Center Kubernetes cluster. If Prometheus is not installed on the Astra Control Center cluster, you need to make sure they can communicate with the metrics service running on the Astra Control Center cluster.

Configure Prometheus

Astra Control Center exposes a metrics service on TCP port 9090 in the Kubernetes cluster. You need to configure Prometheus to collect metrics from this service.

Steps

  1. Log into the Prometheus server.

  2. Add your cluster entry into the prometheus.yml file. In the yml file, add an entry similar to the following for your cluster in the scrape_configs section:

    job_name: '<Add your cluster name here. You can abbreviate. It just needs to be a unique name>'
  metrics_path: /accounts/<replace with your account ID>/metrics
  authorization:
     credentials: <replace with your API token>
  tls_config:
     insecure_skip_verify: true
  static_configs:
    - targets: ['<replace with your astraAddress. If using FQDN, the prometheus server has to be able to resolve it>']
    Note If you set the tls_config insecure_skip_verify to true, the TLS encryption protocol is not required.

  3. Restart the Prometheus service:

    sudo systemctl restart prometheus

Access Prometheus

Access the Prometheus URL.

Steps

  1. In a browser, enter the Prometheus URL with port 9090.

  2. Verify your connection by selecting Status > Targets.

View data in Prometheus

You can use Prometheus to view Astra Control Center data.

Steps

  1. In a browser, enter the Prometheus URL.

  2. From the Prometheus menu, select Graph.

  3. To use the Metrics Explorer, select the icon next to Execute.

  4. Select scrape_samples_scraped and select Execute.

  5. To see sample scraping over time, select Graph.

    Note If multiple cluster data was collected, each cluster's metrics appear in a different color.

Connect to Fluentd

You can send logs (Kubernetes events) from a system monitored by Astra Control Center to your Fluentd endpoint. The Fluentd connection is disabled by default.

This is a conceptual diagram of event logs going from Astra to Fluentd.

Note Only the event logs from managed clusters are forwarded to Fluentd.
Before you begin

  • An Astra Control Center account with admin/owner privileges.

  • Astra Control Center installed and running on a Kubernetes cluster.

Important Astra Control Center does not validate the details you enter for your Fluentd server. Ensure that you enter the correct values.
Steps

  1. Log in to Astra Control Center using an account with admin/owner privilege.

  2. Select Account > Connections.

  3. Select Connect from the drop-down list where it shows Disconnected to add the connection.

    This image shows the UI screen for enabling connection to Fluentd.

  4. Enter the host IP address, the port number, and shared key for your Fluentd server.

  5. Select Connect.

Result

If the details you entered for your Fluentd server were saved, the Fluentd section of the Account > Connections page indicates that it is connected. Now you can visit the Fluentd server that you connected and view the event logs.

If the connection failed for some reason, the status shows Failed. You can find the reason for failure under Notifications at the top-right side of the UI.

You can also find the same information under Account > Notifications.

Important If you are having trouble with log collection, you should log in to your worker node and ensure that your logs are available in /var/log/containers/.

Edit the Fluentd connection

You can edit the Fluentd connection to your Astra Control Center instance.

Steps

  1. Log in to Astra Control Center using an account with admin/owner privilege.

  2. Select Account > Connections.

  3. Select Edit from the drop-down list to edit the connection.

  4. Change the Fluentd endpoint settings.

  5. Select Save.

Disable the Fluentd connection

You can disable the Fluentd connection to your Astra Control Center instance.

Steps

  1. Log in to Astra Control Center using an account with admin/owner privilege.

  2. Select Account > Connections.

  3. Select Disconnect from the drop-down list to disable the connection.

  4. In the dialog box that opens, confirm the operation.