Skip to main content
AI Data Engine

Set up and configure AI Data Engine

Contributors dmp-netapp netapp-dbagwell

As an ONTAP storage administrator, you use ONTAP System Manager to integrate AI Data Engine (AIDE) with your AFX environment. After you have completed the installation of your data compute nodes, ONTAP can discover them and add them to a cluster. You can add AIDE nodes during initial AFX cluster setup or add them to an existing AFX cluster, and then complete the required AIDE configuration.

Before you begin
  • You have NetApp DCNs or third-party servers installed and connected to the cluster switches. See installation documentation for AIDE software on third-party servers or NetApp DCNs for more information.

  • (For third-party servers) You have completed AIDE software installation on each server. ONTAP can then discover these servers as compute nodes, and you can add them to a cluster.

Set up AIDE and integrate it with an AFX storage system

There are two ways to set up AIDE and integrate it with an AFX storage system. Select the option that's appropriate for your environment.

Set up AIDE with a new AFX cluster

If you're setting up AIDE as part of an initial AFX system deployment, the AIDE setup process is part of the standard AFX cluster setup workflow. During the ONTAP cluster setup, System Manager automatically discovers the connected compute nodes and includes them as part of the cluster configuration.

Note You'll need to configure OpenID Connect authentication to enable access to AIDE Console.

Set up AIDE with an existing AFX cluster

If you're adding compute nodes (either NetApp DCNs or third-party servers) to an existing AFX storage system, you need to add the nodes and finish setting up your AIDE cluster.

Add compute nodes to the cluster

ONTAP detects the compute nodes connected to your cluster network and displays them in System Manager. Add compute nodes to your storage cluster to make it an AIDE cluster.

Finish setting up your AIDE cluster

After adding the compute nodes and completing the initial network configuration, you can finish setting up your new AIDE cluster.

About this task

A welcome setup guidance window is displayed on the page with the necessary configuration steps. A checkmark is displayed to the left of each step or action item that has already been completed. An arrow (blue arrow pointing to the right) is displayed for items that have not yet been completed. For each of the incomplete actions:

  • Select the enabled title link and complete the setup action for your environment.

  • If the link is disabled, hover over the title to display the action required to enable it and continue with the setup action.

Each step has a link to additional documentation where possible. Some of the configuration might be included as part of the AFX cluster setup in AFX documentation.

Steps
  1. Select Configure link aggregation groups and VLANs.

    If required for your environment, you can set up cluster-level LAGs and VLANs. Selecting this option launches the Ethernet ports page.

  2. Select Configure network protocols.

    You can configure the storage VM (SVM) network protocols.

  3. Select Update data compute software.

    If an AIDE software image is available for update, this option will be enabled. Select it to launch the software update page. For more information, refer to Update AIDE software.

  4. Select Configure data engine networking.

    This option displays the page to configure the data engine network address.

  5. Select Create intercluster network interfaces

    This option launches the page to configure the intercluster network interfaces as part of a two-step procedure if you intend to catalog remote data.

  6. Select Peer with other ONTAP storage systems.

    After creating the intercluster network interfaces, you can establish peering relationships with other ONTAP storage systems.

  7. Select Add a data container.

    You can add a volume for use by AIDE and associate it with a specific SVM.

  8. Select Add Workspaces.

    This launches the Data Engine workspaces page where you can create a workspace.

  9. Select Configure OpenID Connect.

    You'll need to configure OpenID authentication to enable access to AIDE Console.

After you finish

After all the action items are completed, the guidance window is hidden. You can manually reopen and close it as needed.

Activate your AIDE license for NetApp DCN deployments

If you have NetApp DCNs in your configuration, you need to install your AIDE premium services license after your AIDE cluster is set up and integrated with the AFX storage system. The AIDE premium services license is required for full AIDE functionality, including vectorization and guardrails capabilities.