Skip to main content
AI Data Engine

Connect a data source to AI Data Engine

Contributors netapp-dbagwell
PDFs

AI Data Engine scans your storage systems to collect and analyze metadata. To add a data source, complete the onboarding wizard. The wizard collects connection details, scan scope, and settings for your source type. After you add the system, activate scanning to begin metadata collection.

Before you begin

  • You must have AI Data Engine administrator privileges to connect and configure data sources in AI Data Engine.

  • Discover storage systems in NetApp Console using a Console Agent before adding them to AI Data Engine. This applies to all supported storage types, including on-premises ONTAP clusters, Cloud Volumes ONTAP, Amazon FSx for NetApp ONTAP, Google Cloud NetApp Volumes, and Azure NetApp Files. For on-premises ONTAP clusters, refer to Discover on-premises ONTAP clusters in the NetApp Console documentation. Direct discovery doesn't enable data services such as AI Data Engine.

  • Verify that the network connections required for AI Data Engine to reach your data sources are open. Refer to AI Data Engine requirements.

Add a data source

Steps

  1. From the AI Data Engine UI, select Configuration.

  2. On the Scanned systems tab, select Add system.

  3. Select a source type:

    Source type Description

    File shares group

    Add NFS or SMB/CIFS file shares from the cloud or on-premises as a named group.

    Database

    Add a database server to scan selected schemas.

    StorageGRID

    Scan data from NetApp StorageGRID using the S3 protocol.

  4. Enter the connection details for your source type:

    Source type Required details

    File shares group

    A name for the share group, then the share host and path details.

    Database

    Database type, host, port, and authentication credentials.

    StorageGRID

    System name, S3 endpoint URL, and S3 access key and secret key.

  5. Review your selections and select Confirm to add the data source.

Activate scanning

After you configure a data source, scanning doesn't start automatically. You must activate scanning for each system.

Steps

  1. From the AI Data Engine UI, select Configuration.

  2. On the Scanned systems tab, locate the system you want to scan.

  3. Select Activate scans.

Result

The system status updates in the Scanned systems tab to show that scanning is running. To monitor scan progress and verify that AI Data Engine is indexing data resources, refer to Manage data sources and Monitor scanning health.