GenAI now supports the Amazon Nova foundation models. Amazon Nova Micro, Amazon Nova Lite, and Amazon Nova Pro are supported.

GenAI requirements

GenAI now supports selecting specific file types to include in the data source scan when you add a data source.

Add data sources to the knowledge base

GenAI now supports filtering files to include in the data source scan by modification date when you add a data source. You can choose a modification date range for the included files.

Add data sources to the knowledge base

GenAI now supports scanning image files and images within PDF files (also known as multi-modal file support). If you choose image files, the text from the images is scanned into the data source and used as data. This capability includes images within PDF documents; if you include PDF file types, images within each PDF are scanned for text, and that text is included in the information from the data source.

Add data sources to the knowledge base

GenAI now enhances the relevance of search results by using hybrid search and re-ranking the results. Hybrid search combines keyword searches with vector and semantic searching. The standard keyword search results are augmented with close matches and linguistic nuance, enhancing relevance. GenAI re-ranks the search results and only returns results with the highest relevance.

Learn about BlueXP workload factory for GenAI

You can now provide a snapshot name for an ad-hoc snapshot.

Protect a knowledge base with snapshots

You can now give a custom name to the AI engine instance during deployment.

Deploy the GenAI infrastructure

If your AI engine instance becomes corrupted or is somehow deleted, you can let workload factory rebuild it for you. Workload factory automatically reattaches your knowledge bases to the infrastructure after rebuilding is complete, so that they are ready to use.

Troubleshooting

BlueXP workload factory for GenAI now supports cloning a knowledge base from a snapshot. This enables quick recovery of knowledge bases and creation of new knowledge bases with existing data sources, and helps with data recovery and development.

Clone a knowledge base

Discover and replicate on-premises ONTAP cluster data to an FSx for ONTAP file system so that it can be used to enrich AI knowledge bases. All on-premises discovery and replication workflows are possible from the new On-Premises ONTAP tab in the Storage inventory.

Discover an on-premises ONTAP cluster

The Generative AI workload introduces the data guardrails feature, powered by BlueXP classification. The data guardrails feature identifies and masks Personal Identifiable Information (PII) helping you maintain compliance and strengthen security for your sensitive organizational data.

Create a knowledge base

Learn about BlueXP classification

You can now protect your Generative AI workloads data by taking a point-in-time copy of a knowledge base. This enables you to protect your data against accidental loss or test changes to the settings of the knowledge base. You can restore the previous version of the knowledge base volume at any time.

Take a snapshot of a knowledge base volume

Restore a snapshot of a knowledge base volume

You can now pause scheduled data source scans. By default, Generative AI workloads scans each data source daily to ingest new data into each knowledge base. If you don't want the latest changes to be ingested (during testing or while restoring a snapshot, for example) you can pause the scheduled scans and resume them at any time.

Manage knowledge bases

When selecting a knowledge base volume, you can now choose a data protection volume that is part of a NetApp SnapMirror replication relationship. This enables you to store knowledge bases on volumes that are already protected by SnapMirror replication.

Identify the data sources to integrate in your knowledge base

Generative AI workloads now supports multi-sentence chunking and overlap-based chunking for data sources.

Generative AI workloads now creates a dedicated Amazon FSx for NetApp ONTAP volume for each new knowledge base, enabling individual snapshot policies for each knowledge base and improved protection against failures and data poisoning.

Generative AI workloads is now integrated with Amazon CloudWatch Logs, enabling you to monitor Generative AI workloads log files.

The NetApp workload factory GenAI sample application enables you to test authentication and retrieval from your published NetApp workload factory knowledge base by interacting directly with it in a web-based chatbot application.

The initial release includes the capability to develop a knowledge base that is customized by embedding your organization's data. The knowledge base can be accessed by a chatbot application for your users. This capability ensures accurate and relevant responses to organization-specific questions, enhancing the satisfaction and productivity for all of your users.