What's new in BlueXP classification
Learn what's new in BlueXP classification.
4 November 2024
Version 1.37
This BlueXP classification release includes the following updates.
This release provides support for Red Hat Enterprise Linux v8.10 in addition to previously supported versions. This is applicable to any manual on-premises installation of BlueXP classification, including dark site deployments.
The following operating systems require using the Podman container engine, and they require BlueXP classification version 1.30 or greater: Red Hat Enterprise Linux version 8.8, 8.10, 9.0, 9.1, 9.2, 9.3, and 9.4.
Learn more about BlueXP classification.
This release provides support for NFS v4.1 in addition to previously supported versions.
Learn more about BlueXP classification.
10 October 2024
Version 1.36
This release provides support for Red Hat Enterprise Linux v9.4 in addition to previously supported versions. This is applicable to any manual on-premises installation of BlueXP classification, including dark site deployments.
The following operating systems require using the Podman container engine, and they require BlueXP classification version 1.30 or greater: Red Hat Enterprise Linux version 8.8, 9.0, 9.1, 9.2, 9.3, and 9.4.
Learn more about BlueXP classification deployments overview.
This release provides improved scan performance.
2 September 2024
Version 1.35
BlueXP classification can now scan data in StorageGRID.
For details, refer to Scan StorageGRID data.
5 August 2024
Version 1.34
This BlueXP classification release includes the following update.
BlueXP classification has updated its Linux operating system for Microsoft Azure and Google Cloud Platform (GCP) from CentOS 7.9 to Ubuntu 22.04.
For deployment details, refer to Install on a Linux host with internet access and prepare the Linux host system.
1 July 2024
Version 1.33
This release supports the Ubuntu 24.04 Linux platform.
The following metadata is extracted from files during mapping scans and is displayed on the Governance, Compliance, and Investigation dashboards:
-
Working environment
-
Working environment type
-
Storage repository
-
File type
-
Used capacity
-
Number of files
-
File size
-
File creation
-
File last access
-
File last modified
-
File discovered time
-
Permissions extraction
This release updates which data appears in the Governance, Compliance, and Investigation dashboards during mapping scans.
For details, see What's the difference between mapping and classification scans
5 June 2024
Version 1.32
This release now shows a new Mapping status column in the Configuration page. The new column helps you identify if the mapping is running, queued, paused or more.
For explanations of the statuses, see Change scan settings.
15 May 2024
Version 1.31
BlueXP classification is now available as a core capability within BlueXP at no additional charge for up to 500 TiB of scanned data. No Classification license or paid subscription is required. As we focus BlueXP classification functionality on scanning NetApp storage systems with this new version, some legacy functionality will only be available to customers who had previously paid for a license. The use of those legacy features will expire when the paid contract reaches its end date.
1 April 2024
Version 1.30
This release provides support for Red Hat Enterprise Linux v8.8 and v9.3 in addition to previously supported 9.x, which requires Podman, rather than the Docker engine. This is applicable to any manual on-premises installation of BlueXP classification.
The following operating systems require using the Podman container engine, and they require BlueXP classification version 1.30 or greater: Red Hat Enterprise Linux version 8.8, 9.0, 9.1, 9.2, and 9.3.
Learn more about BlueXP classification deployments overview.
BlueXP classification is supported if you install the Connector on a RHEL 8 or 9 host that resides on-premises. It's not supported if the RHEL 8 or 9 host resides in AWS, Azure, or Google Cloud.
The option to activate audit log collection has been disabled.
Scan performance on secondary scanner nodes has been improved. You can add more scanner nodes if you need additional processing power for your scans. For details, refer to Install BlueXP classification on a host that has internet access.
If you deployed BlueXP classification on a system with internet access, the system upgrades automatically. Previously, the upgrade occurred after a specific time elapsed since the last user activity. With this release, BlueXP classification upgrades automatically if the local time is between 1:00 AM and 5:00 AM. If the local time is outside of these hours, the upgrade occurs after a specific time elapses since the last user activity. For details, refer to Install on a Linux host with internet access.
If you deployed BlueXP classification without internet access, you'll need to upgrade manually. For details, refer to Install BlueXP classification on a Linux host with no internet access.
4 March 2024
Version 1.29
If you want BlueXP classification to exclude scanning data that resides in certain data source directories, you can add these directory names to a configuration file that BlueXP classification processes. This feature enables you to avoid scanning directories that are unnecessary, or that would result in returning false positive personal data results.
If you need BlueXP classification to scan more than 250 million files, you can use an Extra Large instance in your cloud deployment or on-premises installation. This type of system can scan up to 500 million files.
10 January 2024
Version 1.27
The filtered results in the Investigation page now shows the total size of the items in addition to the total number of files. This can help when moving files, deleting files, and more.
Now you can configure Group IDs in NFS to be considered as "Open to Organization" directly from BlueXP classification if the group had not initially been set with that permission. Any files and folders that have these group IDs attached will show as "Open to Organization" in the Investigation Details page. See how to add additional Group IDs as "open to organization".
14 December 2023
Version 1.26.6
This release included some minor enhancements.
The release also removed the following options:
-
The option to activate audit log collection has been disabled.
-
During the Directories investigation, the option to calculate the number of personal identifiable information (PII) data by Directories is not available. Refer to Investigate the data stored in your organization.
-
The option to integrate data using Azure Information Protection (AIP) labels has been disabled. Refer to Organize your private data.
6 November 2023
Version 1.26.3
The following issues have been fixed in this release
-
Fixed an inconsistency when presenting the number of files scanned by the system in dashboards.
-
Improved the scanning behavior by handling and reporting on files and directories with special characters in the name and metadata.
4 October 2023
Version 1.26
Red Hat Enterprise Linux versions 8 and 9 do not support the Docker engine; which was required for the BlueXP classification installation. We now support BlueXP classification installation on RHEL 9.0, 9.1, and 9.2 using Podman version 4 or greater as the container infrastructure. If your environment requires using the newest versions of RHEL, now you can install BlueXP classification (version 1.26 or greater) when using Podman.
At this time we don't supported dark site installations or distributed scanning environments (using a master and remote scanner nodes) when using RHEL 9.x.
5 September 2023
Version 1.25
When you deploy an instance of BlueXP classification in AWS, the option to select Deploy > Configuration and choose a small or medium-sized instance is unavailable at this time. You can still deploy the instance using the large instance size by selecting Deploy > Deploy.
In the past you could only apply tags to a single page at a time in the Investigation Results page (20 items). Now you can select all items in the Investigation Results pages and apply tags to all the items - up to 100,000 items at a time. See how.
BlueXP classification used to identify duplicated files only when files were 50 MB or larger. Now duplicated files starting with 1 MB can be identified. You can use the Investigation page filters "File Size" along with "Duplicates" to see which files of a certain size are duplicated in your environment.
17 July 2023
Version 1.24
BlueXP classification can identify and categorize files that contain the following types of data:
-
German ID (Personalausweisnummer)
-
German Social Security Number (Sozialversicherungsnummer)
BlueXP classification is now fully supported in sites with no internet access (Private mode) and with limited outbound internet access (Restricted mode). Learn more about BlueXP deployment modes for the Connector.
Now you can upgrade to a newer version of BlueXP classification even if it is not sequential. This means that the current limitation of upgrading BlueXP classification by one version at a time is no longer required. This feature is relevant starting from version 1.24 onwards.
The BlueXP classification API enables you to perform actions, create queries, and export information about the data you are scanning. The interactive documentation is available using Swagger. The documentation is separated into multiple categories, including Investigation, Compliance, Governance, and Configuration. Each category is a reference to the tabs in the BlueXP classification UI.
6 June 2023
Version 1.23
Japanese names can now be entered when searching for a subject's name in response to a Data Subject Access Request (DSAR). You can generate a Data Subject Access Request report with the resulting information. You can also enter Japanese names in the "Data Subject" filter in the Data Investigation page to identify files that contain the subject's name.
Ubuntu 22.04 has been qualified as a supported operating system for BlueXP classification. You can install BlueXP classification on a Ubuntu Linux host in your network, or on a Linux host in the cloud when using version 1.23 of the installer. See how to install BlueXP classification on a host with Ubuntu installed.
These versions are not supported with new deployments because Red Hat no longer supports Docker, which is a prerequisite. If you have an existing BlueXP classification machine running on RHEL 8.6 or 8.7, NetApp will continue to support your configuration.
You can enable file access audit logs to be collected on your BlueXP classification system for file access events detected on volumes in your working environments. BlueXP classification can capture the following types of FPolicy events and the users who performed the actions on your files: Create, Read, Write, Delete, Rename, Change owner/permissions, and Change SACL/DACL.
Now you can upload your Data Sense BYOL license into the BlueXP digital wallet in a dark site so that you are notified when your license is getting low. See how to obtain and upload your Data Sense BYOL license.
3 April 2023
Version 1.22
The Data Discovery Assessment Report provides a high-level analysis of your scanned environment to highlight the system's findings and to show areas of concern and potential remediation steps. The goal of this report is to raise awareness of data governance concerns, data security exposures, and data compliance gaps of your data set. See how to generate and use the Data Discovery Assessment Report.
When deploying BlueXP classification from a BlueXP Connector in an AWS environment, now you can select from two smaller instance types than what is available with the default instance. If you are scanning a small environment this can help you save on cloud costs. However, there are some restrictions when using the smaller instance. See the available instance types and limitations.
If you would like to verify that your Linux system meets all prerequisites independently of running the BlueXP classification installation, there is a separate script you can download that only tests for the prerequisites. See how to check if your Linux host is ready to install BlueXP classification.
7 March 2023
Version 1.21
BlueXP classification now enables you to add your own custom categories so that BlueXP classification will identify the files that fit into those categories. BlueXP classification has many predefined categories, so this feature enables you to add custom categories to identify where information that is unique to your organization are found in your data.
BlueXP classification has had the ability to add custom keywords that BlueXP classification will identify in future scans for a while. However, you needed to log into the BlueXP classification Linux host and use a command line interface to add the keywords. In this release, the ability to add custom keywords is in the BlueXP classification UI, making it very easy to add and edit these keywords.
By default, if BlueXP classification doesn't have adequate "write" permissions, the system won't scan files in your volumes because BlueXP classification can't revert the "last access time" to the original timestamp. However, if you don't care if the last access time is reset to the original time in your files, you can override this behavior in the Configuration page so that BlueXP classification will scan the volumes regardless of permissions.
In conjunction with this capability, and new filter named "Scan Analysis Event" has been added so you can view the files that were not classified because BlueXP classification couldn't revert last accessed time, or the files that were classified even though BlueXP classification couldn't revert last accessed time.
Learn more about the "Last access time timestamp" and the permissions BlueXP classification requires.
BlueXP classification can identify and categorize files that contain the following types of data:
-
Botswana Identity Card (Omang) Number
-
Botswana Passport Number
-
Singapore National Registration Identity Card (NRIC)
-
The "Light CSV Report" option for Data Investigation Reports now includes information from directories.
-
The "Last Accessed" time filter now shows the last accessed time for both files and directories.
-
The BlueXP classification installer for sites without internet access (dark sites) now performs a pre-check to make sure your system and networking requirements are in place for a successful installation.
-
Installation audit log files are saved now; they are written to
/ops/netapp/install_logs
.
5 February 2023
Version 1.20
In earlier versions of BlueXP classification you could send email alerts to the BlueXP users in your account when certain critical Policies return results. This feature enables you to get notifications to protect your data when you're not online. Now you can also send email alerts from Policies to any other users - up to 20 email addresses - who are not in your BlueXP account.
BlueXP classification has had the ability to add custom "personal data" that BlueXP classification will identify in future scans for a while. However, you needed to log into the BlueXP classification Linux host and use a command line to add the custom patterns. In this release, the ability to add personal patterns using a regex is in the BlueXP classification UI, making it very easy to add and edit these custom patterns.
In the past you could have BlueXP classification move a maximum of 100,000 source files to any NFS share. Now you can move up to 15 million files at a time. Learn more about moving source files using BlueXP classification.
The filter "Number of users with access" now supports files stored in SharePoint Online repositories. In the past only files on CIFS shares were supported. Note that SharePoint groups that are not active directory based will not be counted in this filter at this time.
The new "Partial Success" status indicates that a BlueXP classification action is finished and some items failed and some items succeeded, for example, when you are moving or deleting 100 files. Additionally, the "Finished" status has been renamed to "Success". In the past, the "Finished" status might list actions that succeeded and that failed. Now the "Success" status means that all actions succeeded on all items. See how to view the Actions Status panel.
9 January 2023
Version 1.19
The Governance dashboard has added a new Sensitive Data and Wide Permissions area that provides a heatmap of files that contain sensitive data (including both sensitive and sensitive personal data) and that are overly permissive. This can help you to see where you may have some risks with sensitive data. Learn more.
New filters are available to refine the results that display in the Data Investigation page:
-
The "Number of users with access" filter shows which files and folders are open to a certain number of users. You can choose a number range to refine the results - for example, to see which files are accessible by 51-100 users.
-
The "Created Time", "Discovered Time", "Last Modified", and "Last Accessed" filters now allow you to create a custom date range instead of just selecting a pre-defined range of days. For example, you can look for files with a "Created Time" "older than 6 months", or with a "Last Modified" date within the "last 10 days".
-
The "File Path" filter now enables you to specify paths that you want to exclude from the filtered query results. If you enter paths to both include and exclude certain data, BlueXP classification finds all files in the included paths first, then it removes files from excluded paths, and then it displays the results.
BlueXP classification can identify and categorize files that contain the Japanese Individual Number (also known as My Number). This includes both the Personal and Corporate My Number. See all the types of personal data that BlueXP classification can identify in your data.