Skip to main content
ONTAP Technical Reports

Storage efficiency

Contributors whyistheinternetbroken

NetApp AFX changes deduplication boundaries and, beginning with ONTAP 9.19.1, supports a global deduplication domain across the Storage Availability Zone.

Deduplication domains

Deduplication allows a storage system to find duplicate blocks in its file system and then create pointers to a single block to reduce the total amount of used capacity. In unified ONTAP, deduplication follows a specific boundary for what blocks can be reduced. Those boundaries depend on the type of deduplication in use. In general:

  • Volume-based deduplication → Volume boundary

  • Cross-volume deduplication → Aggregate boundary

Unified ONTAP deduplication domains

Image

Because NetApp AFX removes physical aggregates and moves capacity management to the new Storage Availability Zone, the deduplication domain boundaries also change. In AFX, the deduplication domain is at the volume-level (like unified ONTAP) and the node (rather than the aggregate) prior to 9.19.1.

Starting in ONTAP 9.19.1, AFX supports a global deduplication domain at the Storage Availability Zone level, so all duplicated blocks in the cluster storage pool are treated the same.

NetApp AFX – Global deduplication domain (ONTAP 9.19.1)

Image

The table below compares capacity behaviors for duplicated data in different scenarios. As file copies span nodes and aggregates (and thus, deduplication domains) in unified ONTAP, space savings get reduced. In AFX prior to 9.19.1, the same happens when copies span nodes. Starting in 9.19.1, global deduplication applies the same savings across the Storage Availability Zone.

Deduplication behaviors for identical 10GB files – unified ONTAP and NetApp AFX

Scenario Unified ONTAP AFX 9.18.1 AFX 9.19.1

Four copies of same 10GB file, same volume (volume deduplication)

10GB

10GB

10GB

Four copies of same 10GB file, different volumes, same aggregate (unified ONTAP) or same node (AFX); cross-volume deduplication enabled

10GB

10GB

10GB

Four copies of same 10GB file, 4 different volumes, 4 different aggregates (unified ONTAP) or 4 different nodes (AFX); cross-volume deduplication enabled

40GB

40GB

10GB

Previous: RAID changes

Next: ONTAP feature support changes