Recommended ESXi host and other ONTAP settings
NetApp has developed a set of optimal ESXi host settings for both NFS and block protocols. Specific guidance is also provided for multipathing and HBA timeout settings for proper behavior with ONTAP based on NetApp and VMware internal testing.
These values are easily set using ONTAP tools for VMware vSphere: From the ONTAP tools overview page, scroll down to the bottom and click apply recommended Settings in the ESXi Host compliance portlet.
Here are the recommended host settings for all currently supported versions of ONTAP.
Host Setting | NetApp Recommended Value | Reboot Required |
---|---|---|
ESXi Advanced Configuration |
||
VMFS3.HardwareAcceleratedLocking |
Keep default (1) |
No |
VMFS3.EnableBlockDelete |
Keep default (0), but can be changed if needed. |
No |
VMFS3.EnableVMFS6Unmap |
Keep default (1) |
No |
NFS Settings |
||
newSyncInterval |
If you are not using the vSphere CSI for Kubernetes, set per VMware KB 386364 |
No |
Net.TcpipHeapSize |
vSphere 6.0 or later, set to 32. |
Yes |
Net.TcpipHeapMax |
Set to 512MB for most vSphere 6.X releases. |
Yes |
NFS.MaxVolumes |
vSphere 6.0 or later, set to 256 |
No |
NFS41.MaxVolumes |
vSphere 6.0 or later, set to 256. |
No |
NFS.MaxQueueDepth1 |
vSphere 6.0 or later, set to 128 |
Yes |
NFS.HeartbeatMaxFailures |
Set to 10 for all NFS configurations |
No |
NFS.HeartbeatFrequency |
Set to 12 for all NFS configurations |
No |
NFS.HeartbeatTimeout |
Set to 5 for all NFS configurations. |
No |
SunRPC.MaxConnPerIP |
vSphere 7.0 to 8.0, set to 128. This setting is ignored in ESXi releases after 8.0. |
No |
FC/FCoE Settings |
||
Path selection policy |
Set to RR (round robin) when FC paths with ALUA are used. Set to FIXED for all other configurations. |
No |
Disk.QFullSampleSize |
Set to 32 for all configurations. |
No |
Disk.QFullThreshold |
Set to 8 for all configurations. |
No |
Emulex FC HBA timeouts |
Use the default value. |
No |
QLogic FC HBA timeouts |
Use the default value. |
No |
iSCSI Settings |
||
Path selection policy |
Set to RR (round robin) for all iSCSI paths. |
No |
Disk.QFullSampleSize |
Set to 32 for all configurations. |
No |
Disk.QFullThreshold |
Set to 8 for all configurations. |
No |
|
NFS advanced configuration option MaxQueueDepth may not work as intended when using VMware vSphere ESXi 7.0.1 and VMware vSphere ESXi 7.0.2. Reference VMware KB 86331 for more information. |
ONTAP tools also specify certain default settings when creating ONTAP FlexVol volumes and LUNs:
ONTAP Tool |
Default Setting |
Snapshot reserve (-percent-snapshot-space) |
0 |
Fractional reserve (-fractional-reserve) |
0 |
Access time update (-atime-update) |
False |
Minimum readahead (-min-readahead) |
False |
Scheduled snapshots |
None |
Storage efficiency |
Enabled |
Volume guarantee |
None (thin provisioned) |
Volume Autosize |
grow_shrink |
LUN space reservation |
Disabled |
LUN space allocation |
Enabled |
Multipath settings for performance
While not currently configured by available ONTAP tools, NetApp suggests these configuration options:
-
When using non-ASA systems in high-performance environments or when testing performance with a single LUN datastore, consider changing the load balance setting of the round-robin (VMW_PSP_RR) path selection policy (PSP) from the default IOPS setting of 1000 to a value of 1. See VMware KB 2069356 for more info.
-
In vSphere 6.7 Update 1, VMware introduced a new latency load balance mechanism for the Round Robin PSP. The latency option is now also available when using the HPP (High Performance Plugin) with NVMe namespaces, and with vSphere 8.0u2 and later, iSCSI and FCP connected LUNs. The new option considers I/O bandwidth and path latency when selecting the optimal path for I/O. NetApp recommends using the latency option in environments with non-equivalent path connectivity, such as cases with more network hops on one path than another, or when using a NetApp ASA system. See Change Default Parameters for Latency Round Robin for more information.
Additional documentation
For FCP and iSCSI with vSphere 7, more details can be found at Use VMware vSphere 7.x with ONTAP
For FCP and iSCSI with vSphere 8, more details can be found at Use VMware vSphere 8.x with ONTAP
For NVMe-oF with vSphere 7, more details can be found at For NVMe-oF, more details can be found at NVMe-oF Host Configuration for ESXi 7.x with ONTAP
For NVMe-oF with vSphere 8, more details can be found at For NVMe-oF, more details can be found at NVMe-oF Host Configuration for ESXi 8.x with ONTAP