Using Oracle Linux 7.9 with NetApp ONTAP
Installing the Linux Unified Host Utilities
The NetApp Linux Unified Host Utilities software package is available on the NetApp Support Site in a 32-bit and 64-bit .rpm file. If you do not know which file is right for your configuration, use the NetApp Interoperability Matrix Tool to verify which one you need.
Installing the Linux Unified Host Utilities is strongly recommended, but not mandatory. The utilities do not change any settings on your Linux host. The utilities improve management and assist NetApp customer support in gathering information about your configuration.
If you have a version of Linux Unified Host Utilities currently installed you should upgrade it or, you should remove it and use the following steps to install the latest version.
-
Download the 32-bit or 64-bit Linux Unified Host Utilities software package from the NetApp Support Site Site to your host.
-
Use the following command to install the software package:
rpm -ivh netapp_linux_unified_host_utilities-7-1.x86_64
|
You can use the configuration settings provided in this document to configure cloud clients connected to Cloud Volumes ONTAP and Amazon FSx for ONTAP. |
SAN Toolkit
The toolkit is installed automatically when you install the NetApp Host Utilities package. This kit provides the sanlun
utility, which helps you manage LUNs and HBAs. The sanlun
command returns information about the LUNs mapped to your host, multipathing, and information necessary to create initiator groups.
In the following example, the sanlun lun show
command returns LUN information.
# sanlun lun show all
Example output:
controller(7mode/E-Series)/ device host lun vserver(cDOT/FlashRay) lun-pathname filename adapter protocol size Product ------------------------------------------------------------------------- data_vserver /vol/vol1/lun1 /dev/sdb host16 FCP 120.0g cDOT data_vserver /vol/vol1/lun1 /dev/sdc host15 FCP 120.0g cDOT data_vserver /vol/vol2/lun2 /dev/sdd host16 FCP 120.0g cDOT data_vserver /vol/vol2/lun2 /dev/sde host15 FCP 120.0g cDOT
SAN Booting
If you decide to use SAN booting, it must be supported by your configuration. You can use the NetApp Interoperability Matrix Tool to verify that your OS, HBA, HBA firmware and the HBA boot BIOS, and ONTAP version are supported.
-
Map the SAN boot LUN to the host.
-
Verify that multiple paths are available.
Multiple paths become available after the host OS is up and running on the paths. -
Enable SAN booting in the server BIOS for the ports to which the SAN boot LUN is mapped.
For information on how to enable the HBA BIOS, see your vendor-specific documentation.
-
Reboot the host to verify that the boot is successful.
Multipathing
For Oracle Linux (OL) 7.9 the /etc/multipath.conf file must exist, but you do not need to make specific changes to the file. OL 7.9 is compiled with all settings required to recognize and correctly manage ONTAP LUNs.
You can use the multipath -ll
command to verify the settings for your ONTAP LUNs.
The following sections provide sample multipath outputs for a LUN mapped to non-ASA and ASA personas.
Non-ASA configuration
For non-ASA configurations, there should be two groups of paths with different priorities. The paths with the higher priorities are Active/Optimized, meaning they are serviced by the controller where the aggregate is located. The paths with the lower priorities are active but are non-optimized because they are served from a different controller. The non-optimized paths are only used when no optimized paths are available.
The following example displays the correct output for an ONTAP LUN with two Active/Optimized paths and two Active/Non-Optimized paths:
# multipath -ll 3600a098038303458772450714535415a dm-15 NETAPP ,LUN C-Mode size=40G features='4 queue_if_no_path pg_init_retries 50 retain_attached_hw_handle' hwhandler='1 alua' wp=rw |-+- policy='service-time 0' prio=50 status=active | |- 11:0:5:7 sdbg 67:160 active ready running | `- 12:0:13:7 sdlg 67:480 active ready running |-+- policy='service-time 0' prio=10 status=enabled |- 11:0:8:7 sdck 69:128 active ready running |- 11:0:12:7 sddy 128:0 active ready running
|
Do not use an excessive number of paths to a single LUN. No more than four paths should be required. More than eight paths might cause path issues during storage failures. |
All SAN Array configurations
In ASA configurations, all paths to a given LUN are active and optimized. This improves performance by serving I/O operations through all paths at the same time.
The following example displays the correct output for an ONTAP LUN:
# multipath -ll 3600a0980383143596f5d514b65507846 dm-7 NETAPP ,LUN C-Mode size=10G features='4 queue_if_no_path pg_init_retries 50 retain_attached_hw_handle' hwhandler='1 alua' wp=rw |-+- policy='service-time 0' prio=50 status=active |- 11:0:7:6 sdbz 68:208 active ready running |- 11:0:11:6 sddn 71:80 active ready running |- 11:0:15:6 sdfb 129:208 active ready running |- 12:0:1:6 sdgp 132:80 active ready running
|
Do not use an excessive number of paths to a single LUN. No more than four paths should be required. More than eight paths might cause path issues during storage failures. |
Recommended Settings
The Oracle Linux 7.9 OS is compiled to recognize ONTAP LUNs and automatically set all configuration parameters correctly.
The multipath.conf
file must exist for the multipath daemon to start, but you can create an empty, zero-byte file by using the following command:
touch /etc/multipath.conf
The first time you create this file, you might need to enable and start the multipath services:
# systemctl enable multipathd # systemctl start multipathd
-
There is no requirement to add anything directly to the
multipath.conf
file, unless you have devices that you do not want to be managed by multipath or you have existing settings that override defaults. -
To exclude unwanted devices, add the following syntax to the
multipath.conf
file .blacklist { wwid <DevId> devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*" devnode "^hd[a-z]" devnode "^cciss.*" }
Replace the
<DevId>
with theWWID
string of the device you want to exclude.
In this example, sda
is the local SCSI disk that we need to add to the blacklist.
-
Run the following command to determine the WWID:
# /lib/udev/scsi_id -gud /dev/sda 360030057024d0730239134810c0cb833
-
Add the
WWID
to the blacklist stanza in/etc/multipath.conf
:blacklist { wwid 360030057024d0730239134810c0cb833 devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*" devnode "^hd[a-z]" devnode "^cciss.*" }
You should always check your /etc/multipath.conf
file for legacy settings, especially in the defaults section, that might be overriding the default settings.
The following table demonstrates the critical multipathd
parameters for ONTAP LUNs and the required values. If a host is connected to LUNs from other vendors and any of these parameters are overridden, they will need to be corrected by later stanzas in the multipath.conf
file that apply specifically to ONTAP LUNs. If this is not done, the ONTAP LUNs might not work as expected. These defaults should only be overridden in consultation with NetApp and/or an OS vendor and only when the impact is fully understood.
Parameter | Setting |
---|---|
detect_prio |
yes |
dev_loss_tmo |
"infinity" |
failback |
immediate |
fast_io_fail_tmo |
5 |
features |
"3 queue_if_no_path pg_init_retries 50" |
flush_on_last_del |
"yes" |
hardware_handler |
"0" |
path_checker |
"tur" |
path_grouping_policy |
"group_by_prio" |
path_selector |
"service-time 0" |
polling_interval |
5 |
prio |
"ontap" |
product |
LUN.* |
retain_attached_hw_handler |
yes |
rr_weight |
"uniform" |
user_friendly_names |
no |
vendor |
NETAPP |
The following example shows how to correct an overridden default. In this case, the multipath.conf
file defines values for path_checker
and detect_prio
that are not compatible with ONTAP LUNs. If they cannot be removed because of other SAN arrays still attached to the host, these parameters can be corrected specifically for ONTAP LUNs with a device stanza.
defaults { path_checker readsector0 detect_prio no } devices { device { vendor "NETAPP " product "LUN.*" path_checker tur detect_prio yes } }
|
To configure Oracle Linux 7.9 RedHat Enterprise Kernel (RHCK), use the recommended settings for Red Hat Enterprise Linux (RHEL) 7.9. |
Known Problems and Limitations
NetApp Bug ID | Title | Description | Bugzilla ID |
---|---|---|---|
1440718 |
If you unmap or map a LUN without performing a SCSI rescan, it might lead to data corruption on the host. |
When you set the 'disable_changed_wwids' multipath configuration parameter to YES, it disables access to the path device in the event of a WWID change. Multipath will disable access to the path device until the WWID of the path is restored to the WWID of the multipath device. To learn more, see NetApp Knowledge Base: The filesystem corruption on iSCSI LUN on the Oracle Linux 7. |
N/A |
I/O delays observed during storage failover with Emulex LPe32002(32G) host |
I/O operations might fail to continue through existing active paths during storage failover operations on Oracle Linux 7.8 kernel (5.4.17-2011.1.2.el8uek.x86_64) with QLogic LPe32002 32G HBA. |