Skip to main content
NetApp Solutions


Contributors banum-netapp

In this validation, we used four servers as Network Shared Disk (NSD) servers to provide physical disks for GPFS. GPFS is created on top of the NSD disks to export them as NFS exports so that NFS clients can access them, as shown in the figure below. We used XCP to copy the data from GPFS- exported NFS to a NetApp NFS volume.

Error: Missing Graphic Image

GPFS essentials

The following node types are used in GPFS:

  • Admin node. Specifies an optional field containing a node name used by the administration commands to communicate between nodes. For example, the admin node could pass a network check to all other nodes in the cluster.

  • Quorum node. Determines whether a node is included in the pool of nodes from which quorum is derived. You need at least one node as a quorum node.

  • Manager Node. Indicates whether a node is part of the node pool from which file system managers and token managers can be selected. It is a good idea to define more than one node as a manager node. How many nodes you designate as manager depends on the workload and the number of GPFS server licenses you have. If you are running large parallel jobs, you might need more manager nodes than in a four-node cluster supporting a web application.

  • NSD Server. The server that prepares each physical disk for use with GPFS.

  • Protocol node. The node that shares GPFS data directly through any Secure Shell (SSH) protocol with the NFS. This node requires a GPFS server license.

List of operations for GPFS, NFS, and XCP

This section provides the list of operations that create GPFS, export GPFS as an NFS export, and transfer the data by using XCP.

Create GPFS

To create GPFS, complete the following steps:

  1. Download and install spectrum-scale data access for the Linux version on one of the servers.

  2. Install the prerequisite package (chef for example) in all nodes and disable Security-Enhanced Linux (SELinux) in all nodes.

  3. Set up the install node and add the admin node and the GPFS node to the cluster definition file.

  4. Add the manager node, the quorum node, the NSD servers, and the GPFS node.

  5. Add the GUI, admin, and GPFS nodes, and add an additional GUI server if required.

  6. Add another GPFS node and check the list of all nodes.

  7. Specify a cluster name, profile, remote shell binary, remote file copy binary, and port range to be set on all the GPFS nodes in the cluster definition file.

  8. View the GPFS configuration settings and add an additional admin node.

  9. Disable the data collection and upload the data package to the IBM Support Center.

  10. Enable NTP and precheck the configurations before install.

  11. Configure, create, and check the NSD disks.

  12. Create the GPFS.

  13. Mount the GPFS.

  14. Verify and provide the required permissions to the GPFS.

  15. Verify the GPFS read and write by running the dd command.

Export GPFS into NFS

To export the GPFS into NFS, complete the following steps:

  1. Export GPFS as NFS through the /etc/exports file.

  2. Install the required NFS server packages.

  3. Start the NFS service.

  4. List the files in the GPFS to validate the NFS client.

Configure NFS client

To configure the NFS client, complete the following steps:

  1. Export the GPFS as NFS through the /etc/exports file.

  2. Start the NFS client services.

  3. Mount the GPFS through the NFS protocol on the NFS client.

  4. Validate the list of GPFS files in the NFS mounted folder.

  5. Move the data from GPFS exported NFS to NetApp NFS by using XCP.

  6. Validate the GPFS files on the NFS client.