IBM United States
Software Announcement 200-453
December 19, 2000

General Parallel File System V1R4 Now Supported on Clusters of RS/6000 Workstations and Servers Running HACMP

 ENUS200-453.PDF (34KB)


At a Glance

General Parallel File System (GPFS) V1R4 for AIX extends the benefits of GPFS to the cluster environment, and provides new support for directly-attached SSA disks.

GPFS is a fast, highly available, and highly scalable, shared file system for clusters of IBM's UNIX® systems; both IBM e(logo)server pSeries and IBM RS/6000 workstations and/or servers running HACMP/ES.

For ordering, contact:

Your IBM representative, an IBM Business Partner, or IBM Americas Call Centers at 800-IBM-CALL (Reference: RE001).

Overview

General Parallel File System for AIX® is now available on your clusters of RS/6000® servers and workstations. This will enable you to move data quickly into and out of the node clusters, with high availability among nodes.

GPFS V1R4 provides the capability to share data across Serial Storage Architecture (SSA) shared disks or disk arrays directly attached to multiple RS/6000 workstations or servers running AIX V4R3.3 and HACMP/ES V4R4. In this environment, a GPFS nodeset consists of up to eight nodes.

In addition, GPFS now provides the capability to operate in an SP™ environment with directly attached disks. Here, SSA shared disks or disk arrays are directly attached to each node in the nodeset, which consists of up to eight nodes.

Note: There is no SP switch requirement for GPFS in this environment, however, HACMP/ES is a requirement in this case.

Additional enhancements to both the SP and cluster environments include dynamic addition of nodes to a GPFS nodeset when using TCP/IP as the GPFS communications protocol, and support for a single-node quorum in a two-node nodeset.

GPFS V1R4 does not support running with the SP Switch2 at availability. Refer to the Statement of Direction .

Key Prerequisites

For RS/6000 Clusters

  • AIX V4R3.3
  • High Availability Cluster Multi-Processing/Enhanced Scalability V4R4

For RS/6000 SP Systems with a Switch

  • AIX V4R3.3
  • Parallel System Support Programs V3R2

For RS/6000 SP Systems without a Switch

  • AIX V4R3.3
  • High Availability Cluster Multi-Processing/Enhanced Scalability V4R4

Planned Availability Date

December 22, 2000

Description

General Parallel File System (GPFS) provides file system services to parallel and serial applications running on the AIX Operating Environment. GPFS allows parallel applications simultaneous access to the same or different files from any node in the GPFS nodeset while managing a high level of control over all file system operations. A nodeset is a group of nodes that all run the same level of GPFS and operate on the same file system. Serial applications are dynamically assigned to processors based on availability and achieve high performance access to their data from wherever they run.

GPFS provides the capability to operate in:

  • An SP switch environment, building on the shared disk concepts of the IBM Virtual Shared Disk and Recoverable Virtual Shared Disk components of the Parallel System Support Programs (PSSP)
  • An SP non-switch environment with directly attached Serial Storage Architecture (SSA) disks
  • A non-SP, HACMP cluster environment

In a switch environment, a nodeset consists of a set of SP nodes that provide access to GPFS file systems. Here, GPFS takes advantage of the SP Switch speed and uses it to accelerate parallel file operations that would overload serial file system management.

In a non-switch environment, a GPFS nodeset consists of up to eight RS/6000 workstations, servers, or SP nodes with uniform disk access, thus enabling concurrent data sharing. In this environment, SSA shared disks or disk arrays are directly attached to each node in the nodeset.

In both SP environments, there can be multiple GPFS nodesets per SP partition, however, a GPFS file system may only be accessed from a single nodeset.

A non-SP, GPFS cluster is a group of RS/6000 workstations or servers. This cluster is a subset of a predefined HACMP/ES cluster. In this environment, a GPFS nodeset consists of up to eight RS/6000 servers and/or workstations with uniform disk access enabling concurrent data sharing. After a GPFS nodeset has been configured, GPFS obtains the necessary configuration data from the HACMP/ES global Object Data Manager (ODM).

The following commands have been added to support this new environment:

  • mmcrcluster
  • mmchcluster
  • mmaddcluster
  • mmdelcluster
  • mmlscluster

Additional functions are available in all GPFS environments:

  • Nodes can be added dynamically to a nodeset via the mmaddnode command when the communication protocol is TCP/IP and a quorum exists for the nodeset.
  • Support for single-node quorum in a two-node nodeset. In a two-node nodeset use of the single-node quorum algorithm allows the GPFS daemon to continue operating in the event only one node is available. Use of this quorum algorithm is not valid if more than two nodes have been defined in the nodeset.

Note: The maximum number of supported nodes in a GPFS cluster is eight due to the limitations of the SSA adapter.

For additional information on GPFS function and capabilities, refer to Software Announcement 200-223 , dated July 18, 2000.

Euro Currency

This program is not impacted by euro currency.

Product Positioning

For IBM e(logo)server pSeries scientific and technical computing users, GPFS provides a single, global file system for multiple nodes, workstations, and servers, and is ideal for high performance parallel file transfer and parallel I/O to single or multiple files. For pSeries Business Intelligence usage, GPFS provides parallel enablement for applications such as SAS, improves performance of database loading utilities, and supports parallel operation of online analysis processing using tools not enabled for parallel use. For pSeries server consolidation use, GPFS provides a fast, global file system for applications sharing data within the cluster.

Users of SP systems who want to use GPFS with the SP Switch2 should use GPFS Release 3 until GPFS Release 4 is updated with SP Switch2 support. Refer to Statement of Direction.

GPFS is also ideal for users of HACMP/ES clusters who need a global UNIX file system.

Statement of Direction

General Parallel File System V1R4 Support of the SP Switch2

As of this announcement, GPFS V1R4 does not support running with the SP Switch2.

In order to keep the pSeries software products at the latest switch technology, IBM intends to provide support for the SP Switch2 on SP Systems running GPFS V1R4. It is expected that this support will be provided in the first half of 2001.

All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objective only.

Reference Information

Refer to

  • Software Announcement 200-223 , dated July 18, 2000
  • Software Announcement 200-183 , dated June 20, 2000

Trademarks

 
pSeries, SP, and the e-business logo are trademarks of International Business Machines Corporation in the United States or other countries or both.
 
AIX and RS/6000 are registered trademarks of International Business Machines Corporation in the United States or other countries or both.
 
UNIX is a registered trademark in the United States and other countries exclusively through X/Open Company Limited.
 
Other company, product, and service names may be trademarks or service marks of others.

Offering Information

Product information will be available on day of announcement through Offering Information (OITOOL) at:

Publications

No hardcopy publications are shipped with this program.

Displayable Softcopy Publications

The following publications are offered in displayable softcopy form:

  • IBM General Parallel File System for AIX®: Administration and Programming Reference
  • IBM General Parallel File System for AIX: Concepts, Planning, and Installation Guide
  • IBM General Parallel File System for AIX: Data Management API Guide
  • IBM General Parallel File System for AIX: Problem Determination Guide

These displayable manuals are part of the basic machine-readable material and are viewable in PDF and HTML formats. They are also available on the RS/6000® Web site at general availability of the product.

Terms and conditions for use of the machine-readable files are shipped with the files.

Technical Information

Specified Operating Environment

Hardware Requirements

Cluster Environment:

  • An existing system cluster from which to define a GPFS cluster
  • Up to 1024 external SSA shared disks or disk arrays with the correct SSA adapters
  • An IP network of sufficient bandwidth (minimum of 100 Mb per second) for GPFS communications (token sets)

SP™ Environment:

  • RS/6000 SP
  • Enough disks to contain the file system

Additional hardware is required to operate in a switch environment:

  • SP Switch
  • SP Switch MX adapter or MX2 adapter to exploit LAPI as the communication protocol

Additional hardware is required to operate in a direct-attached disk environment:

  • Up to 1024 external SSA shared disks or disk arrays with the correct number of SSA adapters
  • An IP network of sufficient bandwidth (minimum of 100 Mb per second) for GPFS communications (token sets)

Note: This release of GPFS is not supported with the SP Switch2.

Software Requirements

  • AIX V4R3.3, or later modification (5765-C34) with APAR IY12051 (10/2000 AIX Update CD)
  • DFS for AIX, V3R1, or later modification level (5630-A20) to exploit DFS Interoperability

    On Clusters of RS/6000 workstations and/or servers and on the RS/6000 SP without a Switch:

  • High Availability Cluster Multi-Processing/Enhanced Scalability V4R4, or later modification level (5765-E54) with APAR IY12984

    On RS/6000 SP Systems with a Switch:

  • Parallel System Support Programs (PSSP) for AIX, V3R2, or later modification level (5765-D51)
  • The IBM Virtual Shared Disk image and Recoverable Virtual Shared Disk image of PSSP

Compatibility: File systems created under a previous release of GPFS may not be used in a GPFS cluster environment.

Limitations: There can be only one GPFS cluster per HACMP/ES cluster. V1R4 does not support the SP Switch2. V1R4 supports a maximum of eight nodes when operating (1) in the cluster environment and (2) with directly attached disks in the SP environment. V1R4 does not support LAPI communication as the GPFS communication protocol in the cluster environment.

Planning Information

Planning for your disk subsystem in a GPFS cluster environment includes determining:

  • Sufficient disks to meet the expected I/O load
  • Sufficient connectivity (adapters and buses) between disks

Customer Responsibilities

Coexistence Guidelines in Cluster Environment

  • A GPFS file system may only be accessed from a single HACMP/ES cluster.
  • All nodes in a GPFS nodeset must be defined to be in the GPFS cluster.

Installability: The default communications protocol for communication between nodes in a GPFS nodeset is TCP/IP. This is the only supported communication protocol in a cluster (non-SP switch) environment.

Packaging: IBM General Parallel File System for AIX is distributed in one package with:

  • IBM International Program License Agreement in multilanguage booklet and its License Information (LI)
  • Proof of Entitlement (PoE)
  • CD-ROM (LCD4-3034)

Hardcopy publications will not be shipped. All publications are available in softcopy only on the product media.

Security, Auditability, and Control

General Parallel File System uses the security and auditability features of the AIX Version 4 Operating System and the RS/6000 SP.

The customer is responsible for evaluation, selection, and implementation of security features, administrative procedures, and appropriate controls in application systems and communication facilities.

Ordering Information

GPFS V1R4 has one charge unit based on installations. One-time charge (OTC) feature numbers are available in variable order quantities based on the number of nodes in your RS/6000 SP system, or the number of workstations or servers in your cluster, that will be running GPFS.

General Parallel File System V1R4 is available for those customers currently licensed for GPFS V1R1, GPFS V1R2, or GPFS V1R3. Upgrades may be acquired up to the current level of use authorized for the qualifying programs.

Program Name: General Parallel File System for AIX, V1R4.

New users of General Parallel File System V1R4 should specify Type 5765, Model B95, asset feature number 9001, and the feature number equal to the total number of desired licenses to be installed times the quantity of installs. For example, if ordering GPFS for 12 nodes, order the feature code for Order Type Description 11 to 50 Installs with a quantity equal to 12.

                                 OTC         Medium
Order Type                       Feature     Feature
Description                      Number      Number       Medium
 
Machine Type/Model:  5765-B95
 
 1 to 5 Installs                 3001        5244         CD-ROM
 6 to 10 Installs                3002
11 to 50 Installs                3003
51 or More Installs              3004

GPFS V1R3 will remain orderable until December 31, 2001. Refer to Software Announcement 200-223 , dated July 18, 2000, for ordering information.

Upgrades

Current licensees of General Parallel File System V1R1 or V1R2 who wish to upgrade to GPFS V1R4 should specify Type 5765 and Model B95 and order an upgrade equal to the current level of use authorized. For example, if currently licensed to use GPFS V1R1 or V1R2 on 8 nodes, order the feature code for Order Type Description 6 to 10 Installs with a quantity equal to 8.

                                 OTC         Medium
Order Type                       Feature     Feature
Description                      Number      Number       Medium
 
Machine Type/Model:  5765-B95
 
V1R1 or V1R2 to V1R4 Upgrade
 
 1 to 5 Installs                 3005        5244         CD-ROM
 6 to 10 Installs                3006
11 to 50 Installs                3007
51 or More Installs              3008

Current licensees of General Parallel File System V1R3 who wish to upgrade to GPFS V1R4 should specify Type 5765 and Model B95 and order an upgrade equal to the current level of use authorized. For example, if currently licensed to use GPFS V1R3 on 8 nodes, order the feature code listed below with a quantity equal to 8. If currently licensed to use GPFS V1R3 on 24 nodes, order the feature code listed below with a quantity equal to 24.

                                 OTC         Medium
Order Type                       Feature     Feature
Description                      Number      Number       Medium
 
Machine Type/Model:  5765-B95
 
V1R3 to V1R4 Upgrade                         5244         CD-ROM
 
 1 to 5 Installs                 1314
 6 to 10 Installs                1315
11 to 50 Installs                1316
51 or More Installs              1317

Software Subscription for AIX

Customers who purchased protection for GPFS V1R3 for AIX, under Software Subscription for AIX (5692-SS0) are entitled to receive V1R4 at no charge. Eligible customers should add CD media supply feature number 0572 under their existing 5692-SS0 record. GPFS V1R4 for AIX is offered on CD-ROM media only.

Note: SSO customers who wish to remain with GPFS V1R3 may do so and will still be eligible for follow on releases. It is not necessary to move to GPFS V1R4.

Planned Availability for Software Subscription: December 22, 2000

                                                           CD-ROM
                                                           Media
                                   5692-SS0 Eligible       Supply
Description                        Billing Features(1)     Feature
 
From 5765-B95 GPFS V1R3
 to 5765-B95 GPFS V1R4                                     0572
 
 1 to 5 Installs                   6484, 6486, 6488,
 6 to 10 Installs                  6485, 6487, 6489,
11 to 50 Installs                  6490, 6492, 6493,
51 or More Installs                6491, 6494, 6495

1
Denotes billing features that customer must have previously purchased in order to receive this upgrade at no charge. The billing features must currently be on a customer's record as proof of eligibility.

New Licensees for Future Upgrades of SSO

To register for future upgrades of products from Software Subscription for AIX for programs described in this announcement, specify 5692-SSO and feature number 9001 for asset registration, and the applicable billing features with quantity equal to the number of licenses in the Software Subscription for AIX contract. Use the tables below as reference to select the appropriate billing feature.

                                                       Annual
                                   Order               Support
                                   Type                Billing
Description                        Number              Feature
 
GPFS Version 1.4 for AIX           5692-SSO
 (5765-B95)
 1 to 5 Installs                                       6680
 6 to 10 Installs                                      6681
11 to 50 Installs                                      6682
51 or More Installs                                    6683

Withdrawal of Software Subscription for AIX Feature Numbers: None

Software Subscription feature codes for GPFS V1R3 will not be withdrawn with this announcement because GPFS V1R3 is still orderable.

Customization Options for 5765-B95: Select the appropriate feature numbers to customize your order with delivery options desired. These features can be specified on the initial or MES orders.

                                                    Feature
Description                                         Number
 
Initial Shipments
 
Serial Number Only (suppresses shipment             3444
 of media and documentation)
 
Update Shipments
 
Suppress Updates (suppresses update                 3482
 shipment of media and documentation)
 
Expedite Shipments
 
Local IBM Office Expedite                           3445
 (for IBM use only)
 
Customer Expedite Process Charge                    3446
 ($30 charge for each product)

Expedite shipments will be processed to receive 72-hour delivery from the time IBM Software Delivery and Fulfillment (SDF) receives the order. SDF will then ship the order via overnight air transportation.

Terms and Conditions

Licensing: IBM International Program License Agreement. PoEs are required for all authorized use.

Limited Warranty Applies: Yes

Program Services

  • GPFS Version 1.4 available until December 31, 2002
  • GPFS Version 1.3 available until December 31, 2002
  • GPFS Version 1.2 available until December 31, 2001
  • GPFS Version 1.1 available until January 31, 2001

Money-Back Guarantee: Two-month, money-back guarantee

Copy and Use on Home/Portable Computer: No

Volume Orders (IVO): Yes, contact your IBM representative.

Passport Advantage Applies: No

Passport Advantage Subscription Applies: No

Support Line: Yes

AIX/UNIX® Upgrade Protection Applies: Yes

Entitled Upgrade for Current AIX/UNIX Upgrade Protection Licensees: Yes

AS/400® Software Subscription Applies: No

Variable Charges Apply: No

Educational Allowance Available: Yes, 15% education allowance applies to qualified education institution customers.

Prices

Contact your IBM representative for charges information for this announcement.

Order Now

 Use Priority/Reference Code: RE001
 
 Phone:     800-IBM-CALL
 Fax:       800-2IBM-FAX
 Internet:  ibm_direct@us.ibm.com
 Mail:      IBM Atlanta Sales Center
            Dept. RE001
            P.O. Box 2690
            Atlanta, GA  30301-2690

You can also contact your local IBM Business Partner or IBM representative. To identify them, call 800-IBM-4YOU.

Note: Shipments will begin after the planned availability date.

Trademarks

 
SP is a trademark of International Business Machines Corporation in the United States or other countries or both.
 
AIX, RS/6000, and AS/400 are registered trademarks of International Business Machines Corporation in the United States or other countries or both.
 
UNIX is a registered trademark in the United States and other countries exclusively through X/Open Company Limited.
 
Other company, product, and service names may be trademarks or service marks of others.