IBM United States
Software Announcement 203-270
October 14, 2003

IBM Parallel Environment V4.1 enhanced for AIX 5L 5.2

 ENUS203-270.PDF (40KB)


At a glance

Parallel Environment V4.1 contains functional enhancements, including:

  • Support of the IBM High Performance Switch (HPS).
  • Message Passing Interface (MPI) is restructured to use Low-level Application Programming Interface (LAPI) as its transport protocol.
  • MPI Collective Communication performance enhancements.
  • Cluster-based security support.

For ordering, contact:

Your IBM representative, an IBM Business Partner, or the Americas Call Centers at 800-IBM-CALL (Reference: RE001).

Overview

This release of IBM Parallel Environment for AIX® contains functional enhancements for high performance computing customers whose parallel applications use the industry-standard Message Passing Interface (MPI). MPI is a message passing library specification which was developed by a group of industry, academic, and government experts. Today, it serves as a common standard for developing parallel message passing applications which run a variety of computer systems. IBM's implementation of MPI uses a special LAPI designed to maximize parallel application performance on clusters made up of POWER4™ servers running AIX 5L. The new release, Parallel Environment V4.1, includes the following enhancements:

  • Parallel Environment now runs on the new IBM eServer pSeries® 655 and 690 servers and High Performance Switch (HPS) with AIX 5.2, and can coexist in clusters managed by Cluster Systems Management (CSM). Parallel Environment continues to run on selected pSeries (RS/6000® SP™) switches with AIX 5L, V5.2 and Parallel System Support Programs (PSSP) 3.5.
  • MPI is enhanced to use LAPI as the transport protocol.
    • The MPI and LAPI APIs can be used in a single application either sharing one LAPI instance or with distinct LAPI instances.
    • The use of LAPI as a common transport improves scalability by reducing the memory requirements for large MPI jobs.
    • MPI Collective Communications performance is enhanced for several collective communications operations when there are multiple tasks per node.
  • LAPI has been repackaged as an AIX fileset.
  • Threaded library support only, with binary compatibility for signal (non-threaded) library applications.
  • Electronic licensing.
  • Cluster-based security support.
  • Xprofiler is now part of AIX.
  • A new library is to be used when converting MPI trace files to the slog2 file format that is used by the latest version of Jumpshot, an MPI trace viewer program available from Argonne National Laboratory.
  • Statistics collection and printing enhancements.
  • Co-scheduler for parallel task scheduling.

Key prerequisites

  • AIX 5L 5.2.0 operating system, or later, with service
  • SP systems and PSSP: PSSP 3.5, or later, with service

Planned availability dates

  • October 31, 2003: Parallel Environment V4.1
  • December 19, 2003: Parallel Environment V4.1 running with PSSP V3.5 on AIX 5.2

Description

This release of IBM Parallel Environment for AIX contains the following enhancements: IBM eServer pSeries High Performance Switch

  • Parallel Environment now operates with the new pSeries High Performance Switch using Low Level Application Interface (LAPI) to optimize Message Passing Interface (MPI) performance over the switch in User Space.

Parallel System Support Programs (PSSP), SP Switch, and SP Switch2

  • This version of Parallel Environment also operates with the SP Switch and SP Switch2 on selected node types of the RS/6000 SP or Cluster 1600, with support provided by PSSP.
  • A parallel job that uses both MPI and LAPI may specify shared access to the User Space communication subsystem. This allows more efficient use of the processor and adapter resources on the SP Switch and SP Switch2.
MPI and LAPI
  • MPI now uses LAPI as the underlying transport. This provides resource sharing, improved memory scalability for large parallel jobs, and access to optimized performance support for the pSeries High Performance Switch, the SP Switch, and the SP Switch2.
  • MPI has enhanced the performance of several collective communication operations when multiple tasks are running on the same SMP node.
  • LAPI has been repackaged as an AIX fileset.
Library support
  • Threaded library support only, with binary compatibility for signal (non-threaded) library applications.
Security and usability
  • Electronic licensing
  • Cluster-based security support
  • Statistics collection and printing enhancements
  • Co-scheduler for parallel task scheduling
Functional changes
  • MPL is no longer supported.
  • Xprofiler is now part of AIX.
  • A new library is used when converting MPI trace files to the slog2 file format that is used by the latest version of Jumpshot, an MPI trace viewer program available from Argonne National Laboratory.
  • Program Marker Array has been removed and is no longer supported.

Product positioning

Parallel Environment is a must for high-performance cluster customers who demand effective tools for developing, debugging, analyzing, tuning, and running parallel C/C++ and Fortran applications which use the industry-standard MPI. It is designed to ease application porting and development, and to maximize application performance on pSeries clusters.

Trademarks

 
POWER4 and SP are trademarks of International Business Machines Corporation in the United States or other countries or both.
 
The e-business logo, AIX, pSeries, and RS/6000 are registered trademarks of International Business Machines Corporation in the United States or other countries or both.
 
Other company, product, and service names may be trademarks or service marks of others.

Offering information

Product information will be available through the Offering Information Web site at:

Publications

The Publications Center is a worldwide central repository for IBM product publications and marketing material with a catalog of 70,000 items. Extensive search facilities are provided. Payment options for orders are via credit card or customer number. A large number of publications are available online in various file formats, and they can all be downloaded free of charge.

The IBM Publications Notification System

The Publications Notification System (PNS) enables subscribers to set up profiles of interest by order number/product number. PNS subscribers automatically receive notifications by e-mail of all new publications defined in their profiles. These may then be downloaded via the Publications Center.

The following publications are available from the Web in PDF formats from:

And, the IBM eServer Cluster Information Center at:

                                                  Document
Title                                             number
 
IBM Parallel Environment for AIX(R):
 Installation                                     GA22-7943
 
IBM Parallel Environment for AIX:
 Messages                                         GA22-7944
 
IBM Parallel Environment for AIX:
 MPI Programming Guide                            SA22-7945
 
IBM Parallel Environment for AIX:
 MPI Subroutine Reference                         SA22-7946
 
IBM Parallel Environment for AIX:
 Hitchhikers Guide                                SA22-7947
 
IBM Parallel Environment for AIX:
 Operation and Use Vol  1                         SA22-7948
 
IBM Parallel Environment for AIX:
 Operation and Use Vol  2                         SA22-7949

Manual pages for public code

On the same medium as the Parallel Environment product code, IBM ships Parallel Environment manual pages (manpages). In order to use these publications you must first install the ppe.man fileset.

Technical information

Specified operating environment

Hardware requirements

Parallel Environment V4.1 is supported in the following environments:

  • Clustered IBM eServer pSeries® p655 and p690 servers interconnected with the pSeries High Performance Switch, running the AIX 5.2 64-bit kernel.
  • Clustered pSeries POWER4™ servers attached to a Cluster 1600 interconnected with the SP™ Switch2, running the AIX 5.2 64-bit kernel.
  • Cluster 1600 (RS/6000® SP) systems consisting of any combination of:
    • 375 MHz POWER3™ processors interconnected with the SP Switch2
    • 333 MHz POWER3 processors interconnected with the SP Switch
    • 375 MHz POWER3 processors interconnected with the SP Switch
    • 333 MHz POWER3 processors interconnected with the SP Switch2

    The AIX 5.2 64-bit kernel is required.

  • Clustered RS/6000 workstations, POWER3 and/or POWER4 servers, either standalone or connected via a LAN supporting IP, running AIX 5.2 32-bit OR 64-bit kernel.
  • Cluster 1600 (RS/6000 SP) processor models not specifically mentioned above may run, but are not formally supported.

Software requirements

  • AIX 5L V5.2 (5765-E62) with the 5200-02 Recommended Maintenance package, or later.
  • PSSP V3.5 (5765-D51), with APAR IY49007 (PSSP 3.5 support for Cluster software products running AIX 5.2), or later, when running on an SP system. PSSP is not required when Parallel Environment is used on a standalone or cluster of pSeries or RS/6000 workstations and/or servers.
  • If User Space batch or interactive jobs are to be submitted under Parallel Environment, then LoadLeveler® V3.2 (5765-E69) is required. Minimal support for a customer-supplied scheduler is provided via sample code.
  • XL Fortran for AIX V8.1 (5765-F70), or later, if Fortran programs are to be run.
  • VisualAge® C++ Professional for AIX, V6.0, (5765-F56), or later, if C or C++ programs are to be run.

    IBM C for AIX V6 is now part of VisualAge C++ Professional for AIX, V6.0, and is also available as a separate file set.

Compatibility: IBM Parallel Environment for AIX V4.1 is a functional enhancement of IBM Parallel Environment for AIX V3.2.

MPI programs compiled with prior versions of Parallel Environment using shared library support are binary compatible. That is, executables built using Parallel Environment V2.4, V3.1, and V3.2 will run correctly with Parallel Environment V4.1.

Applications compiled with XL High Performance Fortran for AIX, V1.3.1 (5765-612) will run correctly, but will use the threaded MPI library.

Parallel ESSL for AIX, V3.1 (5765-F84) works with Parallel Environment for AIX, V4.1.

Application programs containing Message Passing Library (MPL) function calls will need to be replaced with programs using MPI or LAPI calls.

When Parallel Environment V4.1 is run with PSSP, the AIX 64-bit kernel is required. When Parallel Environment V4.1 operates on the pSeries High Performance Switch, the AIX 64-bit kernel is required. Standalone servers (which will use shared memory for inter-task communication) and IP-connected servers may use either the 32-bit or 64-bit kernel.

Limitations: Parallel Environment V4.1 runs with PSSP V3.5, fulfilling the following Statement of Direction. Refer to Software Announcement 203-118 , dated May 6, 2003.

When Parallel Environment is used with the SP system, Parallel Environment jobs can only run in a system partition that has all of its nodes at the same PSSP level.

LAPI is distributed as part of AIX V5.2, and later. When Parallel Environment is used in conjunction with PSSP, it uses a version of LAPI shipped with PSSP.

Parallel Environment V4.1 does not support the following processor nodes as part of a Cluster 1600 (RS/6000 SP).

  • POWER3 200 MHz SMP High nodes (2054)
  • POWER3 SMP Thin nodes (2052)
  • POWER3 SMP Wide nodes (2053)
  • POWER2™ microchannel architecture processors (these are not supported by AIX 5.2)
  • PowerPC 332 MHz SMP Thin nodes (2050)
  • POWER3 servers such as S80, M80

SP nodes are only supported when running the 64-bit kernel. Standalone servers are supported both with the 32-bit and 64-bit kernel.

Program Marker Array has been removed.

Parallel utility subroutine MP_QUERYINTRDELAY, mpc_queryintrdelay is no longer supported. When invoked, it returns a value of zero.

User-written SIGIO handlers are no longer invoked when a packet arrives.

MPL is no longer supported.

Performance considerations: Parallel Environment and the MPI library are intended for use in High Performance Computing (HPC) applications which can exploit multiple processors to achieve parallelism, using message passing to pass data among the processors where necessary. In such environments, performance of the interconnecting network is important. This version of Parallel Environment exploits the features of the pSeries High Performance Switch to achieve high bandwidth and low latency for messages between clustered pSeries servers. The basic technique employed, called "User Space", reserves a portion of the High Performance Switch adapter for use by a user process, which then can read/write message data directly onto the interconnect without having to copy the data from/to the AIX kernel.

The User Space support is provided by Low-level API (LAPI), which is optimized for the features of the High Performance Switch, and supports both "packet mode" and "bulk transfer mode" data transfers with reliable delivery. Maximum bandwidth is achieved when the bulk transfer mode is used in conjunction with large contiguous messages and the large page option of AIX.

For additional performance, shared memory may be used for point-to-point passing of data among processors within an SMP without changes to the application. In 64-bit mode, there are shared memory based enhancements to certain collective communication routines.

For convenience in developing applications, the user may select UDP/IP as the packet transport rather than User Space. This is done via a run-time specification, and is transparent to the application. Performance does not match User Space but the application under development ties up fewer dedicated resources.

Large parallel jobs are often constrained by the amount of memory available to a process. This version of Parallel Environment uses less memory for large parallel jobs than prior versions, and may improve performance by allowing a large portion of the problem data space to be maintained in real memory.

This announcement satisfies or partially satisfies four requirements from one or more of the worldwide user group communities. Groups include Australasian SHARE/GUIDE (ASG), COMMON, COMMON Europe, GUIDE International, G.U.I.D.E. Europe, Japan GUIDE/SHARE (JGS), Guide Latin American (LAG), SHARE EUROPE, SP-XXL, and SHARE Incorporated. Requirements satisfied include:

  1. MPI/LAPI coexistence and resource sharing
  2. SMP collective communication topology awareness
  3. SMP collective communication scalability
  4. MPI memory scalability

Planning information

Customer responsibilities: For all processors within a parallel job, the same release level of the IBM Parallel Environment for AIX software is required.

For the IBM pSeries High Performance Switch, you need to install and configure the switch, and ensure that it is accessible via IP from all nodes on which PE is to be installed. If LoadLeveler is being used, LoadLeveler must be configured with the appropriate network definitions, pools, and classes.

Installability

Direct customer support: For technical support or assistance, contact your IBM representative or go to:

Packaging: IBM Parallel Environment program package is distributed in one package with the following:

  • One CD-ROM containing the Parallel Environment product. The License Information document is included in softcopy form.

Security, auditability, and control

The announced program uses the security features of the AIX 5L V5.2 operating system. No additional security enhancements are included in this announcement.

The customer is responsible for evaluation, selection, and implementation of security features, administrative procedures, and appropriate controls in application systems and communication facilities.

Ordering information

Parallel Environment is a product with one charge unit: number of active processors. The number of processors is the sum of the active number of processors in each of the machines on which Parallel Environment will be installed or run. A license is required for each machine on which Parallel Environment will be installed and run, for a quantity as computed above.

Program name: Parallel Environment V4.1

New users of IBM Parallel Environment for AIX V4.1 should specify machine type 5765, model F83 and feature number times the quantity equal to the total number of active processors required. For example, if ordering Parallel Environment for three machines (a 4-way, an 8-way, and a 16-way), order three licenses with the respective quantities each (for a total quantity of 28). The block of 250 processors feature number is provided for convenience with large orders.

                                  OTC          Medium
                  Machine         feature      feature
Description       type/model      number       number       Medium
 
Number of         5765-F83        0001         5809         CD-ROM
 processors
Block of 250      5765-F83        0002
 processors

OTC = One-time charge

This software license includes Software Maintenance, previously referred to as Software Subscription and Technical Support.

Extending coverage for a total of three years from date of acquisition may be elected. Order the program number, feature number, and quantity to extend coverage for your software licenses. If maintenance has expired, specify the after license feature number.

Parallel Environment V4.1
Maintenance IASP PID: 1 Year 5771-PAE
Media feature number: 5819
 
                                                         Feature
Description                                              number
 
Use Authorizations:
 (to be ordered in quantity of processors)
-- Software (SW) Maintenance No-Charge Registration      0404
-- SW Maintenance 1-Year Renewal                         0406
-- SW Maintenance 1-Year After-License                   0408
 
250 Use Authorizations:
 (to be ordered in quantities of 250 processors)
-- SW Maintenance No-Charge Registration                 0405
-- SW Maintenance 1-Year Renewal                         0407
-- SW Maintenance 1-Year After-License                   0409
 
Maintenance IASP PID:  3 Year 5773-PAE
Media feature number:  5819
 
                                                         Feature
Description                                              number
 
Use Authorizations:
 (to be ordered in quantity of processors)
--SW Maintenance 3-Year Registration                     0380
--SW Maintenance 3-Year Renewal                          0382
--SW Maintenance 3-Year After-License                    0384
 
250 Use Authorizations:
 (to be ordered in quantities of 250 processors)
--SW Maintenance 3-Year Registration                     0381
--SW Maintenance 3-Year Renewal                          0383
--SW Maintenance 3-Year After-License                    0385

Customization Options: Select the appropriate feature number to customize your order with delivery options desired. This feature can be specified on the initial or MES orders.

Expedite shipments
 
Feature                       Description
 
3445                          Local IBM Office Expedite
                              (for IBM use only)

Terms and conditions

Licensing: IBM International Program License Agreement. Proofs of Entitlement (PoEs) are required for all authorized use.

This software license includes Software Maintenance, previously referred to as Software Subscription and Technical Support.

The following agreements apply for maintenance and do not require customer signatures:

  • IBM Agreement for Acquisition of Support (Z125-6011)
  • Addendum for Support (Software Maintenance) for Select iSeries™ and pSeries Programs (Z125-6495)

Limited warranty applies: Yes

Warranty: This program has warranty for a minimum of one year from acquisition from IBM or authorized Business Partner. The warranty provided to the customer, for at least one year from acquisition, is access to data bases (read Web sites) for program information, FAQs, including any known fixes to defects, which the customer can download or obtain otherwise and install at their leisure.

Money-back guarantee: If for any reason you are dissatisfied with the Program, return it within 30 days from the invoice date, to the party (either IBM or its reseller) from whom you acquired it, for a refund. This applies only to your first acquisition of the Program.

Copy and use on home/portable computer: No

Volume Orders (IVO): Yes, contact your IBM representative.

Passport Advantage® applies: No

Software Maintenance applies: Yes

All distributed software licenses include Software Maintenance (software subscription and technical support) for a period of 12 months from the date of acquisition providing a streamlined way to acquire IBM software and assure technical support coverage for all licenses. Extending coverage for a total of three years from date of acquisition may be elected.

While your Software Maintenance is in effect: IBM provides you assistance for your (1) routine, short duration installation and usage (how-to) questions; and (2) code-related questions. IBM provides assistance via telephone and, if available, electronic access, only to your information systems (IS) technical support personnel during the normal business hours (published prime shift hours) of your IBM support center. (This assistance is not available to your end users.) IBM provides Severity 1 assistance 24 hours a day, every day of the year. For additional details, consult your IBM Software Support Guide at:

Software Maintenance does not include assistance for (1) the design and development of applications, (2) your use of programs in other than their specified operating environment or (3) failures caused by products for which IBM is not responsible under this agreement.

IBM Operational Support Services — Support Line: Yes

AIX/UNIX® upgrade protection applies: No

Entitled upgrade for current AIX/UNIX upgrade protection licensees: No

iSeries Software Subscription applies: No

Variable charges apply: No

Educational allowance available: Yes, 15% education allowance applies to qualified education institution customers.

Prices

The prices provided in this announcement are suggested retail prices for the U.S. only and are provided for your information only. Dealer prices may vary, and prices may also vary by country. Prices are subject to change without notice. For additional information and current prices, contact your local IBM representative.

Program name: Parallel Environment V4.1

                                               OTC
                              Machine          feature
Description                   type-model       number        OTC
 
Number of processors          5765-F83         0001          $    550
Block of 250 processors       5765-F83         0002           137,500

Parallel Environment OTC 1-Year Software Maintenance program 5771-PAE

              Registra-                         Maintenance
              tion                              after-
              (no-            Renewal           license
              charge)         billing           billing
              feature         feature           feature
Program name  number    OTC   number   OTC      number       OTC
 
Parallel      0404      NC    0406     $   110  0408         $   165
 Environment
 (5765-F83)
 
              Registra-                         Maintenance
              tion                              after-
              (no-            Renewal           license
              charge)         billing           billing
              feature         feature           feature
Program name  number    OTC   number   OTC      number       OTC
 
 
Block of 250
 processors   0405      NC    407      $27,500  0409         $41,250

NC = No Charge

Parallel Environment OTC 3-Year Software Maintenance program 5773-PAE

                                                  Maintenance
                                                  after-
              Registra-         Renewal           license
              tion              billing           billing
 
              feature           feature           feature
Program name  number   OTC      number   OTC      number      OTC
 
Parallel      0380     $   187  0382     $   297  0384        $   352
 Environment
 (5765-F83)
 
Block of 250
 processors   0381      46,750  0383      74,250  0385         88,000

Global Financing

IBM Global Financing offers competitive financing to credit-qualified customers to assist them in acquiring IT solutions. Our offerings include financing for IT acquisition, including hardware, software, and services, both from IBM and other manufacturers or vendors. Offerings (for all customer segments: small, medium, and large enterprise), rates, terms, and availability can vary by country. Contact your local IBM Global Financing organization or visit the Web at:

Order now

To order, contact the Americas Call Centers, your local IBM representative, or your IBM Business Partner.

To identify your local IBM representative or IBM Business Partner, call 800-IBM-4YOU (426-4968).

 Phone:     800-IBM-CALL (426-2255)
 Fax:       800-2IBM-FAX (242-6329)
 Internet:  ibm_direct@vnet.ibm.com
 Mail:      The Americas Call Centers
            Dept. RE001
            P.O. Box 2690
            Atlanta, GA  30301-2690
 
 Reference: RE001

The Americas Call Centers, our national direct marketing organization, can add your name to the mailing list for catalogs of IBM products.

Note: Shipments will begin after the planned availability date.

Trademarks

 
POWER4, SP, POWER3, POWER2, and iSeries are trademarks of International Business Machines Corporation in the United States or other countries or both.
 
eServer, pSeries, AIX, RS/6000, LoadLeveler, VisualAge, and Passport Advantage are registered trademarks of International Business Machines Corporation in the United States or other countries or both.
 
The e-business logo and UNIX are registered trademarks of the Open Company in the United States and other countries.
 
Other company, product, and service names may be trademarks or service marks of others.