IBM Parallel Environment for Linux improves usability and performanceIBM United States Software Announcement 210-004
June 8, 2010
|Table of contents|
|At a glance|
IBM® Parallel Environment for Linux®, V5.2 provides the following enhancements to scalability and performance:
- Support for additional parallel programming APIs
- New environment variables designed to improve performance
- Enhanced flexibility in choosing the number of Message Passing Interface - Input/Output (MPI-IO) agents and their placements, which can improve MPI-IO performance
- Scaling improvements for collective communication
- Flexibility in choice for resource managers, including allocation of nodes for user space jobs to run without any resource manager
- An Eclipse plug-in that allows users to run IBM High Performance Computing Toolkit (HPC Toolkit) from within Eclipse to analyze their application performance
For ordering, contact your IBM representative, an IBM Business Partner, or IBM Americas Call Centers at 800-IBM-CALL (Reference: RE001).
Back to top
IBM Parallel Environment (IBM PE) for Linux is a high-function development and execution environment for parallel applications. IBM PE for Linux can offer High Performance Computing (HPC) users a tool for creating and using parallel applications with a familiar look and feel.
Version 5.2 offers:
- The ability to use the resource manager of your choice for submitting and managing batch or interactive parallel jobs. Or instead of using a separate resource manager, IBM PE manages the adapter resources itself, on behalf of the user application.
- An enhanced LAPI designed to increase parallel application performance.
- The capability of process creation and management, as provided by MPI-2.1.
- New environment variables for controlling the number of active I/O agents assigned to a job, which can help improve performance.
- In addition to Message Passing Interface (MPI) and low-level application programming interface (LAPI), IBM PE 5.2 provides support for other parallel programming APIs.
- An OpenSSH-based user authentication method.
- Executable and library functions as 64-bit objects. The MPI library provides both 32-bit and 64-bit object support.
- The IBM High Performance Computing Toolkit, which includes an Eclipse plug-in that integrates the IBM HPC Toolkit tools with the Eclipse Integrated Development Environment (IDE).
Back to top
IBM Power Systems
- SUSE Linux Enterprise Server (SLES) 11
- Red Hat Enterprise Linux (RHEL) 5.4
Back to top
|Planned availability date|
June 11, 2010
Back to top
Beginning with IBM PE for Linux, V5.2:
- You can use the resource manager of your choice for submitting and managing batch or interactive parallel jobs. IBM PE 5.2 includes a set of resource management interfaces and data areas for configuring your resource manager to interact with the parallel operating environment.
Additionally, support is provided for running a job without a resource manager. You can launch a User Space job, using the InfiniBand interconnect, without the use of a resource manager such as LoadLeveler®. Instead of using a separate resource manager, IBM PE manages the adapter resources itself, on behalf of the user application.
- IBM PE 5.2 supports process creation and management as provided by the MPI-2.1 standard. New processes can be created and terminated after a job has started, and the newly created processes can communicate with the processes that started them. It also allows two independent MPI applications to communicate.
- To help improve performance, new environment variables are provided for controlling the number of active I/O agents assigned to a job. Additionally, improvements have been made in the ability to run the parallel operating environment in large-scale environments.
- In addition to MPI and LAPI, IBM PE 5.2 provides support for other parallel programming APIs. These APIs can be used in any combination in a single parallel program. Options are also included for specifying how the parallel APIs in your application will use system resources.
- IBM PE 5.2 provides its executable and library functions as 64-bit objects. The MPI library provides both 32-bit and 64-bit object support.
- The IBM High Performance Computing Toolkit includes an Eclipse plug-in that integrates the IBM HPC Toolkit tools with the Eclipse Integrated Development Environment (IDE). The IBM HPC Toolkit tools can be used to instrument an application program in order to obtain application performance measurements for hardware performance counters, MPI tracing, OpenMP profiling, and I/O profiling. This plug-in also allows users to view this performance measurement data for their application.
Accessibility by people with disabilities
A U.S. Section 508 Voluntary Product Accessibility Template (VPAT) containing details on accessibility compliance can be requested at
Back to top
Program Program number VRM name 5765-PEL 5.2.1 IBM Parallel Environment for Linux
Product identification number
Maintenance Maintenance Program PID number 1-year PID number 3-year PID number 5765-PEL 5660-PEP 5662-PEP 5661-PEP 5663-PEP 5664-PEP
Back to top
|Electronic Software Update Orders|
Entitled Software Update (ESU) is a way for customers to self order their Power® software release upgrades via the Entitled Software Support (ESS) Web site without the need to go to their seller to place the upgrade order. Entitled Software Update (ESU) orders for Electronic Software Delivery (ESD) are now available in all countries.
ESU orders for software will be placed on the Entitled Software Support (ESS) Web site
Customers should generally select electronic delivery when ordering via ESU, but do have the ability to select physical delivery. Programs ordered for ESD will have the same download images provided as on the CD media shipped for physical orders. Countries requiring physical delivery of License Information documentation will have these documents shipped separately. This physical shipment will not delay the immediate availability of the ESD images for customer download.
ESD customers placing ESD software orders will receive an e-mail with the software order information. The ESU customer will be able to immediately proceed to the Downloads Web site for program access, instead of waiting for delivery of a physical package shipped from IBM.
Customers choosing physical delivery will also have the electronic images available for ESD download.
- ESD help (instructions on how to use)
- ESD sign-in (must have customer number and product software entitlements to get in)
- List of Power software products that are available for electronic download
Back to top
The following publications are available from the Web:
- IBM Parallel Environment: Installation
- IBM Parallel Environment: Operation and Use
- IBM Parallel Environment: Messages
- IBM Parallel Environment: MPI Programming Guide
- IBM Parallel Environment: MPI Subroutine Reference
To access the above Parallel Environment documentation, refer to the IBM Cluster Information Center Web site, which contains the most recent Parallel Environment documentation in PDF and HTML formats
IBM HPC Toolkit documentation is downloadable by following the documentation link at the HPC Central Web site
The IBM Publications Center
The Publications Center is a worldwide central repository for IBM product publications and marketing material with a catalog of 70,000 items. Extensive search facilities are provided. Payment options for orders are via credit card (in the U.S.) or customer number for 50 countries. A large number of publications are available online in various file formats, and they can all be downloaded by all countries, free of charge.
Back to top
Specified operating environment
- Power Systems (POWER6 and POWER7)
- IBM System x®
- IBM BladeCenter® (Power Architecture® and X-Architecture)
IBM PE is supported in a clustered environment interconnected with the InfiniBand host channel adapters and switches, running on IBM clusters. In IP mode, IBM PE uses the standard UDP/IP protocol, which is available on many interconnects. IBM PE in IP mode is tested extensively on 1 Gb Ethernet.
Note: InfiniBand support on POWER7 is limited to the Power 755.
Running IBM Power Systems:
- SLES 11, Service Pack 1
- PE service update 5.2.1-2
Running IBM X-Architecture systems:
- RHEL 5.4
- PE service update 5.2.1-2
If Fortran or C/C++ programs are to be developed, you will need a supported level of the specific compiler. Refer to the Parallel Environment Installation Guide for the required levels.
If using the HPC Toolkit, the C and Fortran compiler and runtime requirements, along with other software requirements and instructions for downloading, are documented in the IBM High Performance Computing Toolkit Installation and Usage Guide provided on the CD-ROM.
The program's specifications and specified operating environment information may be found in documentation accompanying the program, if available, such as a readme file, or other information published by IBM, such as an announcement letter. Documentation and other program content may be supplied only in the English language.
IBM Tivoli® Workload Scheduler LoadLeveler can be used to submit batch parallel jobs. It can help assist with node allocation for job management.
Parallel Engineering and Scientific Subroutine Library (Parallel ESSL) is a scalable mathematical subroutine library that provides outstanding performance through simple subroutine calls for engineering and scientific MPI applications on clusters of IBM Power Systems servers and Power Architecture BladeCenter servers using the Parallel Environment MPI library for communications.
If you are using TWS LoadLeveler as your resource manager, IBM PE 5.2 requires the 64-bit TWS LoadLeveler 4.1 shared library. IBM PE 5.2 does not work with earlier versions of TWS LoadLeveler.
All nodes in a parallel job must run the same versions of IBM PE, LAPI, and TWS LoadLeveler at the same maintenance levels. IBM PE 5.2 is only compatible with the following versions of LAPI and TWS LoadLeveler:
- LAPI 3.1.5 (shipped with IBM PE 5.2)
- TWS LoadLeveler 4.1
Because IBM PE 5.2 is only compatible with TWS LoadLeveler 4.1, when Parallel Environment is migrated to Version 5.2, TWS LoadLeveler must also be migrated to Version 4.1.
Note: IBM PE 5.2 is not compatible with back levels of LAPI.
- IBM PE does not support interoperability between nodes running AIX® and Linux. Parallel jobs cannot be mixed between AIX and Linux IBM PE nodes.
- The supported node limit for IBM PE is 64 nodes. However, for clusters larger than 64 nodes, a request can be submitted through special bid.
- User space support is not available running RHEL on System x.
- The hardware performance counter tools contained in the HPC Toolkit are not supported on Linux systems.
- The use of the IBM MetaCluster Distributed Checkpoint Restart (MDCR) function to coordinate the checkpointing and restarting of jobs is only available with IBM PE for AIX running AIX 6.1.
- InfiniBand support on POWER7 is limited to the Power 755.
IBM PE for Linux is distributed as a single package available via CD-ROM media with the following:
- IBM International Program License Agreement in multilanguage booklet (LC23-5052-01) and its License Information (L-RHAN-7WEJDH) in multiple languages (license.rpm)
- Proof of Entitlement (POE)
- Product readme file that describes the program's specified operating environment and program specifications
- Documentation for the HPCT (/usr/lpp/ppe.hpct/doc/hpct_guide.pdf and /usr/lpp/ppe.hpct/doc/hpct_guide.html)
- Installation script file for installing the parallel operating environment
- Program RPMs, one each for Power Systems and System x
- hpct.rpm, hpct_runtime.rpm
- lapi.IP.rpm, lapi.US.rpm
Security, auditability, and control
IBM Parallel Environment for Linux uses the security and auditability features of the Linux operating system being used.
The customer is responsible for evaluation, selection, and implementation of security features, administrative procedures, and appropriate controls in application systems and communication facilities.
Back to top
IBM Software Services has the breadth, depth, and reach to manage your services needs. You can leverage the deep technical skills of our lab-based, software services team and the business consulting, project management, and infrastructure expertise of our IBM Global Services team. Also, we extend our IBM Software Services reach through IBM Business Partners to provide an extensive portfolio of capabilities. Together, we provide the global reach, intellectual capital, industry insight, and technology leadership to support a wide range of critical business needs.
To learn more about IBM Software Services or to contact a Software Services sales specialist, visit
Back to top
Part number or Program name PID number Charge metric IBM Parallel 5765-PEL Per processor - small, Environment medium, or large for Linux processor tier
A processor is the unit of measure by which this program is licensed. A processor (commonly called a CPU or core) is a functional unit within a computing device that interprets and executes instructions. A processor consists of at least an instruction control unit and one or more arithmetic or logic units. With multicore technology, each core is considered a processor.
The terms and conditions for IBM Parallel Environment for Linux, as previously announced in Software Announcement 208-373, dated November 11, 2008 are unchanged.
Back to top
|IBM Electronic Services|
IBM has transformed its delivery of hardware and software support services to help you achieve higher system availability. Electronic Services is a Web-enabled solution that offers an exclusive, no-additional-charge enhancement to the service and support available for IBM servers. These services are designed to provide the opportunity for greater system availability with faster problem resolution and preemptive monitoring. Electronic Services comprises two separate, but complementary, elements: Electronic Services news page and Electronic Services Agent.
The Electronic Services news page is a single Internet entry point that replaces the multiple entry points traditionally used to access IBM Internet services and support. The news page enables you to gain easier access to IBM resources for assistance in resolving technical problems.
The Electronic Service Agent is no-additional-charge software that resides on your server. It monitors events and transmits system inventory information to IBM on a periodic, client-defined timetable. The Electronic Service Agent automatically reports hardware problems to IBM. Early knowledge about potential problems enables IBM to deliver proactive service that may result in higher system availability and performance. In addition, information collected through the Service Agent is made available to IBM service support representatives when they help answer your questions or diagnose problems. Installation and use of IBM Electronic Service Agent for problem reporting enables IBM to provide better support and service for your IBM server.
To learn how Electronic Services can work for you, visit
The charges are unchanged by this announcement.
Back to top
To order, contact the Americas Call Centers or your local IBM representative, or your IBM Business Partner.
To identify your local IBM representative or IBM Business Partner, call 800-IBM-4YOU (426-4968).
Phone: 800-IBM-CALL (426-2255) Fax: 800-2IBM-FAX (242-6329) For IBM representative: firstname.lastname@example.org For IBM Business Partner: email@example.com Mail: IBM Teleweb Customer Support ibm.com® Sales Execution Center, Americas North 3500 Steeles Ave. East, Tower 3/4 Markham, Ontario Canada L3R 2Z1
The Americas Call Centers, our national direct marketing organization, can add your name to the mailing list for catalogs of IBM products.
Note: Shipments will begin after the planned availability date.
Power Systems, POWER6, POWER7 and Electronic Service Agent are trademarks of IBM Corporation in the United States, other countries, or both.
IBM, X-Architecture, LoadLeveler, Power, System x, BladeCenter, Power Architecture, Tivoli, AIX and ibm.com are registered trademarks of IBM Corporation in the United States, other countries, or both.
Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.
Other company, product, and service names may be trademarks or service marks of others.
For the most current information regarding IBM products, consult your IBM representative or reseller, or visit the IBM worldwide contacts page