IBM United States
Software Announcement 202-084
April 8, 2002

IBM eServer Cluster 1600 Now Includes IBM eServer pSeries 690/670 Offerings

 ENUS202-084.PDF (28KB)

(Corrected on May 6, 2002)

Changed and added the Software Requirements for Clusters with pSeries 690/670 Servers.

At a Glance

The Cluster 1600 system now offers:

  • pSeries 690 and pSeries 670 support when running the PSSP V3.4 software
  • Capability to rack-mount up to eight SP Switch2s in the 9076-556 frame or expansion frame
  • Attachment of the pSeries 690 and pSeries 670 to the SP Switch and SP Switch2 fabric
  • New switch frame models that can be mounted in IBM's 19-inch racks
  • Increased scaling of the pSeries 660 models to 64 servers (currently available)
  • HACMP V4.4.1 support of LPARs on the pSeries 690 (currently available)
  • HACMP V4.4.1 support of LPARs on the pSeries 670

Overview

IBM eServer Cluster 1600 can now be configured with the pSeries 690 and pSeries 670 in addition to the already supported pSeries 660 models, pSeries 680, and RS/6000® SP™, in switched and non-switched environments. Switched environments include the SP Switch or the SP Switch2. The SP Switch2 environments include single- and two-plane configurations.

The Cluster 1600 software expands the list of hardware building blocks to include support for the pSeries 690 and pSeries 670 including:

  • The server running as a full system partition or with logical partitions (LPARs)
  • Switchless or switched configurations (SP Switch and SP Switch2)
  • An SP Switch2 environment with some non-switched LPARs or servers

For all servers with machine type 7026, including the pSeries 660 Models 6H1/6H0 with the new 750 MHz feature, scaling is increased to 64 servers.

The RS/6000 SP Switch Frame family is expanded to include new models that can be mounted in IBM's 19-inch racks, enhancing the available switch building blocks of the Cluster 1600.

The following licensed programs are the software building blocks that deliver support for the pSeries 690 and pSeries 670 server:

  • Parallel System Support Programs for AIX ® (PSSP) V3.4
  • High Availability Cluster Multi-Processor (HACMP) for AIX, V4.4.1
  • High Availability Geographic Cluster for AIX (HAGEO)/Geographic Remote Mirror for AIX (GeoRM) V2.3
  • LoadLeveler® for AIX 5L, V3.1
  • General Parallel File System (GPFS) V1.5
  • Parallel Environment for AIX 5L, V3.2
  • Engineering and Scientific Subroutine Library(ESSL) V3.3
  • Parallel ESSL V2.3

Note: Refer to the Software Requirements section for the service levels needed to provide announced support.

Key Prerequisites

For the Cluster 1600 Type 9078, one or more of the following building blocks subject to the scalability limits announced:

  • Servers with machine type 7040 including pSeries 690 and pSeries 670
  • Servers with machine type 7026 including pSeries 660 models
  • Servers with machine type 7017 including pSeries 680
  • RS/6000 SP
  • PSSP V3.4 on a Control Workstation
  • AIX 5L for POWER V5.1 for pSeries 690 and pSeries 670 support

Planned Availability Dates

April 26, 2002

  • May 31, 2002 — Support of SP Switch2 Adapter two-plane configurations
  • June 14, 2002 — 19-inch Switch Frame package

Description

The IBM eServer Cluster 1600 gives you a single cluster serial number when ordering machine type 9078 Model 160, which simplifies cluster administration and makes it easier for you to track and manage your cluster over time. There is no cost for ordering the feature for the single serial number 9078-160.

The Cluster 1600 is enhanced to include more pSeries 660 models and now, the pSeries 690 and the new pSeries 670. The pSeries 690 is a high-end, 32-way, Giga processor POWER4™ system. The new pSeries 670 brings advanced POWER4 technology to the mid-range server environment. The physical components of the pSeries 690 and pSeries 670 can be divided into up to 16 LPARs within one physical server. Each LPAR functions as an individual node within that server. These servers require AIX 5L V5.1, or later, and PSSP V3.4.

The pSeries 690 and pSeries 670 are supported as a Cluster 1600 building block with the SP Switch2, the SP Switch, or no switch. This support requires a fix level update on PSSP. A Cluster 1600 system with PSSP is limited to the 32-bit AIX kernel only. This limits pSeries 690 LPARs to 96 GB of memory.

Scaling Statement for Clusters

A Cluster 1600 with PSSP can consist of 2 to 128 AIX operating system images. An operating system image, or logical node , can be:

  1. A 7017 server (S70, S7A, S80, pSeries 680)
  2. A 7026 server (H80, M80, pSeries 660, 6H0/6H1, 6M1)
  3. A 7040 server (pSeries 670, pSeries 690) running as a full system partition
  4. An LPAR of a 7040 server (pSeries 670, pSeries 690)
  5. A 9076 SP node

Logical nodes are limited in a cluster running PSSP as described in the 7040 Cluster Limits table and the scaling rules that follow. Any cluster system that exceeds any of the announced supported logical node limits requires a special bid.

7040 Cluster Limits

                                        SP Switch2 (total
                                        switched plus non-
Maximum             SP        SP        switched, subject   Switch-
Values              Switch    Switch2   to other limits)(1) less
 
pSeries 690/        2         16        16                  16
 pSeries 670
 servers per
 Cluster
LPARs per           8         8         16                  16
 pSeries 690
 server
LPARs per           4         4         16                  16
 pSeries 670
 server
LPARs               6         48        48                  48
 per Cluster

Additional Information
                                        SP Switch2 (total
                                        switched plus non-
Maximum             SP        SP        switched, subject   Switch-
Values              Switch    Switch2   to other limits)(1) less
 
Number of           1         1 or 2    1 or 2              0
 switch
 planes
 supported
Number of           2         4         4                   4
 pSeries 690/
 pSeries 670
 servers
 per HMC(2)

1
With the SP Switch, switched and non-switched logical nodes cannot be mixed.
2
Hardware Management Console

A PSSP cluster with an SP Switch2 must meet all of the following limits:

  • No more than 16 servers from the set {7017}
  • No more than 16 servers from the set {7040}
  • No more than 16 servers from the set {7017, 7040}

    (Refer to the numbered list following the Scaling Statement for Clusters heading for the servers in a given set.)

    For example, a system with 15 pSeries 680s can have at most one pSeries 690.

  • No more than 64 logical nodes from the set {7017, 7026, 7040, 7040 LPARs}

    For example, a system with 50 pSeries 660s and 12 pSeries 680s can have only two pSeries 690s running as a full system partition.

  • No more than 128 logical nodes of which no more than 48 are LPARs of 7040

    For example:

    • 50 pSeries 660s, 12 pSeries 680s, 2 pSeries 690s each running as a full system partition and 64 9076 SP nodes
    • 52 pSeries 660s, 3 pSeries 690s configured with 4 LPARs each and 64 RS/6000 SP nodes
    • 32 pSeries 660s, 2 pSeries 690s with 16 LPARs each (8 on the switch, 8 non-switched), and 64 RS/6000 SP nodes

A PSSP cluster with an SP Switch must meet all of the following limits:

  • No more than 16 servers from the set {7017}
  • No more than 2 servers from the set {7040}
  • No more than 16 servers from the set {7017, 7040}

    (Refer to the numbered list following the Scaling Statement for Clusters heading for the servers in a given set.)

    For example, a system with 15 pSeries 680s can have at most one pSeries 690.

  • No more than 64 logical nodes from the set {7017, 7026, 7040, 7040 LPARs}

    For example, a system with 50 pSeries 660s and 12 pSeries 680s can have only two pSeries 690s running as a full system partition.

  • No more than 128 logical nodes of which no more than 16 are LPARs of 7040

    For example:

    • 50 pSeries 660s, 12 pSeries 680s, 2 pSeries 690s, each running as a full system partition and 64 RS/6000 SP nodes
    • 48 pSeries 660s and 2 pSeries 690s configured with 8 LPARs each and 64 RS/6000 SP nodes

A PSSP cluster with no Switch must meet all of the following limits:

  • No more than 16 servers from the set {7017}
  • No more than 16 servers from the set {7040}
  • No more than 16 servers from the set {7017, 7040}

    (Refer to the numbered list following the Scaling Statement for Clusters heading for the servers in a given set.)

    For example, a system with 15 pSeries 680s can have at most one pSeries 690.

  • No more than 64 logical nodes from the set {7017, 7026, 7040, 7040 LPARs}

    For example, a system with 50 pSeries 660s and 12 pSeries 680s can have only two pSeries 690s running as a full system partition.

  • No more than 128 logical nodes of which no more than 48 are LPARs of 7040

    For example:

    • 50 pSeries 660s, 12 pSeries 680s, 2 pSeries 690s, each running as a full system partition and 64 9076 SP nodes
    • 16 pSeries 660s, 16 pSeries 690s configured with 3 LPARs each and 64 RS/6000 SP nodes
    • 6 pSeries 660s, 10 pSeries 680s, 2 pSeries 690s with 16 LPARs each, 4 pSeries 690s with 4 LPARs each and 64 RS/6000 SP nodes

Complete configuration restrictions will be documented in the PSSP and Cluster 1600 Sales Manual update and will include specific node and server combinations/limits. Any cluster systems that exceed the announced supported server limit must be special bid. For additional pSeries 690 scaling, refer to the Statement of Direction section.

HACMP Support

HACMP 4.4.1 ES and ESCRM features now support LPARs on a pSeries 690 and pSeries 670. HACMP 4.4.1 ES and ESCRM features now also support the AIX 5L 64-bit kernel on 64-bit capable hardware models, including the pSeries 690 and pSeries 670. A 64-bit kernel is not supported by HACMP 4.4.1 HAS and CRM features nor for any HACMP running on a PSSP cluster.

Software Requirements

The following service is needed for HACMP 64-bit support:

  • HACMP V4.4.1 — APAR IY19466
  • RSCT V2.2 — APAR IY23767
  • HACMP ES & ESCRM V4.4.1 — APAR IY26492 and APAR IY26561

The following service is needed for HACMP LPAR support:

  • HACMP V4.4.1 — APAR IY26837
  • AIX 5L for POWER V5.1 — APAR# IY28102

The following service is needed in support of clusters with pSeries 690/670 servers:

  • AIX 5L for POWER V5.1 — APAR# IY28102.
  • Support for switchless environments — APAR# IY30345
  • Support for SP Switch environments — APAR# IY29560
  • Support for SP Switch2 single-plane environments — APAR# IY30343
  • Support for SP Switch2 two-plane environments — APAR# IY30344

Limitations

HACMP support of the 64-bit kernel, when run on any system with PSSP, is not supported since PSSP supports only the 32-bit kernel.

PSSP is limited to the 32-bit AIX kernel only. This limits pSeries 690 LPARs to 96 GB of memory.

Customer Planning

The establishment of a trusted network between the control workstation (CWS) and the Hardware Management Console (HMC) is needed to bypass a security vulnerability in Cluster 1600 systems with pSeries 690 or 670 servers. Refer to the PSSP V3.4 Read This First document at the Web site:

Accessibility by People with Disabilities

The following feature supports use by people with disabilities:

  • Operation by keyboard alone

Product Positioning

The Cluster 1600 offering is best implemented in three primary market segments:

e-business Infrastructure and Workload Consolidation

For large corporations (over 1000 employees) focused on lowering IT acquisition and operating costs, the Cluster 1600 helps them build, run, maintain, and continuously adapt hardware, software, and network infrastructure to support a broad range of e-business applications common in the enterprise. With the addition of pSeries 690/pSeries 670 as Cluster 1600 building blocks, IBM's proven cluster system management software, PSSP, can now manage copies of the AIX operating system running on either LPARs of a pSeries 690/pSeries 670 or on a full system partition. LPARs give the customer the flexibility to change the configurations easily to adapt to changing workload patterns and capacity requirements. That, coupled with the current SP environment, gives you extreme flexibility and investment protection. Customers can assign workloads to different LPARs of a pSeries 690/pSeries 670 or to other SMP servers in their Cluster 1600, thus simplifying management of their IT infrastructure and reducing total cost of ownership.

High Performance Computing

In High Performance Computing, the POWER4-based pSeries 690 offers outstanding floating-point performance and extreme SMP scalability. The world's largest, most challenging scientific and technical applications, like weather forecasting or other large-scale simulations, need vast amounts of computational power. A single pSeries 690 server (1.3 GHz) is designed to deliver peak performance of 166 gigaflops. For massively parallel, message-passing workloads, a cluster of 16 pSeries 690 servers can deliver peak performance of 2.6 teraflops. With IBM's highly scalable, highly reliable cluster file system, GPFS, a cluster of pSeries 690 servers can share vast amounts of data among different engineering workgroups in a large automotive or aerospace engineering firm. As such, job throughput can be maximized and job turn-around minimized. Clustering the innovative and powerful pSeries 690 is the latest step in the long tradition of IBM excellence in high-performance computing.

Large Scale Data Warehousing

Increasingly, large corporations are using information technology to improve customer focus. The ability to collect and efficiently analyze increasingly large amounts of operational and third-party market data is critical to improving product and service offerings, customer satisfaction, and ultimately competitive advantage. Following in the tradition of the RS/6000 SP, the Cluster 1600, configured with either pSeries 690 or pSeries 660-6M1 servers, offers an extremely scalable, highly reliable platform for hosting extremely large and growing corporate data warehouses.

Statement of Direction

Increased pSeries 690/670 Scaling

Support for clusters with as many as 32 pSeries 690/670 servers is planned to be provided by third quarter 2002.

IBM intends to provide support for a maximum of 128 LPARs in a cluster with a maximum of 128 instances of the operating system and a maximum of 32 pSeries 690/pSeries 670 servers.

All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Reference Information

  • Refer to Hardware Announcement 102-072 , dated April 8, 2002.
  • Refer to Hardware Announcement 102-080 , dated April 8, 2002.
  • Refer to Hardware Announcement 102-081 , dated April 8, 2002.
  • Refer to Hardware Announcement 101-338 , dated November 13, 2001.
  • Refer to Preview Announcement 101-283 , dated October 4, 2001.
  • Refer to Software Announcement 201-332 , dated November 13, 2001.
  • Refer to Software Announcement 201-331 , dated November 13, 2001.
  • Refer to Software Announcement 201-333 , dated November 13, 2001.
  • Refer to Software Announcement 201-336 , dated November 13, 2001.
  • Refer to Software Announcement 201-334 , dated November 13, 2001.
  • Refer to Software Announcement 202-003 , dated January 8, 2002.

Trademarks

 
pSeries is a trademark of International Business Machines Corporation.
 
The e-business logo is a trademark of International Business Machines Corporation in the United States or other countries or both.
 
SP and POWER4 are trademarks of International Business Machines Corporation in the United States or other countries or both.
 
RS/6000, AIX, and LoadLeveler are registered trademarks of International Business Machines Corporation in the United States or other countries or both.
 
Other company, product, and service names may be trademarks or service marks of others.