Description
Continuing the commitment to Linux and FCP environments
FCP SAN Management support:
zSeries 990 hardware is now enabled to support the industry-standard interface for Storage Area
Network (SAN) management tools. Now, zSeries FCP hardware may be used with industry-standard SAN
management tools which leverage the Common Host Bus Adapter (HBA) Applications Programming Interface
(API). The HBA API is used by management application programs to request SAN management services,
enabling the management of Fibre Channel Host Bus Adapters and the discovery of SAN resources.
SAN management software tool support for exploiting the z990 function of FCP SAN Management is to be
delivered by software vendors. Software vendors are now welcome to include Linux on zSeries FCP as
an additional platform for SAN management tool development and exploitation.
Linux on zSeries support for accessing the z990 function of FCP SAN Management will be delivered as
an Open Source contribution via:
early in 2004. Once available, this contribution will allow z990 users
performing their own Linux builds to exploit these functions. IBM is
working with its distribution partners to provide these functions in
future distribution releases.
SCSI Initial Program Load (IPL):
SCSI IPL allows the IPL of an operating system from a SCSI-type disk
attached via the zSeries Fibre Channel Protocol (FCP) channel.
You may also IPL a standalone dump program from a SCSI-type disk attached
via the zSeries FCP channel. The standalone dump program may also store
the generated dump data on such a disk. Thus, the Linux LPARs may be
started and operated completely from their FCP-attached disks in your
hardware configuration.
Delivery of SCSI IPL satisfies the Statement of General Direction ("IPL
from FCP-attached disks") in Hardware Announcement
103-142
, dated May 13, 2003.
To use this function, a no-charge orderable platform feature (#9904) is
required.
z/VM V4.4 support of SCSI IPL allows Linux and other guest operating
systems that support SCSI IPL to be IPLed from FCP-attached SCSI disks.
When z/VM is running on a z990, z900, z800, or equivalent server equipped
with the SCSI IPL function. Thus, Linux guests may be started and run
completely from FCP disks on your hardware configuration. Refer to the
z/VM subset of the 2084DEVICE Preventive Service Planning (PSP) bucket
for any service required for z/VM support for SCSI IPL. z/VM continues
to require ESCON®- or FICON-attached disk or tape for its own IPL,
storing guest dumps, and other functions. Refer to Software Announcement
203-128
, dated May 13, 2003, for additional information on z/VM V4.4.
Linux on zSeries support of SCSI IPL to exploit the z990, z900, z800, or
equivalent function was delivered in June 2003 as an Open Source
contribution via:
IBM is working with its distribution partners to provide these functions
in future distribution releases.
GDPS/PPRC and Cross Site Parallel Sysplex distance extended to 100 km
Customers will now have the capability to configure GDPS/PPRC or a multi-site Parallel Sysplex with
up to 100 km between two sites. An immediate advantage of this extended distance is to potentially
decrease the risk that the same disaster will affect both sites, thus permitting customers to
recover their production applications at another site. Support for ETR (External Time Reference)
links and the ISC-3 (Inter System Channel) links operating in Peer mode has been extended from the
current capability of 50 km to an extended capability of 100 km. The ETR links attach the 9037
Sysplex Timer® to zSeries, or S/390® 9672 servers. The ISC-3 links, operating in Peer mode and
supported on all zSeries servers, connect z/OS or OS/390® systems to a Coupling Facility. The
extended distance support for ETR and ISC-3 links is now consistent with other cross site link
technologies that already support 100 km, such as FICON, Peer to Peer Remote Copy (PPRC), and Peer
to Peer Virtual Tape Server (PtP VTS). It should be noted that the maximum fiber distance between a
pair of 9037 Sysplex Timers in an Expanded Availability configuration remains at 40 km. Therefore,
to achieve the extended distance of 100 km between sites, one of the options to be considered is
locating one of the Sysplex Timers in an intermediary site that is less than 40 km from one of the
two sites. Other potential options can be evaluated when the RPQ is ordered. The extended distance
support is planned to be available on October 31, 2003. Contact your IBM or Business
Partner representative for details.
Updated zSeries software pricing MSUs
The IBM zSeries software pricing MSUs for the z990 as updated on August 22, 2003, can be located at
the following Web site:
This IBM zSeries Software Pricing Exhibits Web site contains information
extracted from IBM customer agreements and contracts. Certain mainframe
hardware information is required to determine software charges for
zSeries and S/390 capacity-based software products. This information
includes the capacity-based customer software charging data common in all
geographies for IBM and our customers. The information includes vendor,
machine model, WLC, PSLC, MSU, and other data related to capacity-based
software charging.
Sysplex Timer Model 1 reaching end of service
The Sysplex Timer Model 1, 9037-001, has an announced worldwide End Of Service (EOS) date of
December 31, 2003. The Sysplex Timer Model 1, a critical component of any multi-CEC
sysplex or Parallel Sysplex, will no longer be supported by IBM after December 31, 2003.
IBM recommends that you begin the planning to replace all Sysplex Timer Model 1s with Sysplex
Timer Model 2s.
The Sysplex Timer Model 2 is a full replacement box for the Sysplex Timer Model 1. There
is no upgrade path from the Sysplex Timer Model 1 to the Sysplex Timer Model 2. An
International Technical Support Organization (ITSO) Redpaper,
Migration Planning for the 9037 Model 2 Sysplex Timer,
REDP3666, is available. Refer to the following Web site for a link to the Redpaper:
Contact your local IBM support representative for a detailed migration
procedures document. Refer to Services Announcement
602-015
, dated June 18, 2002, Declaration of Plan to Discontinue.
On/Off Capacity on Demand now supports IFLs
On/Off Capacity on Demand (On/Off CoD) now supports Integrated Facilities for Linux (IFLs) as well
as Central Processor (CP) types of processor units for temporary capacity. Previously
uncharacterized processor units (PUs), unassigned CPs, and unassigned IFLs that are available within
the current model may be used as temporary IFLs or CPs. On/Off CoD is delivered through the
function of Customer Initiated Upgrade (CIU). To participate in this offering, you must have
installed CIU Enablement (#9898) and On/Off CoD Enablement (#9896). Subsequently, you may
concurrently install temporary capacity by ordering On/Off CoD Active CP (#9897) up to the number of
current CPs, and/or On/Off CoD Active IFL (#9888) up to the number of current IFLs, and use it for
an indeterminate time.
Update on the OSA-Express family of LAN adapters for z800 and z900
OSA-Express usability enhancement Port name relief:
When configuring an OSA-Express feature in QDIO mode (OSD CHPID type), specification of a
PORTNAME is no longer required as part of the operating system configuration and can be omitted if
not needed by the operating system. For compatibility purposes, OSA-Express will now permit
activation with or without a PORTNAME.
Prior to this change, operating system administrators that wished to share an OSA-Express were
required to coordinate the configuration of the PORTNAME (configure matching names). If a mismatch
occurred, activation would fail. To avoid the coordination effort when multiple operating systems
share an OSA-Express, this usability enhancement has been introduced. This usability enhancement is
supported on all of the OSA-Express features offered on z800, z900, and z990.
Operating systems notes:
-
z/OS
z/OS Communications Server (z/OS CS) still requires the use of the OSA-Express PORTNAME.
The PORTNAME must be the same among all z/OS systems (or any operating system that still uses
PORTNAME) sharing the OSA-Express CHPID.
-
z/VM
In a z/VM environment when using a Guest LAN with a simulated OSA-Express QDIO feature, the
PORTNAME may now be omitted when configuring the device. For example, in z/VM TCPIP the PORTNAME is
specified on the OSD DEVICE statement and now may be omitted. If it is a Linux on zSeries guest
with the "June 2003 stream," the PORTNAME may now be omitted in the add_parms command of the
QETH interface parameters. For z/VM V4.3 corequisites refer to the PSP bucket. This function is
integrated in z/VM V4.4.
-
Linux on zSeries
Linux on zSeries support for port name relief was delivered in June 2003
as an Open Source contribution via:
With this contribution, Linux does not require a PORTNAME. Users should
ensure that OSA PORTNAME relief is available and installed on their
system before activating the interface without specifying a PORTNAME.
This support is applicable to all of the OSA-Express features in QDIO
mode (OSD CHPID type).
Full VLAN support for z/OS to increase traffic flow on z800 and z900:
Full Virtual Local Area Networks (VLANs) was announced on
May 13, 2003, as supported on z990. This support extended the
z/OS V1.2 VLAN priority-tagged frame support to full VLAN as defined by
the IEEE 802.1q standard. Now, this support is also being offered for
z800 and z900.
VLANs ease the administration of logical groups of users so that they can
communicate as if they were on the same LAN. VLANs increase traffic flow
and reduce overhead by allowing the organization of networks by traffic
patterns rather than by physical location.
This support is offered by z/OS V1.5 Communications Server. For
additional information, refer to Software Announcement
203-131
, dated May 13, 2003. Linux on zSeries support is available
via SuSE SLES 8, Turbo Linux TLES 8, and Conectiva CLEE.
VLAN support on z800 and z900 applies to the following features in QDIO
mode only (OSD CHPID type): Fast Ethernet (#2366) and Gigabit Ethernet
(#2364, #2365).
Another usability enhancement Direct SNMP subagent MIB changes:
For z/OS and Linux, an updated Simple Network Management Protocol
(SNMP) Management Information Base (MIB) was introduced in May 2003,
for the OSA-Express features supported on z990. Refer to Hardware
Announcement
103-142
, dated May 13, 2003.
Now, performance data for each image, reflecting OSA-Express utilization,
is returned in individual objects without the need to "decode" a larger
object that previously contained all of the information. The information
returned includes the percentage of time the microprocessor was utilized
to transfer data, as well as the number of inbound and outbound packets.
The updated MIB is now available for z800 and z900 also. The updated MIB
can be found on Resource Link at:
You will need to sign in with your IBM Resource Link user name and
password.
OSA-Express Direct SNMP subagent support was first announced in
April 2002 on z800 and z900. At that time IBM announced that the
query function was supported using the SNMP "get" command. Support was
offered for all of the OSA-Express features when configured in QDIO mode
(OSD CHPID type). This was supported by z/OS V1.4 with a
corequisite. Refer to the PSP bucket. This was also supported by SuSE
SLES 8, Turbo Linux TLES 8, and Conectiva CLEE.
In May 2003 support in the z/OS and Linux environments was expanded
to include Ethernet data for the dot3StatsTable from the SNMP EtherLike
Management Information Base (MIB) module in RFC 2665 (for all of the
Ethernet features supported on z800, z900, and z990), and an updated SNMP
MIB module was announced (now applicable to all of the OSA-Express
features on z800, z900, z990). Refer to Hardware Announcement
103-142
, dated May 13, 2003. For dot3StatsTable and the updated SNMP
MIB, z/OS V1.4 with a corequisite is required. Refer to the PSP bucket.
For Linux Direct SNMP, required support was delivered in June 2003
as an Open Source contribution via:
For more information on SNMP support as well as the applicable features
and modes of operation, refer to the
Open Systems Adapter-Express Customer's Guide and Reference
(SA22-7935 for z990, SA22-7476 for z800 and z900).
Technical information
Specified operating environment
Physical specifications
2084 servers:
The mechanical package for the IBM
zSeries 990 conforms to EIA guidelines for frames. Packaging for new build systems
is two frames. Upgrades will be contained within the two frames initially shipped. Note that
height reduction for transport is available. Keep in mind that the height of the z990 is equal to
the height of a reduced z900. When considering placement of a z990, review clearances for doors to
be opened. A new build system at the minimum level will consist of two frames with one I/O cage.
The maximum will consist of two frames with three I/O cages. 60-amp service is required.
Environmental specifications Server models
New build New build
minimum maximum
system system
Model A08 Model D32
with one with three
I/O cage I/O cages
Power requirements
50/60 Hz, kVA 5.3 kW 15.8 kW
Heat output kBtu/hr 18.02 53.73
Air flow CFM (at 16 degrees C)
Air flow m*3/min 500 CFM 1450 CFM
Floor space
-- Sq meters 2.49 2.49
-- Sq feet 26.78 26.78
Including service clearance
-- Sq meters 5.45 5.45
-- Sq feet 58.69 58.69
Approximate weight
System with IBF feature
-- kg 1263 2007
-- lb 2779 4415
System without IBF feature
-- kg 1174 1738
-- lb 2582 3824
Dimensions:
Depth Width Height
System with all covers
Inches 62.1 62.1 76.4
Centimeters 157.7 157.7 194.1
System with covers
and reduction
Inches 62.1 62.1 70.3
Centimeters 157.7 157.7 178.5
Each frame with one side
cover and without packaging
Inches 46.2 30.7 76.4
Centimeters 117.3 78.0 194.1
Each frame on casters with one
side cover and with packaging
Inches 47.6 32.4 76.9
Centimeters 120.9 82.2 195.3
Each frame with one side cover
and with packaging (ARBO)
Inches 51.5 36.5 87.6
Centimeters 130.8 92.7 222.5
See your IBM representative for the available width and height reduction transport option for return
of z900 or 9672 systems. There is no feature option available for width. There is height reduction
on the z990. However, keep in mind that the z990 is equal in height to a height reduced z900.
Therefore, one may not automatically assume that a reduction is necessary due to their experience
with z900. Check the height and only order as necessary.
Operating environment:
Refer to the
zSeries Installation Manual Physical Planning (IMPP)
that is available via IBM's Resource Link.
Hardware requirements
Specified operating environment:
The functions, features, and model upgrades available on October 31, 2003,
require HMC EC #J12846 and a set of required patches. Prior to implementing the functions,
features, and model upgrades on the z990, the customer must load Driver Level 53, EC #J12864,
and the required patches. These may be loaded concurrently. The code driver specified in ECA 221
and the required patches will be available on October 29, 2003.
z990 supports LPAR mode only.
In a Parallel Sysplex environment with z990 servers, all z900- or z800-based Coupling Facilities
must be running CFCC Level 12 with current maintenance including CFCC compatibility code.
G5/G6-based Coupling Facilities must be running CFCC Level 11.
Peripheral hardware and device attachments:
For the appropriate peripheral hardware and device attachments, contact your IBM
representative.
IBM devices previously attached to IBM S/370 or S/390 systems are supported for attachment to
z990 I/O channels, unless noted. The subject I/O devices must meet ESCON or FICON architecture
requirements to be supported. I/O devices that meet OEMI architecture requirements are supported
only via a parallel channel converter. Prerequisite Engineering Change Levels may be required. For
further details, contact IBM service personnel.
Note:
IBM cannot confirm the accuracy of performance, compatibility, or any other claims related to
non-IBM products. Questions regarding the capabilities of non-IBM products should be addressed to
the suppliers of those products.
TKE workstation:
Customers with TKE 3.X installed workstations may carry forward the features listed below
to control legacy systems only. An update from TKE 3.0 or TKE 3.1 code levels to the TKE 4.0 code
level is required to control the z990. Workstations updated to the TKE 4.0 code level may be used
to control 7060, 9672 Generation 5 and 6, z800, z900, and z990 servers. To use the TKE
function on a z990, the PCIX Cryptographic Coprocessor (PCIXCC) feature, the TKE 4.0 code level, and
the CP Assist for Cryptographic Function (CPACF) must be installed.
-
TKE with Token Ring (#0866)
-
TKE with Ethernet (#0869)
-
TKE with Token Ring (#0876)
-
TKE with Ethernet (#0879)
-
TKE with Token Ring (#0886)
-
TKE with Ethernet (#0889)
Software requirements
Mode of operation:
The z990 supports LPAR mode only.
Linux on zSeries support:
The currently available distributions SuSE SLES 7, SuSE SLES 8, Red Hat 7.1, Red Hat 7.2,
Turbo Linux TLES 8, and Conectiva CLEE support compatibility with z990. In addition, the currently
available distributions support running Linux in any of the 30 LPARs and either of the two LCSS's.
Support to further exploit z990 functions was delivered as an Open Source Contribution in
June 2003 via:
IBM is working with its distribution partners to provide these functions
in future distribution releases.
Note:
Conectiva CLEE is Conectiva Linux Enterprise Edition Powered by
UnitedLinux for zSeries.
z/OS®, z/VM®, VSE/ESA, and TPF support and availability by date:
Today, the IBM
zSeries 990 is supported by the following
operating systems and levels:
-
TPF V4R1 is compatible with z990.
-
z/OS
-
z/OS V1R4 z990 Compatibility Support: This orderable, unpriced, and
optional feature is required to allow z/OS V1R4 to run on a z990 server.
It is required on all systems in a Parallel Sysplex when a z/OS or CF
image in that same Parallel Sysplex is running on a z990 and the LPAR ID
of the operating system or CF image is greater than 15 (x"F"). With
regards to cryptography, it provides support for the PCICA feature and
the CP Assist for Cryptographic Function for z/OS V1R4.
-
z990 Compatibility for Selected Releases: This Web deliverable provides
support to allow OS/390® V2.10, z/OS V1.2, and z/OS 1.3 to run on
a z990. It is required on all OS/390 V2.10, z/OS V1.2, z/OS 1.3, and
z/OS.e V1.3 systems in a Parallel Sysplex when a z/OS or CF image in that
same Parallel Sysplex is running on a z990 and the LPAR ID of the
operating system or CF is greater than 15 (x"F").
-
z990 Cryptographic CP Assist Support for z/OS V1R3: This Web
deliverable provides support in z/OS V1.3 for the PCICA adapter and CP
Assist for Cryptographic Function (#3863).
-
z/OS.e V1.4 z990 Coexistence: This orderable, unpriced, and optional
feature is required on all z/OS.e V1.4 systems in a Parallel Sysplex when
a z/OS or CF image in that same Parallel Sysplex is running on a z990 and
the LPAR ID of the operating system or CF is greater than 15 (x"F").
z/OS.e cannot execute on a z990 server.
-
z990 Cryptographic Support: This Web deliverable will provide
exploitation support for z/OS 1.4 for PCIXCC (#0868) and extends
exploitation support for the CP Assist for Cryptographic Function
(#3863), PCICA, and PCIXCC features to z/OS 1.2.
-
VSE/ESA compatibility is provided on VSE/ESA V2R5, VSE/ESA V2R6, and
VSE/ESA V2R7. For the latest information on compatibility support
requirements refer to the VSE subset of the 2084DEVICE Preventative
Service Planning (PSP) bucket prior to installing the z990 server.
-
z/VM
-
z/VM compatibility support for V3.1, V4.2, and V4.3 and limited
exploitation for two LCSS's when running on a z990 server. Dynamic-I/O
configuration is supported when only LCSS0 is defined. Refer to the z/VM
subset of the 2084DEVICE Preventive Service Planning (PSP) bucket prior
to installing a z990.
-
z/VM V4.4 and later releases will provide additional exploitation support
for the following functions:
-
Two logical channel subsystems
Dynamic-I/O Configuration only in LCSS0
-
Adapter interruptions for OSA-Express and FCP Channels
-
Performance Assist for V=V guests in z/VM environment
The IBM
zSeries 990 is planned to be supported by the following
operating system levels by the dates indicated:
-
October 17, 2003
-
z990 Cryptographic Support: This Web deliverable extends exploitation
support for the CP Assist for Cryptographic Function (#3863), PCICA, and
PCIXCC features to z/OS V1.3.
-
October 31, 2003
-
z/OS V1.4 z990 Exploitation Support: This orderable, unpriced, and
optional feature provides exploitation support for two Logical Channel
SubSystems and 30 LPARs.
-
z/OS.e V1.4 Coexistence Update: This orderable, unpriced, and optional
feature allows customers to maintain a consistent code base for z/OS and
z/OS.e. It contains the z/OS.e Coexistence feature. Note that z/OS.e
cannot execute on a z990 server.
-
z/VM V4.4 and later releases will provide further exploitation support
for the following functions:
-
30 LPARs
-
Dynamic I/O Support for LCSS0 and LCSS1
-
Internal Spanned Channels (ICs and HiperSockets)
-
VSE/ESA V2R5 and later releases will provide further exploitation support
for the following functions:
-
30 LPARs
-
Two logical channel subsystems
-
HiperSockets (IQD CHPID type) Spanned Channels (VSE/ESA V2R7 and later
releases)
-
October 17, 2003
-
z990 Cryptographic Support: This Web deliverable extends exploitation
support for the CP Assist for Cryptographic Function (#3863), PCICA, and
PCIXCC features to z/OS V1.3.
-
December 31, 2003
-
VSE/ESA V2R7 and later releases will provide exploitation for adapter
interruptions for OSA-Express (OSD CHPID Type).
-
Fourth Quarter 2003
-
z990 Cryptographic Support: This Web deliverable extends exploitation
support for the CP Assist for Cryptographic Function (#3863), PCICA, and
PCIXCC features to OS/390 V2.10.
-
Note that z/OS.e cannot execute on a z990 server. z/OS.e releases are
provided to permit coexistence within a Parallel Sysplex and maintain
consistent code levels with z/OS.
Software support availability by operating system and level:
The new models of IBM
zSeries 990 are planned to be supported by
operating system releases on the schedules indicated below for each
release.
z/OS V1.4
-
Available Today
-
z/OS V1.4 z990 Compatibility Support Feature: This orderable, unpriced,
and optional feature is required to allow z/OS V1.4 to run on a z990
server. It is also required on all systems in a Parallel Sysplex when a
z/OS or CF image in that same Parallel Sysplex is running on a z990 and
the LPAR ID of the operating system or CF image is greater than 15
(x"F"). With regards to cryptography, it provides support for the PCICA
feature and the CP Assist for Cryptographic Function for z/OS V1.4.
-
z990 Cryptographic Support: This Web deliverable will provide
exploitation support for z/OS V1.4 for PCIXCC (#0868).
-
October 31, 2003
-
z/OS V1.4 z990 Exploitation Support: This orderable, unpriced, and
optional feature provides exploitation support for two logical channel
subsystems and 30 LPARs.
z/OS V1.3
-
Available Today
-
z990 Compatibility for Selected Releases: This Web deliverable provides
support to allow OS/390 V2.10, z/OS V1.2, and z/OS 1.3 to run on a z990.
It is required on all OS/390 V2.10, z/OS V1.2, z/OS 1.3, and z/OS.e V1.3
systems in a Parallel Sysplex when a z/OS or CF image in that same
Parallel Sysplex is running on a z990 and the LPAR ID of the operating
system or CF is greater than 15 (x"F").
-
z990 Cryptographic Assist Support for z/OS V1.3: This Web deliverable
provides support on z/OS V1.3 for the PCICA adapter and CP Assist for
Cryptographic Function (#3863).
-
October 17, 2003
-
z990 Cryptographic Support: This Web deliverable will provide
exploitation support for z/OS V1.3 for PCIXCC (#0868).
z/OS V1.2
-
Available Today
-
z990 Compatibility for Selected Releases: This Web deliverable provides
support to allow OS/390 V2.10, z/OS V1.2, and z/OS 1.3 to run on a z990.
It is required on all OS/390 V2.10, z/OS V1.2, z/OS 1.3, and z/OS.e V1.3
systems in a Parallel Sysplex when a z/OS or CF image in that same
Parallel Sysplex is running on a z990 and the LPAR ID of the operating
system or CF is greater than 15 (x"F").
-
z990 Cryptographic Support: This Web deliverable will extend
exploitation support for the CP Assist for Cryptographic Function
(#3863), PCICA, and PCIXCC features to z/OS V1.2.
OS/390 V2.10
-
Available Today
-
z990 Compatibility for Selected Releases: This Web deliverable provides
support to allow OS/390 V2.10, z/OS V1.2, and z/OS 1.3 to run on a z990.
It is required on all OS/390 V2.10, z/OS V1.2, z/OS 1.3, and z/OS.e V1.3
systems in a Parallel Sysplex when a z/OS or CF image in that same
Parallel Sysplex is running on a z990 and the LPAR ID of the operating
system or CF is greater than 15 (x"F").
-
Fourth Quarter 2003
-
z990 Cryptographic Support: This Web deliverable will provide
exploitation support for the CP Assist for Cryptographic Function
(#3863), PCICA, and PCIXCC features on OS/390 V2.10.
z/OS.e V1.3
-
Available Today
-
z990 Compatibility for Selected Releases: This Web deliverable provides
support to allow OS/390 V2.10, z/OS V1.2, and z/OS 1.3 to run on a z990.
It is required on all OS/390 V2.10, z/OS V1.2, z/OS 1.3, and z/OS.e V1.3
systems in a Parallel Sysplex when a z/OS or CF image in that same
Parallel Sysplex is running on a z990 and the LPAR ID of the operating
system or CF is greater than 15 (x"F"). z/OS.e cannot execute on a z990
server.
z/OS.e V1.4
-
Available Today
-
z/OS.e V1.4 z990 Coexistence Feature: This orderable, unpriced, and
optional feature is required on all z/OS.e V1.4 systems in a Parallel
Sysplex when a z/OS or CF image in that same Parallel Sysplex is running
on a z990 and the LPAR ID of the operating system or CF is greater than
15 (x"F").
-
October 31, 2003
-
z/OS.e V1.4 Coexistence Update: This Web deliverable allows customers to
maintain a consistent code base for z/OS and z/OS.e. It contains the
z/OS.e Coexistence feature. Note that z/OS.e cannot execute on a z990
processor.
z/VM
-
Available Today
-
z/VM compatibility support for V3.1, z/VM V4.2, and z/VM V4.3 and limited
exploitation for two LCSS's when running on a z990 server. Dynamic-I/O
configuration is supported when only LCSS0 is defined. Refer to the z/VM
subset for the 2084DEVICE Preventative Service Planning (PSP) bucket
prior to installing a z990.
-
z/VM V4.4 and later releases will provide additional exploitation support
for the following functions:
-
Two logical channel subsystems
Dynamic-I/O configuration only in LCSS0
-
Adapter interruptions for OSA-Express and FCP channels
-
Performance Assist for V=V guests in z/VM environment
-
October 31, 2003
-
z/VM V4.4 and later releases will provide further exploitation support
for the following functions:
-
30 LPARs
-
Dynamic I/O support for LCSS0 and LCSS1
-
Internal spanned channels (ICs and HiperSockets)
VSE/ESA
-
Available Today
-
VSE/ESA compatibility is provided on VSE/ESA V2R5, VSE/ESA V2R6, and
VSE/ESA V2R7. For the latest information on compatibility support
requirements, refer to the VSE subset of the 2084DEVICE Preventative
Service Planning (PSP) bucket prior to installing the z990 server.
-
October 31, 2003
-
VSE/ESA V2R5 and later releases will provide further exploitation support
for the following functions:
-
30 LPARs
-
Two logical channel subsystems
-
HiperSockets (IQD CHPID type) Spanned Channels (VSE/ESA V2R7 and later
releases)
-
December 31, 2003
-
VSE/ESA V2R7 and later releases will provide exploitation for adapter
interruptions for OSA-Express (OSD CHPID Type).
Software requirements for the FICON Express features:
The minimum software requirements for the FICON Express features
installed in a z990 are identified.
FICON Express (FCV CHPID type)
attachment to the ESCON Director Model 5 FICON Bridge feature
requires at a minimum:
-
OS/390 V2.10
-
z/VM V3.1, z/VM V4.2
-
VSE/ESA V2.5
-
TPF V4.1 at PUT 16
FICON Express (FC CHPID type)
, including Channel-To-Channel (CTC), requires at a minimum:
-
OS/390 V2.10
-
z/VM V3.1, z/VM V4.2
-
VSE/ESA V2.5
-
Linux on zSeries: Red Hat 7.1 and 7.2, SuSE SLES 7, Turbo Linux TLES 8,
or Conectiva CLEE.
-
TPF V4.1 at PUT 16
FICON Express (FCP CHPID type)
, for support of Linux environments, requires at a minimum:
-
z/VM V4.3 (for Linux as a guest under z/VM)
-
z/VM V4.4 for
-
Performance Assist for Adapter Interruptions
-
Performance Assist for V=V Guests
-
Linux on zSeries: SuSE SLES 7, Turbo Linux TLES 8, or Conectiva CLEE.
Cascaded FICON Directors (FC CHPID type)
, including CTC with Cascading, require at a minimum:
-
OS/390 V2.10 (refer to note below)
-
z/OS V1.3 with PTFs
-
z/OS V1.4 with PTFs
-
z/VM V4.4
-
VSE/ESA V2.5
-
Linux on zSeries support was delivered in June 2003 as an Open
Source contribution via:
-
TPF V4.1 at PUT 16
Note:
OS/390 V2.10 can support a cascaded configuration. z/OS V1.3 is
required in an LPAR to dynamically define a cascaded director, for
dynamic I/O changes, and to use the enhanced display functions. Refer to
the 9032/9042 PSP buckets.
Software requirements for Cryptographic Functions:
The following are required as indicated to support cryptographic
function on z990:
-
z990 Cryptographic Assist Support for z/OS V1.3: This Web deliverable
will provide support for the CP Assist for Cryptographic Function (#3863)
and the PCICA (#0862) feature on z/OS V1.3.
-
z/OS V1.4 z990 Compatibility Support: This orderable, unpriced, and
optional feature provides the CP Assist for Cryptographic Function
(#3863) and the PCICA (#0862) feature on z/OS V1R4.
-
z990 Cryptographic Support: This Web deliverable provides support for
the CP Assist for Cryptographic Function (#3863), PCICA (#0862), and
PCIXCC (#0868) features for z/OS V1.4, z/OS V1.3, z/OS V1.2, and OS/390
V2.10. A staged rollout is planned. Review "Software support
availability by operating system and level" under "Software requirements"
for specific plans for each software level.
The minimum software requirements for the CP Assist for Cryptographic
Function (CPACF), PCI Cryptographic Accelerator (PCICA), and PCIX
Cryptographic Coprocessor (PCIXCC) are as follows:
For CPACF:
-
The SHA-1 hash function is shipped enabled. However, DES and TDES
functions require enablement of the CPACF function (#3863) for export
control.
-
z/OS 1.4 with z/OS V1.4 z990 Compatibility Support feature.
-
z/OS V1.3 with z990 Cryptographic Assist Support Web deliverable.
-
z/OS V1.2 with z990 Cryptographic Support Web deliverable.
-
OS/390 V2.10 with z990 Cryptographic Support Web deliverable (available
fourth quarter 2003).
-
z/VM V3.1, V4.2 and later.
-
Linux distributions picking up the right combination of newest crypto
libraries at:
For PCICA:
-
z/OS 1.4 with z/OS V1.4 z990 Compatibility Support feature
-
z/OS V1.3 with z990 Cryptographic Assist Support Web deliverable
-
z/OS V1.2 with z990 Cryptographic Support Web deliverable
-
OS/390 V2.10 with z990 Cryptographic Support Web deliverable (available
fourth quarter 2003)
-
z/VM V4.2 with PTFs and later releases (for Linux Guests only)
-
VSE/ESA V2.7 and IBM TCP/IP for VSE/ESA V1.5
-
Linux on zSeries: Red Hat 7.1 and 7.2 with crypto modules, SuSE SLES 7,
Turbo Linux TLES 8, or Conectiva CLEE
For PCIXCC:
-
z/OS 1.4 with z990 Cryptographic Support Web deliverable
-
z/OS V1.3 with z990 Cryptographic Support Web deliverable (available
fourth quarter 2003)
-
z/OS V1.2 with z990 Cryptographic Support Web deliverable
-
OS/390 V2.10 with z990 Cryptographic Support Web deliverable (available
fourth quarter 2003)
-
z/OS V1.4
-
z/OS V1.2, V1.3, OS/390 V2.10 (available by year end 2003)
The following is required for User-Defined Extensions (UDX) support:
-
One or more PCIXCC features
-
An HMC
-
A TKE workstation at 4.0 code level, if the UDX requires access control
point
-
z/OS V1.4
-
z990 Cryptographic Support, a Web deliverable feature
Software requirements for the OSA-Express features:
The minimum software requirements for the OSA-Express features
available on a z990 are identified. Other functions, not identified in
this announcement, may also have unique software prerequisites. For
further details, including the QDIO and non-QDIO modes of operation,
consult the
Open Systems Adapter-Express Customer's Guide and Reference
(SA22-7935) or refer to the Preventive Service Planning (PSP) bucket for
OSA.
-
OS/390 V2.10, all features and modes
-
z/VM V3.1, all features and modes with exception noted below
-
z/VM V4.2 (required for OSA-Express Token Ring in QDIO mode)
-
VSE/ESA V2.6, all features and modes
-
Linux on zSeries: Red Hat 7.1 and 7.2, SuSE SLES 7, Conectiva CLEE, or
Turbo Linux TLES 8 (QDIO mode [QETH] for all OSA-Express features,
non-QDIO mode [LCS] for OSA-Express Fast Ethernet and Token Ring)
-
TPF 4.1 at PUT 13 (supports Gigabit Ethernet only)
Checksum offload for IPv4 Packets
applies to OSA-Express Gigabit Ethernet (#1364, #1365) and 1000BASE-T
Ethernet (#1366) when in QDIO mode (OSD CHPID type). The minimum
software requirements are:
-
z/OS V1.5.
-
Linux on zSeries. Support was delivered in June 2003 as an Open
Source contribution via:
Port name relief
applies to all of the OSA-Express features in QDIO mode (OSD CHPID
type). The minimum software requirements are:
-
z/VM V4.3 with PTFs. Refer to the PSP bucket.
-
For Linux Direct SNMP required support was delivered in June 2003 as
an Open Source contribution via:
VLAN (802.1q) support
applies to OSA-Express 1000BASE-T Ethernet (#1366), Fast Ethernet
(#2366), and Gigabit Ethernet (#2364, #2365, #1364, #1365) when in QDIO
mode (OSD CHPID type). The minimum software requirements are:
-
z/OS V1.5 Communications Server (refer to Software Announcement
203-131
, dated May 13, 2003)
-
z/VM V4.4
-
SuSE SLES 8, Turbo Linux TLES 8, or Conectiva CLEE
Intrusion Detection Services
applies to all of the OSA-Express features supported on z990 when in
QDIO mode (OSD CHPID type). The minimum software requirements are:
-
z/OS V1.5 Communications Server (refer to Software Announcement
203-131
, dated May 13, 2003)
160 TCP/IP stacks per OSA-Express port
applies to all of the OSA-Express features supported on z990 when in
QDIO mode (OSD CHPID type).
There are no prerequisite software requirements.
New version of OSA/SF and Java GUI
. A new version of the Open Systems Adapter Support Facility (OSA/SF) is
available. This deliverable is a complete replacement of OSA/SF
Version 2 Release 1 (5655-B57), is integrated in the operating
systems, and will be shipped as a PTF where applicable. Refer to the
appropriate PSP bucket. This support applies to all of the OSA-Express
and OSA-2 features and to all servers that support them. The new version
of OSA/SF with the Java GUI is integrated in the operating systems and is
available as follows:
-
z/OS V1.4 z990 Compatibility Support feature
-
z990 Compatibility for Selected Releases Web deliverables
-
OS/390 V2.10, z/OS V1.2, z/OS V1.3
-
Integrated in z/VM V4.4
-
z/VM V3.1, z/VM V4.2, z/VM V4.3 delivered as a PTF
-
VSE/ESA V2.5 delivered as a PTF
OSA-Express Direct SNMP subagent support for dot3StatsTable and updated
SNMP MIB
applies to all of the OSA-Express Ethernet features when in QDIO mode
(OSD CHPID type). The minimum software requirements are:
-
z/OS V1.4 or later with PTFs. Refer to the PSP bucket.
-
For Linux, Direct SNMP required support was delivered in June 2003
as an Open Source contribution via:
Software requirements for HiperSockets enhancements
HiperSockets support in a VSE/ESA environment
HiperSockets VLAN (802.1q) support
is supported by the following operating system:
-
Linux on zSeries. Support was delivered in June 2003 as an Open
Source contribution via:
HiperSockets support 16 Internal LANs and 4096 TCP/IP stacks
is new for HiperSockets (IQD CHPID type), and is exclusive to z990.
There are no prerequisite software requirements.
HiperSockets support of Broadcast for IPv4 packets
is supported by the following operating systems:
-
z/OS V1.5.
-
z/VM V4.4.
-
Linux on zSeries. Support was delivered in June 2003 as an Open
Source contribution via:
HiperSockets (IQD CHPID type) Spanned Channels
is supported by the following operating systems:
-
z/OS support is available via the following PTFs:
-
OA02212/UA01784 for z/OS V1.2 and z/OS V1.3
-
UA01785 for z/OS V1.4
-
z/VM V3.1, z/VM V4.2, z/VM V4.3, and z/VM V4.4
-
VSE/ESA V2.7 and later releases
HiperSockets transparently bridging traffic (Linux Layer 2
Switch support)
Linux on zSeries will be delivered as an Open Source contribution via:
This is aligned with the delivery of hardware support which is planned
for October 31, 2003.
Software requirements for Performance Assists
Adapter Interruptions
are applicable to the FICON Express features (FCP CHPID type) and
OSA-Express features (OSD CHPID type) and are supported by the following
operating systems:
-
z/VM V4.4.
-
VSE/ESA V2.7 and later releases (for OSD CHPID type only).
-
Linux on zSeries. Support was delivered in June 2003 as an Open
Source contribution via:
The Performance Assist for V=V Guests
is applicable to the FICON Express features (FCP CHPID type),
HiperSockets (IQD CHPID type), and OSA-Express features (OSD CHPID type)
and is supported by the following operating system:
Compatibility:
zSeries 800 may not be upgraded to a zSeries 990.
Limitations
Code load required to implement features, functions, and upgrades:
The functions, features, and model upgrades available on
October 31, 2003, require HMC EC #J12846 and a set of required
patches. Prior to implementing the functions, features, and model
upgrades on the z990, the customer must load Driver Level 53, EC
#J12864, and the required patches. These may be loaded concurrently.
The code driver specified in ECA 221 and the required patches will be
available on October 29, 2003.
Mode of operation:
The z990 supports LPAR mode only. Basic mode will not be
supported.
OS/390 2.10 and z/OS limited to LCCS0:
OS/390 V2.10, z/OS V1.2, z/OS V1.3, and z/OS V1.4, with z990
compatibility code installed, can only be IPLed using LCSS0 when running
in LPAR mode. However, these releases may run as a guest under z/VM 4.4,
where z/VM 4.4 is using any channel subsystem. Therefore, you may
run z/OS (or OS/390 V2.10) in LCSS0, and z/VM in LCSS1 where one or more
z/OS images are running as guests.
Note the z/OS V1.4 with the z/OS V1.4 z990 Exploitation feature installed
a z990 can be IPLed using any LCSS.
Dynamic I/O:
Support for dynamic I/O configuration, with z/OS V1.4 z990
Exploitation Support and z/VM V4.4, is planned to be extended to allow
channel paths, control units, and devices to be dynamically added,
changed, and deleted in multiple LCSS's. However, dynamic I/O
configuration is only supported in LCSS0 until October 2003.
Until z/OS V1.4 z990 Exploitation Support is available, z/OS can run only
in a single LCSS. Therefore, z/OS may only execute in LCSS0. z/VM V4.4
may execute in LCSS0 and LCSS1.
z/VM is providing compatibility support for V3.1, V4.2, and V4.3 and
limited exploitation of two LCSS's when running on a z990 server.
Dynamic-I/O configuration is supported when only LCSS0 is defined. z/VM
V4.4 may execute in LCSS0 and LCSS1. However, until October 2003,
dynamic-I/O is supported in only LCSS0.
Refer to the
Software requirements
section for more information on availability dates for z/OS and z/VM.
When z/VM is the controlling LPAR, z/VM's dynamic I/O support is designed to handle all of the new
elements of the multiple channel subsystem facility for dynamic I/O configuration changes. To
dynamically change the I/O configuration, one of two techniques can be employed:
-
z/VM Control Program (CP) suite of interactive dynamic I/O commands
-
HCM/HCD New configuration management tools
TKE limitations:
Customers with TKE 3.X installed workstations may carry forward the features listed below
to control legacy systems only. An update from TKE 3.0 or TKE 3.1 code levels to the TKE 4.0 code
level is required to control the z990. Workstations updated to the TKE 4.0 code level may be used
to control 7060, 9672 Generation 5 and 6, z800, z900, and z990 servers. To use the TKE
function on a z990, the PCIX Cryptographic Coprocessor (PCIXCC) feature, the TKE 4.0 code level, and
the CP Assist for Cryptographic Function (CPACF) must be installed. Refer to the
Software requirements
section for availability dates.
-
TKE with Token Ring (#0866)
-
TKE with Ethernet (#0869)
-
TKE with Token Ring (#0876)
-
TKE with Ethernet (#0879)
-
TKE with Token Ring (#0886)
-
TKE with Ethernet (#0889)
Cryptographic limitations on the z990:
The maximum number of PCIXCC features (#0868) is limited to four per system (one processor
per feature). The total number of PCICAs (#0862) and PCIXCCs (#0868) cannot exceed eight per
system. The number of PCICA features cannot exceed six (12 accelerator features). To enable any
cryptographic function on the z990, the CP Assist for Cryptographic Function (#3863) must be
installed and enabled to use PCIXCC, TKE 4.0 code level hardware, and/or PCICA. Review Hardware and
Software requirements, and Planned availability.
SNA Operations Management:
With the industry move to TCP/IP networks, Systems Network Architecture (SNA) Operations
Management commands will no longer be supported on z990 servers. These commands were previously
used by the System Automation for OS/390 product as well as NetView®. It is recommended that you
now use the Simple Network Management Protocol (SNMP) Application Programming Interfaces (APIs) for
your automation needs.
-
If you previously used the System Automation for OS/390 product, you must now use Version 2.2
or later. This will allow you to define an automation policy for SNMP APIs rather than a policy for
SNA Operations Management commands.
-
If you directly used the SNA Operations Management commands on NetView, you must now use an SNMP
agent and the SNMP APIs for systems automation management.
For detailed information on the SNMP API commands and environment requirements, refer to
zSeries Application Programming Interfaces
(SB10-7030). For more information on the SNA Operations Management command support that is not
offered on z990, refer to
Managing Your Processors
(GC38-0452). Both publications are available on Resource Link.
Planning information
Customer responsibilities
Customer responsibilities for site preparation:
Information on customer responsibilities for site preparation can be found in the following
publications, which are available in the Library section of Resource Link at:
-
System Overview (SA22-1032)
-
Systems Assurance Product Review (SAPR) Guide (SA02-018)
-
Planning for Fiber Optic Links (GA23-0367)
-
zSeries 990 Installation Manual Physical Planning (GC28-6824)
This document contains information necessary for planning the physical
installation of a zSeries 990 system. It includes physical
specifications, power and cooling data, cabling, and additional details
required for physical installation planning. The intended audience for
this document includes all customer personnel who are responsible for
providing the necessary and appropriate environment for the successful
installation and operation of a zSeries 990 system.
Cable orders
Fiber optic cable orders:
Fiber optic cables for z800, z900, and z990 are available via
IBM Networking Services.
IBM Networking Services
is enhancing its fiber cabling services to ensure that IBM has a
comprehensive set of scalable solutions to address all cabling
requirements, from product-level to enterprise-level. IBM Network
Integration and Deployment Services for zSeries fiber cabling provides
planning and installation services for individual fiber optic
connections. IBM Network Integration and Deployment Services for
enterprise fiber cabling provides planning, IBM Fiber Transport System
trunking components, and installation services for small, medium, and
large enterprises.
IGS has the expertise and personnel available to effectively plan and
deploy the appropriate cabling with the future in mind. These services
may include planning, consultation, cable selection, installation, and
documentation, depending upon the services selected.
These services are designed to be right-sized for your products or the
end-to-end enterprise, and to take into consideration the requirements
for all of the protocols/media types supported on zSeries (for example,
ESCON, FICON, Coupling Links, OSA), whether the focus is the data center,
the Storage Area Network (SAN), the Local Area Network (LAN), or the
end-to-end enterprise.
IBM Networking Services
is designed to deliver convenient, packaged services to help reduce the
complexity of planning, ordering, and installing fiber optic cables. The
appropriate fiber cabling is selected based upon the product requirements
and the installed fiber plant.
The services are packaged as follows:
Under the
zSeries fiber cabling services
umbrella there are
three
options to provide individual fiber optic cables (jumper cables,
conversion kits, MCP cables) for connecting to the z800, z900, or z990,
each option incorporating a specific set of services.
-
Option 1 Fiber optic jumper cabling package (available today for z800
and z900). IBM does the detailed planning. This option includes
planning, new cables, installation, and documentation. An analysis of
the zSeries channel configuration, I/O devices, and any existing fiber
optic cabling is required to determine the appropriate fiber optic
cables.
-
Option 2 Fiber optic jumper cable migration and reuse for a zSeries
upgrade (new option). IBM organizes the existing fiber optic cables
based upon the new z990 connection details. Relabeling, rerouting, and
reconnection to the appropriate z990 channels is performed. New cables
are not offered as a part of this option.
-
Option 3 Fiber optic jumper cables and installation (new option).
The customer tells us what they need. They do the detailed planning.
The service includes new cables, installation, and documentation.
Planning and providing the list of required cables are customer
responsibilities.
Options 1 and 2 can be combined within one statement of work to provide
complete upgrade coverage.
Under the
enterprise fiber cabling services
umbrella there are
two
options to provide IBM Fiber Transport System (FTS) trunking commodities
(fiber optic trunk cables, fiber harnesses, panel-mount boxes) for
connecting to the z800, z900, and z990.
-
Option 1 zSeries fiber optic trunk cabling package (new option). IBM
reduces the cable clutter under the floor. An analysis of the zSeries
(z800, z900, z990) channel configuration and any existing fiber optic
cabling is performed to determine the required FTS fiber optic trunking
commodities (trunk cables, harnesses, panel-mount boxes). This option
includes zSeries planning, FTS fiber optic trunking commodities,
installation, and documentation. This option does not include
enterprise-level planning.
-
Option 2 Enterprise fiber cabling services. IBM organizes the entire
enterprise. This option includes enterprise planning, new cables, fiber
optic trunking commodities, installation, and documentation. This is the
most comprehensive set of services.
Refer to the services section of Resource Link for further details.
Access Resource Link at:
Cabling responsibilities:
Fiber optic cables, cable planning, labeling, and placement are
all customer responsibilities for new installations and upgrades. Fiber
optic conversion kits and Mode Conditioning Patch (MCP) cables are not
orderable as features on z990. Installation Planning Representatives
(IPRs) and System Service Representatives (SSRs) will not perform the
fiber optic cabling tasks without a services contract.
The following tasks are required to be performed by the customer prior to
machine installation:
-
All fiber optic cable planning.
-
All purchasing of correct, qualified fiber optic cables.
-
All installation of any required Mode Conditioning Patch (MCP) cables.
-
All installation of any required Conversion Kits.
-
All routing of fiber optic cables to correct floor cutouts for proper
installation to server.
-
Use the Physical CHannel IDentifier (PCHID) report or the report from the
CHannel Path IDentifier (CHPID) Mapping Tool to accurately route all
cables.
-
All labeling of fiber optic cables with PCHID numbers for proper
installation to server.
-
Use the PCHID report or the report from the CHPID Mapping Tool to
accurately label all cables.
Additional service charges may be incurred during the server installation
if the above cabling tasks are not accomplished as required.
The table lists the connectors and cabling supported for each of the
features available for ordering on the z990. For convenience, those
features brought forward on an upgrade from a z900 are also listed.
Feature Connector
number Feature name type Cable type
0219 ISC-3 link LC Duplex 9 micron SM
6154 ETR MTRJ 62.5 micron MM
2324 ESCON channel MTRJ 62.5 micron MM(1)
2319 FICON Express LC Duplex 9 micron SM(2)
LX
2320 FICON Express LC Duplex 50, 62.5
SX micron MM
1364 OSA-E GbE LX(3) LC Duplex 9 micron SM
2364(4) OSA-E GbE LX SC Duplex(5) 9 micron SM
1365 OSA-E GbE SX LC Duplex 50, 62.5
micron MM
2365(4) OSA-E GbE SX SC Duplex(5) 50, 62.5
micron MM
1366 OSA-E RJ-45 Category 5 UTP(7)
1000BASE-T(6)
2366(4) OSA-E Fast RJ-45 Category 5 UTP
Ethernet(6)
2367 OSA-E Token RJ-45 UTP or STP(8)
Ring
-
1
-
MM is multimode fiber.
-
2
-
SM is single mode fiber.
-
3
-
OSA-E refers to OSA-Express.
-
4
-
Brought forward to z990 on an upgrade from z900.
-
5
-
The OSA-Express GbE features brought forward from z900 have a different
connector (SC Duplex) than the new OSA-E GbE features (LC Duplex).
-
6
-
1000BASE-T is the new Ethernet feature.
-
7
-
UTP is Unshielded Twisted Pair.
-
8
-
STP is Shielded Twisted Pair.
Fiber Quick Connect (FQC), a fiber harness integrated in the zSeries
frame for "quick" connect, is offered as a feature on zSeries for
connection to ESCON channels.
Cables for ICB (Integrated Cluster Bus) links continue to be available as
features. Refer to the Sales Manual for a list of these cables and their
feature numbers.
For further details regarding the features, refer to the Sales Manual,
the Physical Planning Manual, or the General Information Manual (GIM)
available on Resource Link.
Note:
IBM Networking Services can satisfy your fiber optic as well as your
copper cabling requirements.
Installability:
Average Installation time for a zSeries 990 is approximately eight
hours. This does not include planning hours. This assumes the
Pre-Installation Configuration Service, a full System Assurance Product
Review, and implementation of the cable services have been performed.
See your IBM representative for details on these services.
Security, auditability, and control
The customer is responsible for evaluation, selection, and implementation of security features,
administrative procedures, and appropriate controls in application systems and communications
facilities.