IBM Tivoli Workload Scheduler LoadLeveler for AIX 5L, V3.4 delivers improved job scheduling and job launch performance

IBM United States Software Announcement 206-245
October 10, 2006


 ENUS206-245.PDF (48KB)

Table of contents   Document options  
TOC link At a glance TOC link Publications
TOC link Overview TOC link Technical information
TOC link Key prerequisites TOC link Ordering information
TOC link Planned availability date TOC link Terms and conditions
TOC link Description TOC link IBM Electronic Services
TOC link Product positioning TOC link Prices
TOC link Reference information TOC link Order now
TOC link Offering Information  
Printable version Printable version

At a glance

IBM Tivoli® Workload Scheduler (TWS) LoadLeveler for AIX 5L, V3.4 allows users to run more jobs on IBM System p servers in less time by matching the jobs' processing needs with the available resources. Version 3.4 adds the following enhancements:

  • Provides enhanced job spool recovery
  • Provides a new communication scheme for reliable and fast job launch performance and improved scalability
  • Incorporates multiple top-dog support into the BACKFILL scheduler
  • Integrates MPICH job management with TWS LoadLeveler
  • Enables TWS LoadLeveler to coschedule multiple job steps while placing minimal restrictions on the type and number of resource requirements that can be specified within the coscheduled job steps
  • Removes restriction for the maximum number of reservations allowed in a cluster
  • Allows jobs to exploit the SMT feature of POWER and POWER5+ architecture

For ordering, contact:

Your IBM representative, an IBM Business Partner, or IBM Americas Call Centers at 800-IBM-CALL (Reference: RE001).
Back topBack to top


TWS LoadLeveler® for AIX 5L™, V3.4 is a job management system that allows users to run more jobs in less time by matching the jobs' processing needs with the available resources. TWS LoadLeveler schedules jobs and provides functions for building, submitting, and processing jobs quickly and efficiently in a dynamic environment.

Version 3.4 enhancements include:

  • The llmovespool command has been added to move the job records from the spool of one managing schedd to another managing schedd in the local cluster. This command is intended to recover job records from a spool when the original managing schedd is no longer available.
  • A new communication scheme has been introduced in TWS LoadLeveler to provide reliable and fast job launch performance and improved scalability.
  • Multiple top-dog support (top dog is a high-priority job that cannot run due to insufficient available resources) has been incorporated into the BACKFILL scheduler, which allows one or more top dogs to be allocated a future start time. The scheduler will identify the lack of required resources for job execution, and compute the earliest start time when the resources are available. The resources will be allocated to the top-dog jobs, and remaining jobs in the queue will be backfilled so that top-dog jobs are not delayed.
  • A coscheduling function has been added to enable TWS LoadLeveler to coschedule multiple job steps while placing minimal restrictions on the type and number of resource requirements that can be specified within the coscheduled job steps. This allows coscheduled job steps to take advantage of the current state-of-the-art job scheduling paradigms such as top-dog reservation, BACKFILL, preemption, and advance resource reservations, which are presently supported in the TWS LoadLeveler product.
  • MPICH job management has been integrated with TWS LoadLeveler. Operations allowed for Parallel Environment parallel jobs are supported for MPICH parallel jobs.
  • The job command language has been extended to allow jobs to exploit the SMT feature of POWER™ and POWER5+™ architecture.
  • The restriction on the maximum number of reservations allowed in a cluster has been removed.

Back topBack to top
Key prerequisites
  • AIX 5L V5.3
  • Any of these systems:
    • System p™ servers
    • pSeries® servers
    • BladeCenter® servers
    • Cluster 1600

Back topBack to top
Planned availability date

October 27, 2006
Back topBack to top


TWS LoadLeveler for AIX 5L, V3.4 is a distributed network-wide job management facility designed to dynamically schedule work on UNIX® servers, such as the System p.

TWS LoadLeveler schedules jobs and provides functions for building, submitting, and processing jobs quickly and efficiently in a dynamic environment. Batch jobs can be submitted, either serial or parallel, to run in the background and require no input from the user.

The smt keyword has been introduced in the TWS LoadLeveler job command file to enable or disable dynamic simultaneous multithreading (SMT). This keyword can also be set in the job class stanza in the TWS LoadLeveler administration file so that all parallel jobs submitted in that class will run with SMT on or off by default.

To help you find information about quickly starting TWS LoadLeveler using the default configuration, the new "Getting a quick start using the default configuration" topic has been added to the TWS LoadLeveler: Using and Administering manual.

Accessibility by people with disabilities

A U.S. Section 508 Voluntary Product Accessibility Template containing details on the products accessibility compliance can be requested at

Back topBack to top
Product positioning

Tivoli Workload Scheduler LoadLeveler is ideal for users who need to submit jobs as necessary, not according to any pre-set schedule. Other job schedulers that provide a rule-based batch workload management for inter-job dependencies and scheduling jobs at predetermined schedules can be integrated with TWS LoadLeveler.

TWS LoadLeveler fits well in:

  • Cluster environments where you want to improve resource utilization and job throughput across a variety of servers
  • Cluster environments where you want to exploit idle server cycles
  • A Beowulf cluster environment for running massively parallel MPI applications
  • Environments where users are new to cluster computing and need an easy-to-use, fully documented and supported job scheduler
  • Grid environments in which multiple applications are being dispatched across virtualized resources

TWS LoadLeveler provides an excellent framework for managing both serial and parallel batch workload in a single cluster as well as multicluster environments. Both Linux™ and AIX® jobs can be submitted within the same LoadLeveler cluster or across multiple clusters on a grid. Tivoli Workload Scheduler LoadLeveler also supports load balancing for interactive parallel operating environment sessions and provides various advanced job scheduling functions in a large-scale parallel computing environment.

Advanced interconnects from IBM and third-party vendors, used for High Performance Computing such as the High Performance Switch, are supported in this latest version of TWS LoadLeveler.
Back topBack to top

Reference information

Refer to Software Announcement 206-263 , dated October 10, 2006.

Business Partner information

If you are a Direct Reseller - System Reseller acquiring products from IBM, you may link directly to Business Partner information for this announcement. A PartnerWorld ID and password are required (use IBM ID).

BP Attachment for Announcement Letter 206-245


AIX 5L, POWER, POWER5+, and System p are trademarks of International Business Machines Corporation in the United States or other countries or both.
LoadLeveler, eServer, pSeries, BladeCenter, Tivoli, and AIX are registered trademarks of International Business Machines Corporation in the United States or other countries or both.
UNIX is a registered trademark of the Open Company in the United States and other countries.
Linux is a trademark of Linus Torvalds in the United States, other countries or both.
Other company, product, and service names may be trademarks or service marks of others.

Back topBack to top
Offering Information

Product information is available via the Offering Information Web site

Back topBack to top

No publications are shipped with this program.

The following publications are available from the Web:

  • IBM TWS LoadLeveler®: Using and Administering
  • IBM TWS LoadLeveler: Diagnosis and Messages Guide
  • IBM TWS LoadLeveler: Installation Guide

To access all TWS LoadLeveler documentation, refer to the IBM Cluster Information Center Web site. This Web site contains the most recent TWS LoadLeveler documentation in PDF and HTML formats and is located at

A Documentation Updates file is also maintained on this Web site, which contains updates to the TWS LoadLeveler documentation. These updates include corrections and clarifications made after the TWS LoadLeveler books were originally published.
Back topBack to top

Technical information

Specified operating environment

Hardware requirements

  • System p™
  • pSeries®
  • BladeCenter® POWER™ technology-based servers
  • Cluster 1600

Software requirements

  • AIX 5L™ V5.3, TL 5300-05.
  • TWS LoadLeveler APAR IY89241.
  • To run parallel operating environment jobs, Parallel Environment for AIX 5L, V4.2.2 or V4.3 (5765-F83) is required.
  • If using the GUI, AIXwindows® Environment and Java™ Runtime Environment are required.
  • If using the Config Tasks Wizard, TaskGuide Runtime Environment is required.

Compatibility: A TWS LoadLeveler cluster can consist of some machines running the TWS LoadLeveler V3.4 level of software while the rest of the cluster remains at the TWS LoadLeveler V3.3 software level. See the IBM TWS LoadLeveler V3.4: Installation Guide .

Performance considerations: TWS LoadLeveler will run at least two daemon processes on every machine in the TWS LoadLeveler cluster, except on submit-only machines where no TWS LoadLeveler daemon processes run. The master daemon is responsible for starting and monitoring all other daemons run on every machine that is not a submit-only machine.

A schedd daemon process must be configured to run on one or more machines in the TWS LoadLeveler cluster. The schedd daemon manages a local internal database containing all the records for jobs the daemon receives from the submit command. The schedd daemon will communicate with the negotiator daemon and the startd daemons in order to dispatch and monitor its jobs. The number of schedd daemons in a cluster should increase as the number of active jobs increases.

The startd daemon must run on each machine in the cluster that will be running jobs. The startd is responsible to monitor resource availability on the machine and report it to the central manager. The startd is also responsible for starting the job on the machine.

The negotiator daemon runs on a single machine in the cluster. The negotiator daemon receives job requirements from the schedd daemons and resource availability from the startd daemons and runs the scheduling algorithm that determines the order in which the jobs run and the resources assigned to the jobs. Typically, the negotiator daemon will require the most CPU and memory resources. The resource usage of the negotiator daemon depends on the number of jobs that need to be scheduled, the number of machines in the cluster, and the frequency at which the scheduling algorithm is scheduled to run.

Planning information

TWS LoadLeveler, V3.4 no longer supports the following functions:

  • Gang Scheduler
  • Network Queuing System
  • SP™ Switch
  • Distributed Computing Environment
  • Parallel Job API
  • Parallel System Support Program

Version 3.4 is the last release to support the following functions:

  • The scheduling of parallel jobs with the default scheduler (SCHEDULER_TYPE=LL_DEFAULT)
  • The API functions 'll_get_nodes', 'll_get_jobs', and 'll_start_job'

Packaging: This program is distributed as a single package available via CD-ROM media (LCD8-0563). A product README file and license information is shipped with the product in softcopy (L-RHAN-6RRRD4 or LC23-4999-00). Publications are available online.

Security, auditability, and control

IBM TWS LoadLeveler uses the security and auditability features of the AIX 5L Operating System.

The customer is responsible for evaluation, selection, and implementation of security features, administrative procedures, and appropriate controls in application systems and communication facilities.

Software Services

IBM Services has the breadth, depth, and reach to manage your services needs. You can leverage the deep technical skills of our lab-based, software services team and the business consulting, project management, and infrastructure expertise of our IBM Global Services team. Also, we extend our IBM Software Services reach through IBM Business Partners to provide an unmatched portfolio of capabilities. Together, we provide the global reach, intellectual capital, industry insight, and technology leadership to support any critical business need.

To learn more about IBM Software Services or to contact a software services sales specialist, visit

Back topBack to top
Ordering information

Charge metric

                  Part number
Program name      or PID number   Charge metric
TWS LoadLeveler   5765-E69        Per processor, per small,
 for AIX 5L                        medium, or large server
1-year SWMA:      5660-LLV        Per processor, per small,
 Registration                      medium, or large server
 and Renewal
1-year SWMA:      5661-LLV        Per processor, per small,
 After-license                     medium, or large server
3-year SWMA:      5662-LLV        Per processor, per small,
 Registration                      medium, or large server
3-year SWMA:      5663-LLV        Per processor, per small,
 Renewal                           medium, or large server
3-year SWMA:      5664-LLV        Per processor, per small,
 After-license                     medium, or large server


A processor (commonly called a "CPU" or "core") is a functional unit within a computing device that interprets and executes instructions. A processor consists of at least an instruction control unit and one or more arithmetic or logic unit. With multicore technology, each core is considered a processor. With full capacity licensing, a proof of entitlement (POE) must be acquired for all activated processors on the server available to the program or a component of the program.

System Program Order (SPO) (5692-A5L): A 5692-A5L SPO is mandatory for shipments of program distribution and publications. The individual licensed program orders are for registration and billing purposes only. No shipment occurs under these orders.

Machine-readable materials are only available on CD-ROM. To receive shipment of machine-readable materials under SPO (5692-A5L), order the CD-ROM media.

Specify feature number 3410. Billing for the media is generated under the SPO. To prevent additional billing expenses, place only one SPO order per machine.

Select one of the following (5692-A5L) features for the licensed program hardcopy entitled publications.

Include feature number 9001 for asset registration to be shipped on a given date.

Program                                         Feature
number      Program name                        number
5692-A5L    TWS LoadLeveler for AIX 5L, V3.3    0980
5692-A5L    TWS LoadLeveler for AIX 5L, V3.4    1410

Under SPO 5692-A5L, feature number 3470 can be used to suppress hardcopy documentation. To order entitled hardcopy documentation only, order feature number 3430.
Back topBack to top

Terms and conditions

Licensing: IBM International Program License Agreement and License Information document. POEs are required for all authorized use.

This software license includes Software Maintenance, previously referred to as Software Subscription and Technical Support.

The following agreement applies for maintenance and does not require customer signatures:

  • IBM Agreement for Acquisition of Software Maintenance (Z125-6011)

Limited warranty applies: Yes

Warranty: This program includes a warranty for one year from acquisition from IBM or an authorized IBM Business Partner. For one year from acquisition of the program, this warranty provides the customer with access to databases containing program information and FAQs, including any known fixes to defects, which the customer can download or otherwise obtain and install.

Money-back guarantee: If for any reason you are dissatisfied with the program and you are the original licensee, return it within 30 days from the invoice date, to the party (either IBM or its reseller) from whom you acquired it, for a refund. For clarification, note that for programs acquired under any of IBM's On/Off Capacity on Demand (On/Off CoD) software offerings, this term does not apply since these offerings apply to programs already acquired and in use by the customer.

Copy and use on home/portable computer: No

Volume orders (IVO): Yes, contact your IBM representative.

Passport Advantage® applies: No

Software Maintenance applies: Yes

All distributed software licenses include Software Maintenance (Software Subscription and Technical Support) for a period of 12 months from the date of acquisition, providing a streamlined way to acquire IBM software and assure technical support coverage for all licenses. Extending coverage for a total of three years from date of acquisition may be elected.

While your Software Maintenance is in effect, IBM provides you assistance for your routine, short duration installation and usage (how-to) questions; and code-related questions. IBM provides assistance via telephone and, if available, electronic access, only to your IS technical support personnel during the normal business hours (published prime shift hours) of your IBM support center. (This assistance is not available to your end users.) IBM provides Severity 1 assistance 24 hours a day, every day of the year. For additional details, consult your IBM Software Support Guide at

Software Maintenance does not include assistance for the design and development of applications, your use of programs in other than their specified operating environment, or failures caused by products for which IBM is not responsible under this agreement.

IBM Operational Support Services — SoftwareXcel: No

Other support: System p SWMA

iSeries™ Software Maintenance applies: No

Variable charges apply: Yes

Educational allowance available

Yes, 15% education allowance applies to qualified education institution customers.

On/Off Capacity on Demand

To be eligible for On/Off Capacity on Demand pricing, customers must be enabled for temporary capacity on the corresponding hardware, and the required contract — Z125-6907, Amendment for iSeries and pSeries Temporary Capacity On Demand — Software — must be signed prior to use.
Back topBack to top

IBM Electronic Services

IBM Global Services has transformed its delivery of hardware and software support services to put you on the road to higher systems availability. IBM Electronic Services is a Web-enabled solution that provides you with an exclusive, no-additional-charge enhancement to the service and support available on the IBM eServer platform. These services provide the opportunity for greater system availability due to faster problem resolution and preemptive monitoring. IBM Electronic Services is comprised of two separate, but complementary, elements: IBM Electronic Services news page and IBM Electronic Service Agent™.

IBM Electronic Services news page provides you with a single Internet entry point that replaces the multiple entry points traditionally used by customers to access IBM Internet services and support. The news page enables you to gain easier access to IBM resources for assistance in resolving technical problems.

The IBM Electronic Service Agent is no-additional-charge software that resides on your IBM eServer system. It is designed to proactively monitor events and transmit system inventory information to IBM on a periodic, customer-defined timetable. The IBM Electronic Service Agent tracks system inventory, hardware error logs, and performance information. If the server is under a current IBM maintenance service agreement or within the IBM warranty period, the Service Agent automatically reports hardware problems to IBM. Early knowledge about potential problems enables IBM to provide proactive service that may result in higher system availability and performance. In addition, information collected through the Service Agent will be made available to IBM service support representatives when they are helping answer your questions or diagnosing problems.

To learn how IBM Electronic Services can work for you, visit

Back topBack to top

The prices provided in this announcement are suggested retail prices for the U.S. only and are provided for your information only. Dealer prices may vary, and prices may also vary by country. Prices are subject to change without notice. For additional information and current prices, contact your local IBM representative.

Variable charges: The applicable processor-based one-time charge will be based on the group of the designated machine on which the program is licensed for use. If the program is designated to a processor in a group for which no charge is listed, the charge of the next higher group listed applies. For movement to a machine in a higher group, an upgrade charge equal to the difference in the then-current charges between the two groups will apply. For movement to a machine in a lower group, there will be no adjustment or refund of charges paid.
Back topBack to top

Order now

To order, contact the Americas Call Centers, your local IBM representative, or your IBM Business Partner.

To identify your local IBM representative or IBM Business Partner, call 800-IBM-4YOU (426-4968).

 Phone:      800-IBM-CALL (426-2255)
 Fax:        800-2IBM-FAX (242-6329)
 Mail:       IBM Americas Call Centers
             Dept. Teleweb Customer Support, 9th floor
             105 Moatfield Drive
             North York, Ontario
             Canada M3B 3R1
 Reference:  RE001

The Americas Call Centers, our national direct marketing organization, can add your name to the mailing list for catalogs of IBM products.

Note: Shipments will begin after the planned availability date.


System p, POWER, AIX 5L, SP, iSeries, and Electronic Service Agent are trademarks of International Business Machines Corporation in the United States or other countries or both.
LoadLeveler, eServer, pSeries, BladeCenter, AIXwindows, and Passport Advantage are registered trademarks of International Business Machines Corporation in the United States or other countries or both.
Java is a trademark of Sun Microsystems, Inc.
Other company, product, and service names may be trademarks or service marks of others.

Back to topBack to top

Printable version Printable version  

Share this page

Digg Linked In

Contact IBM