A fix is available
APAR status
Closed as program error.
Error description
In the reported case, queue managers were being restarted in a Queue Sharing Group (QSG) in a Disaster Recovery (DR) environment. An ABEND occurred with: DUMP TITLE=CSQ1,ABN=5C6-00C51165,S=00000C17,C=MQ900.920.CFM -CS QERUSH,M=CSQGFRCV,LOC=CSQELPLM.CSQERUSH followed by : IXL016I CONNECTOR CSQEQSG1CSQ102 TO STRUCTURE QSG1CSQ_ADMIN TERMINATING: JOB CSQ1MSTR ASID 00nn REQUESTED DISCONNECT REASON=FAILURE. IXC585E STRUCTURE QSG1CSQ_ADMIN IN COUPLING FACILITY <cfname>, PHYSICAL STRUCTURE VERSION xxxxxxxx xxxxxxxx, IS AT OR ABOVE STRUCTURE FULL MONITORING THRESHOLD OF 85%: SPACE USAGE IN-USE TOTAL % ENTRIES: 6708 52945 12 ELEMENTS: 107043 107055 99 CSQE006I CSQ1 CSQECLOS Structure CSQ_ADMIN connection name CSQEQSG1CSQ102 disconnected IEA794I SVC DUMP HAS CAPTURED: DUMPID=002 REQUESTED BY JOB (CSQ1MSTR) DUMP TITLE=CSQ1, QUEUE MANAGER TERMINATION REQUESTED, REASON=00 C510AB CSQV086E CSQ1 QUEUE MANAGER ABNORMAL TERMINATION REASON=00C510AB 00C51165 means there was an unexpected XES error 00000C17 equates to IXLRSNCODESTRFULL 00C510AB means equates to CSQE_STRFAILURE_OR_LOSSCDNN_ENCOUNTERED In the system log (syslog), an IXC582I message indicated that the ALLOCATION SIZE had not yet reached the MAX STRUCTURE SIZE. A structure rebuild was started, which would increase the number of elements: IXC530I START ALTER REQUEST FOR STRUCTURE QSGLCSQ_ADMIN ACCEPTED. If CSQERUSH retries the IXLLSTE ENTRYTYPE(NEW) for EUOW / UOWD blocks in CSQ_ADMIN, similar to what is done in APAR PH22437, that could give the rebuild time to make more elements available.
Local fix
It is possible that one or more restarts of the queue manager will allow rebuild processing to provide enough space for restart to complete.
Problem summary
**************************************************************** * USERS AFFECTED: All users of IBM MQ for z/OS Version 9 * * Release 2 Modification 0. * **************************************************************** * PROBLEM DESCRIPTION: Abend 5C6-00C51165 in CSQERUSH occurs * * during queue manager startup while * * recovering the admin structure due to * * IxlRsnCodeStrFull. * * The abend is followed by abnormal * * queue manager termination S6C6. * **************************************************************** Following the failure of the admin structure and one or more queue managers, for example in a Disaster Recovery scenario, a queue manager detected that the admin structure needed rebuilding during queue manager startup. While adding the eUOWd control blocks representing units of work for a failed queue manager to the admin structure, each was rewritten to the admin structure with the maximum eUOWd size of 4K rather than the size that was written to the queue manager logs. When there are a large number of units of work being added, this can result in the admin structure filling, leading to the reported abend and subsequent failure of the queue manager to complete startup processing.
Problem conclusion
CSQERUSH has been changed to use the logged size of each eUOWd when repopulating the admin structure.
Temporary fix
Comments
APAR Information
APAR number
PH39578
Reported component name
IBM MQ Z/OS V9
Reported component ID
5655MQ900
Reported release
200
Status
CLOSED PER
PE
NoPE
HIPER
YesHIPER
Special Attention
NoSpecatt / Xsystem
Submitted date
2021-08-04
Closed date
2021-11-17
Last modified date
2022-01-04
APAR is sysrouted FROM one or more of the following:
APAR is sysrouted TO one or more of the following:
UI78113
Modules/Macros
CSQERUSH
Fix information
Fixed component name
IBM MQ Z/OS V9
Fixed component ID
5655MQ900
Applicable component levels
R200 PSY UI78113
UP21/12/11 P F112 ¢
Fix is available
Select the PTF appropriate for your component level. You will be required to sign in. Distribution on physical media is not available in all countries.
[{"Line of Business":{"code":"LOB45","label":"Automation"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Product":{"code":"SSYHRD","label":"IBM MQ"},"Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"200"}]
Document Information
Modified date:
05 January 2022