Troubleshooting
Problem
An IBM MQ queue manager is reporting errors logging data or recovering information from its logs, and you need to collect Mustgather data to find a solution.
Environment
These instructions apply only to IBM MQ V9.0 and V8.0, and WebSphere MQ V7.5, V7.1, V7.0 and V6.0 on AIX, HP-UX, Linux, Solaris and Windows, and to IBM MQ V9.0 and V8.0, and WebSphere MQ V7.1, V7.0 and V6.0 on IBM i. Refer to the IBM MQ Read First page for instructions on other operating systems:
Resolving The Problem
Please answer these questions about the problem and then follow the steps below:
- What logging or recovery problem did you observe on the system?
- What time did the logging or recovery problem start and when did it stop?
- What other details can you provide to help determine the cause of the problem?
Step 1: Generate Data
If the logging or recovery problem is happening right now, or if you can reproduce it, generate data to provide more information about the problem:
- Generate a trace of the queue manager while the problem is happening. Consider gather a high detail trace if you have plenty of disk space:
- On Linux, UNIX and Windows systems, dump the contents of the queue manager logs. This is particularly useful if you suspect a problem with the amount of data being logged. Please note that you must stop the queue manager in question in order to dump its logs, and you must also provide the log path for the queue manager, which is available as the "LogPath" attribute in its qm.ini file. For example:
Dumping logs for queue manager QMA on Linux and UNIX
sh> endmqm -i QMA
sh> dmpmqlog -b -m QMA -f /var/mqm/log/QMA > /tmp/QMA.dmpmqlog.txt
sh> strmqm QMADumping logs for queue manager QMA on Windows
C:\> endmqm -i QMA
C:\> dmpmqlog -b -m QMA -f "C:\ProgramData\IBM\MQ\log\QMA" > %TEMP%\QMA.dmpmqlog.txt
C:\> strmqm QMA
- On Linux and UNIX systems, save the output from the mqconfig command. If you are running IBM MQ V9.0 or V8.0, WebSphere MQ V7.5.0.2 or later, or V7.1.0.3 or later, the mqconfig command is already available as part of the MQ server installation.
Step 2: Collect Data
- If you gathered these files in Step 1, place the dmpmqlog output and the mqconfig data directly in the top-level MQ errors directory. Both the runmqras automation tool and the manual collection steps below collect files found there.
- Collect data automatically with the runmqras command if you are running IBM MQ V9.0 or V8.0, WebSphere MQ V7.5, V7.1.0.1 or later, or V7.0.1.8 or later. Be sure to collect the runmqras defs, logger and trace sections, and to specify your PMR number:
- Alternatively, collect the MQ data manually.
- If your system has more than one MQ installation, use the setmqenv command to choose the one with the problem before proceeding:
Linux and UNIX
sh> . /path/to/mqm/bin/setmqenv -n InstallationXWindows
C:\> "C:\Program Files\IBM\MQ\bin\setmqenv" -n InstallationX - Record the MQ version and maintenance level.
- Record the operating system version and maintenance level.
- Save the MQ configuration information, for example registry keys and ini files.
- If your system has more than one MQ installation, record your MQ installation details:
Linux and UNIX
sh> dspmqinst > /tmp/dspmqinst.txtWindows
C:\> dspmqinst > %TEMP%/dspmqinst.txt - On MQ server installations, record the status of your queue managers:
Linux and UNIX
sh> dspmq -a > /tmp/dspmq.txtWindows
C:\> dspmq -a > %TEMP%/dspmq.txtIBM i Command Line
===> WRKMQMIBM i Qshell
===> /QSYS.LIB/QMQM.LIB/DSPMQ.PGM -a > /tmp/dspmq.txt - On MQ server installations, record the MQ processes active on your system:
Linux and UNIX
sh> ps -ef | grep mq > /tmp/ps.txtWindows
C:\> TASKLIST /V > %TEMP%/tasklist.txtIBM i Command Line
===> WRKACTJOB SBS(QMQM)IBM i Qshell
===> ps -ef | grep mq > /tmp/ps.txt - On Linux, UNIX and Windows systems, list the contents of the queue manager LogPath directory. For example:
Listing logs for queue manager QMA on Linux and UNIX
sh> ls -ltR /var/mqm/log/QMA > /tmp/QMA.logfiles.txtListing log files for queue manager QMA on Windows
C:\> DIR /s "C:\ProgramData\IBM\MQ\log\QMA" > %TEMP%/QMA.logfiles.txt - On Linux, UNIX and Windows systems, make sure the file system or disk holding the logs is not full. For example:
Displaying file systems on Linux and UNIX
sh> df -k > /tmp/filesystems.txtDisplaying disk usage on Windows
C:\> DIR C: > %TEMPT/diskuage.txt - On Linux, UNIX and Windows systems, run the amqldmpa program against the queue manager to gather details about the logger. The command must be run by an MQ administrator and the output file should be in a location which is writeable by the queue manager. For example:
Dumping logger information for queue manager QMA on Linux and UNIX
sh> amqldmpa -m QMA -c H -d 8 -f /tmp/QMA.amqldmpa.logger.txtDumping logger information for queue manager QMA on Windows
C:\> amqldmpa -m QMA -c H -d 8 -f %TEMP%\QMA.amqldmpa.logger.txt - On all systems, run the amqldmpa program against the queue manager to gather details about the persistence layer. The command must be run by an MQ administrator and the output file should be in a location which is writeable by the queue manager. For example:
Dumping persistence information for queue manager QMA on Linux and UNIX
sh> amqldmpa -m QMA -c A -d 8 -f /tmp/QMA.amqldmpa.dap.txtDumping persistence information for queue manager QMA on Windows
C:\> amqldmpa -m QMA -c A -d 8 -f %TEMP%\QMA.amqldmpa.dap.txtDumping persistence information for queue manager QMA in the IBM i Qshell
===> /QSYS.LIB/QMQM.LIB/AMQLDMPA.PGM -m QMA -c A -d 8 -f /tmp/QMA.amqldmpa.dap.txt - On Linux, UNIX and Windows systems, collect the log file header, amqhlctl.lfh, which is found in the active subdirectory of the queue manager's LogPath. For example:
Log file header for queue manager QMA on Linux and UNIX
/var/mqm/log/QMA/active/amqhlctl.lfhLog file header for queue manager QMA on on Windows
C:\ProgramData\IBM\MQ\Log\QMA\active\amqhlctl.lfh - On IBM i only, find the "Library" attribute from the queue manager's qm.ini file and display its contents. Alternatively, display library "QM*" and select your queue manager from the the list to display its contents. For example:
Display the library for queue manager QMA on IBM i
===> WRKLIB LIB(QMQMA)Display the library for all queue manager
===> WRKLIB LIB(QM*) - On IBM i only,use the same "Library" value to work with the queue manager's journals. Save the output, then use F17 to display attached journal receives and save the output form those screens as well. For example:
Display the journals and journal receivers for queue manager QMA on IBM i
===> WRKJRNA JRN(QMQMA/AMQAJRN)
Then press F17=Display attachd receiver attributes - Manually package your files for IBM, including files containing the output from the commands listed in Step 1 and 2.
- If your system has more than one MQ installation, use the setmqenv command to choose the one with the problem before proceeding:
Collecting runmqras output from queue manager QMA
runmqras -section defs,logger,trace -qmlist QMA -pmrno 12345,67R,890
Step 3: Send Data to IBM
- Send your data to the IBM ECuRep repository by email to [email protected], by standard or secure HTTP or FTP. or by using the IBM Secure Diagnostic Data Upload Utility (SDDUU) Java application.
- While the data is transferring, send an email or use the IBM Service Request tool to update your PMR with your description of the problem and of the data you are sending.
- Contact your country representative if you need to speak to an IBM technical support representative, or in the US call 1-800-IBM-SERV. Refer to the IBM Software Support Handbook for more information on working with IBM.
A good description of the problem and the data is the most important information you can provide to IBM. Please do not send data without providing a description!
[{"Product":{"code":"SSFKSJ","label":"WebSphere MQ"},"Business Unit":{"code":"BU053","label":"Cloud & Data Platform"},"Component":"Problem Determination","Platform":[{"code":"PF002","label":"AIX"},{"code":"PF010","label":"HP-UX"},{"code":"PF012","label":"IBM i"},{"code":"PF016","label":"Linux"},{"code":"PF027","label":"Solaris"}],"Version":"9.0;8.0;7.5;7.1;7.0;6.0","Edition":"All Editions","Line of Business":{"code":"LOB45","label":"Automation"}}]Product Synonym
IBMMQ WebSphere MQ WMQ
Was this topic helpful?
Document Information
Modified date:
22 June 2018
UID
swg21632016