Event messages using WebSphere MQ transport arrive in the wrong order at WebSphere Business Monitor
When monitoring events that are sent over WebSphere MQ, metrics and KPIs are calculated incorrectly, and event messages are routed to the failed event queue.
The Monitor model requires events to arrive in the same order in which they were sent, but the events arrive out of order.
Some Monitor models require events to be sent from the same event producer, such as an instance of a process or a message flow, to be processed by Business Monitor in the order in which they were produced. For models where event order is important, incorrect event sequence order can result in model processing exceptions, and incorrectly calculated data.
Ensuring strict message sequencing across a distributed environment is complex and does not scale easily. If possible, message (re)ordering should be done in the target application, such as Business Monitor using sequence attributes of the message payload. This reduces the possibility of
messages being processed out of sequence.
When Monitor events flow through a WebSphere MQ network with multiple queue managers, careful planning is necessary to keep messages in sequence. Some of the factors that might affect message ordering are:
- Message priority
- Syncpointing and backout handling in the emitter applications
- Usage of a dead-letter queue
- Topology of MQ network (multi-hopping)
- Channel options (message-retry channel exit, NPMSPEED(FAST) )
- Cluster workload balancing options
Resolving the problem
If possible, use the event re-sequencing (reordering) mechanism that is available in Business Monitor for the Monitor model.
If this is not possible, you must ensure that all events emitted from the same application travel through the same MQ network route. If any applications, such as a message-driven bean, process the events enroute, all events must be processed by the same instance of the application.
1. Ensure MQOO_BIND_ON_OPEN is set on the MQ cluster queues.
This option ensures that messages emitted from a specific application instance are sent to the same MQ cluster queue. Individual application instances will continue to be workload-balanced between MQ cluster queues to provide scalability.
This option must be used when messages from the same application instance must be delivered in a strict sequence.
Note that if the destination queue manager becomes unavailable while an instance of an application is still emitting messages to it, this application will fail.
If MQOO_BIND_NOT_FIXED is set on MQ cluster queues, all messages will be workload-balanced on a message-by-message basis. This means that message sequence at the destination cannot be predicted.
3. To force the sequence of delivery from SI bus, the "Maintain strict message order" option must be enabled for destinations on the CEI and MONITOR bus.
Note: There is no way to make strict message ordering the default for newly deployed Monitor models, it must be explicitly set for the MONITOR bus destinations of the Monitor model each time, if required.
Processing strategies for monitor models
Event sequencing in Business Monitor
JMS emitter event sequencing and multi-threaded process
Strict message ordering using activation specifications
Strict message order for a bus destination
Message affinities in WebSphere MQ clusters
Delivery ordering with WebSphere MQ mesaging provider
|Business Integration||IBM Business Monitor||Not Applicable||AIX, Linux, Solaris, Windows, z/OS||184.108.40.206, 8.0.1, 8.0, 220.127.116.11, 7.5.1, 18.104.22.168, 7.5|
|Business Integration||WebSphere MQ||Not Applicable||AIX, HP-UX, Linux, Solaris, Windows, z/OS||22.214.171.124, 7.5, 126.96.36.199, 188.8.131.52, 7.1, 184.108.40.206, 220.127.116.11, 18.104.22.168, 7.0.4, 7.0.3, 7.0.2, 22.214.171.124, 126.96.36.199, 188.8.131.52, 184.108.40.206, 220.127.116.11, 18.104.22.168, 22.214.171.124, 126.96.36.199, 188.8.131.52, 184.108.40.206, 7.0.1, 220.127.116.11, 18.104.22.168, 7.0, 22.214.171.124, 126.96.36.199, 188.8.131.52, 184.108.40.206, 220.127.116.11, 18.104.22.168, 22.214.171.124, 126.96.36.199, 188.8.131.52, 184.108.40.206, 220.127.116.11, 18.104.22.168, 6.0.2, 22.214.171.124, 126.96.36.199, 6.0.1, 6.0|
|Business Integration||WebSphere Message Broker||MQSeries||AIX, HP-UX, Linux, OS/390, Solaris, Windows||188.8.131.52, 184.108.40.206, 8.0, 220.127.116.11, 18.104.22.168, 22.214.171.124, 126.96.36.199, 188.8.131.52, 7.0, 6.1, 6.0.2, 6.0|
More support for:
WebSphere Business Monitor
Software version: 6.1, 6.1.1, 6.1.2, 6.2, 184.108.40.206, 220.127.116.11, 18.104.22.168, 7.0, 22.214.171.124, 126.96.36.199, 188.8.131.52, 184.108.40.206, 7.5, 7.5.1
Operating system(s): AIX, Linux, Solaris, Windows, z/OS
Reference #: 1641963
Modified date: 2013-07-10