Batch job statistics

One of the Task Comments of the TaskBObj contains the batch job status and statistics.

After batch job processing has begun, the batch processor constantly tracks and updates its statistical information for the task in each batch job status comment.

Note: Some statistics, such as the total number of records processed, may not begin tracking until the job has progressed.

The statistics are saved in the Description column of the InfoSphere® MDM database’s Alerts table.

The batch processor tracks the following statistics for each bulk processing task:

  • Total – The total number of records to be processed (either the number of records in an input file or the number of records returned from the database query). If the total number of records has not yet been determined, the value is recorded as -1.
  • Completed – The total number of successful service calls.
  • Failed – The total number of failed service calls.
  • Termination reason – When the batch must terminate early for any reason, the task status is set to Stopped and the batch processor records one of the following termination reasons:
    • The system is shutting down due to a critical error. The number of failed messages exceeded the specified limit defined in batch.properties.
    • The system is shutting down by user request - the user cancelled the batch run by typing "q" or "Q" in the command window.
    • The task was stopped by user request - the user invoked a service and updated the task status to ’STOPPING’.
    • The input file cannot be found or read.
    • The SQL defined in the task is not valid.
    • Other.
  • File – The name of the input file used for batch processing.
  • Search SQL – The final SQL that is used for searching the database for input records. This value is generated if the SQL is provided through the request TaskBObj’s SQLPrefix, TaskParameter, and SQLSuffix values.
  • Batch instance – The instance name of the batch process that worked on this task.
  • Heartbeat interval – The heartbeat is an integer, in seconds, that measures how frequently the batch processor updates the statistics.
  • Initiate time – The time when the task started for the first time.
  • Start time – The time when the task started for the current batch run.
  • End time – The time when the task was completed, stopped, or terminated.
  • Throughput – The number of transactions per second (TPS), calculated from the start time to the current time. The throughput is represented to two decimal places of precision (0.00).