Batch processor log files and output files

At runtime, the batch processor generates folders and names for each Activity log file and output file.

Activity logs

The Activity log records all major activities performed by the batch processor for each batch job. The Activity log includes:

• Batch job statistics (see Batch job statistics)
• Start, stop, and restart information
• Error information

Before a batch job or chain is picked up by a batch processor instance, the instance writes a Start Up message in the Activity log in the $home/logs folder.

For single batch jobs, each job has its own Activity log file. For chained batch jobs, all jobs in the chain share a single Activity log so that you can more easily locate all information related to your jobs.

When the batch processor starts work on a new job or job chain, it creates a new Activity log file in $home/logs/<processID>. The log name is based on the process ID, according to the format <processID>_Activity.log, such as 15787858_Activity.log.

Output files

The batch processor defines three output writers to generate output files in Write.properties. When providing output for batch processor, such as runbatch.sh inputURL outputURL, the output files will be created under the outputURL. Otherwise, output files will be created for each batch job in the $home/logs/<processID>/<TaskID> folder. Each batch job has its own output files, including jobs that are part of a chain.

The following output writers create output files:

batchLoadSuccess output

The Success writer records the following information about each successful record in the batch:

• date and time
• message ID

The format of output is: <timestamp>,Message ID:<messageId>

For example:

2012-03-07 00:01:12,212, Message ID: 1
2012-03-07 00:01:12,221, Message ID: 2
2012-03-07 00:01:12,261, Message ID: 3
...

Success output files are named batchLoadSuccess.out.

batchLoadSuccessResponse output

The Success Response writer records all successful responses. The output contents include:

• date and time
• message ID
• request
• response

The format of output files is:

<timestamp>,<messageId>,<response>,<request>

Success Response output files are named batchLoadSuccessResponse.out.

batchLoadFail output

The Fail writer records all failed responses. The output contents include:

• date and time
• message ID
• request
• response

The format of output files is:

<timestamp>,<messageId>,<response>,<request>

Failed Response output files are named batchLoadFail.out.