HLASM Toolkit Feature User's Guide
Previous topic | Next topic | Contents | Contact z/OS | Library | PDF


How SuperC partitions and processes large files

HLASM Toolkit Feature User's Guide
GC26-8710-10

In SuperC, there is no limit on the size of files processed in terms of lines, words or bytes. Yet it has an internal methodology based upon a maximum field size for each work area storage structure. SuperC performs the overall comparison process by breaking large files into smaller comparison partitions and combining the intermediate results into one overall result. The process attempts to ensure that the file partitioning does not appear to be determined after some arbitrary limit is reached. This can affect the results on either side of the break point.

A partitioning size of 32000 lines/words/bytes is the default. This size can be adjusted by specifying the WORKSIZE process statement. The compare processes up to this limit and iteratively adjusts the intermediate ending break point of the pass by an adaptive method. Continuation from the adjusted end point is the basis for the next pass. That end point might even be adjusted to some previous records that have already been processed. The objective is to achieve the next best compare set for future unprocessed records.

The overall process ends when both files reach the End-of-File during a pass. The results from the intermediate passes are combined into one user end result. Most large compares never appear to have been partitioned and recombined.

Go to the previous page Go to the next page




Copyright IBM Corporation 1990, 2014