IBM InfoSphere Streams Version 4.1.0

Chain processing

All record related processing is located in the Chains.

Chains consists of two functional blocks, the Chain Processor and the Chain Sink. Depending on the configured variant, the records are additionally passed through another component, the Group or Context. For more information about relations between chains and contexts, see the topic about variants.

The chains receive the filenames of the input files to process from the Filename Ingestion. The components of the chains are described in the following sections.

Reader
The Chain Processor Reader extracts records from the input files, and validates them.
Transformer
The Chain Processor Transformer enriches the parsed records and applies custom transformation rules to the records.
Context
The Group or Context component hosts all functions which need access to all records from all chains or subset of chains, in order to implement record correlation.
ChainSink
The Chain Sink component handles the storage of the records, processed in the previous components.