IBM InfoSphere Streams Version 4.1.0

Check accessibility of input and output directories

Your application reads from and writes to the file system requiring that the application has read and write access to the directories.

The input directories for ITE applications are configured with the ite.ingest.directory.input or ite.ingest.directory.inputListFile parameters. The output directories of ITE applications are configured with ite.storage.directory.outputs and ite.storage.directory.statistics parameters.

The input directories of the Lookup Manager are defined by the lm.commandsDirectory and lm.file.directory parameters. The lm.statisticsDirectory parameter defines the Lookup Manager’s output directory.

It is necessary for hosts that read input files, to have access to the input directories. Hosts that create output files, need to have write access to the output directories.

The Lookup Manager and ITE applications create the required directories during their startup phase.

Performance recommendation: The directories that are configured with the ite.ingest.directory.input and ite.storage.directory.outputs parameters should be located on different mount points to improve the I/O throughput.

Procedure

  1. For every ITE application determine the values of the ite.ingest.directory.input, ite.ingest.directory.inputListFile, ite.storage.directory.outputs, and ite.storage.directory.statistics parameters.
  2. For the Lookup Manager application determine the values of the lm.commandsDirectory, lm.file.directory, and lm.statisticsDirectory parameters.
  3. For every host having an <ite-namespace>_ingest host tag check the accessibility of the input directories.
  4. If the directories are not accessible, make them accessible by either creating them or providing the appropriate access rights.
  5. For every host having the <ite-namespace>_chain or <ite-namespace>_chain_<id> host tag, check the accessibility of the input and output directories.
  6. If the directories are not writeable, make them writeable by creating them if necessary and providing the write access rights.
  7. For every host having the <lm-namespace>_lookup_writer host tag, check the accessibility of the Lookup Manager input directories.
  8. If the directories are not accessible, make them accessible by either creating them or providing the appropriate access rights.
  9. For every host having the <lm-namespace>_lookup_writer tag, check the accessibility of the Lookup Manager output directory.
  10. If the directory is not writeable, make it writeable by creating it if necessary and providing the write access rights

In a single host environment all input directories must by accessible and all output directories must be writeable.