IBM Support

InfoSphere DataStage Sequential File Stage generates Warning message, External string too long. Imported only <nn> out of <nn> external characters. Ignoring last <nn> characters up to delimiter

Troubleshooting


Problem

InfoSphere DataStage parallel job with Sequential File Stage generates new warning message: seq_1,0: External string too long. Imported only 30 out of 32 external characters. Ignoring last 2 characters up to delimiter.

Cause

This warning message was added in 11.3 to indicate that data truncation is occurring.

Resolving The Problem

The warning message indicates that data is being truncated. You need to increase the size of the field to account for all the characters in the sequential file. The truncation is happening because the field definition is too small when compared with the data.

If you cannot make the field bigger, because you can't change the length of the database column or similar reason, then you need to either:

  • Code the truncation, e.g. handle it in a derivation
  • Suppress the warnings
    • Use a message handler as follows: Managing message handlers.
    • Set the environment variable APT_IMPORT_NOWARN_STRING_FIELD_OVERRUNS=1 to suppress the warning message.

Either of the above options will work but if you want the data, the recommendation is to increase the field size.

[{"Product":{"code":"SSZJPZ","label":"IBM InfoSphere Information Server"},"Business Unit":{"code":"BU059","label":"IBM Software w\/o TPS"},"Component":"--","Platform":[{"code":"PF002","label":"AIX"},{"code":"PF010","label":"HP-UX"},{"code":"PF016","label":"Linux"},{"code":"PF027","label":"Solaris"},{"code":"PF033","label":"Windows"}],"Version":"11.3.1.0","Edition":"","Line of Business":{"code":"LOB10","label":"Data and AI"}}]

Document Information

Modified date:
16 June 2018

UID

swg21962771