The bulk load properties file
The bulk load properties file is located in the $COLLATION_HOME/etc/bulkload.properties directory. This file gives the bulk load program information that is required to load the IdML file into the TADDM database.
The following list describes the properties in the $COLLATION_HOME/etc/bulkload.properties file and its default values. You must not change anything in the file if you want to accept the defaults.
- com.ibm.cdb.bulk.numcopies=1
- This property specifies the number of copies of the file to copy.
- com.ibm.cdb.bulk.workdir=bulk
- This property specifies the directory the bulk load program uses to copy files to before loading
them. See the "-c" option and com.ibm.cdb.bulk.createworkingcopy property. The default directory is
relative to the top-level directory of the directory that the $COLLATION_HOME
environment variable references.
Do not copy the IdML file to the $COLLATION_HOME directory, as this location causes the load process to fail.
- com.ibm.cdb.bulk.workdir.cleanup=false
- This property specifies whether the working directory is cleaned up after the load process is finished.
- com.ibm.cdb.bulk.processedfiles.cleanup=30
- This property specifies the number of days to keep files in the processed files list.
- com.ibm.cdb.bulk.retrycount=5
- This property specifies the number of times to try loading a file again if the allowed number of concurrent bulk loads, which is 10 by default, is exceeded.
- com.ibm.cdb.bulk.retrydelay=60
- This property specifies the number of seconds to wait before trying to load a file again, while a discovery is in progress.
- com.ibm.cdb.bulk.resultsdir=bulk/results
- This property specifies the directory to place the results files created, when an IdML file is loaded into the TADDM database. The default directory is relative to the top-level directory referenced by the $COLLATION_HOME variable.
- com.ibm.cdb.bulk.apiservertimeout=60
- This property specifies the number of seconds before the API server returns an error and the bulk load program stops processing.
- com.ibm.cdb.bulk.stats.enabled=false
- This property specifies whether statistics gathering of the bulk load program are performed. Turning on statistics decreases performance and increases log and result file sizes.
- com.ibm.cdb.bulk.log.success.results=true
- This property specifies whether successfully written objects are logged to the results file. Reduced logging can improve performance by reducing output.
- com.ibm.cdb.bulk.allocpoolsize=1024
- This property specifies the maximum amount of memory that can be allocated to the Bulk Loader process. It is an Xmx value that is passed to the main Java™ class of the Bulk Loader. Specify the value in megabytes.
- com.ibm.cdb.bulk.cachesize=2000
- This property specifies the number of objects to be processed in a single write operation when performing graph writing. Increasing this number improves performance at the risk of running out of memory either on the client or at the server. Alter this number only when specific information is available to indicate that processing a file with a larger cache provides a benefit in performance. The cache size setting currently can be no larger than 40000.
- com.ibm.cdb.bulk.createworkingcopy=true
- This property specifies to first copy the IdML source file to the bulk directory and then continue to process the copied file.
- com.ibm.cdb.bulk.forceUniqueSourceTokens=true
- This property specifies whether unique source tokens are created
by the bulk loader. The default value is true. To disable the creation
of unique source tokens, set the value to false.
This property is used only if graph writing is enabled.
When using graph writing, lower level objects with duplicate source tokens might not be displayed correctly when launched in context. When this property is set to true, an index number is appended to a duplicate source token to ensure uniqueness.
- com.ibm.cdb.bulk.idmlcertificationtool.disabled=true
- This property specifies whether IdML Certification Tool is used to validate books before their processing. By default, the certification tool is disabled.
- com.ibm.cdb.bulk.idmlcertificationtool.toolongattrhandling=error
- This property specifies how IdML Certification Tool handles
too long CDM attribute values. The following values are supported:
- error - the default value, reports too long CDM attribute values as errors.
- warn - reports too long CDM attribute values as warnings.
- ignore - ignores problems with too long CDM attribute values.
By default, too long attribute values are reported as errors and IdML books processing is stopped with a parsing error. When the property is set to warn or ignore, the bulk loader program is not stopped.
It is advisable not to ignore the problem with too long attribute values. Although too long attribute values are truncated and stored in the TADDM database, they can cause information inconsistency. It can lead to an unexpected behavior of TADDM and products that are integrated with TADDM.
This property is used only when IdML Certification Tool is enabled.